2023-11-27T17:47:52.671 INFO:root:teuthology version: 0.0.1.dev205+g2442239 2023-11-27T17:47:52.671 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_yuriw@teuthology --description fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/valgrind} --name yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi --archive /home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7467937 --verbose -- /home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7467937/orig.config.yaml 2023-11-27T17:47:52.717 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-27T17:47:52.803 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7467937 branch: wip-yuri10-testing-2023-11-22-1112 description: fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/valgrind} email: yweinste@redhat.com first_in_suite: false job_id: '7467937' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-yuri10-testing-2023-11-22-1112 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd session_timeout: 300 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mds beacon grace: 60 mds heartbeat grace: 60 osd heartbeat grace: 60 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds valgrind exit: true mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon osd crush smoke test: false osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow request - SLOW_OPS - MON_DOWN sha1: 369173db14b6995b2bd07c60ec5f63d01cf21631 valgrind: exit_on_first_error: false mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes watchdog: daemon_restart: normal ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: valgrind: - --tool=memcheck - --leak-check=full - --show-reachable=yes install: ceph: debuginfo: true flavor: default sha1: 369173db14b6995b2bd07c60ec5f63d01cf21631 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri10-testing-2023-11-22-1112 sha1: 369173db14b6995b2bd07c60ec5f63d01cf21631 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 8541 sha1: 369173db14b6995b2bd07c60ec5f63d01cf21631 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-yuri10-testing-2023-11-22-1112 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 369173db14b6995b2bd07c60ec5f63d01cf21631 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi091.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBKVdsiaKfK7JJRWmw0yxYjamAJInhD3MWIycbQ+vulPgVrKu4kAo0dhMzI1Ga0/Ctpp+DMJ+tgefRpK6crNKE0= smithi094.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE2j367sZ/iH6ILWHVsfKU/p16P680VfV/kF7Gk3UXlGjFhS2L7n8rWr/ODyDwDq2P+YJDYM5ZB0XDVzlqsQVUU= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - workunit: clients: all: - suites/dbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 2442239d2653456406c25ae0c71b689c8f2657b6 timestamp: 2023-11-27_17:14:24 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-11-27T17:47:52.803 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa; will attempt to use it 2023-11-27T17:47:52.804 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa/tasks 2023-11-27T17:47:52.804 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-27T17:47:52.805 INFO:teuthology.task.internal:Checking packages... 2023-11-27T17:47:52.828 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '369173db14b6995b2bd07c60ec5f63d01cf21631' 2023-11-27T17:47:52.829 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-27T17:47:52.829 INFO:teuthology.packaging:ref: None 2023-11-27T17:47:52.829 INFO:teuthology.packaging:tag: None 2023-11-27T17:47:52.829 INFO:teuthology.packaging:branch: wip-yuri10-testing-2023-11-22-1112 2023-11-27T17:47:52.829 INFO:teuthology.packaging:sha1: 369173db14b6995b2bd07c60ec5f63d01cf21631 2023-11-27T17:47:52.829 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-yuri10-testing-2023-11-22-1112 2023-11-27T17:47:53.210 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-7498-g369173db-1jammy 2023-11-27T17:47:53.211 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-27T17:47:53.218 INFO:teuthology.task.internal:no buildpackages task found 2023-11-27T17:47:53.218 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-27T17:47:53.231 INFO:teuthology.task.internal:Saving configuration 2023-11-27T17:47:53.251 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-27T17:47:53.257 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-27T17:47:53.283 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi091.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7467937', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-27 17:42:24.513593', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHmlpgoHxTihWGrFT+u2IT5jQY9hLoqMLZcp6SEd0v6i'} 2023-11-27T17:47:53.306 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi094.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7467937', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-27 17:42:24.515239', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFYoXqnGRdFgnC8AECbzog/yASfgEzcl5M+T1u7H+ZJX'} 2023-11-27T17:47:53.306 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-27T17:47:53.312 INFO:teuthology.task.internal:roles: ubuntu@smithi091.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2023-11-27T17:47:53.312 INFO:teuthology.task.internal:roles: ubuntu@smithi094.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2023-11-27T17:47:53.312 INFO:teuthology.run_tasks:Running task console_log... 2023-11-27T17:47:53.383 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1af4d7f0d0>, signals=[15]) 2023-11-27T17:47:53.383 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-27T17:47:53.390 INFO:teuthology.task.internal:Opening connections... 2023-11-27T17:47:53.390 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi091.front.sepia.ceph.com 2023-11-27T17:47:53.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T17:47:53.466 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi094.front.sepia.ceph.com 2023-11-27T17:47:53.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T17:47:53.542 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-27T17:47:53.548 DEBUG:teuthology.orchestra.run.smithi091:> uname -m 2023-11-27T17:47:53.553 INFO:teuthology.orchestra.run.smithi091.stdout:x86_64 2023-11-27T17:47:53.553 DEBUG:teuthology.orchestra.run.smithi091:> cat /etc/os-release 2023-11-27T17:47:53.602 INFO:teuthology.orchestra.run.smithi091.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-27T17:47:53.602 INFO:teuthology.orchestra.run.smithi091.stdout:NAME="Ubuntu" 2023-11-27T17:47:53.602 INFO:teuthology.orchestra.run.smithi091.stdout:VERSION_ID="22.04" 2023-11-27T17:47:53.602 INFO:teuthology.orchestra.run.smithi091.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-27T17:47:53.602 INFO:teuthology.orchestra.run.smithi091.stdout:VERSION_CODENAME=jammy 2023-11-27T17:47:53.602 INFO:teuthology.orchestra.run.smithi091.stdout:ID=ubuntu 2023-11-27T17:47:53.602 INFO:teuthology.orchestra.run.smithi091.stdout:ID_LIKE=debian 2023-11-27T17:47:53.602 INFO:teuthology.orchestra.run.smithi091.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-27T17:47:53.602 INFO:teuthology.orchestra.run.smithi091.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-27T17:47:53.603 INFO:teuthology.orchestra.run.smithi091.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-27T17:47:53.603 INFO:teuthology.orchestra.run.smithi091.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-27T17:47:53.603 INFO:teuthology.orchestra.run.smithi091.stdout:UBUNTU_CODENAME=jammy 2023-11-27T17:47:53.603 INFO:teuthology.lock.ops:Updating smithi091.front.sepia.ceph.com on lock server 2023-11-27T17:47:53.627 DEBUG:teuthology.orchestra.run.smithi094:> uname -m 2023-11-27T17:47:53.632 INFO:teuthology.orchestra.run.smithi094.stdout:x86_64 2023-11-27T17:47:53.633 DEBUG:teuthology.orchestra.run.smithi094:> cat /etc/os-release 2023-11-27T17:47:53.677 INFO:teuthology.orchestra.run.smithi094.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-27T17:47:53.678 INFO:teuthology.orchestra.run.smithi094.stdout:NAME="Ubuntu" 2023-11-27T17:47:53.678 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_ID="22.04" 2023-11-27T17:47:53.678 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-27T17:47:53.678 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_CODENAME=jammy 2023-11-27T17:47:53.678 INFO:teuthology.orchestra.run.smithi094.stdout:ID=ubuntu 2023-11-27T17:47:53.678 INFO:teuthology.orchestra.run.smithi094.stdout:ID_LIKE=debian 2023-11-27T17:47:53.679 INFO:teuthology.orchestra.run.smithi094.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-27T17:47:53.679 INFO:teuthology.orchestra.run.smithi094.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-27T17:47:53.679 INFO:teuthology.orchestra.run.smithi094.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-27T17:47:53.679 INFO:teuthology.orchestra.run.smithi094.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-27T17:47:53.679 INFO:teuthology.orchestra.run.smithi094.stdout:UBUNTU_CODENAME=jammy 2023-11-27T17:47:53.679 INFO:teuthology.lock.ops:Updating smithi094.front.sepia.ceph.com on lock server 2023-11-27T17:47:53.702 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-27T17:47:53.712 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-27T17:47:53.716 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-27T17:47:53.717 DEBUG:teuthology.orchestra.run.smithi091:> test '!' -e /home/ubuntu/cephtest 2023-11-27T17:47:53.719 DEBUG:teuthology.orchestra.run.smithi094:> test '!' -e /home/ubuntu/cephtest 2023-11-27T17:47:53.725 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-27T17:47:53.730 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-27T17:47:53.730 DEBUG:teuthology.orchestra.run.smithi091:> test -z $(ls -A /var/lib/ceph) 2023-11-27T17:47:53.764 DEBUG:teuthology.orchestra.run.smithi094:> test -z $(ls -A /var/lib/ceph) 2023-11-27T17:47:53.784 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-27T17:47:53.842 INFO:teuthology.run_tasks:Running task kernel... 2023-11-27T17:47:53.856 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-11-27T17:47:53.856 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-11-27T17:47:53.857 DEBUG:teuthology.orchestra.run.smithi091:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-27T17:47:53.857 DEBUG:teuthology.orchestra.run.smithi094:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-27T17:47:53.861 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T17:47:53.862 DEBUG:teuthology.orchestra.run.smithi091:> uname -r 2023-11-27T17:47:53.862 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T17:47:53.863 DEBUG:teuthology.orchestra.run.smithi094:> uname -r 2023-11-27T17:47:53.909 INFO:teuthology.orchestra.run.smithi094.stdout:5.15.0-56-generic 2023-11-27T17:47:53.910 INFO:teuthology.task.kernel:Running kernel on smithi094: 5.15.0-56-generic 2023-11-27T17:47:53.910 DEBUG:teuthology.orchestra.run.smithi094:> sudo apt-get clean 2023-11-27T17:47:53.911 INFO:teuthology.orchestra.run.smithi091.stdout:5.15.0-56-generic 2023-11-27T17:47:53.912 INFO:teuthology.task.kernel:Running kernel on smithi091: 5.15.0-56-generic 2023-11-27T17:47:53.912 DEBUG:teuthology.orchestra.run.smithi091:> sudo apt-get clean 2023-11-27T17:47:54.032 DEBUG:teuthology.orchestra.run.smithi094:> sudo apt-get update 2023-11-27T17:47:54.051 DEBUG:teuthology.orchestra.run.smithi091:> sudo apt-get update 2023-11-27T17:47:54.178 INFO:teuthology.orchestra.run.smithi094.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-27T17:47:54.185 INFO:teuthology.orchestra.run.smithi091.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-27T17:47:54.198 INFO:teuthology.orchestra.run.smithi091.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2023-11-27T17:47:54.200 INFO:teuthology.orchestra.run.smithi094.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2023-11-27T17:47:54.200 INFO:teuthology.orchestra.run.smithi094.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-11-27T17:47:54.260 INFO:teuthology.orchestra.run.smithi094.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2023-11-27T17:47:54.262 INFO:teuthology.orchestra.run.smithi091.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2023-11-27T17:47:54.407 INFO:teuthology.orchestra.run.smithi091.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [536 kB] 2023-11-27T17:47:54.411 INFO:teuthology.orchestra.run.smithi094.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [536 kB] 2023-11-27T17:47:54.473 INFO:teuthology.orchestra.run.smithi091.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,200 kB] 2023-11-27T17:47:54.487 INFO:teuthology.orchestra.run.smithi094.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,200 kB] 2023-11-27T17:47:54.501 INFO:teuthology.orchestra.run.smithi091.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [252 kB] 2023-11-27T17:47:54.505 INFO:teuthology.orchestra.run.smithi091.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2023-11-27T17:47:54.506 INFO:teuthology.orchestra.run.smithi091.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,168 kB] 2023-11-27T17:47:54.517 INFO:teuthology.orchestra.run.smithi094.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [252 kB] 2023-11-27T17:47:54.517 INFO:teuthology.orchestra.run.smithi091.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [32.8 kB] 2023-11-27T17:47:54.517 INFO:teuthology.orchestra.run.smithi091.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [190 kB] 2023-11-27T17:47:54.519 INFO:teuthology.orchestra.run.smithi091.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2023-11-27T17:47:54.519 INFO:teuthology.orchestra.run.smithi091.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [667 kB] 2023-11-27T17:47:54.520 INFO:teuthology.orchestra.run.smithi094.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2023-11-27T17:47:54.521 INFO:teuthology.orchestra.run.smithi094.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,168 kB] 2023-11-27T17:47:54.524 INFO:teuthology.orchestra.run.smithi091.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,003 kB] 2023-11-27T17:47:54.531 INFO:teuthology.orchestra.run.smithi091.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [221 kB] 2023-11-27T17:47:54.539 INFO:teuthology.orchestra.run.smithi094.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [32.8 kB] 2023-11-27T17:47:54.539 INFO:teuthology.orchestra.run.smithi094.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [190 kB] 2023-11-27T17:47:54.539 INFO:teuthology.orchestra.run.smithi094.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2023-11-27T17:47:54.540 INFO:teuthology.orchestra.run.smithi094.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [667 kB] 2023-11-27T17:47:54.546 INFO:teuthology.orchestra.run.smithi094.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,003 kB] 2023-11-27T17:47:54.556 INFO:teuthology.orchestra.run.smithi094.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [221 kB] 2023-11-27T17:47:54.559 INFO:teuthology.orchestra.run.smithi094.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2023-11-27T17:47:54.568 INFO:teuthology.orchestra.run.smithi091.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2023-11-27T17:47:54.569 INFO:teuthology.orchestra.run.smithi091.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [3,888 B] 2023-11-27T17:47:54.569 INFO:teuthology.orchestra.run.smithi091.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [41.6 kB] 2023-11-27T17:47:54.570 INFO:teuthology.orchestra.run.smithi091.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [9,768 B] 2023-11-27T17:47:54.570 INFO:teuthology.orchestra.run.smithi091.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2023-11-27T17:47:54.570 INFO:teuthology.orchestra.run.smithi091.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [56.3 kB] 2023-11-27T17:47:54.570 INFO:teuthology.orchestra.run.smithi091.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [64.2 kB] 2023-11-27T17:47:54.571 INFO:teuthology.orchestra.run.smithi091.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.5 kB] 2023-11-27T17:47:54.571 INFO:teuthology.orchestra.run.smithi091.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2023-11-27T17:47:54.578 INFO:teuthology.orchestra.run.smithi094.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [3,888 B] 2023-11-27T17:47:54.578 INFO:teuthology.orchestra.run.smithi094.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [372 kB] 2023-11-27T17:47:54.578 INFO:teuthology.orchestra.run.smithi094.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [41.6 kB] 2023-11-27T17:47:54.579 INFO:teuthology.orchestra.run.smithi094.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [9,768 B] 2023-11-27T17:47:54.579 INFO:teuthology.orchestra.run.smithi094.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2023-11-27T17:47:54.579 INFO:teuthology.orchestra.run.smithi094.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [64.2 kB] 2023-11-27T17:47:54.580 INFO:teuthology.orchestra.run.smithi094.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [56.3 kB] 2023-11-27T17:47:54.581 INFO:teuthology.orchestra.run.smithi094.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.5 kB] 2023-11-27T17:47:54.585 INFO:teuthology.orchestra.run.smithi091.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.9 kB] 2023-11-27T17:47:54.586 INFO:teuthology.orchestra.run.smithi094.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2023-11-27T17:47:54.602 INFO:teuthology.orchestra.run.smithi091.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.8 kB] 2023-11-27T17:47:54.603 INFO:teuthology.orchestra.run.smithi094.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.9 kB] 2023-11-27T17:47:54.603 INFO:teuthology.orchestra.run.smithi091.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.4 kB] 2023-11-27T17:47:54.603 INFO:teuthology.orchestra.run.smithi091.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2023-11-27T17:47:54.604 INFO:teuthology.orchestra.run.smithi094.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.8 kB] 2023-11-27T17:47:54.604 INFO:teuthology.orchestra.run.smithi094.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.4 kB] 2023-11-27T17:47:54.604 INFO:teuthology.orchestra.run.smithi094.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2023-11-27T17:47:54.672 INFO:teuthology.orchestra.run.smithi094.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [989 kB] 2023-11-27T17:47:54.728 INFO:teuthology.orchestra.run.smithi094.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [192 kB] 2023-11-27T17:47:54.733 INFO:teuthology.orchestra.run.smithi094.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2023-11-27T17:47:54.733 INFO:teuthology.orchestra.run.smithi094.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [32.4 kB] 2023-11-27T17:47:54.734 INFO:teuthology.orchestra.run.smithi094.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,143 kB] 2023-11-27T17:47:54.766 INFO:teuthology.orchestra.run.smithi094.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [186 kB] 2023-11-27T17:47:54.770 INFO:teuthology.orchestra.run.smithi094.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2023-11-27T17:47:54.770 INFO:teuthology.orchestra.run.smithi094.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [799 kB] 2023-11-27T17:47:54.785 INFO:teuthology.orchestra.run.smithi094.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [567 kB] 2023-11-27T17:47:54.797 INFO:teuthology.orchestra.run.smithi094.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [148 kB] 2023-11-27T17:47:54.800 INFO:teuthology.orchestra.run.smithi094.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2023-11-27T17:47:54.806 INFO:teuthology.orchestra.run.smithi094.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [36.5 kB] 2023-11-27T17:47:54.807 INFO:teuthology.orchestra.run.smithi094.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,032 B] 2023-11-27T17:47:54.808 INFO:teuthology.orchestra.run.smithi094.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,060 B] 2023-11-27T17:47:54.838 INFO:teuthology.orchestra.run.smithi094.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2023-11-27T17:47:59.904 INFO:teuthology.orchestra.run.smithi094.stdout:Fetched 10.4 MB in 1s (6,959 kB/s) 2023-11-27T17:48:01.214 INFO:teuthology.orchestra.run.smithi094.stdout:Reading package lists... 2023-11-27T17:48:01.230 DEBUG:teuthology.orchestra.run.smithi094:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-11-27T17:48:01.288 INFO:teuthology.orchestra.run.smithi094.stdout:Reading package lists... 2023-11-27T17:48:01.290 INFO:teuthology.orchestra.run.smithi091.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-11-27T17:48:01.476 INFO:teuthology.orchestra.run.smithi094.stdout:Building dependency tree... 2023-11-27T17:48:01.477 INFO:teuthology.orchestra.run.smithi094.stdout:Reading state information... 2023-11-27T17:48:01.542 INFO:teuthology.orchestra.run.smithi091.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [372 kB] 2023-11-27T17:48:01.638 INFO:teuthology.orchestra.run.smithi094.stdout:The following packages were automatically installed and are no longer required: 2023-11-27T17:48:01.638 INFO:teuthology.orchestra.run.smithi094.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-27T17:48:01.638 INFO:teuthology.orchestra.run.smithi094.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-27T17:48:01.639 INFO:teuthology.orchestra.run.smithi094.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-27T17:48:01.639 INFO:teuthology.orchestra.run.smithi094.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-11-27T17:48:01.639 INFO:teuthology.orchestra.run.smithi094.stdout: python2.7-minimal 2023-11-27T17:48:01.639 INFO:teuthology.orchestra.run.smithi094.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-27T17:48:01.640 INFO:teuthology.orchestra.run.smithi094.stdout:The following additional packages will be installed: 2023-11-27T17:48:01.640 INFO:teuthology.orchestra.run.smithi094.stdout: linux-generic linux-headers-5.15.0-89 linux-headers-5.15.0-89-generic 2023-11-27T17:48:01.640 INFO:teuthology.orchestra.run.smithi094.stdout: linux-headers-generic linux-image-5.15.0-89-generic 2023-11-27T17:48:01.641 INFO:teuthology.orchestra.run.smithi094.stdout: linux-modules-5.15.0-89-generic linux-modules-extra-5.15.0-89-generic 2023-11-27T17:48:01.642 INFO:teuthology.orchestra.run.smithi094.stdout:Suggested packages: 2023-11-27T17:48:01.642 INFO:teuthology.orchestra.run.smithi094.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2023-11-27T17:48:01.642 INFO:teuthology.orchestra.run.smithi094.stdout:Recommended packages: 2023-11-27T17:48:01.642 INFO:teuthology.orchestra.run.smithi094.stdout: thermald 2023-11-27T17:48:01.683 INFO:teuthology.orchestra.run.smithi091.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [989 kB] 2023-11-27T17:48:01.686 INFO:teuthology.orchestra.run.smithi094.stdout:The following NEW packages will be installed: 2023-11-27T17:48:01.686 INFO:teuthology.orchestra.run.smithi094.stdout: linux-headers-5.15.0-89 linux-headers-5.15.0-89-generic 2023-11-27T17:48:01.686 INFO:teuthology.orchestra.run.smithi094.stdout: linux-image-5.15.0-89-generic linux-modules-5.15.0-89-generic 2023-11-27T17:48:01.686 INFO:teuthology.orchestra.run.smithi094.stdout: linux-modules-extra-5.15.0-89-generic 2023-11-27T17:48:01.688 INFO:teuthology.orchestra.run.smithi094.stdout:The following packages will be upgraded: 2023-11-27T17:48:01.688 INFO:teuthology.orchestra.run.smithi094.stdout: linux-generic linux-headers-generic linux-image-generic 2023-11-27T17:48:01.781 INFO:teuthology.orchestra.run.smithi091.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [192 kB] 2023-11-27T17:48:01.787 INFO:teuthology.orchestra.run.smithi094.stdout:3 upgraded, 5 newly installed, 0 to remove and 273 not upgraded. 2023-11-27T17:48:01.787 INFO:teuthology.orchestra.run.smithi094.stdout:Need to get 113 MB of archives. 2023-11-27T17:48:01.787 INFO:teuthology.orchestra.run.smithi094.stdout:After this operation, 582 MB of additional disk space will be used. 2023-11-27T17:48:01.787 INFO:teuthology.orchestra.run.smithi094.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-89-generic amd64 5.15.0-89.99 [22.4 MB] 2023-11-27T17:48:01.796 INFO:teuthology.orchestra.run.smithi091.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2023-11-27T17:48:01.796 INFO:teuthology.orchestra.run.smithi091.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,143 kB] 2023-11-27T17:48:01.838 INFO:teuthology.orchestra.run.smithi091.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [32.4 kB] 2023-11-27T17:48:01.839 INFO:teuthology.orchestra.run.smithi091.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [186 kB] 2023-11-27T17:48:01.846 INFO:teuthology.orchestra.run.smithi091.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2023-11-27T17:48:01.846 INFO:teuthology.orchestra.run.smithi091.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [799 kB] 2023-11-27T17:48:01.865 INFO:teuthology.orchestra.run.smithi091.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [567 kB] 2023-11-27T17:48:01.877 INFO:teuthology.orchestra.run.smithi091.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [148 kB] 2023-11-27T17:48:01.879 INFO:teuthology.orchestra.run.smithi091.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2023-11-27T17:48:01.881 INFO:teuthology.orchestra.run.smithi091.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,032 B] 2023-11-27T17:48:01.881 INFO:teuthology.orchestra.run.smithi091.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [36.5 kB] 2023-11-27T17:48:01.916 INFO:teuthology.orchestra.run.smithi091.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,060 B] 2023-11-27T17:48:01.916 INFO:teuthology.orchestra.run.smithi091.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2023-11-27T17:48:02.891 INFO:teuthology.orchestra.run.smithi094.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-89-generic amd64 5.15.0-89.99 [11.5 MB] 2023-11-27T17:48:03.272 INFO:teuthology.orchestra.run.smithi094.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-89-generic amd64 5.15.0-89.99 [63.9 MB] 2023-11-27T17:48:04.729 INFO:teuthology.orchestra.run.smithi094.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.89.86 [1,698 B] 2023-11-27T17:48:04.729 INFO:teuthology.orchestra.run.smithi094.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.89.86 [2,492 B] 2023-11-27T17:48:04.730 INFO:teuthology.orchestra.run.smithi094.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-89 all 5.15.0-89.99 [12.3 MB] 2023-11-27T17:48:05.128 INFO:teuthology.orchestra.run.smithi094.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-89-generic amd64 5.15.0-89.99 [2,885 kB] 2023-11-27T17:48:05.184 INFO:teuthology.orchestra.run.smithi094.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.89.86 [2,336 B] 2023-11-27T17:48:05.598 INFO:teuthology.orchestra.run.smithi094.stdout:Fetched 113 MB in 3s (32.4 MB/s) 2023-11-27T17:48:05.783 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package linux-modules-5.15.0-89-generic. 2023-11-27T17:48:06.577 INFO:teuthology.orchestra.run.smithi091.stdout:Fetched 10.4 MB in 8s (1,280 kB/s) 2023-11-27T17:48:07.853 INFO:teuthology.orchestra.run.smithi094.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2023-11-27T17:48:07.857 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../0-linux-modules-5.15.0-89-generic_5.15.0-89.99_amd64.deb ... 2023-11-27T17:48:07.925 INFO:teuthology.orchestra.run.smithi091.stdout:Reading package lists... 2023-11-27T17:48:07.941 DEBUG:teuthology.orchestra.run.smithi091:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-11-27T17:48:07.954 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking linux-modules-5.15.0-89-generic (5.15.0-89.99) ... 2023-11-27T17:48:08.004 INFO:teuthology.orchestra.run.smithi091.stdout:Reading package lists... 2023-11-27T17:48:08.191 INFO:teuthology.orchestra.run.smithi091.stdout:Building dependency tree... 2023-11-27T17:48:08.192 INFO:teuthology.orchestra.run.smithi091.stdout:Reading state information... 2023-11-27T17:48:08.336 INFO:teuthology.orchestra.run.smithi091.stdout:The following packages were automatically installed and are no longer required: 2023-11-27T17:48:08.337 INFO:teuthology.orchestra.run.smithi091.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-27T17:48:08.337 INFO:teuthology.orchestra.run.smithi091.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-27T17:48:08.337 INFO:teuthology.orchestra.run.smithi091.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-27T17:48:08.337 INFO:teuthology.orchestra.run.smithi091.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-11-27T17:48:08.338 INFO:teuthology.orchestra.run.smithi091.stdout: python2.7-minimal 2023-11-27T17:48:08.338 INFO:teuthology.orchestra.run.smithi091.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-27T17:48:08.338 INFO:teuthology.orchestra.run.smithi091.stdout:The following additional packages will be installed: 2023-11-27T17:48:08.339 INFO:teuthology.orchestra.run.smithi091.stdout: linux-generic linux-headers-5.15.0-89 linux-headers-5.15.0-89-generic 2023-11-27T17:48:08.339 INFO:teuthology.orchestra.run.smithi091.stdout: linux-headers-generic linux-image-5.15.0-89-generic 2023-11-27T17:48:08.339 INFO:teuthology.orchestra.run.smithi091.stdout: linux-modules-5.15.0-89-generic linux-modules-extra-5.15.0-89-generic 2023-11-27T17:48:08.340 INFO:teuthology.orchestra.run.smithi091.stdout:Suggested packages: 2023-11-27T17:48:08.340 INFO:teuthology.orchestra.run.smithi091.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2023-11-27T17:48:08.340 INFO:teuthology.orchestra.run.smithi091.stdout:Recommended packages: 2023-11-27T17:48:08.340 INFO:teuthology.orchestra.run.smithi091.stdout: thermald 2023-11-27T17:48:08.396 INFO:teuthology.orchestra.run.smithi091.stdout:The following NEW packages will be installed: 2023-11-27T17:48:08.396 INFO:teuthology.orchestra.run.smithi091.stdout: linux-headers-5.15.0-89 linux-headers-5.15.0-89-generic 2023-11-27T17:48:08.396 INFO:teuthology.orchestra.run.smithi091.stdout: linux-image-5.15.0-89-generic linux-modules-5.15.0-89-generic 2023-11-27T17:48:08.397 INFO:teuthology.orchestra.run.smithi091.stdout: linux-modules-extra-5.15.0-89-generic 2023-11-27T17:48:08.397 INFO:teuthology.orchestra.run.smithi091.stdout:The following packages will be upgraded: 2023-11-27T17:48:08.398 INFO:teuthology.orchestra.run.smithi091.stdout: linux-generic linux-headers-generic linux-image-generic 2023-11-27T17:48:08.576 INFO:teuthology.orchestra.run.smithi091.stdout:3 upgraded, 5 newly installed, 0 to remove and 273 not upgraded. 2023-11-27T17:48:08.576 INFO:teuthology.orchestra.run.smithi091.stdout:Need to get 113 MB of archives. 2023-11-27T17:48:08.576 INFO:teuthology.orchestra.run.smithi091.stdout:After this operation, 582 MB of additional disk space will be used. 2023-11-27T17:48:08.576 INFO:teuthology.orchestra.run.smithi091.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-89-generic amd64 5.15.0-89.99 [22.4 MB] 2023-11-27T17:48:09.968 INFO:teuthology.orchestra.run.smithi091.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-89-generic amd64 5.15.0-89.99 [11.5 MB] 2023-11-27T17:48:10.151 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package linux-image-5.15.0-89-generic. 2023-11-27T17:48:10.173 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../1-linux-image-5.15.0-89-generic_5.15.0-89.99_amd64.deb ... 2023-11-27T17:48:10.299 INFO:teuthology.orchestra.run.smithi091.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-89-generic amd64 5.15.0-89.99 [63.9 MB] 2023-11-27T17:48:10.448 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking linux-image-5.15.0-89-generic (5.15.0-89.99) ... 2023-11-27T17:48:11.135 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-89-generic. 2023-11-27T17:48:11.155 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-89-generic_5.15.0-89.99_amd64.deb ... 2023-11-27T17:48:11.193 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking linux-modules-extra-5.15.0-89-generic (5.15.0-89.99) ... 2023-11-27T17:48:12.431 INFO:teuthology.orchestra.run.smithi091.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.89.86 [1,698 B] 2023-11-27T17:48:12.431 INFO:teuthology.orchestra.run.smithi091.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.89.86 [2,492 B] 2023-11-27T17:48:12.432 INFO:teuthology.orchestra.run.smithi091.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-89 all 5.15.0-89.99 [12.3 MB] 2023-11-27T17:48:13.090 INFO:teuthology.orchestra.run.smithi091.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-89-generic amd64 5.15.0-89.99 [2,885 kB] 2023-11-27T17:48:13.148 INFO:teuthology.orchestra.run.smithi091.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.89.86 [2,336 B] 2023-11-27T17:48:13.557 INFO:teuthology.orchestra.run.smithi091.stdout:Fetched 113 MB in 5s (23.8 MB/s) 2023-11-27T17:48:13.717 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package linux-modules-5.15.0-89-generic. 2023-11-27T17:48:15.757 INFO:teuthology.orchestra.run.smithi091.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2023-11-27T17:48:15.761 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../0-linux-modules-5.15.0-89-generic_5.15.0-89.99_amd64.deb ... 2023-11-27T17:48:15.855 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking linux-modules-5.15.0-89-generic (5.15.0-89.99) ... 2023-11-27T17:48:17.754 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../3-linux-generic_5.15.0.89.86_amd64.deb ... 2023-11-27T17:48:17.881 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking linux-generic (5.15.0.89.86) over (5.15.0.56.54) ... 2023-11-27T17:48:17.972 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package linux-image-5.15.0-89-generic. 2023-11-27T17:48:17.993 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../1-linux-image-5.15.0-89-generic_5.15.0-89.99_amd64.deb ... 2023-11-27T17:48:18.084 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking linux-image-5.15.0-89-generic (5.15.0-89.99) ... 2023-11-27T17:48:18.198 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.89.86_amd64.deb ... 2023-11-27T17:48:18.294 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking linux-image-generic (5.15.0.89.86) over (5.15.0.56.54) ... 2023-11-27T17:48:18.559 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-89-generic. 2023-11-27T17:48:18.576 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-89-generic_5.15.0-89.99_amd64.deb ... 2023-11-27T17:48:18.597 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package linux-headers-5.15.0-89. 2023-11-27T17:48:18.617 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking linux-modules-extra-5.15.0-89-generic (5.15.0-89.99) ... 2023-11-27T17:48:18.619 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../5-linux-headers-5.15.0-89_5.15.0-89.99_all.deb ... 2023-11-27T17:48:18.664 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking linux-headers-5.15.0-89 (5.15.0-89.99) ... 2023-11-27T17:48:24.395 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package linux-headers-5.15.0-89-generic. 2023-11-27T17:48:24.431 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../6-linux-headers-5.15.0-89-generic_5.15.0-89.99_amd64.deb ... 2023-11-27T17:48:24.469 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking linux-headers-5.15.0-89-generic (5.15.0-89.99) ... 2023-11-27T17:48:25.359 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../3-linux-generic_5.15.0.89.86_amd64.deb ... 2023-11-27T17:48:25.461 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking linux-generic (5.15.0.89.86) over (5.15.0.56.54) ... 2023-11-27T17:48:25.828 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.89.86_amd64.deb ... 2023-11-27T17:48:25.956 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking linux-image-generic (5.15.0.89.86) over (5.15.0.56.54) ... 2023-11-27T17:48:26.259 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package linux-headers-5.15.0-89. 2023-11-27T17:48:26.282 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../5-linux-headers-5.15.0-89_5.15.0-89.99_all.deb ... 2023-11-27T17:48:26.318 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking linux-headers-5.15.0-89 (5.15.0-89.99) ... 2023-11-27T17:48:27.701 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.89.86_amd64.deb ... 2023-11-27T17:48:27.829 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking linux-headers-generic (5.15.0.89.86) over (5.15.0.56.54) ... 2023-11-27T17:48:28.162 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up linux-headers-5.15.0-89 (5.15.0-89.99) ... 2023-11-27T17:48:28.285 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up linux-headers-5.15.0-89-generic (5.15.0-89.99) ... 2023-11-27T17:48:28.411 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up linux-headers-generic (5.15.0.89.86) ... 2023-11-27T17:48:28.565 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up linux-image-5.15.0-89-generic (5.15.0-89.99) ... 2023-11-27T17:48:29.984 INFO:teuthology.orchestra.run.smithi094.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2023-11-27T17:48:29.984 INFO:teuthology.orchestra.run.smithi094.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2023-11-27T17:48:29.984 INFO:teuthology.orchestra.run.smithi094.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-89-generic 2023-11-27T17:48:29.984 INFO:teuthology.orchestra.run.smithi094.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-89-generic 2023-11-27T17:48:30.377 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up linux-modules-extra-5.15.0-89-generic (5.15.0-89.99) ... 2023-11-27T17:48:31.771 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up linux-image-generic (5.15.0.89.86) ... 2023-11-27T17:48:31.897 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up linux-generic (5.15.0.89.86) ... 2023-11-27T17:48:31.998 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up linux-modules-5.15.0-89-generic (5.15.0-89.99) ... 2023-11-27T17:48:32.773 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package linux-headers-5.15.0-89-generic. 2023-11-27T17:48:32.810 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../6-linux-headers-5.15.0-89-generic_5.15.0-89.99_amd64.deb ... 2023-11-27T17:48:32.848 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking linux-headers-5.15.0-89-generic (5.15.0-89.99) ... 2023-11-27T17:48:33.350 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for linux-image-5.15.0-89-generic (5.15.0-89.99) ... 2023-11-27T17:48:33.411 INFO:teuthology.orchestra.run.smithi094.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-11-27T17:48:33.411 INFO:teuthology.orchestra.run.smithi094.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-89-generic 2023-11-27T17:48:35.759 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.89.86_amd64.deb ... 2023-11-27T17:48:35.885 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking linux-headers-generic (5.15.0.89.86) over (5.15.0.56.54) ... 2023-11-27T17:48:36.235 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up linux-headers-5.15.0-89 (5.15.0-89.99) ... 2023-11-27T17:48:36.373 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up linux-headers-5.15.0-89-generic (5.15.0-89.99) ... 2023-11-27T17:48:36.499 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up linux-headers-generic (5.15.0.89.86) ... 2023-11-27T17:48:36.637 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up linux-image-5.15.0-89-generic (5.15.0-89.99) ... 2023-11-27T17:48:37.941 INFO:teuthology.orchestra.run.smithi091.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2023-11-27T17:48:37.941 INFO:teuthology.orchestra.run.smithi091.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2023-11-27T17:48:37.941 INFO:teuthology.orchestra.run.smithi091.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-89-generic 2023-11-27T17:48:37.941 INFO:teuthology.orchestra.run.smithi091.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-89-generic 2023-11-27T17:48:38.079 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up linux-modules-extra-5.15.0-89-generic (5.15.0-89.99) ... 2023-11-27T17:48:39.464 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up linux-image-generic (5.15.0.89.86) ... 2023-11-27T17:48:39.590 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up linux-generic (5.15.0.89.86) ... 2023-11-27T17:48:39.716 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up linux-modules-5.15.0-89-generic (5.15.0-89.99) ... 2023-11-27T17:48:41.451 INFO:teuthology.orchestra.run.smithi091.stdout:Processing triggers for linux-image-5.15.0-89-generic (5.15.0-89.99) ... 2023-11-27T17:48:41.514 INFO:teuthology.orchestra.run.smithi091.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-11-27T17:48:41.514 INFO:teuthology.orchestra.run.smithi091.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-89-generic 2023-11-27T17:48:47.526 INFO:teuthology.orchestra.run.smithi094.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-11-27T17:48:47.526 INFO:teuthology.orchestra.run.smithi094.stdout:Sourcing file `/etc/default/grub' 2023-11-27T17:48:47.547 INFO:teuthology.orchestra.run.smithi094.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-27T17:48:47.574 INFO:teuthology.orchestra.run.smithi094.stdout:Generating grub configuration file ... 2023-11-27T17:48:47.822 INFO:teuthology.orchestra.run.smithi094.stdout:Found linux image: /boot/vmlinuz-5.15.0-89-generic 2023-11-27T17:48:47.837 INFO:teuthology.orchestra.run.smithi094.stdout:Found initrd image: /boot/initrd.img-5.15.0-89-generic 2023-11-27T17:48:48.150 INFO:teuthology.orchestra.run.smithi094.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-27T17:48:48.156 INFO:teuthology.orchestra.run.smithi094.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-27T17:48:48.231 INFO:teuthology.orchestra.run.smithi094.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-27T17:48:48.236 INFO:teuthology.orchestra.run.smithi094.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-27T17:48:48.386 INFO:teuthology.orchestra.run.smithi094.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-27T17:48:48.386 INFO:teuthology.orchestra.run.smithi094.stdout:Systems on them will not be added to the GRUB boot configuration. 2023-11-27T17:48:48.386 INFO:teuthology.orchestra.run.smithi094.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-27T17:48:48.439 INFO:teuthology.orchestra.run.smithi094.stdout:done 2023-11-27T17:48:48.903 DEBUG:teuthology.orchestra.run.smithi094:> dpkg -s linux-image-generic 2023-11-27T17:48:48.924 INFO:teuthology.orchestra.run.smithi094.stdout:Package: linux-image-generic 2023-11-27T17:48:48.924 INFO:teuthology.orchestra.run.smithi094.stdout:Status: install ok installed 2023-11-27T17:48:48.924 INFO:teuthology.orchestra.run.smithi094.stdout:Priority: optional 2023-11-27T17:48:48.924 INFO:teuthology.orchestra.run.smithi094.stdout:Section: kernel 2023-11-27T17:48:48.924 INFO:teuthology.orchestra.run.smithi094.stdout:Installed-Size: 20 2023-11-27T17:48:48.924 INFO:teuthology.orchestra.run.smithi094.stdout:Maintainer: Ubuntu Kernel Team 2023-11-27T17:48:48.925 INFO:teuthology.orchestra.run.smithi094.stdout:Architecture: amd64 2023-11-27T17:48:48.925 INFO:teuthology.orchestra.run.smithi094.stdout:Source: linux-meta 2023-11-27T17:48:48.925 INFO:teuthology.orchestra.run.smithi094.stdout:Version: 5.15.0.89.86 2023-11-27T17:48:48.925 INFO:teuthology.orchestra.run.smithi094.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-89), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-11-27T17:48:48.925 INFO:teuthology.orchestra.run.smithi094.stdout:Depends: linux-image-5.15.0-89-generic, linux-modules-extra-5.15.0-89-generic, linux-firmware, intel-microcode, amd64-microcode 2023-11-27T17:48:48.925 INFO:teuthology.orchestra.run.smithi094.stdout:Recommends: thermald 2023-11-27T17:48:48.925 INFO:teuthology.orchestra.run.smithi094.stdout:Description: Generic Linux kernel image 2023-11-27T17:48:48.925 INFO:teuthology.orchestra.run.smithi094.stdout: This package will always depend on the latest generic kernel image 2023-11-27T17:48:48.925 INFO:teuthology.orchestra.run.smithi094.stdout: available. 2023-11-27T17:48:48.925 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-89-generic 2023-11-27T17:48:48.926 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-11-27T17:48:48.926 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-11-27T17:48:48.926 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-11-27T17:48:48.926 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi094.front.sepia.ceph.com, path=None, version=distro) 2023-11-27T17:48:48.926 DEBUG:teuthology.orchestra.run.smithi094:> sudo apt-get clean 2023-11-27T17:48:49.126 DEBUG:teuthology.orchestra.run.smithi094:> sudo apt-get update 2023-11-27T17:48:49.282 INFO:teuthology.orchestra.run.smithi094.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-11-27T17:48:49.419 INFO:teuthology.orchestra.run.smithi094.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-27T17:48:49.500 INFO:teuthology.orchestra.run.smithi094.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-11-27T17:48:49.582 INFO:teuthology.orchestra.run.smithi094.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-11-27T17:48:50.630 INFO:teuthology.orchestra.run.smithi094.stdout:Reading package lists... 2023-11-27T17:48:50.647 DEBUG:teuthology.orchestra.run.smithi094:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-11-27T17:48:50.707 INFO:teuthology.orchestra.run.smithi094.stdout:Reading package lists... 2023-11-27T17:48:50.889 INFO:teuthology.orchestra.run.smithi094.stdout:Building dependency tree... 2023-11-27T17:48:50.889 INFO:teuthology.orchestra.run.smithi094.stdout:Reading state information... 2023-11-27T17:48:51.052 INFO:teuthology.orchestra.run.smithi094.stdout:linux-image-generic is already the newest version (5.15.0.89.86). 2023-11-27T17:48:51.052 INFO:teuthology.orchestra.run.smithi094.stdout:The following packages were automatically installed and are no longer required: 2023-11-27T17:48:51.052 INFO:teuthology.orchestra.run.smithi094.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-27T17:48:51.052 INFO:teuthology.orchestra.run.smithi094.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-27T17:48:51.052 INFO:teuthology.orchestra.run.smithi094.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-27T17:48:51.052 INFO:teuthology.orchestra.run.smithi094.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-27T17:48:51.053 INFO:teuthology.orchestra.run.smithi094.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-27T17:48:51.053 INFO:teuthology.orchestra.run.smithi094.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-27T17:48:51.093 INFO:teuthology.orchestra.run.smithi094.stdout:0 upgraded, 0 newly installed, 0 to remove and 273 not upgraded. 2023-11-27T17:48:51.095 DEBUG:teuthology.orchestra.run.smithi094:> dpkg -s linux-image-generic 2023-11-27T17:48:51.107 INFO:teuthology.orchestra.run.smithi094.stdout:Package: linux-image-generic 2023-11-27T17:48:51.107 INFO:teuthology.orchestra.run.smithi094.stdout:Status: install ok installed 2023-11-27T17:48:51.107 INFO:teuthology.orchestra.run.smithi094.stdout:Priority: optional 2023-11-27T17:48:51.108 INFO:teuthology.orchestra.run.smithi094.stdout:Section: kernel 2023-11-27T17:48:51.108 INFO:teuthology.orchestra.run.smithi094.stdout:Installed-Size: 20 2023-11-27T17:48:51.108 INFO:teuthology.orchestra.run.smithi094.stdout:Maintainer: Ubuntu Kernel Team 2023-11-27T17:48:51.108 INFO:teuthology.orchestra.run.smithi094.stdout:Architecture: amd64 2023-11-27T17:48:51.108 INFO:teuthology.orchestra.run.smithi094.stdout:Source: linux-meta 2023-11-27T17:48:51.108 INFO:teuthology.orchestra.run.smithi094.stdout:Version: 5.15.0.89.86 2023-11-27T17:48:51.108 INFO:teuthology.orchestra.run.smithi094.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-89), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-11-27T17:48:51.108 INFO:teuthology.orchestra.run.smithi094.stdout:Depends: linux-image-5.15.0-89-generic, linux-modules-extra-5.15.0-89-generic, linux-firmware, intel-microcode, amd64-microcode 2023-11-27T17:48:51.108 INFO:teuthology.orchestra.run.smithi094.stdout:Recommends: thermald 2023-11-27T17:48:51.108 INFO:teuthology.orchestra.run.smithi094.stdout:Description: Generic Linux kernel image 2023-11-27T17:48:51.108 INFO:teuthology.orchestra.run.smithi094.stdout: This package will always depend on the latest generic kernel image 2023-11-27T17:48:51.108 INFO:teuthology.orchestra.run.smithi094.stdout: available. 2023-11-27T17:48:51.109 DEBUG:teuthology.orchestra.run.smithi094:> mktemp 2023-11-27T17:48:51.152 INFO:teuthology.orchestra.run.smithi094.stdout:/tmp/tmp.mTrZoPVvLg 2023-11-27T17:48:51.152 DEBUG:teuthology.orchestra.run.smithi094:> sudo cp /boot/grub/grub.cfg /tmp/tmp.mTrZoPVvLg 2023-11-27T17:48:51.206 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 0666 /tmp/tmp.mTrZoPVvLg 2023-11-27T17:48:51.321 DEBUG:teuthology.orchestra.remote:smithi094:/tmp/tmp.mTrZoPVvLg is 10KB 2023-11-27T17:48:51.333 DEBUG:teuthology.orchestra.run.smithi094:> rm -fr /tmp/tmp.mTrZoPVvLg 2023-11-27T17:48:51.338 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-11-27T17:48:51.391 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-11-27T17:48:51.392 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-11-27T17:48:51.392 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-11-27T17:48:51.473 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-89-generic 2023-11-27T17:48:51.473 DEBUG:teuthology.orchestra.run.smithi094:> sudo update-grub 2023-11-27T17:48:52.690 INFO:teuthology.orchestra.run.smithi094.stderr:Sourcing file `/etc/default/grub' 2023-11-27T17:48:52.691 INFO:teuthology.orchestra.run.smithi094.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-27T17:48:52.692 INFO:teuthology.orchestra.run.smithi094.stderr:Generating grub configuration file ... 2023-11-27T17:48:52.870 INFO:teuthology.orchestra.run.smithi094.stderr:Found linux image: /boot/vmlinuz-5.15.0-89-generic 2023-11-27T17:48:52.876 INFO:teuthology.orchestra.run.smithi094.stderr:Found initrd image: /boot/initrd.img-5.15.0-89-generic 2023-11-27T17:48:53.116 INFO:teuthology.orchestra.run.smithi094.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-27T17:48:53.121 INFO:teuthology.orchestra.run.smithi094.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-27T17:48:53.159 INFO:teuthology.orchestra.run.smithi094.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-27T17:48:53.164 INFO:teuthology.orchestra.run.smithi094.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-27T17:48:53.295 INFO:teuthology.orchestra.run.smithi094.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-27T17:48:53.295 INFO:teuthology.orchestra.run.smithi094.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-27T17:48:53.295 INFO:teuthology.orchestra.run.smithi094.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-27T17:48:53.311 INFO:teuthology.orchestra.run.smithi094.stderr:done 2023-11-27T17:48:53.322 DEBUG:teuthology.orchestra.run.smithi094:> sudo shutdown -r now 2023-11-27T17:48:55.853 INFO:teuthology.orchestra.run.smithi091.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-11-27T17:48:55.854 INFO:teuthology.orchestra.run.smithi091.stdout:Sourcing file `/etc/default/grub' 2023-11-27T17:48:55.881 INFO:teuthology.orchestra.run.smithi091.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-27T17:48:55.909 INFO:teuthology.orchestra.run.smithi091.stdout:Generating grub configuration file ... 2023-11-27T17:48:56.247 INFO:teuthology.orchestra.run.smithi091.stdout:Found linux image: /boot/vmlinuz-5.15.0-89-generic 2023-11-27T17:48:56.274 INFO:teuthology.orchestra.run.smithi091.stdout:Found initrd image: /boot/initrd.img-5.15.0-89-generic 2023-11-27T17:48:56.685 INFO:teuthology.orchestra.run.smithi091.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-27T17:48:56.691 INFO:teuthology.orchestra.run.smithi091.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-27T17:48:56.767 INFO:teuthology.orchestra.run.smithi091.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-27T17:48:56.772 INFO:teuthology.orchestra.run.smithi091.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-27T17:48:56.926 INFO:teuthology.orchestra.run.smithi091.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-27T17:48:56.926 INFO:teuthology.orchestra.run.smithi091.stdout:Systems on them will not be added to the GRUB boot configuration. 2023-11-27T17:48:56.926 INFO:teuthology.orchestra.run.smithi091.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-27T17:48:56.967 INFO:teuthology.orchestra.run.smithi091.stdout:done 2023-11-27T17:48:57.448 DEBUG:teuthology.orchestra.run.smithi091:> dpkg -s linux-image-generic 2023-11-27T17:48:57.471 INFO:teuthology.orchestra.run.smithi091.stdout:Package: linux-image-generic 2023-11-27T17:48:57.471 INFO:teuthology.orchestra.run.smithi091.stdout:Status: install ok installed 2023-11-27T17:48:57.471 INFO:teuthology.orchestra.run.smithi091.stdout:Priority: optional 2023-11-27T17:48:57.471 INFO:teuthology.orchestra.run.smithi091.stdout:Section: kernel 2023-11-27T17:48:57.471 INFO:teuthology.orchestra.run.smithi091.stdout:Installed-Size: 20 2023-11-27T17:48:57.472 INFO:teuthology.orchestra.run.smithi091.stdout:Maintainer: Ubuntu Kernel Team 2023-11-27T17:48:57.472 INFO:teuthology.orchestra.run.smithi091.stdout:Architecture: amd64 2023-11-27T17:48:57.472 INFO:teuthology.orchestra.run.smithi091.stdout:Source: linux-meta 2023-11-27T17:48:57.472 INFO:teuthology.orchestra.run.smithi091.stdout:Version: 5.15.0.89.86 2023-11-27T17:48:57.472 INFO:teuthology.orchestra.run.smithi091.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-89), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-11-27T17:48:57.472 INFO:teuthology.orchestra.run.smithi091.stdout:Depends: linux-image-5.15.0-89-generic, linux-modules-extra-5.15.0-89-generic, linux-firmware, intel-microcode, amd64-microcode 2023-11-27T17:48:57.472 INFO:teuthology.orchestra.run.smithi091.stdout:Recommends: thermald 2023-11-27T17:48:57.472 INFO:teuthology.orchestra.run.smithi091.stdout:Description: Generic Linux kernel image 2023-11-27T17:48:57.473 INFO:teuthology.orchestra.run.smithi091.stdout: This package will always depend on the latest generic kernel image 2023-11-27T17:48:57.473 INFO:teuthology.orchestra.run.smithi091.stdout: available. 2023-11-27T17:48:57.473 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-89-generic 2023-11-27T17:48:57.473 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-11-27T17:48:57.473 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-11-27T17:48:57.473 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-11-27T17:48:57.473 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi091.front.sepia.ceph.com, path=None, version=distro) 2023-11-27T17:48:57.473 DEBUG:teuthology.orchestra.run.smithi091:> sudo apt-get clean 2023-11-27T17:48:57.679 DEBUG:teuthology.orchestra.run.smithi091:> sudo apt-get update 2023-11-27T17:48:57.929 INFO:teuthology.orchestra.run.smithi091.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-27T17:48:57.970 INFO:teuthology.orchestra.run.smithi091.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-11-27T17:48:58.000 INFO:teuthology.orchestra.run.smithi091.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-11-27T17:48:58.082 INFO:teuthology.orchestra.run.smithi091.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-11-27T17:48:59.240 INFO:teuthology.orchestra.run.smithi091.stdout:Reading package lists... 2023-11-27T17:48:59.256 DEBUG:teuthology.orchestra.run.smithi091:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-11-27T17:48:59.314 INFO:teuthology.orchestra.run.smithi091.stdout:Reading package lists... 2023-11-27T17:48:59.503 INFO:teuthology.orchestra.run.smithi091.stdout:Building dependency tree... 2023-11-27T17:48:59.504 INFO:teuthology.orchestra.run.smithi091.stdout:Reading state information... 2023-11-27T17:48:59.655 INFO:teuthology.orchestra.run.smithi091.stdout:linux-image-generic is already the newest version (5.15.0.89.86). 2023-11-27T17:48:59.655 INFO:teuthology.orchestra.run.smithi091.stdout:The following packages were automatically installed and are no longer required: 2023-11-27T17:48:59.656 INFO:teuthology.orchestra.run.smithi091.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-27T17:48:59.656 INFO:teuthology.orchestra.run.smithi091.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-27T17:48:59.656 INFO:teuthology.orchestra.run.smithi091.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-27T17:48:59.656 INFO:teuthology.orchestra.run.smithi091.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-27T17:48:59.656 INFO:teuthology.orchestra.run.smithi091.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-27T17:48:59.656 INFO:teuthology.orchestra.run.smithi091.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-27T17:48:59.694 INFO:teuthology.orchestra.run.smithi091.stdout:0 upgraded, 0 newly installed, 0 to remove and 273 not upgraded. 2023-11-27T17:48:59.696 DEBUG:teuthology.orchestra.run.smithi091:> dpkg -s linux-image-generic 2023-11-27T17:48:59.710 INFO:teuthology.orchestra.run.smithi091.stdout:Package: linux-image-generic 2023-11-27T17:48:59.710 INFO:teuthology.orchestra.run.smithi091.stdout:Status: install ok installed 2023-11-27T17:48:59.710 INFO:teuthology.orchestra.run.smithi091.stdout:Priority: optional 2023-11-27T17:48:59.710 INFO:teuthology.orchestra.run.smithi091.stdout:Section: kernel 2023-11-27T17:48:59.710 INFO:teuthology.orchestra.run.smithi091.stdout:Installed-Size: 20 2023-11-27T17:48:59.710 INFO:teuthology.orchestra.run.smithi091.stdout:Maintainer: Ubuntu Kernel Team 2023-11-27T17:48:59.710 INFO:teuthology.orchestra.run.smithi091.stdout:Architecture: amd64 2023-11-27T17:48:59.710 INFO:teuthology.orchestra.run.smithi091.stdout:Source: linux-meta 2023-11-27T17:48:59.710 INFO:teuthology.orchestra.run.smithi091.stdout:Version: 5.15.0.89.86 2023-11-27T17:48:59.710 INFO:teuthology.orchestra.run.smithi091.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-89), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-11-27T17:48:59.711 INFO:teuthology.orchestra.run.smithi091.stdout:Depends: linux-image-5.15.0-89-generic, linux-modules-extra-5.15.0-89-generic, linux-firmware, intel-microcode, amd64-microcode 2023-11-27T17:48:59.711 INFO:teuthology.orchestra.run.smithi091.stdout:Recommends: thermald 2023-11-27T17:48:59.711 INFO:teuthology.orchestra.run.smithi091.stdout:Description: Generic Linux kernel image 2023-11-27T17:48:59.711 INFO:teuthology.orchestra.run.smithi091.stdout: This package will always depend on the latest generic kernel image 2023-11-27T17:48:59.711 INFO:teuthology.orchestra.run.smithi091.stdout: available. 2023-11-27T17:48:59.712 DEBUG:teuthology.orchestra.run.smithi091:> mktemp 2023-11-27T17:48:59.760 INFO:teuthology.orchestra.run.smithi091.stdout:/tmp/tmp.5TOKOOOZ3t 2023-11-27T17:48:59.761 DEBUG:teuthology.orchestra.run.smithi091:> sudo cp /boot/grub/grub.cfg /tmp/tmp.5TOKOOOZ3t 2023-11-27T17:48:59.811 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod 0666 /tmp/tmp.5TOKOOOZ3t 2023-11-27T17:48:59.932 DEBUG:teuthology.orchestra.remote:smithi091:/tmp/tmp.5TOKOOOZ3t is 10KB 2023-11-27T17:48:59.943 DEBUG:teuthology.orchestra.run.smithi091:> rm -fr /tmp/tmp.5TOKOOOZ3t 2023-11-27T17:48:59.948 DEBUG:teuthology.orchestra.run.smithi091:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-11-27T17:49:00.000 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T17:49:00.000 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-11-27T17:49:00.000 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-11-27T17:49:00.076 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-89-generic 2023-11-27T17:49:00.076 DEBUG:teuthology.orchestra.run.smithi091:> sudo update-grub 2023-11-27T17:49:01.346 INFO:teuthology.orchestra.run.smithi091.stderr:Sourcing file `/etc/default/grub' 2023-11-27T17:49:01.347 INFO:teuthology.orchestra.run.smithi091.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-27T17:49:01.349 INFO:teuthology.orchestra.run.smithi091.stderr:Generating grub configuration file ... 2023-11-27T17:49:01.512 INFO:teuthology.orchestra.run.smithi091.stderr:Found linux image: /boot/vmlinuz-5.15.0-89-generic 2023-11-27T17:49:01.518 INFO:teuthology.orchestra.run.smithi091.stderr:Found initrd image: /boot/initrd.img-5.15.0-89-generic 2023-11-27T17:49:01.801 INFO:teuthology.orchestra.run.smithi091.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-27T17:49:01.807 INFO:teuthology.orchestra.run.smithi091.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-27T17:49:01.848 INFO:teuthology.orchestra.run.smithi091.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-27T17:49:01.853 INFO:teuthology.orchestra.run.smithi091.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-27T17:49:01.985 INFO:teuthology.orchestra.run.smithi091.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-27T17:49:01.985 INFO:teuthology.orchestra.run.smithi091.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-27T17:49:01.985 INFO:teuthology.orchestra.run.smithi091.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-27T17:49:02.018 INFO:teuthology.orchestra.run.smithi091.stderr:done 2023-11-27T17:49:02.027 DEBUG:teuthology.orchestra.run.smithi091:> sudo shutdown -r now 2023-11-27T17:49:23.346 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-11-27T17:49:23.346 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2023-11-27T17:49:23.347 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T17:49:32.038 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-11-27T17:49:32.038 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi091.front.sepia.ceph.com' 2023-11-27T17:49:32.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T17:49:50.562 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.91 2023-11-27T17:49:59.570 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi091.front.sepia.ceph.com' 2023-11-27T17:49:59.571 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T17:50:02.626 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.91 2023-11-27T17:50:17.562 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi091.front.sepia.ceph.com' 2023-11-27T17:50:17.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T17:50:23.355 DEBUG:teuthology.orchestra.remote:timed out 2023-11-27T17:50:32.362 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2023-11-27T17:50:32.363 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T17:50:33.219 DEBUG:teuthology.orchestra.run.smithi094:> true 2023-11-27T17:50:34.286 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi094.front.sepia.ceph.com' 2023-11-27T17:50:34.286 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-89-generic"... 2023-11-27T17:50:34.286 DEBUG:teuthology.orchestra.run.smithi094:> uname -r 2023-11-27T17:50:34.333 INFO:teuthology.orchestra.run.smithi094.stdout:5.15.0-89-generic 2023-11-27T17:50:34.333 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-89-generic vs 5.15.0-89-generic 2023-11-27T17:50:34.333 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-27T17:50:34.333 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-27T17:50:35.334 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-11-27T17:50:35.335 DEBUG:teuthology.orchestra.run.smithi094:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-27T17:50:35.500 INFO:teuthology.orchestra.run.smithi094.stdout:ttyS1 2023-11-27T17:50:35.523 DEBUG:teuthology.parallel:result is None 2023-11-27T17:50:36.130 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.91 2023-11-27T17:50:51.131 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi091.front.sepia.ceph.com' 2023-11-27T17:50:51.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T17:50:51.386 DEBUG:teuthology.orchestra.run.smithi091:> true 2023-11-27T17:50:52.016 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi091.front.sepia.ceph.com' 2023-11-27T17:50:52.016 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-89-generic"... 2023-11-27T17:50:52.017 DEBUG:teuthology.orchestra.run.smithi091:> uname -r 2023-11-27T17:50:52.065 INFO:teuthology.orchestra.run.smithi091.stdout:5.15.0-89-generic 2023-11-27T17:50:52.066 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-89-generic vs 5.15.0-89-generic 2023-11-27T17:50:52.066 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-27T17:50:52.066 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-27T17:50:53.066 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-11-27T17:50:53.067 DEBUG:teuthology.orchestra.run.smithi091:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-27T17:50:53.149 INFO:teuthology.orchestra.run.smithi091.stdout:ttyS1 2023-11-27T17:50:53.187 DEBUG:teuthology.parallel:result is None 2023-11-27T17:50:53.187 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-27T17:50:53.195 INFO:teuthology.task.internal:Creating test directory... 2023-11-27T17:50:53.195 DEBUG:teuthology.orchestra.run.smithi091:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-27T17:50:53.197 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-27T17:50:53.203 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-27T17:50:53.265 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-27T17:50:53.311 INFO:teuthology.task.internal:Creating archive directory... 2023-11-27T17:50:53.312 DEBUG:teuthology.orchestra.run.smithi091:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-27T17:50:53.314 DEBUG:teuthology.orchestra.run.smithi094:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-27T17:50:53.406 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-27T17:50:53.414 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-27T17:50:53.414 DEBUG:teuthology.orchestra.run.smithi091:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-27T17:50:53.416 DEBUG:teuthology.orchestra.run.smithi094:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-27T17:50:53.436 INFO:teuthology.orchestra.run.smithi091.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-27T17:50:53.445 INFO:teuthology.orchestra.run.smithi091.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-27T17:50:53.448 INFO:teuthology.orchestra.run.smithi094.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-27T17:50:53.455 INFO:teuthology.orchestra.run.smithi094.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-27T17:50:53.457 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-27T17:50:53.464 INFO:teuthology.task.internal:Configuring sudo... 2023-11-27T17:50:53.464 DEBUG:teuthology.orchestra.run.smithi091:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-27T17:50:53.490 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-27T17:50:53.512 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-27T17:50:53.522 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-27T17:50:53.522 DEBUG:teuthology.orchestra.run.smithi091:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-27T17:50:53.546 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-27T17:50:53.560 DEBUG:teuthology.orchestra.run.smithi091:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-27T17:50:53.601 DEBUG:teuthology.orchestra.run.smithi091:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-27T17:50:53.649 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T17:50:53.649 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-27T17:50:53.711 DEBUG:teuthology.orchestra.run.smithi094:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-27T17:50:53.717 DEBUG:teuthology.orchestra.run.smithi094:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-27T17:50:53.765 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-11-27T17:50:53.765 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-27T17:50:53.826 DEBUG:teuthology.orchestra.run.smithi091:> sudo service rsyslog restart 2023-11-27T17:50:53.829 DEBUG:teuthology.orchestra.run.smithi094:> sudo service rsyslog restart 2023-11-27T17:50:53.923 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-27T17:50:53.931 INFO:teuthology.task.internal:Starting timer... 2023-11-27T17:50:53.931 INFO:teuthology.run_tasks:Running task pcp... 2023-11-27T17:50:53.976 INFO:teuthology.run_tasks:Running task selinux... 2023-11-27T17:50:54.031 DEBUG:teuthology.task.selinux:Excluding smithi091: OS 'ubuntu' does not support SELinux 2023-11-27T17:50:54.031 DEBUG:teuthology.task.selinux:Excluding smithi094: OS 'ubuntu' does not support SELinux 2023-11-27T17:50:54.031 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-27T17:50:54.031 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-11-27T17:50:54.032 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-27T17:50:54.032 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-27T17:50:54.047 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-11-27T17:50:54.047 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-27T17:50:54.066 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-27T17:50:54.066 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi091.front.sepia.ceph.com,smithi094.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-27T17:58:50.234 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi091.front.sepia.ceph.com'), Remote(name='ubuntu@smithi094.front.sepia.ceph.com')] 2023-11-27T17:58:50.235 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi091.front.sepia.ceph.com' 2023-11-27T17:58:50.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T17:58:50.311 DEBUG:teuthology.orchestra.run.smithi091:> true 2023-11-27T17:58:50.410 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi091.front.sepia.ceph.com' 2023-11-27T17:58:50.410 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2023-11-27T17:58:50.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T17:58:50.485 DEBUG:teuthology.orchestra.run.smithi094:> true 2023-11-27T17:58:50.602 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi094.front.sepia.ceph.com' 2023-11-27T17:58:50.602 INFO:teuthology.run_tasks:Running task clock... 2023-11-27T17:58:50.617 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-27T17:58:50.617 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-27T17:58:50.617 DEBUG:teuthology.orchestra.run.smithi091:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-27T17:58:50.620 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-27T17:58:50.620 DEBUG:teuthology.orchestra.run.smithi094:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-27T17:58:50.647 INFO:teuthology.orchestra.run.smithi091.stdout:27 Nov 17:58:50 ntpd[27980]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-11-27T17:58:50.648 INFO:teuthology.orchestra.run.smithi091.stdout:27 Nov 17:58:50 ntpd[27980]: Command line: ntpd -gq 2023-11-27T17:58:50.648 INFO:teuthology.orchestra.run.smithi091.stdout:27 Nov 17:58:50 ntpd[27980]: ---------------------------------------------------- 2023-11-27T17:58:50.648 INFO:teuthology.orchestra.run.smithi091.stdout:27 Nov 17:58:50 ntpd[27980]: ntp-4 is maintained by Network Time Foundation, 2023-11-27T17:58:50.648 INFO:teuthology.orchestra.run.smithi091.stdout:27 Nov 17:58:50 ntpd[27980]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-11-27T17:58:50.648 INFO:teuthology.orchestra.run.smithi091.stdout:27 Nov 17:58:50 ntpd[27980]: corporation. Support and training for ntp-4 are 2023-11-27T17:58:50.648 INFO:teuthology.orchestra.run.smithi091.stdout:27 Nov 17:58:50 ntpd[27980]: available at https://www.nwtime.org/support 2023-11-27T17:58:50.649 INFO:teuthology.orchestra.run.smithi091.stdout:27 Nov 17:58:50 ntpd[27980]: ---------------------------------------------------- 2023-11-27T17:58:50.649 INFO:teuthology.orchestra.run.smithi091.stdout:27 Nov 17:58:50 ntpd[27980]: proto: precision = 0.045 usec (-24) 2023-11-27T17:58:50.649 INFO:teuthology.orchestra.run.smithi091.stdout:27 Nov 17:58:50 ntpd[27980]: basedate set to 2022-02-04 2023-11-27T17:58:50.649 INFO:teuthology.orchestra.run.smithi091.stdout:27 Nov 17:58:50 ntpd[27980]: gps base set to 2022-02-06 (week 2196) 2023-11-27T17:58:50.650 INFO:teuthology.orchestra.run.smithi091.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-27T17:58:50.650 INFO:teuthology.orchestra.run.smithi091.stdout:27 Nov 17:58:50 ntpd[27980]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-27T17:58:50.650 INFO:teuthology.orchestra.run.smithi091.stdout:27 Nov 17:58:50 ntpd[27980]: restrict ::: KOD does nothing without LIMITED. 2023-11-27T17:58:50.651 INFO:teuthology.orchestra.run.smithi091.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-27T17:58:50.652 INFO:teuthology.orchestra.run.smithi091.stdout:27 Nov 17:58:50 ntpd[27980]: Listen and drop on 0 v6wildcard [::]:123 2023-11-27T17:58:50.652 INFO:teuthology.orchestra.run.smithi091.stdout:27 Nov 17:58:50 ntpd[27980]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-27T17:58:50.652 INFO:teuthology.orchestra.run.smithi091.stdout:27 Nov 17:58:50 ntpd[27980]: Listen normally on 2 lo 127.0.0.1:123 2023-11-27T17:58:50.652 INFO:teuthology.orchestra.run.smithi091.stdout:27 Nov 17:58:50 ntpd[27980]: Listen normally on 3 enp3s0f1 172.21.15.91:123 2023-11-27T17:58:50.653 INFO:teuthology.orchestra.run.smithi091.stdout:27 Nov 17:58:50 ntpd[27980]: Listen normally on 4 lo [::1]:123 2023-11-27T17:58:50.653 INFO:teuthology.orchestra.run.smithi091.stdout:27 Nov 17:58:50 ntpd[27980]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d3d5%5]:123 2023-11-27T17:58:50.653 INFO:teuthology.orchestra.run.smithi091.stdout:27 Nov 17:58:50 ntpd[27980]: Listening on routing socket on fd #22 for interface updates 2023-11-27T17:58:50.670 INFO:teuthology.orchestra.run.smithi094.stdout:27 Nov 17:58:50 ntpd[28009]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-11-27T17:58:50.670 INFO:teuthology.orchestra.run.smithi094.stdout:27 Nov 17:58:50 ntpd[28009]: Command line: ntpd -gq 2023-11-27T17:58:50.670 INFO:teuthology.orchestra.run.smithi094.stdout:27 Nov 17:58:50 ntpd[28009]: ---------------------------------------------------- 2023-11-27T17:58:50.670 INFO:teuthology.orchestra.run.smithi094.stdout:27 Nov 17:58:50 ntpd[28009]: ntp-4 is maintained by Network Time Foundation, 2023-11-27T17:58:50.670 INFO:teuthology.orchestra.run.smithi094.stdout:27 Nov 17:58:50 ntpd[28009]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-11-27T17:58:50.671 INFO:teuthology.orchestra.run.smithi094.stdout:27 Nov 17:58:50 ntpd[28009]: corporation. Support and training for ntp-4 are 2023-11-27T17:58:50.671 INFO:teuthology.orchestra.run.smithi094.stdout:27 Nov 17:58:50 ntpd[28009]: available at https://www.nwtime.org/support 2023-11-27T17:58:50.671 INFO:teuthology.orchestra.run.smithi094.stdout:27 Nov 17:58:50 ntpd[28009]: ---------------------------------------------------- 2023-11-27T17:58:50.671 INFO:teuthology.orchestra.run.smithi094.stdout:27 Nov 17:58:50 ntpd[28009]: proto: precision = 0.047 usec (-24) 2023-11-27T17:58:50.671 INFO:teuthology.orchestra.run.smithi094.stdout:27 Nov 17:58:50 ntpd[28009]: basedate set to 2022-02-04 2023-11-27T17:58:50.672 INFO:teuthology.orchestra.run.smithi094.stdout:27 Nov 17:58:50 ntpd[28009]: gps base set to 2022-02-06 (week 2196) 2023-11-27T17:58:50.672 INFO:teuthology.orchestra.run.smithi094.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-27T17:58:50.672 INFO:teuthology.orchestra.run.smithi094.stdout:27 Nov 17:58:50 ntpd[28009]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-27T17:58:50.672 INFO:teuthology.orchestra.run.smithi094.stdout:27 Nov 17:58:50 ntpd[28009]: restrict ::: KOD does nothing without LIMITED. 2023-11-27T17:58:50.673 INFO:teuthology.orchestra.run.smithi094.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-27T17:58:50.674 INFO:teuthology.orchestra.run.smithi094.stdout:27 Nov 17:58:50 ntpd[28009]: Listen and drop on 0 v6wildcard [::]:123 2023-11-27T17:58:50.674 INFO:teuthology.orchestra.run.smithi094.stdout:27 Nov 17:58:50 ntpd[28009]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-27T17:58:50.674 INFO:teuthology.orchestra.run.smithi094.stdout:27 Nov 17:58:50 ntpd[28009]: Listen normally on 2 lo 127.0.0.1:123 2023-11-27T17:58:50.674 INFO:teuthology.orchestra.run.smithi094.stdout:27 Nov 17:58:50 ntpd[28009]: Listen normally on 3 enp3s0f1 172.21.15.94:123 2023-11-27T17:58:50.674 INFO:teuthology.orchestra.run.smithi094.stdout:27 Nov 17:58:50 ntpd[28009]: Listen normally on 4 lo [::1]:123 2023-11-27T17:58:50.674 INFO:teuthology.orchestra.run.smithi094.stdout:27 Nov 17:58:50 ntpd[28009]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d763%5]:123 2023-11-27T17:58:50.674 INFO:teuthology.orchestra.run.smithi094.stdout:27 Nov 17:58:50 ntpd[28009]: Listening on routing socket on fd #22 for interface updates 2023-11-27T17:58:51.647 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:51 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:58:51.648 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:51 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:58:51.648 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:51 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:58:51.648 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:51 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:58:51.648 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:51 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:58:51.648 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:51 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:58:51.648 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:51 ntpd[27980]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-27T17:58:51.648 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:51 ntpd[27980]: can't open /var/log/ntpstats/peerstats.20231127: Permission denied 2023-11-27T17:58:51.671 INFO:teuthology.orchestra.run.smithi094.stderr:27 Nov 17:58:51 ntpd[28009]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:58:51.671 INFO:teuthology.orchestra.run.smithi094.stderr:27 Nov 17:58:51 ntpd[28009]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:58:51.671 INFO:teuthology.orchestra.run.smithi094.stderr:27 Nov 17:58:51 ntpd[28009]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:58:51.671 INFO:teuthology.orchestra.run.smithi094.stderr:27 Nov 17:58:51 ntpd[28009]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:58:51.671 INFO:teuthology.orchestra.run.smithi094.stderr:27 Nov 17:58:51 ntpd[28009]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:58:51.671 INFO:teuthology.orchestra.run.smithi094.stderr:27 Nov 17:58:51 ntpd[28009]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:58:51.671 INFO:teuthology.orchestra.run.smithi094.stderr:27 Nov 17:58:51 ntpd[28009]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-27T17:58:51.671 INFO:teuthology.orchestra.run.smithi094.stderr:27 Nov 17:58:51 ntpd[28009]: can't open /var/log/ntpstats/peerstats.20231127: Permission denied 2023-11-27T17:58:52.647 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:52 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:58:52.648 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:52 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:58:52.648 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:52 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:58:52.648 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:52 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:58:52.648 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:52 ntpd[27980]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-27T17:58:52.648 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:52 ntpd[27980]: can't open /var/log/ntpstats/peerstats.20231127: Permission denied 2023-11-27T17:58:53.648 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:53 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:58:53.648 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:53 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:58:53.648 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:53 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:58:53.648 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:53 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:58:53.648 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:53 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:58:53.648 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:53 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:58:53.648 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:53 ntpd[27980]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-27T17:58:53.649 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:53 ntpd[27980]: can't open /var/log/ntpstats/peerstats.20231127: Permission denied 2023-11-27T17:58:53.649 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:53 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:58:53.649 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:53 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:58:53.649 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:53 ntpd[27980]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-27T17:58:53.649 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:53 ntpd[27980]: can't open /var/log/ntpstats/peerstats.20231127: Permission denied 2023-11-27T17:58:53.671 INFO:teuthology.orchestra.run.smithi094.stderr:27 Nov 17:58:53 ntpd[28009]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:58:53.671 INFO:teuthology.orchestra.run.smithi094.stderr:27 Nov 17:58:53 ntpd[28009]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:58:53.671 INFO:teuthology.orchestra.run.smithi094.stderr:27 Nov 17:58:53 ntpd[28009]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:58:53.671 INFO:teuthology.orchestra.run.smithi094.stderr:27 Nov 17:58:53 ntpd[28009]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:58:53.671 INFO:teuthology.orchestra.run.smithi094.stderr:27 Nov 17:58:53 ntpd[28009]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:58:53.671 INFO:teuthology.orchestra.run.smithi094.stderr:27 Nov 17:58:53 ntpd[28009]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:58:53.671 INFO:teuthology.orchestra.run.smithi094.stderr:27 Nov 17:58:53 ntpd[28009]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-27T17:58:53.672 INFO:teuthology.orchestra.run.smithi094.stderr:27 Nov 17:58:53 ntpd[28009]: can't open /var/log/ntpstats/peerstats.20231127: Permission denied 2023-11-27T17:58:53.672 INFO:teuthology.orchestra.run.smithi094.stderr:27 Nov 17:58:53 ntpd[28009]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:58:53.672 INFO:teuthology.orchestra.run.smithi094.stderr:27 Nov 17:58:53 ntpd[28009]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:58:53.672 INFO:teuthology.orchestra.run.smithi094.stderr:27 Nov 17:58:53 ntpd[28009]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-27T17:58:53.672 INFO:teuthology.orchestra.run.smithi094.stderr:27 Nov 17:58:53 ntpd[28009]: can't open /var/log/ntpstats/peerstats.20231127: Permission denied 2023-11-27T17:58:54.647 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:54 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:58:54.648 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:54 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:58:54.648 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:54 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:58:54.648 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:54 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:58:54.648 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:54 ntpd[27980]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-27T17:58:54.648 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:54 ntpd[27980]: can't open /var/log/ntpstats/peerstats.20231127: Permission denied 2023-11-27T17:58:54.671 INFO:teuthology.orchestra.run.smithi094.stderr:27 Nov 17:58:54 ntpd[28009]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:58:54.671 INFO:teuthology.orchestra.run.smithi094.stderr:27 Nov 17:58:54 ntpd[28009]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:58:54.671 INFO:teuthology.orchestra.run.smithi094.stderr:27 Nov 17:58:54 ntpd[28009]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:58:54.671 INFO:teuthology.orchestra.run.smithi094.stderr:27 Nov 17:58:54 ntpd[28009]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:58:54.671 INFO:teuthology.orchestra.run.smithi094.stderr:27 Nov 17:58:54 ntpd[28009]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-27T17:58:54.671 INFO:teuthology.orchestra.run.smithi094.stderr:27 Nov 17:58:54 ntpd[28009]: can't open /var/log/ntpstats/peerstats.20231127: Permission denied 2023-11-27T17:58:55.648 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:55 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:58:55.648 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:55 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:58:55.648 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:55 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:58:55.648 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:55 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:58:55.649 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:55 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:58:55.649 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:55 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:58:55.649 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:55 ntpd[27980]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-27T17:58:55.649 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:55 ntpd[27980]: can't open /var/log/ntpstats/peerstats.20231127: Permission denied 2023-11-27T17:58:55.649 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:55 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:58:55.649 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:55 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:58:55.649 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:55 ntpd[27980]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-27T17:58:55.649 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:55 ntpd[27980]: can't open /var/log/ntpstats/peerstats.20231127: Permission denied 2023-11-27T17:58:55.671 INFO:teuthology.orchestra.run.smithi094.stderr:27 Nov 17:58:55 ntpd[28009]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:58:55.671 INFO:teuthology.orchestra.run.smithi094.stderr:27 Nov 17:58:55 ntpd[28009]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:58:55.671 INFO:teuthology.orchestra.run.smithi094.stderr:27 Nov 17:58:55 ntpd[28009]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:58:55.671 INFO:teuthology.orchestra.run.smithi094.stderr:27 Nov 17:58:55 ntpd[28009]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:58:55.672 INFO:teuthology.orchestra.run.smithi094.stderr:27 Nov 17:58:55 ntpd[28009]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:58:55.672 INFO:teuthology.orchestra.run.smithi094.stderr:27 Nov 17:58:55 ntpd[28009]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:58:55.672 INFO:teuthology.orchestra.run.smithi094.stderr:27 Nov 17:58:55 ntpd[28009]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-27T17:58:55.672 INFO:teuthology.orchestra.run.smithi094.stderr:27 Nov 17:58:55 ntpd[28009]: can't open /var/log/ntpstats/peerstats.20231127: Permission denied 2023-11-27T17:58:55.672 INFO:teuthology.orchestra.run.smithi094.stderr:27 Nov 17:58:55 ntpd[28009]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:58:55.672 INFO:teuthology.orchestra.run.smithi094.stderr:27 Nov 17:58:55 ntpd[28009]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:58:55.672 INFO:teuthology.orchestra.run.smithi094.stderr:27 Nov 17:58:55 ntpd[28009]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-27T17:58:55.672 INFO:teuthology.orchestra.run.smithi094.stderr:27 Nov 17:58:55 ntpd[28009]: can't open /var/log/ntpstats/peerstats.20231127: Permission denied 2023-11-27T17:58:56.648 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:56 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:58:56.648 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:56 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:58:56.648 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:56 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:58:56.648 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:56 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:58:56.648 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:56 ntpd[27980]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-27T17:58:56.648 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:56 ntpd[27980]: can't open /var/log/ntpstats/peerstats.20231127: Permission denied 2023-11-27T17:58:56.671 INFO:teuthology.orchestra.run.smithi094.stderr:27 Nov 17:58:56 ntpd[28009]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:58:56.671 INFO:teuthology.orchestra.run.smithi094.stderr:27 Nov 17:58:56 ntpd[28009]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:58:56.671 INFO:teuthology.orchestra.run.smithi094.stderr:27 Nov 17:58:56 ntpd[28009]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:58:56.671 INFO:teuthology.orchestra.run.smithi094.stderr:27 Nov 17:58:56 ntpd[28009]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:58:56.671 INFO:teuthology.orchestra.run.smithi094.stderr:27 Nov 17:58:56 ntpd[28009]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-27T17:58:56.671 INFO:teuthology.orchestra.run.smithi094.stderr:27 Nov 17:58:56 ntpd[28009]: can't open /var/log/ntpstats/peerstats.20231127: Permission denied 2023-11-27T17:58:57.648 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:57 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:58:59.417 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:57 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:58:59.417 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:57 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:58:59.417 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:57 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:58:59.417 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:57 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:58:59.418 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:57 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:58:59.418 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:57 ntpd[27980]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-27T17:58:59.418 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:57 ntpd[27980]: can't open /var/log/ntpstats/peerstats.20231127: Permission denied 2023-11-27T17:58:59.418 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:57 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:58:59.418 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:57 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:58:59.418 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:57 ntpd[27980]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-27T17:58:59.418 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:57 ntpd[27980]: can't open /var/log/ntpstats/peerstats.20231127: Permission denied 2023-11-27T17:58:59.418 INFO:teuthology.orchestra.run.smithi091.stdout:27 Nov 17:58:57 ntpd[27980]: ntpd: time slew +0.000758 s 2023-11-27T17:58:59.419 INFO:teuthology.orchestra.run.smithi091.stdout:ntpd: time slew +0.000758s 2023-11-27T17:58:59.425 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:57 ntpd[27980]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-27T17:58:59.425 INFO:teuthology.orchestra.run.smithi091.stderr:27 Nov 17:58:57 ntpd[27980]: can't open /var/log/ntpstats/loopstats.20231127: Permission denied 2023-11-27T17:58:59.426 INFO:teuthology.orchestra.run.smithi091.stdout: remote refid st t when poll reach delay offset jitter 2023-11-27T17:58:59.426 INFO:teuthology.orchestra.run.smithi091.stdout:============================================================================== 2023-11-27T17:58:59.426 INFO:teuthology.orchestra.run.smithi091.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-27T17:58:59.426 INFO:teuthology.orchestra.run.smithi091.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-27T17:58:59.427 INFO:teuthology.orchestra.run.smithi091.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-27T17:58:59.427 INFO:teuthology.orchestra.run.smithi091.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-27T17:58:59.427 INFO:teuthology.orchestra.run.smithi094.stderr:27 Nov 17:58:57 ntpd[28009]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:58:59.427 INFO:teuthology.orchestra.run.smithi094.stderr:27 Nov 17:58:57 ntpd[28009]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:58:59.428 INFO:teuthology.orchestra.run.smithi094.stderr:27 Nov 17:58:57 ntpd[28009]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:58:59.428 INFO:teuthology.orchestra.run.smithi094.stderr:27 Nov 17:58:57 ntpd[28009]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:58:59.428 INFO:teuthology.orchestra.run.smithi094.stderr:27 Nov 17:58:57 ntpd[28009]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:58:59.428 INFO:teuthology.orchestra.run.smithi094.stderr:27 Nov 17:58:57 ntpd[28009]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:58:59.428 INFO:teuthology.orchestra.run.smithi094.stderr:27 Nov 17:58:57 ntpd[28009]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-27T17:58:59.428 INFO:teuthology.orchestra.run.smithi094.stderr:27 Nov 17:58:57 ntpd[28009]: can't open /var/log/ntpstats/peerstats.20231127: Permission denied 2023-11-27T17:58:59.428 INFO:teuthology.orchestra.run.smithi094.stdout:27 Nov 17:58:57 ntpd[28009]: ntpd: time slew +0.001012 s 2023-11-27T17:58:59.428 INFO:teuthology.orchestra.run.smithi094.stdout:ntpd: time slew +0.001012s 2023-11-27T17:58:59.431 INFO:teuthology.orchestra.run.smithi094.stderr:27 Nov 17:58:57 ntpd[28009]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-27T17:58:59.431 INFO:teuthology.orchestra.run.smithi094.stderr:27 Nov 17:58:57 ntpd[28009]: can't open /var/log/ntpstats/loopstats.20231127: Permission denied 2023-11-27T17:58:59.432 INFO:teuthology.orchestra.run.smithi094.stdout: remote refid st t when poll reach delay offset jitter 2023-11-27T17:58:59.432 INFO:teuthology.orchestra.run.smithi094.stdout:============================================================================== 2023-11-27T17:58:59.432 INFO:teuthology.orchestra.run.smithi094.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-27T17:58:59.432 INFO:teuthology.orchestra.run.smithi094.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-27T17:58:59.432 INFO:teuthology.orchestra.run.smithi094.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-27T17:58:59.432 INFO:teuthology.orchestra.run.smithi094.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-27T17:58:59.432 INFO:teuthology.run_tasks:Running task install... 2023-11-27T17:58:59.446 DEBUG:teuthology.task.install:project ceph 2023-11-27T17:58:59.446 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631'}} 2023-11-27T17:58:59.447 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631'} 2023-11-27T17:58:59.447 INFO:teuthology.task.install:Using flavor: default 2023-11-27T17:58:59.462 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2023-11-27T17:58:59.462 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-27T17:58:59.463 DEBUG:teuthology.orchestra.run.smithi091:> sudo apt-key list | grep Ceph 2023-11-27T17:58:59.463 DEBUG:teuthology.orchestra.run.smithi094:> sudo apt-key list | grep Ceph 2023-11-27T17:58:59.528 INFO:teuthology.orchestra.run.smithi091.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-11-27T17:58:59.544 INFO:teuthology.orchestra.run.smithi094.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-11-27T17:58:59.560 INFO:teuthology.orchestra.run.smithi091.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-27T17:58:59.560 INFO:teuthology.orchestra.run.smithi091.stdout:uid [ unknown] Ceph.com (release key) 2023-11-27T17:58:59.561 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, ceph-common-dbg, ceph-fuse-dbg, ceph-mds-dbg, ceph-mgr-dbg, ceph-mon-dbg, ceph-osd-dbg, ceph-test-dbg, libcephfs2-dbg, librados2-dbg, libradosstriper1-dbg, librbd1-dbg, librgw2-dbg, radosgw-dbg, rbd-fuse-dbg, rbd-mirror-dbg, rbd-nbd-dbg, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-27T17:58:59.561 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-27T17:58:59.562 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=369173db14b6995b2bd07c60ec5f63d01cf21631 2023-11-27T17:58:59.573 INFO:teuthology.orchestra.run.smithi094.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-27T17:58:59.573 INFO:teuthology.orchestra.run.smithi094.stdout:uid [ unknown] Ceph.com (release key) 2023-11-27T17:58:59.574 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, ceph-common-dbg, ceph-fuse-dbg, ceph-mds-dbg, ceph-mgr-dbg, ceph-mon-dbg, ceph-osd-dbg, ceph-test-dbg, libcephfs2-dbg, librados2-dbg, libradosstriper1-dbg, librbd1-dbg, librgw2-dbg, radosgw-dbg, rbd-fuse-dbg, rbd-mirror-dbg, rbd-nbd-dbg, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-27T17:58:59.574 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-27T17:58:59.574 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=369173db14b6995b2bd07c60ec5f63d01cf21631 2023-11-27T17:58:59.715 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default/ 2023-11-27T17:58:59.715 INFO:teuthology.task.install.deb:Package version is 18.0.0-7498-g369173db-1jammy 2023-11-27T17:58:59.832 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default/ 2023-11-27T17:58:59.832 INFO:teuthology.task.install.deb:Package version is 18.0.0-7498-g369173db-1jammy 2023-11-27T17:58:59.937 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-11-27T17:58:59.937 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-27T17:58:59.951 DEBUG:teuthology.orchestra.run.smithi094:> sudo apt-get update 2023-11-27T17:59:00.062 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T17:59:00.063 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-27T17:59:00.077 DEBUG:teuthology.orchestra.run.smithi091:> sudo apt-get update 2023-11-27T17:59:00.128 INFO:teuthology.orchestra.run.smithi094.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-27T17:59:00.139 INFO:teuthology.orchestra.run.smithi094.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-11-27T17:59:00.156 INFO:teuthology.orchestra.run.smithi094.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-11-27T17:59:00.237 INFO:teuthology.orchestra.run.smithi091.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-27T17:59:00.247 INFO:teuthology.orchestra.run.smithi091.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-11-27T17:59:00.253 INFO:teuthology.orchestra.run.smithi094.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-11-27T17:59:00.264 INFO:teuthology.orchestra.run.smithi091.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-11-27T17:59:00.269 INFO:teuthology.orchestra.run.smithi091.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-11-27T17:59:00.289 INFO:teuthology.orchestra.run.smithi094.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy InRelease 2023-11-27T17:59:00.292 INFO:teuthology.orchestra.run.smithi091.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy InRelease 2023-11-27T17:59:00.313 INFO:teuthology.orchestra.run.smithi091.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-11-27T17:59:00.335 INFO:teuthology.orchestra.run.smithi091.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy Release.gpg 2023-11-27T17:59:00.345 INFO:teuthology.orchestra.run.smithi094.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-11-27T17:59:00.356 INFO:teuthology.orchestra.run.smithi091.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,400 B] 2023-11-27T17:59:00.382 INFO:teuthology.orchestra.run.smithi091.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-11-27T17:59:00.403 INFO:teuthology.orchestra.run.smithi094.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy Release.gpg 2023-11-27T17:59:00.459 INFO:teuthology.orchestra.run.smithi094.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-11-27T17:59:00.519 INFO:teuthology.orchestra.run.smithi094.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,400 B] 2023-11-27T17:59:00.571 INFO:teuthology.orchestra.run.smithi091.stdout:Fetched 28.5 kB in 0s (88.6 kB/s) 2023-11-27T17:59:00.594 INFO:teuthology.orchestra.run.smithi094.stdout:Fetched 28.5 kB in 0s (61.5 kB/s) 2023-11-27T17:59:01.466 INFO:teuthology.orchestra.run.smithi094.stdout:Reading package lists... 2023-11-27T17:59:01.475 INFO:teuthology.orchestra.run.smithi091.stdout:Reading package lists... 2023-11-27T17:59:01.480 DEBUG:teuthology.orchestra.run.smithi094:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-7498-g369173db-1jammy cephadm=18.0.0-7498-g369173db-1jammy ceph-mds=18.0.0-7498-g369173db-1jammy ceph-mgr=18.0.0-7498-g369173db-1jammy ceph-common=18.0.0-7498-g369173db-1jammy ceph-fuse=18.0.0-7498-g369173db-1jammy ceph-test=18.0.0-7498-g369173db-1jammy ceph-volume=18.0.0-7498-g369173db-1jammy radosgw=18.0.0-7498-g369173db-1jammy python3-rados=18.0.0-7498-g369173db-1jammy python3-rgw=18.0.0-7498-g369173db-1jammy python3-cephfs=18.0.0-7498-g369173db-1jammy python3-rbd=18.0.0-7498-g369173db-1jammy libcephfs2=18.0.0-7498-g369173db-1jammy libcephfs-dev=18.0.0-7498-g369173db-1jammy librados2=18.0.0-7498-g369173db-1jammy librbd1=18.0.0-7498-g369173db-1jammy rbd-fuse=18.0.0-7498-g369173db-1jammy ceph-common-dbg=18.0.0-7498-g369173db-1jammy ceph-fuse-dbg=18.0.0-7498-g369173db-1jammy ceph-mds-dbg=18.0.0-7498-g369173db-1jammy ceph-mgr-dbg=18.0.0-7498-g369173db-1jammy ceph-mon-dbg=18.0.0-7498-g369173db-1jammy ceph-osd-dbg=18.0.0-7498-g369173db-1jammy ceph-test-dbg=18.0.0-7498-g369173db-1jammy libcephfs2-dbg=18.0.0-7498-g369173db-1jammy librados2-dbg=18.0.0-7498-g369173db-1jammy libradosstriper1-dbg=18.0.0-7498-g369173db-1jammy librbd1-dbg=18.0.0-7498-g369173db-1jammy librgw2-dbg=18.0.0-7498-g369173db-1jammy radosgw-dbg=18.0.0-7498-g369173db-1jammy rbd-fuse-dbg=18.0.0-7498-g369173db-1jammy rbd-mirror-dbg=18.0.0-7498-g369173db-1jammy rbd-nbd-dbg=18.0.0-7498-g369173db-1jammy python3-cephfs=18.0.0-7498-g369173db-1jammy cephfs-shell=18.0.0-7498-g369173db-1jammy cephfs-top=18.0.0-7498-g369173db-1jammy cephfs-mirror=18.0.0-7498-g369173db-1jammy 2023-11-27T17:59:01.490 DEBUG:teuthology.orchestra.run.smithi091:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-7498-g369173db-1jammy cephadm=18.0.0-7498-g369173db-1jammy ceph-mds=18.0.0-7498-g369173db-1jammy ceph-mgr=18.0.0-7498-g369173db-1jammy ceph-common=18.0.0-7498-g369173db-1jammy ceph-fuse=18.0.0-7498-g369173db-1jammy ceph-test=18.0.0-7498-g369173db-1jammy ceph-volume=18.0.0-7498-g369173db-1jammy radosgw=18.0.0-7498-g369173db-1jammy python3-rados=18.0.0-7498-g369173db-1jammy python3-rgw=18.0.0-7498-g369173db-1jammy python3-cephfs=18.0.0-7498-g369173db-1jammy python3-rbd=18.0.0-7498-g369173db-1jammy libcephfs2=18.0.0-7498-g369173db-1jammy libcephfs-dev=18.0.0-7498-g369173db-1jammy librados2=18.0.0-7498-g369173db-1jammy librbd1=18.0.0-7498-g369173db-1jammy rbd-fuse=18.0.0-7498-g369173db-1jammy ceph-common-dbg=18.0.0-7498-g369173db-1jammy ceph-fuse-dbg=18.0.0-7498-g369173db-1jammy ceph-mds-dbg=18.0.0-7498-g369173db-1jammy ceph-mgr-dbg=18.0.0-7498-g369173db-1jammy ceph-mon-dbg=18.0.0-7498-g369173db-1jammy ceph-osd-dbg=18.0.0-7498-g369173db-1jammy ceph-test-dbg=18.0.0-7498-g369173db-1jammy libcephfs2-dbg=18.0.0-7498-g369173db-1jammy librados2-dbg=18.0.0-7498-g369173db-1jammy libradosstriper1-dbg=18.0.0-7498-g369173db-1jammy librbd1-dbg=18.0.0-7498-g369173db-1jammy librgw2-dbg=18.0.0-7498-g369173db-1jammy radosgw-dbg=18.0.0-7498-g369173db-1jammy rbd-fuse-dbg=18.0.0-7498-g369173db-1jammy rbd-mirror-dbg=18.0.0-7498-g369173db-1jammy rbd-nbd-dbg=18.0.0-7498-g369173db-1jammy python3-cephfs=18.0.0-7498-g369173db-1jammy cephfs-shell=18.0.0-7498-g369173db-1jammy cephfs-top=18.0.0-7498-g369173db-1jammy cephfs-mirror=18.0.0-7498-g369173db-1jammy 2023-11-27T17:59:01.536 INFO:teuthology.orchestra.run.smithi094.stdout:Reading package lists... 2023-11-27T17:59:01.550 INFO:teuthology.orchestra.run.smithi091.stdout:Reading package lists... 2023-11-27T17:59:01.724 INFO:teuthology.orchestra.run.smithi094.stdout:Building dependency tree... 2023-11-27T17:59:01.724 INFO:teuthology.orchestra.run.smithi094.stdout:Reading state information... 2023-11-27T17:59:01.733 INFO:teuthology.orchestra.run.smithi091.stdout:Building dependency tree... 2023-11-27T17:59:01.734 INFO:teuthology.orchestra.run.smithi091.stdout:Reading state information... 2023-11-27T17:59:01.888 INFO:teuthology.orchestra.run.smithi094.stdout:The following packages were automatically installed and are no longer required: 2023-11-27T17:59:01.888 INFO:teuthology.orchestra.run.smithi094.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-27T17:59:01.889 INFO:teuthology.orchestra.run.smithi094.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-27T17:59:01.889 INFO:teuthology.orchestra.run.smithi094.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-27T17:59:01.889 INFO:teuthology.orchestra.run.smithi094.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-27T17:59:01.890 INFO:teuthology.orchestra.run.smithi094.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-27T17:59:01.890 INFO:teuthology.orchestra.run.smithi094.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-27T17:59:01.890 INFO:teuthology.orchestra.run.smithi094.stdout:The following additional packages will be installed: 2023-11-27T17:59:01.890 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-27T17:59:01.890 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-11-27T17:59:01.890 INFO:teuthology.orchestra.run.smithi094.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liboath0 libonig5 libpcre2-16-0 2023-11-27T17:59:01.890 INFO:teuthology.orchestra.run.smithi094.stdout: libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 librdkafka1 librgw2 2023-11-27T17:59:01.891 INFO:teuthology.orchestra.run.smithi094.stdout: libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli python-asyncssh-doc 2023-11-27T17:59:01.891 INFO:teuthology.orchestra.run.smithi094.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2023-11-27T17:59:01.891 INFO:teuthology.orchestra.run.smithi094.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2023-11-27T17:59:01.892 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ceph-common python3-certifi python3-cheroot python3-cherrypy3 2023-11-27T17:59:01.892 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cmd2 python3-colorama python3-google-auth python3-idna 2023-11-27T17:59:01.892 INFO:teuthology.orchestra.run.smithi094.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2023-11-27T17:59:01.892 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2023-11-27T17:59:01.892 INFO:teuthology.orchestra.run.smithi094.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2023-11-27T17:59:01.892 INFO:teuthology.orchestra.run.smithi094.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2023-11-27T17:59:01.892 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2023-11-27T17:59:01.892 INFO:teuthology.orchestra.run.smithi094.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2023-11-27T17:59:01.892 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pyperclip 2023-11-27T17:59:01.892 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pytest python3-repoze.lru python3-requests python3-requests-oauthlib 2023-11-27T17:59:01.892 INFO:teuthology.orchestra.run.smithi094.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-11-27T17:59:01.892 INFO:teuthology.orchestra.run.smithi094.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2023-11-27T17:59:01.893 INFO:teuthology.orchestra.run.smithi094.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2023-11-27T17:59:01.893 INFO:teuthology.orchestra.run.smithi094.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2023-11-27T17:59:01.893 INFO:teuthology.orchestra.run.smithi094.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2023-11-27T17:59:01.893 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-mirror rbd-nbd socat xmlstarlet 2023-11-27T17:59:01.893 INFO:teuthology.orchestra.run.smithi094.stdout:Suggested packages: 2023-11-27T17:59:01.893 INFO:teuthology.orchestra.run.smithi094.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-11-27T17:59:01.893 INFO:teuthology.orchestra.run.smithi094.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-11-27T17:59:01.893 INFO:teuthology.orchestra.run.smithi094.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-11-27T17:59:01.893 INFO:teuthology.orchestra.run.smithi094.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-11-27T17:59:01.893 INFO:teuthology.orchestra.run.smithi094.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-11-27T17:59:01.893 INFO:teuthology.orchestra.run.smithi094.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-11-27T17:59:01.893 INFO:teuthology.orchestra.run.smithi094.stdout: python3-watchdog 2023-11-27T17:59:01.894 INFO:teuthology.orchestra.run.smithi094.stdout:Recommended packages: 2023-11-27T17:59:01.894 INFO:teuthology.orchestra.run.smithi094.stdout: btrfs-tools 2023-11-27T17:59:01.895 INFO:teuthology.orchestra.run.smithi091.stdout:The following packages were automatically installed and are no longer required: 2023-11-27T17:59:01.896 INFO:teuthology.orchestra.run.smithi091.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-27T17:59:01.896 INFO:teuthology.orchestra.run.smithi091.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-27T17:59:01.896 INFO:teuthology.orchestra.run.smithi091.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-27T17:59:01.896 INFO:teuthology.orchestra.run.smithi091.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-27T17:59:01.897 INFO:teuthology.orchestra.run.smithi091.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-27T17:59:01.897 INFO:teuthology.orchestra.run.smithi091.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-27T17:59:01.897 INFO:teuthology.orchestra.run.smithi091.stdout:The following additional packages will be installed: 2023-11-27T17:59:01.897 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-27T17:59:01.898 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-11-27T17:59:01.898 INFO:teuthology.orchestra.run.smithi091.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liboath0 libonig5 libpcre2-16-0 2023-11-27T17:59:01.898 INFO:teuthology.orchestra.run.smithi091.stdout: libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 librdkafka1 librgw2 2023-11-27T17:59:01.898 INFO:teuthology.orchestra.run.smithi091.stdout: libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli python-asyncssh-doc 2023-11-27T17:59:01.899 INFO:teuthology.orchestra.run.smithi091.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2023-11-27T17:59:01.899 INFO:teuthology.orchestra.run.smithi091.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2023-11-27T17:59:01.899 INFO:teuthology.orchestra.run.smithi091.stdout: python3-ceph-common python3-certifi python3-cheroot python3-cherrypy3 2023-11-27T17:59:01.899 INFO:teuthology.orchestra.run.smithi091.stdout: python3-cmd2 python3-colorama python3-google-auth python3-idna 2023-11-27T17:59:01.899 INFO:teuthology.orchestra.run.smithi091.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2023-11-27T17:59:01.899 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2023-11-27T17:59:01.899 INFO:teuthology.orchestra.run.smithi091.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2023-11-27T17:59:01.899 INFO:teuthology.orchestra.run.smithi091.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2023-11-27T17:59:01.899 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2023-11-27T17:59:01.899 INFO:teuthology.orchestra.run.smithi091.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2023-11-27T17:59:01.899 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pyperclip 2023-11-27T17:59:01.899 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pytest python3-repoze.lru python3-requests python3-requests-oauthlib 2023-11-27T17:59:01.899 INFO:teuthology.orchestra.run.smithi091.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-11-27T17:59:01.900 INFO:teuthology.orchestra.run.smithi091.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2023-11-27T17:59:01.900 INFO:teuthology.orchestra.run.smithi091.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2023-11-27T17:59:01.900 INFO:teuthology.orchestra.run.smithi091.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2023-11-27T17:59:01.900 INFO:teuthology.orchestra.run.smithi091.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2023-11-27T17:59:01.900 INFO:teuthology.orchestra.run.smithi091.stdout: rbd-mirror rbd-nbd socat xmlstarlet 2023-11-27T17:59:01.900 INFO:teuthology.orchestra.run.smithi091.stdout:Suggested packages: 2023-11-27T17:59:01.900 INFO:teuthology.orchestra.run.smithi091.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-11-27T17:59:01.900 INFO:teuthology.orchestra.run.smithi091.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-11-27T17:59:01.901 INFO:teuthology.orchestra.run.smithi091.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-11-27T17:59:01.901 INFO:teuthology.orchestra.run.smithi091.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-11-27T17:59:01.901 INFO:teuthology.orchestra.run.smithi091.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-11-27T17:59:01.901 INFO:teuthology.orchestra.run.smithi091.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-11-27T17:59:01.901 INFO:teuthology.orchestra.run.smithi091.stdout: python3-watchdog 2023-11-27T17:59:01.901 INFO:teuthology.orchestra.run.smithi091.stdout:Recommended packages: 2023-11-27T17:59:01.901 INFO:teuthology.orchestra.run.smithi091.stdout: btrfs-tools 2023-11-27T17:59:02.016 INFO:teuthology.orchestra.run.smithi094.stdout:The following NEW packages will be installed: 2023-11-27T17:59:02.016 INFO:teuthology.orchestra.run.smithi094.stdout: ceph ceph-base ceph-common ceph-common-dbg ceph-fuse ceph-fuse-dbg ceph-mds 2023-11-27T17:59:02.016 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mds-dbg ceph-mgr ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-dbg 2023-11-27T17:59:02.016 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2023-11-27T17:59:02.016 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mon ceph-mon-dbg ceph-osd ceph-osd-dbg ceph-test ceph-test-dbg 2023-11-27T17:59:02.017 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-volume cephadm cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev 2023-11-27T17:59:02.017 INFO:teuthology.orchestra.run.smithi094.stdout: libcephfs2 libcephfs2-dbg libdouble-conversion3 libjq1 liblttng-ust1 2023-11-27T17:59:02.017 INFO:teuthology.orchestra.run.smithi094.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2023-11-27T17:59:02.017 INFO:teuthology.orchestra.run.smithi094.stdout: librados2 librados2-dbg libradosstriper1 libradosstriper1-dbg librbd1 2023-11-27T17:59:02.017 INFO:teuthology.orchestra.run.smithi094.stdout: librbd1-dbg librdkafka1 librgw2 librgw2-dbg libsqlite3-mod-ceph 2023-11-27T17:59:02.018 INFO:teuthology.orchestra.run.smithi094.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-11-27T17:59:02.018 INFO:teuthology.orchestra.run.smithi094.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-11-27T17:59:02.018 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-11-27T17:59:02.019 INFO:teuthology.orchestra.run.smithi094.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-11-27T17:59:02.019 INFO:teuthology.orchestra.run.smithi094.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-11-27T17:59:02.019 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-11-27T17:59:02.019 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-11-27T17:59:02.019 INFO:teuthology.orchestra.run.smithi094.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-11-27T17:59:02.019 INFO:teuthology.orchestra.run.smithi094.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-11-27T17:59:02.019 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-11-27T17:59:02.020 INFO:teuthology.orchestra.run.smithi094.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-11-27T17:59:02.020 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-11-27T17:59:02.020 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-11-27T17:59:02.020 INFO:teuthology.orchestra.run.smithi094.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-11-27T17:59:02.020 INFO:teuthology.orchestra.run.smithi094.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-11-27T17:59:02.020 INFO:teuthology.orchestra.run.smithi094.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-11-27T17:59:02.020 INFO:teuthology.orchestra.run.smithi094.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-11-27T17:59:02.020 INFO:teuthology.orchestra.run.smithi094.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-11-27T17:59:02.020 INFO:teuthology.orchestra.run.smithi094.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw 2023-11-27T17:59:02.021 INFO:teuthology.orchestra.run.smithi094.stdout: radosgw-dbg rbd-fuse rbd-fuse-dbg rbd-mirror rbd-mirror-dbg rbd-nbd 2023-11-27T17:59:02.021 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-nbd-dbg socat xmlstarlet 2023-11-27T17:59:02.024 INFO:teuthology.orchestra.run.smithi091.stdout:The following NEW packages will be installed: 2023-11-27T17:59:02.024 INFO:teuthology.orchestra.run.smithi091.stdout: ceph ceph-base ceph-common ceph-common-dbg ceph-fuse ceph-fuse-dbg ceph-mds 2023-11-27T17:59:02.024 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mds-dbg ceph-mgr ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-dbg 2023-11-27T17:59:02.024 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2023-11-27T17:59:02.024 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mon ceph-mon-dbg ceph-osd ceph-osd-dbg ceph-test ceph-test-dbg 2023-11-27T17:59:02.024 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-volume cephadm cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev 2023-11-27T17:59:02.025 INFO:teuthology.orchestra.run.smithi091.stdout: libcephfs2 libcephfs2-dbg libdouble-conversion3 libjq1 liblttng-ust1 2023-11-27T17:59:02.025 INFO:teuthology.orchestra.run.smithi091.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2023-11-27T17:59:02.025 INFO:teuthology.orchestra.run.smithi091.stdout: librados2 librados2-dbg libradosstriper1 libradosstriper1-dbg librbd1 2023-11-27T17:59:02.026 INFO:teuthology.orchestra.run.smithi091.stdout: librbd1-dbg librdkafka1 librgw2 librgw2-dbg libsqlite3-mod-ceph 2023-11-27T17:59:02.026 INFO:teuthology.orchestra.run.smithi091.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-11-27T17:59:02.026 INFO:teuthology.orchestra.run.smithi091.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-11-27T17:59:02.026 INFO:teuthology.orchestra.run.smithi091.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-11-27T17:59:02.026 INFO:teuthology.orchestra.run.smithi091.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-11-27T17:59:02.026 INFO:teuthology.orchestra.run.smithi091.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-11-27T17:59:02.026 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-11-27T17:59:02.026 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-11-27T17:59:02.026 INFO:teuthology.orchestra.run.smithi091.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-11-27T17:59:02.026 INFO:teuthology.orchestra.run.smithi091.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-11-27T17:59:02.026 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-11-27T17:59:02.026 INFO:teuthology.orchestra.run.smithi091.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-11-27T17:59:02.026 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-11-27T17:59:02.027 INFO:teuthology.orchestra.run.smithi091.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-11-27T17:59:02.027 INFO:teuthology.orchestra.run.smithi091.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-11-27T17:59:02.027 INFO:teuthology.orchestra.run.smithi091.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-11-27T17:59:02.027 INFO:teuthology.orchestra.run.smithi091.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-11-27T17:59:02.027 INFO:teuthology.orchestra.run.smithi091.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-11-27T17:59:02.027 INFO:teuthology.orchestra.run.smithi091.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-11-27T17:59:02.027 INFO:teuthology.orchestra.run.smithi091.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw 2023-11-27T17:59:02.027 INFO:teuthology.orchestra.run.smithi091.stdout: radosgw-dbg rbd-fuse rbd-fuse-dbg rbd-mirror rbd-mirror-dbg rbd-nbd 2023-11-27T17:59:02.027 INFO:teuthology.orchestra.run.smithi091.stdout: rbd-nbd-dbg socat xmlstarlet 2023-11-27T17:59:02.075 INFO:teuthology.orchestra.run.smithi094.stdout:0 upgraded, 132 newly installed, 0 to remove and 261 not upgraded. 2023-11-27T17:59:02.075 INFO:teuthology.orchestra.run.smithi094.stdout:Need to get 3,014 MB of archives. 2023-11-27T17:59:02.075 INFO:teuthology.orchestra.run.smithi094.stdout:After this operation, 3,953 MB of additional disk space will be used. 2023-11-27T17:59:02.076 INFO:teuthology.orchestra.run.smithi094.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-11-27T17:59:02.093 INFO:teuthology.orchestra.run.smithi094.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-11-27T17:59:02.103 INFO:teuthology.orchestra.run.smithi094.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-11-27T17:59:02.143 INFO:teuthology.orchestra.run.smithi094.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-11-27T17:59:02.164 INFO:teuthology.orchestra.run.smithi094.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-11-27T17:59:02.167 INFO:teuthology.orchestra.run.smithi094.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-11-27T17:59:02.178 INFO:teuthology.orchestra.run.smithi094.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-11-27T17:59:02.227 INFO:teuthology.orchestra.run.smithi094.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-11-27T17:59:02.231 INFO:teuthology.orchestra.run.smithi094.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-11-27T17:59:02.241 INFO:teuthology.orchestra.run.smithi094.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-11-27T17:59:02.246 INFO:teuthology.orchestra.run.smithi094.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-11-27T17:59:02.246 INFO:teuthology.orchestra.run.smithi094.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-11-27T17:59:02.254 INFO:teuthology.orchestra.run.smithi094.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-11-27T17:59:02.255 INFO:teuthology.orchestra.run.smithi094.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-11-27T17:59:02.255 INFO:teuthology.orchestra.run.smithi094.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-11-27T17:59:02.256 INFO:teuthology.orchestra.run.smithi094.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-11-27T17:59:02.256 INFO:teuthology.orchestra.run.smithi094.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-11-27T17:59:02.263 INFO:teuthology.orchestra.run.smithi094.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-11-27T17:59:02.264 INFO:teuthology.orchestra.run.smithi094.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-11-27T17:59:02.280 INFO:teuthology.orchestra.run.smithi094.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-11-27T17:59:02.281 INFO:teuthology.orchestra.run.smithi094.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-11-27T17:59:02.281 INFO:teuthology.orchestra.run.smithi094.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-11-27T17:59:02.283 INFO:teuthology.orchestra.run.smithi094.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-11-27T17:59:02.284 INFO:teuthology.orchestra.run.smithi094.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-11-27T17:59:02.284 INFO:teuthology.orchestra.run.smithi094.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-11-27T17:59:02.285 INFO:teuthology.orchestra.run.smithi094.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-11-27T17:59:02.286 INFO:teuthology.orchestra.run.smithi094.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-27T17:59:02.288 INFO:teuthology.orchestra.run.smithi091.stdout:0 upgraded, 132 newly installed, 0 to remove and 261 not upgraded. 2023-11-27T17:59:02.288 INFO:teuthology.orchestra.run.smithi091.stdout:Need to get 3,014 MB of archives. 2023-11-27T17:59:02.288 INFO:teuthology.orchestra.run.smithi091.stdout:After this operation, 3,953 MB of additional disk space will be used. 2023-11-27T17:59:02.288 INFO:teuthology.orchestra.run.smithi091.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-11-27T17:59:02.297 INFO:teuthology.orchestra.run.smithi094.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-11-27T17:59:02.297 INFO:teuthology.orchestra.run.smithi094.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-11-27T17:59:02.312 INFO:teuthology.orchestra.run.smithi094.stdout:Get:30 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-7498-g369173db-1jammy [3,468 kB] 2023-11-27T17:59:02.313 INFO:teuthology.orchestra.run.smithi094.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-11-27T17:59:02.314 INFO:teuthology.orchestra.run.smithi091.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-7498-g369173db-1jammy [3,468 kB] 2023-11-27T17:59:02.314 INFO:teuthology.orchestra.run.smithi094.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-11-27T17:59:02.315 INFO:teuthology.orchestra.run.smithi094.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-11-27T17:59:02.320 INFO:teuthology.orchestra.run.smithi094.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-11-27T17:59:02.320 INFO:teuthology.orchestra.run.smithi094.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-11-27T17:59:02.321 INFO:teuthology.orchestra.run.smithi094.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-11-27T17:59:02.321 INFO:teuthology.orchestra.run.smithi094.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-11-27T17:59:02.323 INFO:teuthology.orchestra.run.smithi094.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-11-27T17:59:02.330 INFO:teuthology.orchestra.run.smithi094.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-11-27T17:59:02.331 INFO:teuthology.orchestra.run.smithi094.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-11-27T17:59:02.342 INFO:teuthology.orchestra.run.smithi094.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-11-27T17:59:02.343 INFO:teuthology.orchestra.run.smithi094.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-11-27T17:59:02.345 INFO:teuthology.orchestra.run.smithi094.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-11-27T17:59:02.346 INFO:teuthology.orchestra.run.smithi094.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-11-27T17:59:02.348 INFO:teuthology.orchestra.run.smithi094.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-11-27T17:59:02.370 INFO:teuthology.orchestra.run.smithi091.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-11-27T17:59:02.400 INFO:teuthology.orchestra.run.smithi094.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-11-27T17:59:02.401 INFO:teuthology.orchestra.run.smithi094.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-11-27T17:59:02.402 INFO:teuthology.orchestra.run.smithi094.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-11-27T17:59:02.403 INFO:teuthology.orchestra.run.smithi094.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-27T17:59:02.403 INFO:teuthology.orchestra.run.smithi094.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-11-27T17:59:02.403 INFO:teuthology.orchestra.run.smithi094.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-11-27T17:59:02.416 INFO:teuthology.orchestra.run.smithi091.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-11-27T17:59:02.420 INFO:teuthology.orchestra.run.smithi094.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-11-27T17:59:02.422 INFO:teuthology.orchestra.run.smithi094.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-11-27T17:59:02.422 INFO:teuthology.orchestra.run.smithi094.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-11-27T17:59:02.437 INFO:teuthology.orchestra.run.smithi094.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-11-27T17:59:02.437 INFO:teuthology.orchestra.run.smithi094.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-11-27T17:59:02.437 INFO:teuthology.orchestra.run.smithi094.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-11-27T17:59:02.438 INFO:teuthology.orchestra.run.smithi094.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-11-27T17:59:02.438 INFO:teuthology.orchestra.run.smithi094.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-11-27T17:59:02.439 INFO:teuthology.orchestra.run.smithi094.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-11-27T17:59:02.452 INFO:teuthology.orchestra.run.smithi094.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-11-27T17:59:02.453 INFO:teuthology.orchestra.run.smithi094.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-11-27T17:59:02.456 INFO:teuthology.orchestra.run.smithi094.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-11-27T17:59:02.469 INFO:teuthology.orchestra.run.smithi094.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-11-27T17:59:02.470 INFO:teuthology.orchestra.run.smithi094.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-11-27T17:59:02.470 INFO:teuthology.orchestra.run.smithi094.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-11-27T17:59:02.474 INFO:teuthology.orchestra.run.smithi094.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-11-27T17:59:02.476 INFO:teuthology.orchestra.run.smithi094.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-11-27T17:59:02.476 INFO:teuthology.orchestra.run.smithi094.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-11-27T17:59:02.480 INFO:teuthology.orchestra.run.smithi094.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-11-27T17:59:02.486 INFO:teuthology.orchestra.run.smithi094.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-11-27T17:59:02.486 INFO:teuthology.orchestra.run.smithi094.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-27T17:59:02.487 INFO:teuthology.orchestra.run.smithi094.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-11-27T17:59:02.502 INFO:teuthology.orchestra.run.smithi094.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-11-27T17:59:02.504 INFO:teuthology.orchestra.run.smithi094.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-11-27T17:59:02.505 INFO:teuthology.orchestra.run.smithi094.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-11-27T17:59:02.511 INFO:teuthology.orchestra.run.smithi094.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-11-27T17:59:02.511 INFO:teuthology.orchestra.run.smithi094.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-11-27T17:59:02.511 INFO:teuthology.orchestra.run.smithi094.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-11-27T17:59:02.513 INFO:teuthology.orchestra.run.smithi094.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-11-27T17:59:02.519 INFO:teuthology.orchestra.run.smithi094.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-11-27T17:59:02.619 INFO:teuthology.orchestra.run.smithi091.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-11-27T17:59:02.714 INFO:teuthology.orchestra.run.smithi091.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-11-27T17:59:02.728 INFO:teuthology.orchestra.run.smithi091.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-11-27T17:59:02.780 INFO:teuthology.orchestra.run.smithi091.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-11-27T17:59:02.954 INFO:teuthology.orchestra.run.smithi091.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-11-27T17:59:02.963 INFO:teuthology.orchestra.run.smithi091.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-11-27T17:59:02.990 INFO:teuthology.orchestra.run.smithi091.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-11-27T17:59:02.999 INFO:teuthology.orchestra.run.smithi091.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-11-27T17:59:03.164 INFO:teuthology.orchestra.run.smithi091.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-11-27T17:59:03.440 INFO:teuthology.orchestra.run.smithi094.stdout:Get:82 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-7498-g369173db-1jammy [3,111 kB] 2023-11-27T17:59:03.449 INFO:teuthology.orchestra.run.smithi091.stdout:Get:14 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-7498-g369173db-1jammy [3,111 kB] 2023-11-27T17:59:03.735 INFO:teuthology.orchestra.run.smithi091.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-11-27T17:59:03.739 INFO:teuthology.orchestra.run.smithi091.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-11-27T17:59:03.739 INFO:teuthology.orchestra.run.smithi091.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-11-27T17:59:03.745 INFO:teuthology.orchestra.run.smithi091.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-11-27T17:59:03.746 INFO:teuthology.orchestra.run.smithi091.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-11-27T17:59:03.747 INFO:teuthology.orchestra.run.smithi091.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-11-27T17:59:03.748 INFO:teuthology.orchestra.run.smithi091.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-11-27T17:59:03.750 INFO:teuthology.orchestra.run.smithi091.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-11-27T17:59:03.750 INFO:teuthology.orchestra.run.smithi091.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-11-27T17:59:03.817 INFO:teuthology.orchestra.run.smithi091.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-11-27T17:59:03.906 INFO:teuthology.orchestra.run.smithi094.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-7498-g369173db-1jammy [691 kB] 2023-11-27T17:59:03.936 INFO:teuthology.orchestra.run.smithi091.stdout:Get:25 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-7498-g369173db-1jammy [691 kB] 2023-11-27T17:59:04.008 INFO:teuthology.orchestra.run.smithi094.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-7498-g369173db-1jammy [356 kB] 2023-11-27T17:59:04.016 INFO:teuthology.orchestra.run.smithi091.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-11-27T17:59:04.022 INFO:teuthology.orchestra.run.smithi094.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-7498-g369173db-1jammy [32.8 kB] 2023-11-27T17:59:04.037 INFO:teuthology.orchestra.run.smithi091.stdout:Get:27 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-7498-g369173db-1jammy [356 kB] 2023-11-27T17:59:04.059 INFO:teuthology.orchestra.run.smithi094.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-7498-g369173db-1jammy [180 kB] 2023-11-27T17:59:04.068 INFO:teuthology.orchestra.run.smithi094.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-7498-g369173db-1jammy [63.5 kB] 2023-11-27T17:59:04.070 INFO:teuthology.orchestra.run.smithi094.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-7498-g369173db-1jammy [329 kB] 2023-11-27T17:59:04.090 INFO:teuthology.orchestra.run.smithi091.stdout:Get:28 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-7498-g369173db-1jammy [32.8 kB] 2023-11-27T17:59:04.091 INFO:teuthology.orchestra.run.smithi091.stdout:Get:29 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-7498-g369173db-1jammy [180 kB] 2023-11-27T17:59:04.101 INFO:teuthology.orchestra.run.smithi091.stdout:Get:30 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-7498-g369173db-1jammy [63.5 kB] 2023-11-27T17:59:04.119 INFO:teuthology.orchestra.run.smithi094.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-7498-g369173db-1jammy [6,224 kB] 2023-11-27T17:59:04.133 INFO:teuthology.orchestra.run.smithi091.stdout:Get:31 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-7498-g369173db-1jammy [329 kB] 2023-11-27T17:59:04.150 INFO:teuthology.orchestra.run.smithi091.stdout:Get:32 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-7498-g369173db-1jammy [6,224 kB] 2023-11-27T17:59:04.233 INFO:teuthology.orchestra.run.smithi091.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-11-27T17:59:04.268 INFO:teuthology.orchestra.run.smithi091.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-11-27T17:59:04.293 INFO:teuthology.orchestra.run.smithi091.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-11-27T17:59:04.400 INFO:teuthology.orchestra.run.smithi091.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-27T17:59:04.416 INFO:teuthology.orchestra.run.smithi091.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-11-27T17:59:04.422 INFO:teuthology.orchestra.run.smithi091.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-11-27T17:59:04.479 INFO:teuthology.orchestra.run.smithi091.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-11-27T17:59:04.507 INFO:teuthology.orchestra.run.smithi091.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-11-27T17:59:04.514 INFO:teuthology.orchestra.run.smithi091.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-11-27T17:59:04.631 INFO:teuthology.orchestra.run.smithi091.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-11-27T17:59:04.700 INFO:teuthology.orchestra.run.smithi094.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-7498-g369173db-1jammy [112 kB] 2023-11-27T17:59:04.703 INFO:teuthology.orchestra.run.smithi094.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-7498-g369173db-1jammy [439 kB] 2023-11-27T17:59:04.715 INFO:teuthology.orchestra.run.smithi094.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-7498-g369173db-1jammy [22.6 MB] 2023-11-27T17:59:04.743 INFO:teuthology.orchestra.run.smithi091.stdout:Get:43 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-7498-g369173db-1jammy [112 kB] 2023-11-27T17:59:04.745 INFO:teuthology.orchestra.run.smithi091.stdout:Get:44 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-7498-g369173db-1jammy [439 kB] 2023-11-27T17:59:04.794 INFO:teuthology.orchestra.run.smithi091.stdout:Get:45 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-7498-g369173db-1jammy [22.6 MB] 2023-11-27T17:59:04.796 INFO:teuthology.orchestra.run.smithi091.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-11-27T17:59:04.989 INFO:teuthology.orchestra.run.smithi091.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-11-27T17:59:05.043 INFO:teuthology.orchestra.run.smithi091.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-11-27T17:59:05.182 INFO:teuthology.orchestra.run.smithi091.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-11-27T17:59:05.274 INFO:teuthology.orchestra.run.smithi091.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-11-27T17:59:05.292 INFO:teuthology.orchestra.run.smithi091.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-11-27T17:59:05.322 INFO:teuthology.orchestra.run.smithi091.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-11-27T17:59:05.334 INFO:teuthology.orchestra.run.smithi091.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-11-27T17:59:05.374 INFO:teuthology.orchestra.run.smithi091.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-11-27T17:59:05.382 INFO:teuthology.orchestra.run.smithi091.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-11-27T17:59:05.410 INFO:teuthology.orchestra.run.smithi091.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-11-27T17:59:05.796 INFO:teuthology.orchestra.run.smithi091.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-11-27T17:59:06.111 INFO:teuthology.orchestra.run.smithi091.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-11-27T17:59:06.201 INFO:teuthology.orchestra.run.smithi091.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-11-27T17:59:06.226 INFO:teuthology.orchestra.run.smithi091.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-27T17:59:06.238 INFO:teuthology.orchestra.run.smithi091.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-11-27T17:59:06.287 INFO:teuthology.orchestra.run.smithi091.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-11-27T17:59:06.388 INFO:teuthology.orchestra.run.smithi094.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-7498-g369173db-1jammy [6,900 kB] 2023-11-27T17:59:06.411 INFO:teuthology.orchestra.run.smithi091.stdout:Get:63 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-7498-g369173db-1jammy [6,900 kB] 2023-11-27T17:59:06.535 INFO:teuthology.orchestra.run.smithi091.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-11-27T17:59:06.544 INFO:teuthology.orchestra.run.smithi091.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-11-27T17:59:06.545 INFO:teuthology.orchestra.run.smithi091.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-11-27T17:59:06.610 INFO:teuthology.orchestra.run.smithi091.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-11-27T17:59:06.611 INFO:teuthology.orchestra.run.smithi091.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-11-27T17:59:06.638 INFO:teuthology.orchestra.run.smithi094.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-7498-g369173db-1jammy [238 kB] 2023-11-27T17:59:06.644 INFO:teuthology.orchestra.run.smithi094.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-7498-g369173db-1jammy [124 kB] 2023-11-27T17:59:06.670 INFO:teuthology.orchestra.run.smithi094.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-7498-g369173db-1jammy [1,495 kB] 2023-11-27T17:59:06.776 INFO:teuthology.orchestra.run.smithi091.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-11-27T17:59:06.860 INFO:teuthology.orchestra.run.smithi091.stdout:Get:70 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-7498-g369173db-1jammy [238 kB] 2023-11-27T17:59:06.868 INFO:teuthology.orchestra.run.smithi091.stdout:Get:71 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-7498-g369173db-1jammy [124 kB] 2023-11-27T17:59:06.871 INFO:teuthology.orchestra.run.smithi091.stdout:Get:72 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-7498-g369173db-1jammy [1,495 kB] 2023-11-27T17:59:06.877 INFO:teuthology.orchestra.run.smithi094.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-7498-g369173db-1jammy [9,956 kB] 2023-11-27T17:59:06.957 INFO:teuthology.orchestra.run.smithi091.stdout:Get:73 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-7498-g369173db-1jammy [9,956 kB] 2023-11-27T17:59:06.972 INFO:teuthology.orchestra.run.smithi091.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-11-27T17:59:07.021 INFO:teuthology.orchestra.run.smithi091.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-11-27T17:59:07.084 INFO:teuthology.orchestra.run.smithi091.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-11-27T17:59:07.117 INFO:teuthology.orchestra.run.smithi091.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-11-27T17:59:07.153 INFO:teuthology.orchestra.run.smithi091.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-11-27T17:59:07.303 INFO:teuthology.orchestra.run.smithi091.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-11-27T17:59:07.339 INFO:teuthology.orchestra.run.smithi091.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-11-27T17:59:07.362 INFO:teuthology.orchestra.run.smithi091.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-11-27T17:59:07.370 INFO:teuthology.orchestra.run.smithi091.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-11-27T17:59:07.409 INFO:teuthology.orchestra.run.smithi091.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-11-27T17:59:07.547 INFO:teuthology.orchestra.run.smithi094.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-7498-g369173db-1jammy [31.8 MB] 2023-11-27T17:59:07.596 INFO:teuthology.orchestra.run.smithi091.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-11-27T17:59:07.608 INFO:teuthology.orchestra.run.smithi091.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-7498-g369173db-1jammy [31.8 MB] 2023-11-27T17:59:07.781 INFO:teuthology.orchestra.run.smithi091.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-11-27T17:59:08.125 INFO:teuthology.orchestra.run.smithi091.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-11-27T17:59:08.186 INFO:teuthology.orchestra.run.smithi091.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-11-27T17:59:08.187 INFO:teuthology.orchestra.run.smithi091.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-27T17:59:08.194 INFO:teuthology.orchestra.run.smithi091.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-11-27T17:59:08.197 INFO:teuthology.orchestra.run.smithi091.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-11-27T17:59:08.215 INFO:teuthology.orchestra.run.smithi091.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-11-27T17:59:08.224 INFO:teuthology.orchestra.run.smithi091.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-11-27T17:59:08.284 INFO:teuthology.orchestra.run.smithi091.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-11-27T17:59:08.285 INFO:teuthology.orchestra.run.smithi091.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-11-27T17:59:08.450 INFO:teuthology.orchestra.run.smithi091.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-11-27T17:59:08.891 INFO:teuthology.orchestra.run.smithi091.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-11-27T17:59:08.907 INFO:teuthology.orchestra.run.smithi091.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-11-27T17:59:09.790 INFO:teuthology.orchestra.run.smithi091.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-7498-g369173db-1jammy [14.0 kB] 2023-11-27T17:59:09.791 INFO:teuthology.orchestra.run.smithi091.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-7498-g369173db-1jammy [839 kB] 2023-11-27T17:59:09.807 INFO:teuthology.orchestra.run.smithi091.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-7498-g369173db-1jammy [2,143 kB] 2023-11-27T17:59:09.891 INFO:teuthology.orchestra.run.smithi091.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-7498-g369173db-1jammy [803 kB] 2023-11-27T17:59:09.943 INFO:teuthology.orchestra.run.smithi094.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-7498-g369173db-1jammy [14.0 kB] 2023-11-27T17:59:09.944 INFO:teuthology.orchestra.run.smithi094.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-7498-g369173db-1jammy [839 kB] 2023-11-27T17:59:09.960 INFO:teuthology.orchestra.run.smithi094.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-7498-g369173db-1jammy [2,143 kB] 2023-11-27T17:59:09.965 INFO:teuthology.orchestra.run.smithi091.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-7498-g369173db-1jammy [139 kB] 2023-11-27T17:59:09.969 INFO:teuthology.orchestra.run.smithi091.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-7498-g369173db-1jammy [1,900 kB] 2023-11-27T17:59:10.074 INFO:teuthology.orchestra.run.smithi094.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-7498-g369173db-1jammy [803 kB] 2023-11-27T17:59:10.144 INFO:teuthology.orchestra.run.smithi094.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-7498-g369173db-1jammy [139 kB] 2023-11-27T17:59:10.147 INFO:teuthology.orchestra.run.smithi094.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-7498-g369173db-1jammy [1,900 kB] 2023-11-27T17:59:10.160 INFO:teuthology.orchestra.run.smithi091.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-7498-g369173db-1jammy [8,625 kB] 2023-11-27T17:59:10.304 INFO:teuthology.orchestra.run.smithi094.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-7498-g369173db-1jammy [8,625 kB] 2023-11-27T17:59:10.709 INFO:teuthology.orchestra.run.smithi091.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-7498-g369173db-1jammy [14.2 kB] 2023-11-27T17:59:10.710 INFO:teuthology.orchestra.run.smithi091.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-7498-g369173db-1jammy [48.6 MB] 2023-11-27T17:59:10.927 INFO:teuthology.orchestra.run.smithi094.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-7498-g369173db-1jammy [14.2 kB] 2023-11-27T17:59:10.928 INFO:teuthology.orchestra.run.smithi094.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-7498-g369173db-1jammy [48.6 MB] 2023-11-27T17:59:14.351 INFO:teuthology.orchestra.run.smithi091.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-7498-g369173db-1jammy [121 kB] 2023-11-27T17:59:14.354 INFO:teuthology.orchestra.run.smithi091.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-7498-g369173db-1jammy [226 kB] 2023-11-27T17:59:14.359 INFO:teuthology.orchestra.run.smithi091.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-7498-g369173db-1jammy [34.0 kB] 2023-11-27T17:59:14.360 INFO:teuthology.orchestra.run.smithi091.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-7498-g369173db-1jammy [23.4 kB] 2023-11-27T17:59:14.361 INFO:teuthology.orchestra.run.smithi091.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-7498-g369173db-1jammy [38.3 kB] 2023-11-27T17:59:14.362 INFO:teuthology.orchestra.run.smithi091.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-7498-g369173db-1jammy [12.3 MB] 2023-11-27T17:59:14.683 INFO:teuthology.orchestra.run.smithi094.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-7498-g369173db-1jammy [121 kB] 2023-11-27T17:59:14.759 INFO:teuthology.orchestra.run.smithi094.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-7498-g369173db-1jammy [226 kB] 2023-11-27T17:59:14.763 INFO:teuthology.orchestra.run.smithi094.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-7498-g369173db-1jammy [34.0 kB] 2023-11-27T17:59:14.764 INFO:teuthology.orchestra.run.smithi094.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-7498-g369173db-1jammy [23.4 kB] 2023-11-27T17:59:14.765 INFO:teuthology.orchestra.run.smithi094.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-7498-g369173db-1jammy [38.3 kB] 2023-11-27T17:59:14.767 INFO:teuthology.orchestra.run.smithi094.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-7498-g369173db-1jammy [12.3 MB] 2023-11-27T17:59:14.990 INFO:teuthology.orchestra.run.smithi091.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-7498-g369173db-1jammy [91.1 kB] 2023-11-27T17:59:14.994 INFO:teuthology.orchestra.run.smithi091.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror amd64 18.0.0-7498-g369173db-1jammy [3,048 kB] 2023-11-27T17:59:15.208 INFO:teuthology.orchestra.run.smithi091.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd amd64 18.0.0-7498-g369173db-1jammy [178 kB] 2023-11-27T17:59:15.213 INFO:teuthology.orchestra.run.smithi091.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common-dbg amd64 18.0.0-7498-g369173db-1jammy [691 MB] 2023-11-27T17:59:15.589 INFO:teuthology.orchestra.run.smithi094.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-7498-g369173db-1jammy [91.1 kB] 2023-11-27T17:59:15.591 INFO:teuthology.orchestra.run.smithi094.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror amd64 18.0.0-7498-g369173db-1jammy [3,048 kB] 2023-11-27T17:59:15.798 INFO:teuthology.orchestra.run.smithi094.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd amd64 18.0.0-7498-g369173db-1jammy [178 kB] 2023-11-27T17:59:15.808 INFO:teuthology.orchestra.run.smithi094.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common-dbg amd64 18.0.0-7498-g369173db-1jammy [691 MB] 2023-11-27T18:01:16.613 INFO:teuthology.orchestra.run.smithi091.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse-dbg amd64 18.0.0-7498-g369173db-1jammy [17.3 MB] 2023-11-27T18:01:17.690 INFO:teuthology.orchestra.run.smithi091.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds-dbg amd64 18.0.0-7498-g369173db-1jammy [75.6 MB] 2023-11-27T18:01:32.390 INFO:teuthology.orchestra.run.smithi091.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dbg amd64 18.0.0-7498-g369173db-1jammy [39.8 MB] 2023-11-27T18:01:36.116 INFO:teuthology.orchestra.run.smithi091.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon-dbg amd64 18.0.0-7498-g369173db-1jammy [47.8 MB] 2023-11-27T18:01:40.330 INFO:teuthology.orchestra.run.smithi094.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse-dbg amd64 18.0.0-7498-g369173db-1jammy [17.3 MB] 2023-11-27T18:01:40.910 INFO:teuthology.orchestra.run.smithi091.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd-dbg amd64 18.0.0-7498-g369173db-1jammy [247 MB] 2023-11-27T18:01:41.749 INFO:teuthology.orchestra.run.smithi094.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds-dbg amd64 18.0.0-7498-g369173db-1jammy [75.6 MB] 2023-11-27T18:01:49.148 INFO:teuthology.orchestra.run.smithi094.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dbg amd64 18.0.0-7498-g369173db-1jammy [39.8 MB] 2023-11-27T18:01:53.492 INFO:teuthology.orchestra.run.smithi094.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon-dbg amd64 18.0.0-7498-g369173db-1jammy [47.8 MB] 2023-11-27T18:02:06.860 INFO:teuthology.orchestra.run.smithi094.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd-dbg amd64 18.0.0-7498-g369173db-1jammy [247 MB] 2023-11-27T18:02:12.006 INFO:teuthology.orchestra.run.smithi091.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test-dbg amd64 18.0.0-7498-g369173db-1jammy [916 MB] 2023-11-27T18:02:40.378 INFO:teuthology.orchestra.run.smithi094.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test-dbg amd64 18.0.0-7498-g369173db-1jammy [916 MB] 2023-11-27T18:04:44.939 INFO:teuthology.orchestra.run.smithi091.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2-dbg amd64 18.0.0-7498-g369173db-1jammy [15.6 MB] 2023-11-27T18:04:52.218 INFO:teuthology.orchestra.run.smithi091.stdout:Get:125 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 librados2-dbg amd64 18.0.0-7498-g369173db-1jammy [79.1 MB] 2023-11-27T18:05:25.648 INFO:teuthology.orchestra.run.smithi091.stdout:Get:126 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1-dbg amd64 18.0.0-7498-g369173db-1jammy [10.5 MB] 2023-11-27T18:05:30.795 INFO:teuthology.orchestra.run.smithi091.stdout:Get:127 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 librbd1-dbg amd64 18.0.0-7498-g369173db-1jammy [98.5 MB] 2023-11-27T18:05:59.541 INFO:teuthology.orchestra.run.smithi091.stdout:Get:128 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 librgw2-dbg amd64 18.0.0-7498-g369173db-1jammy [166 MB] 2023-11-27T18:06:03.553 INFO:teuthology.orchestra.run.smithi094.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2-dbg amd64 18.0.0-7498-g369173db-1jammy [15.6 MB] 2023-11-27T18:06:06.057 INFO:teuthology.orchestra.run.smithi094.stdout:Get:125 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 librados2-dbg amd64 18.0.0-7498-g369173db-1jammy [79.1 MB] 2023-11-27T18:06:12.604 INFO:teuthology.orchestra.run.smithi094.stdout:Get:126 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1-dbg amd64 18.0.0-7498-g369173db-1jammy [10.5 MB] 2023-11-27T18:06:13.520 INFO:teuthology.orchestra.run.smithi094.stdout:Get:127 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 librbd1-dbg amd64 18.0.0-7498-g369173db-1jammy [98.5 MB] 2023-11-27T18:06:20.123 INFO:teuthology.orchestra.run.smithi091.stdout:Get:129 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 radosgw-dbg amd64 18.0.0-7498-g369173db-1jammy [324 MB] 2023-11-27T18:06:28.002 INFO:teuthology.orchestra.run.smithi094.stdout:Get:128 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 librgw2-dbg amd64 18.0.0-7498-g369173db-1jammy [166 MB] 2023-11-27T18:06:48.462 INFO:teuthology.orchestra.run.smithi094.stdout:Get:129 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 radosgw-dbg amd64 18.0.0-7498-g369173db-1jammy [324 MB] 2023-11-27T18:07:03.274 INFO:teuthology.orchestra.run.smithi091.stdout:Get:130 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse-dbg amd64 18.0.0-7498-g369173db-1jammy [1,685 kB] 2023-11-27T18:07:03.305 INFO:teuthology.orchestra.run.smithi091.stdout:Get:131 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror-dbg amd64 18.0.0-7498-g369173db-1jammy [93.5 MB] 2023-11-27T18:07:08.514 INFO:teuthology.orchestra.run.smithi091.stdout:Get:132 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd-dbg amd64 18.0.0-7498-g369173db-1jammy [2,946 kB] 2023-11-27T18:07:09.167 INFO:teuthology.orchestra.run.smithi091.stdout:Fetched 3,014 MB in 8min 7s (6,195 kB/s) 2023-11-27T18:07:09.305 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-27T18:07:09.406 INFO:teuthology.orchestra.run.smithi091.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165983 files and directories currently installed.) 2023-11-27T18:07:09.407 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-11-27T18:07:09.445 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-11-27T18:07:09.740 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-27T18:07:09.766 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-11-27T18:07:09.806 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-27T18:07:10.101 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-cmd2. 2023-11-27T18:07:10.127 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-11-27T18:07:10.159 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-11-27T18:07:10.462 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-11-27T18:07:10.488 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-11-27T18:07:10.554 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-27T18:07:10.899 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-27T18:07:10.925 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-11-27T18:07:10.999 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-27T18:07:11.335 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-27T18:07:11.361 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-11-27T18:07:11.401 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-27T18:07:11.780 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-27T18:07:11.806 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-27T18:07:11.847 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-27T18:07:12.225 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-27T18:07:12.251 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-27T18:07:12.291 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-27T18:07:12.644 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-27T18:07:12.670 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-27T18:07:12.711 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-27T18:07:13.039 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-11-27T18:07:13.062 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-11-27T18:07:13.097 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-27T18:07:13.425 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package librados2. 2023-11-27T18:07:13.453 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../010-librados2_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:07:13.491 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking librados2 (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:07:13.944 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package librbd1. 2023-11-27T18:07:13.970 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../011-librbd1_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:07:14.011 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking librbd1 (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:07:14.473 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libcephfs2. 2023-11-27T18:07:14.498 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:07:14.530 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libcephfs2 (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:07:14.791 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-rados. 2023-11-27T18:07:14.806 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../013-python3-rados_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:07:14.849 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-rados (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:07:15.160 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-27T18:07:15.187 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-7498-g369173db-1jammy_all.deb ... 2023-11-27T18:07:15.227 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-ceph-argparse (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:07:15.462 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-cephfs. 2023-11-27T18:07:15.489 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:07:15.529 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-cephfs (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:07:15.850 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-27T18:07:15.875 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-7498-g369173db-1jammy_all.deb ... 2023-11-27T18:07:15.915 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-ceph-common (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:07:16.201 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-prettytable. 2023-11-27T18:07:16.228 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2023-11-27T18:07:16.268 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-11-27T18:07:16.504 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-rbd. 2023-11-27T18:07:16.519 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:07:16.562 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-rbd (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:07:16.915 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-27T18:07:16.941 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-11-27T18:07:16.982 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-27T18:07:17.318 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package librgw2. 2023-11-27T18:07:17.344 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../020-librgw2_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:07:17.384 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking librgw2 (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:07:17.903 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-rgw. 2023-11-27T18:07:17.963 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../021-python3-rgw_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:07:17.963 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-rgw (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:07:18.290 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package liboath0:amd64. 2023-11-27T18:07:18.316 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../022-liboath0_2.6.7-3build1_amd64.deb ... 2023-11-27T18:07:18.356 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-11-27T18:07:18.667 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libradosstriper1. 2023-11-27T18:07:18.693 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../023-libradosstriper1_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:07:18.734 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libradosstriper1 (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:07:19.181 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-common. 2023-11-27T18:07:19.205 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../024-ceph-common_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:07:19.245 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-common (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:07:20.526 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-base. 2023-11-27T18:07:20.552 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../025-ceph-base_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:07:20.602 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-base (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:07:21.313 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-11-27T18:07:21.339 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../026-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-11-27T18:07:21.380 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-11-27T18:07:21.682 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-cheroot. 2023-11-27T18:07:21.709 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../027-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-11-27T18:07:21.749 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-27T18:07:21.819 INFO:teuthology.orchestra.run.smithi094.stdout:Get:130 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse-dbg amd64 18.0.0-7498-g369173db-1jammy [1,685 kB] 2023-11-27T18:07:22.061 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-11-27T18:07:22.086 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../028-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-11-27T18:07:22.127 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-11-27T18:07:22.371 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-jaraco.text. 2023-11-27T18:07:22.386 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../029-python3-jaraco.text_3.6.0-2_all.deb ... 2023-11-27T18:07:22.421 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-11-27T18:07:22.481 INFO:teuthology.orchestra.run.smithi094.stdout:Get:131 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror-dbg amd64 18.0.0-7498-g369173db-1jammy [93.5 MB] 2023-11-27T18:07:22.716 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-11-27T18:07:22.742 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../030-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-11-27T18:07:22.782 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-11-27T18:07:23.085 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-tempora. 2023-11-27T18:07:23.111 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../031-python3-tempora_4.1.2-1_all.deb ... 2023-11-27T18:07:23.151 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-11-27T18:07:23.429 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-portend. 2023-11-27T18:07:23.444 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../032-python3-portend_3.0.0-1_all.deb ... 2023-11-27T18:07:23.479 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-11-27T18:07:23.749 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-11-27T18:07:23.775 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../033-python3-zc.lockfile_2.0-1_all.deb ... 2023-11-27T18:07:23.815 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-11-27T18:07:24.118 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-27T18:07:24.144 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../034-python3-cherrypy3_18.6.1-4_all.deb ... 2023-11-27T18:07:24.184 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-11-27T18:07:24.496 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-natsort. 2023-11-27T18:07:24.512 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../035-python3-natsort_8.0.2-1_all.deb ... 2023-11-27T18:07:24.571 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-11-27T18:07:24.866 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-logutils. 2023-11-27T18:07:24.892 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../036-python3-logutils_0.3.3-8_all.deb ... 2023-11-27T18:07:24.933 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-11-27T18:07:25.235 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-27T18:07:25.262 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../037-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-11-27T18:07:25.302 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-11-27T18:07:25.605 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-mako. 2023-11-27T18:07:25.631 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../038-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-11-27T18:07:25.671 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-27T18:07:25.975 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-27T18:07:26.001 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../039-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-27T18:07:26.041 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-27T18:07:26.319 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-27T18:07:26.345 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../040-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-11-27T18:07:26.385 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-11-27T18:07:26.696 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-webob. 2023-11-27T18:07:26.725 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../041-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-11-27T18:07:26.763 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-11-27T18:07:27.110 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-waitress. 2023-11-27T18:07:27.136 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../042-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-11-27T18:07:27.179 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-27T18:07:27.487 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-tempita. 2023-11-27T18:07:27.514 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../043-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-11-27T18:07:27.554 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-11-27T18:07:27.815 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-paste. 2023-11-27T18:07:27.841 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../044-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-11-27T18:07:27.898 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-11-27T18:07:28.452 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-27T18:07:28.479 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../045-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-11-27T18:07:28.518 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-11-27T18:07:28.779 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-27T18:07:28.806 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../046-python3-pastedeploy_2.1.1-1_all.deb ... 2023-11-27T18:07:28.837 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-11-27T18:07:29.123 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-webtest. 2023-11-27T18:07:29.150 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../047-python3-webtest_2.0.35-1_all.deb ... 2023-11-27T18:07:29.190 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-11-27T18:07:29.501 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-pecan. 2023-11-27T18:07:29.528 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../048-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-11-27T18:07:29.568 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-11-27T18:07:29.939 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-certifi. 2023-11-27T18:07:29.966 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../049-python3-certifi_2020.6.20-1_all.deb ... 2023-11-27T18:07:30.014 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-11-27T18:07:30.359 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-idna. 2023-11-27T18:07:30.385 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../050-python3-idna_3.3-1_all.deb ... 2023-11-27T18:07:30.425 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-idna (3.3-1) ... 2023-11-27T18:07:30.711 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-urllib3. 2023-11-27T18:07:30.738 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../051-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-11-27T18:07:30.778 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-27T18:07:31.073 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-requests. 2023-11-27T18:07:31.099 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../052-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-11-27T18:07:31.131 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-27T18:07:31.451 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-27T18:07:31.477 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../053-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-11-27T18:07:31.517 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-27T18:07:31.828 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-27T18:07:31.844 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../054-ceph-mgr-modules-core_18.0.0-7498-g369173db-1jammy_all.deb ... 2023-11-27T18:07:31.886 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-mgr-modules-core (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:07:32.225 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-27T18:07:32.251 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../055-libsqlite3-mod-ceph_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:07:32.283 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:07:32.577 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-openssl. 2023-11-27T18:07:32.604 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../056-python3-openssl_21.0.0-1_all.deb ... 2023-11-27T18:07:32.644 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-11-27T18:07:32.980 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-mgr. 2023-11-27T18:07:33.007 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../057-ceph-mgr_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:07:33.047 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-mgr (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:07:33.425 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-mon. 2023-11-27T18:07:33.452 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../058-ceph-mon_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:07:33.491 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-mon (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:07:34.378 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-osd. 2023-11-27T18:07:34.404 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../059-ceph-osd_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:07:34.445 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-osd (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:07:36.306 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph. 2023-11-27T18:07:36.333 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../060-ceph_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:07:36.373 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:07:36.700 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-fuse. 2023-11-27T18:07:36.727 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../061-ceph-fuse_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:07:36.767 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-fuse (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:07:37.078 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-mds. 2023-11-27T18:07:37.101 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../062-ceph-mds_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:07:37.145 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-mds (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:07:37.540 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package cephadm. 2023-11-27T18:07:37.566 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../063-cephadm_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:07:37.606 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking cephadm (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:07:37.951 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-27T18:07:37.978 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../064-python3-asyncssh_2.5.0-1_all.deb ... 2023-11-27T18:07:38.017 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-11-27T18:07:38.329 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python-babel-localedata. 2023-11-27T18:07:38.344 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../065-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-11-27T18:07:38.394 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-27T18:07:39.367 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-babel. 2023-11-27T18:07:39.394 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../066-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-11-27T18:07:39.425 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-11-27T18:07:39.720 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-jinja2. 2023-11-27T18:07:39.747 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../067-python3-jinja2_3.0.3-1_all.deb ... 2023-11-27T18:07:39.786 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-11-27T18:07:40.123 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-27T18:07:40.150 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../068-ceph-mgr-cephadm_18.0.0-7498-g369173db-1jammy_all.deb ... 2023-11-27T18:07:40.189 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-mgr-cephadm (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:07:40.527 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-27T18:07:40.553 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../069-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-11-27T18:07:40.593 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-11-27T18:07:40.896 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-27T18:07:40.922 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../070-python3-repoze.lru_0.7-2_all.deb ... 2023-11-27T18:07:40.962 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-27T18:07:41.315 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-routes. 2023-11-27T18:07:41.342 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../071-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-11-27T18:07:41.382 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-11-27T18:07:41.702 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-27T18:07:41.729 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.0.0-7498-g369173db-1jammy_all.deb ... 2023-11-27T18:07:41.768 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-mgr-dashboard (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:07:42.197 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-11-27T18:07:42.212 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../073-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-11-27T18:07:42.255 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-27T18:07:42.775 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-joblib. 2023-11-27T18:07:42.802 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../074-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-11-27T18:07:42.842 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-11-27T18:07:43.187 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-11-27T18:07:43.214 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../075-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-11-27T18:07:43.253 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-11-27T18:07:43.539 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-sklearn. 2023-11-27T18:07:43.555 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../076-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-11-27T18:07:43.598 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-27T18:07:44.290 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-27T18:07:44.317 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_18.0.0-7498-g369173db-1jammy_all.deb ... 2023-11-27T18:07:44.356 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:07:45.334 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-cachetools. 2023-11-27T18:07:45.361 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../078-python3-cachetools_5.0.0-1_all.deb ... 2023-11-27T18:07:45.401 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-11-27T18:07:45.704 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-27T18:07:45.731 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.8-1_all.deb ... 2023-11-27T18:07:45.770 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-11-27T18:07:46.082 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-27T18:07:46.109 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-11-27T18:07:46.148 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-11-27T18:07:46.426 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-rsa. 2023-11-27T18:07:46.453 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../081-python3-rsa_4.8-1_all.deb ... 2023-11-27T18:07:46.485 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-rsa (4.8-1) ... 2023-11-27T18:07:46.813 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-google-auth. 2023-11-27T18:07:46.840 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-3_all.deb ... 2023-11-27T18:07:46.879 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-11-27T18:07:47.294 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-27T18:07:47.320 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../083-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-11-27T18:07:47.359 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-27T18:07:47.646 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-websocket. 2023-11-27T18:07:47.673 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../084-python3-websocket_1.2.3-1_all.deb ... 2023-11-27T18:07:47.712 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-11-27T18:07:48.007 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-27T18:07:48.034 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../085-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-11-27T18:07:48.065 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-27T18:07:48.687 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-27T18:07:48.701 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../086-ceph-mgr-k8sevents_18.0.0-7498-g369173db-1jammy_all.deb ... 2023-11-27T18:07:48.745 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:07:48.998 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-27T18:07:49.014 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../087-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-11-27T18:07:49.048 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-27T18:07:49.393 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-27T18:07:49.420 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../088-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-11-27T18:07:49.459 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-27T18:07:49.728 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package jq. 2023-11-27T18:07:49.744 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../089-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-11-27T18:07:49.787 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-11-27T18:07:49.997 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package socat. 2023-11-27T18:07:50.013 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../090-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-11-27T18:07:50.047 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-11-27T18:07:50.309 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package xmlstarlet. 2023-11-27T18:07:50.325 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../091-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-11-27T18:07:50.359 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-11-27T18:07:50.713 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-test. 2023-11-27T18:07:50.730 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../092-ceph-test_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:07:50.771 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-test (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:07:53.000 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-volume. 2023-11-27T18:07:53.016 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../093-ceph-volume_18.0.0-7498-g369173db-1jammy_all.deb ... 2023-11-27T18:07:53.058 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-volume (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:07:53.438 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-27T18:07:53.465 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../094-cephfs-mirror_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:07:53.504 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking cephfs-mirror (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:07:53.824 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-colorama. 2023-11-27T18:07:53.851 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../095-python3-colorama_0.4.4-1_all.deb ... 2023-11-27T18:07:53.899 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-11-27T18:07:54.151 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package cephfs-shell. 2023-11-27T18:07:54.167 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../096-cephfs-shell_18.0.0-7498-g369173db-1jammy_all.deb ... 2023-11-27T18:07:54.201 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking cephfs-shell (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:07:54.454 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package cephfs-top. 2023-11-27T18:07:54.470 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../097-cephfs-top_18.0.0-7498-g369173db-1jammy_all.deb ... 2023-11-27T18:07:54.512 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking cephfs-top (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:07:54.798 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-27T18:07:54.826 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../098-libcephfs-dev_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:07:54.864 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libcephfs-dev (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:07:55.268 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package nvme-cli. 2023-11-27T18:07:55.295 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../099-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-11-27T18:07:55.334 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-11-27T18:07:55.681 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-27T18:07:55.709 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../100-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-11-27T18:07:55.747 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-11-27T18:07:56.184 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-iniconfig. 2023-11-27T18:07:56.212 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../101-python3-iniconfig_1.1.1-2_all.deb ... 2023-11-27T18:07:56.250 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-11-27T18:07:56.553 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-pastescript. 2023-11-27T18:07:56.581 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../102-python3-pastescript_2.0.2-4_all.deb ... 2023-11-27T18:07:56.620 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-27T18:07:56.914 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-pluggy. 2023-11-27T18:07:56.931 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../103-python3-pluggy_0.13.0-7.1_all.deb ... 2023-11-27T18:07:56.964 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-11-27T18:07:57.268 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-psutil. 2023-11-27T18:07:57.295 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../104-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-11-27T18:07:57.342 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-11-27T18:07:57.679 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-py. 2023-11-27T18:07:57.706 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../105-python3-py_1.10.0-1_all.deb ... 2023-11-27T18:07:57.746 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-py (1.10.0-1) ... 2023-11-27T18:07:58.017 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-pygments. 2023-11-27T18:07:58.043 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../106-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-11-27T18:07:58.098 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-11-27T18:07:58.554 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-27T18:07:58.580 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-11-27T18:07:58.619 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-11-27T18:07:58.938 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-toml. 2023-11-27T18:07:58.967 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../108-python3-toml_0.10.2-1_all.deb ... 2023-11-27T18:07:59.004 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-11-27T18:07:59.574 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-pytest. 2023-11-27T18:07:59.601 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../109-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-11-27T18:07:59.640 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-11-27T18:07:59.986 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-simplejson. 2023-11-27T18:08:00.013 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../110-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-11-27T18:08:00.052 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-11-27T18:08:00.296 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-27T18:08:00.324 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../111-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-11-27T18:08:00.363 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-11-27T18:08:01.059 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package radosgw. 2023-11-27T18:08:01.087 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../112-radosgw_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:08:01.117 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking radosgw (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:01.836 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package rbd-fuse. 2023-11-27T18:08:01.852 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../113-rbd-fuse_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:08:01.894 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking rbd-fuse (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:02.231 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package rbd-mirror. 2023-11-27T18:08:02.259 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../114-rbd-mirror_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:08:02.297 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking rbd-mirror (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:02.717 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package rbd-nbd. 2023-11-27T18:08:02.733 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../115-rbd-nbd_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:08:02.775 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking rbd-nbd (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:03.027 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-common-dbg. 2023-11-27T18:08:03.055 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../116-ceph-common-dbg_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:08:03.085 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-common-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:09.663 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-fuse-dbg. 2023-11-27T18:08:09.690 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../117-ceph-fuse-dbg_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:08:09.729 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-fuse-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:10.190 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-mds-dbg. 2023-11-27T18:08:10.206 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../118-ceph-mds-dbg_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:08:10.249 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-mds-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:10.304 INFO:teuthology.orchestra.run.smithi094.stdout:Get:132 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd-dbg amd64 18.0.0-7498-g369173db-1jammy [2,946 kB] 2023-11-27T18:08:11.226 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-mgr-dbg. 2023-11-27T18:08:11.253 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../119-ceph-mgr-dbg_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:08:11.292 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-mgr-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:11.936 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-mon-dbg. 2023-11-27T18:08:11.952 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../120-ceph-mon-dbg_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:08:11.986 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-mon-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:12.780 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-osd-dbg. 2023-11-27T18:08:12.799 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../121-ceph-osd-dbg_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:08:12.828 INFO:teuthology.orchestra.run.smithi094.stdout:Fetched 3,014 MB in 9min 10s (5,479 kB/s) 2023-11-27T18:08:12.840 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-osd-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:12.969 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-27T18:08:13.056 INFO:teuthology.orchestra.run.smithi094.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165983 files and directories currently installed.) 2023-11-27T18:08:13.064 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-11-27T18:08:13.119 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-11-27T18:08:13.413 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-27T18:08:13.439 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-11-27T18:08:13.471 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-27T18:08:13.774 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-cmd2. 2023-11-27T18:08:13.800 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-11-27T18:08:13.841 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-11-27T18:08:14.177 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-11-27T18:08:14.203 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-11-27T18:08:14.285 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-27T18:08:14.639 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-27T18:08:14.665 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-11-27T18:08:14.705 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-27T18:08:15.000 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-27T18:08:15.026 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-11-27T18:08:15.066 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-27T18:08:15.528 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-27T18:08:15.554 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-27T18:08:15.603 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-27T18:08:15.977 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-test-dbg. 2023-11-27T18:08:15.992 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../122-ceph-test-dbg_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:08:16.006 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-27T18:08:16.032 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-27T18:08:16.034 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-test-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:16.089 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-27T18:08:16.400 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-27T18:08:16.429 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-27T18:08:16.459 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-27T18:08:16.787 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-11-27T18:08:16.813 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-11-27T18:08:16.853 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-27T18:08:17.173 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package librados2. 2023-11-27T18:08:17.199 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../010-librados2_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:08:17.239 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking librados2 (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:17.709 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package librbd1. 2023-11-27T18:08:17.735 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../011-librbd1_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:08:17.775 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking librbd1 (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:18.161 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libcephfs2. 2023-11-27T18:08:18.188 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:08:18.228 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libcephfs2 (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:18.505 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-rados. 2023-11-27T18:08:18.521 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../013-python3-rados_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:08:18.563 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-rados (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:18.891 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-27T18:08:18.918 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-7498-g369173db-1jammy_all.deb ... 2023-11-27T18:08:18.958 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-ceph-argparse (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:19.218 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-cephfs. 2023-11-27T18:08:23.761 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:08:23.762 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-cephfs (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:23.762 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-27T18:08:23.762 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-7498-g369173db-1jammy_all.deb ... 2023-11-27T18:08:23.762 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-ceph-common (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:23.762 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-prettytable. 2023-11-27T18:08:23.762 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2023-11-27T18:08:23.762 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-11-27T18:08:23.762 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-rbd. 2023-11-27T18:08:23.762 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:08:23.762 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-rbd (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:23.763 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-27T18:08:23.763 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-11-27T18:08:23.763 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-27T18:08:23.763 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package librgw2. 2023-11-27T18:08:23.763 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../020-librgw2_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:08:23.763 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking librgw2 (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:23.763 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-rgw. 2023-11-27T18:08:23.763 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../021-python3-rgw_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:08:23.763 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-rgw (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:23.763 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package liboath0:amd64. 2023-11-27T18:08:23.763 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../022-liboath0_2.6.7-3build1_amd64.deb ... 2023-11-27T18:08:23.763 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-11-27T18:08:23.763 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libradosstriper1. 2023-11-27T18:08:23.764 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../023-libradosstriper1_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:08:23.764 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libradosstriper1 (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:23.764 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-common. 2023-11-27T18:08:23.764 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../024-ceph-common_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:08:23.764 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-common (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:24.375 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-base. 2023-11-27T18:08:24.401 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../025-ceph-base_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:08:24.451 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-base (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:24.824 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libcephfs2-dbg. 2023-11-27T18:08:24.840 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../123-libcephfs2-dbg_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:08:24.882 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libcephfs2-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:25.162 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-11-27T18:08:25.178 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../026-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-11-27T18:08:25.221 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-11-27T18:08:25.284 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package librados2-dbg. 2023-11-27T18:08:25.300 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../124-librados2-dbg_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:08:25.334 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking librados2-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:25.507 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-cheroot. 2023-11-27T18:08:25.534 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../027-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-11-27T18:08:25.566 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-27T18:08:25.862 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-11-27T18:08:25.887 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../028-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-11-27T18:08:25.927 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-11-27T18:08:26.230 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-jaraco.text. 2023-11-27T18:08:26.257 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../029-python3-jaraco.text_3.6.0-2_all.deb ... 2023-11-27T18:08:26.297 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-11-27T18:08:26.345 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libradosstriper1-dbg. 2023-11-27T18:08:26.373 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../125-libradosstriper1-dbg_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:08:26.411 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libradosstriper1-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:26.600 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-11-27T18:08:26.627 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../030-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-11-27T18:08:26.666 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-11-27T18:08:26.806 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package librbd1-dbg. 2023-11-27T18:08:26.833 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../126-librbd1-dbg_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:08:26.872 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking librbd1-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:26.920 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-tempora. 2023-11-27T18:08:26.946 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../031-python3-tempora_4.1.2-1_all.deb ... 2023-11-27T18:08:26.986 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-11-27T18:08:27.272 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-portend. 2023-11-27T18:08:27.298 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../032-python3-portend_3.0.0-1_all.deb ... 2023-11-27T18:08:27.339 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-11-27T18:08:27.642 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-11-27T18:08:27.669 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../033-python3-zc.lockfile_2.0-1_all.deb ... 2023-11-27T18:08:27.709 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-11-27T18:08:28.012 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-27T18:08:28.038 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../034-python3-cherrypy3_18.6.1-4_all.deb ... 2023-11-27T18:08:28.078 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-11-27T18:08:28.150 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package librgw2-dbg. 2023-11-27T18:08:28.177 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../127-librgw2-dbg_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:08:28.216 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking librgw2-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:28.458 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-natsort. 2023-11-27T18:08:28.487 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../035-python3-natsort_8.0.2-1_all.deb ... 2023-11-27T18:08:28.525 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-11-27T18:08:28.810 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-logutils. 2023-11-27T18:08:28.826 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../036-python3-logutils_0.3.3-8_all.deb ... 2023-11-27T18:08:28.860 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-11-27T18:08:29.130 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-27T18:08:29.157 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../037-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-11-27T18:08:29.197 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-11-27T18:08:29.500 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-mako. 2023-11-27T18:08:29.527 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../038-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-11-27T18:08:29.566 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-27T18:08:29.903 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-27T18:08:29.934 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../039-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-27T18:08:29.970 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-27T18:08:29.985 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package radosgw-dbg. 2023-11-27T18:08:30.001 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../128-radosgw-dbg_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:08:30.034 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking radosgw-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:30.248 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-27T18:08:30.271 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../040-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-11-27T18:08:30.306 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-11-27T18:08:30.592 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-webob. 2023-11-27T18:08:30.619 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../041-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-11-27T18:08:30.659 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-11-27T18:08:31.012 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-waitress. 2023-11-27T18:08:31.039 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../042-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-11-27T18:08:31.082 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-27T18:08:31.401 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-tempita. 2023-11-27T18:08:31.426 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../043-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-11-27T18:08:31.490 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-11-27T18:08:31.785 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-paste. 2023-11-27T18:08:31.813 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../044-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-11-27T18:08:31.851 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-11-27T18:08:32.171 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-27T18:08:32.187 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../045-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-11-27T18:08:32.230 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-11-27T18:08:32.516 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-27T18:08:32.544 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../046-python3-pastedeploy_2.1.1-1_all.deb ... 2023-11-27T18:08:32.583 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-11-27T18:08:32.861 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-webtest. 2023-11-27T18:08:32.888 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../047-python3-webtest_2.0.35-1_all.deb ... 2023-11-27T18:08:32.928 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-11-27T18:08:33.246 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package rbd-fuse-dbg. 2023-11-27T18:08:33.247 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pecan. 2023-11-27T18:08:33.273 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../129-rbd-fuse-dbg_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:08:33.274 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../048-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-11-27T18:08:33.312 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking rbd-fuse-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:33.314 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-11-27T18:08:33.606 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package rbd-mirror-dbg. 2023-11-27T18:08:33.622 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../130-rbd-mirror-dbg_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:08:33.664 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking rbd-mirror-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:33.680 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-certifi. 2023-11-27T18:08:33.705 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../049-python3-certifi_2020.6.20-1_all.deb ... 2023-11-27T18:08:33.747 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-11-27T18:08:34.072 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-idna. 2023-11-27T18:08:34.101 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../050-python3-idna_3.3-1_all.deb ... 2023-11-27T18:08:34.140 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-idna (3.3-1) ... 2023-11-27T18:08:34.417 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-urllib3. 2023-11-27T18:08:34.433 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../051-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-11-27T18:08:34.469 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-27T18:08:34.798 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-requests. 2023-11-27T18:08:34.810 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../052-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-11-27T18:08:34.817 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package rbd-nbd-dbg. 2023-11-27T18:08:34.833 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../131-rbd-nbd-dbg_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:08:34.845 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-27T18:08:34.874 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking rbd-nbd-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:35.131 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-27T18:08:35.158 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../053-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-11-27T18:08:35.196 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-11-27T18:08:35.198 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-27T18:08:35.446 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-27T18:08:35.459 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-27T18:08:35.475 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../054-ceph-mgr-modules-core_18.0.0-7498-g369173db-1jammy_all.deb ... 2023-11-27T18:08:35.509 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-mgr-modules-core (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:35.573 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-11-27T18:08:35.838 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-11-27T18:08:35.865 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-27T18:08:35.891 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../055-libsqlite3-mod-ceph_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:08:35.932 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:36.218 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-openssl. 2023-11-27T18:08:36.224 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-11-27T18:08:36.245 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../056-python3-openssl_21.0.0-1_all.deb ... 2023-11-27T18:08:36.284 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-11-27T18:08:36.587 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-mgr. 2023-11-27T18:08:36.614 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../057-ceph-mgr_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:08:36.654 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-mgr (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:36.674 INFO:teuthology.orchestra.run.smithi091.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-11-27T18:08:36.783 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up cephadm (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:37.041 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-mon. 2023-11-27T18:08:37.068 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../058-ceph-mon_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:08:37.107 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-mon (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:37.890 INFO:teuthology.orchestra.run.smithi091.stdout:Adding system user cephadm....done 2023-11-27T18:08:37.994 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-osd. 2023-11-27T18:08:38.022 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../059-ceph-osd_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:08:38.061 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-osd (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:38.094 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-27T18:08:38.448 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-11-27T18:08:38.793 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-11-27T18:08:38.919 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-11-27T18:08:39.179 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-27T18:08:39.438 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-11-27T18:08:39.573 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-py (1.10.0-1) ... 2023-11-27T18:08:39.861 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-11-27T18:08:39.931 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph. 2023-11-27T18:08:39.947 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../060-ceph_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:08:39.989 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:40.193 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-11-27T18:08:40.318 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-fuse. 2023-11-27T18:08:40.344 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../061-ceph-fuse_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:08:40.384 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-fuse (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:40.452 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-11-27T18:08:40.729 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-11-27T18:08:40.729 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-mds. 2023-11-27T18:08:40.756 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../062-ceph-mds_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:08:40.795 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-mds (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:40.997 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-11-27T18:08:41.182 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package cephadm. 2023-11-27T18:08:41.209 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../063-cephadm_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:08:41.249 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking cephadm (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:41.331 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-11-27T18:08:41.565 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-11-27T18:08:41.585 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-27T18:08:41.612 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../064-python3-asyncssh_2.5.0-1_all.deb ... 2023-11-27T18:08:41.652 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-11-27T18:08:41.800 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-ceph-argparse (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:41.955 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python-babel-localedata. 2023-11-27T18:08:41.982 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../065-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-11-27T18:08:42.021 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-27T18:08:42.067 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-27T18:08:42.194 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-11-27T18:08:42.453 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-11-27T18:08:42.713 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-27T18:08:42.838 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-11-27T18:08:43.010 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-babel. 2023-11-27T18:08:43.026 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../066-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-11-27T18:08:43.060 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-11-27T18:08:43.223 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-27T18:08:43.324 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-11-27T18:08:43.372 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-jinja2. 2023-11-27T18:08:43.399 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../067-python3-jinja2_3.0.3-1_all.deb ... 2023-11-27T18:08:43.438 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-11-27T18:08:43.575 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-11-27T18:08:43.801 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-27T18:08:43.828 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../068-ceph-mgr-cephadm_18.0.0-7498-g369173db-1jammy_all.deb ... 2023-11-27T18:08:43.834 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-11-27T18:08:43.867 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-mgr-cephadm (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:44.144 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-11-27T18:08:44.221 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-27T18:08:44.247 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../069-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-11-27T18:08:44.287 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-11-27T18:08:44.590 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-27T18:08:44.617 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../070-python3-repoze.lru_0.7-2_all.deb ... 2023-11-27T18:08:44.657 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-27T18:08:44.804 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-11-27T18:08:44.952 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-routes. 2023-11-27T18:08:44.979 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../071-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-11-27T18:08:45.035 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-11-27T18:08:45.088 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-11-27T18:08:45.206 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-11-27T18:08:45.307 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-27T18:08:45.397 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-27T18:08:45.424 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.0.0-7498-g369173db-1jammy_all.deb ... 2023-11-27T18:08:45.464 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-mgr-dashboard (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:45.591 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-11-27T18:08:45.909 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-11-27T18:08:45.936 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../073-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-11-27T18:08:45.968 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-11-27T18:08:45.979 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-27T18:08:46.235 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-11-27T18:08:46.496 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-joblib. 2023-11-27T18:08:46.523 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../074-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-11-27T18:08:46.563 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-11-27T18:08:46.612 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-27T18:08:46.905 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-11-27T18:08:46.969 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-11-27T18:08:46.994 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../075-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-11-27T18:08:47.042 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-11-27T18:08:47.189 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-27T18:08:47.345 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-sklearn. 2023-11-27T18:08:47.372 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../076-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-11-27T18:08:47.411 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-27T18:08:47.507 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-11-27T18:08:47.775 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-11-27T18:08:47.901 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-ceph-common (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:48.091 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-27T18:08:48.115 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_18.0.0-7498-g369173db-1jammy_all.deb ... 2023-11-27T18:08:48.154 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:48.202 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-idna (3.3-1) ... 2023-11-27T18:08:48.528 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-27T18:08:49.149 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-cachetools. 2023-11-27T18:08:49.176 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../078-python3-cachetools_5.0.0-1_all.deb ... 2023-11-27T18:08:49.215 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-11-27T18:08:49.527 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-27T18:08:49.554 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.8-1_all.deb ... 2023-11-27T18:08:49.593 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-11-27T18:08:49.742 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-27T18:08:49.876 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-toml (0.10.2-1) ... 2023-11-27T18:08:49.947 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-27T18:08:49.974 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-11-27T18:08:50.013 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-11-27T18:08:50.153 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-27T18:08:50.279 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-11-27T18:08:50.309 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-rsa. 2023-11-27T18:08:50.336 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../081-python3-rsa_4.8-1_all.deb ... 2023-11-27T18:08:50.375 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-rsa (4.8-1) ... 2023-11-27T18:08:50.405 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-27T18:08:50.689 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-11-27T18:08:50.695 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-google-auth. 2023-11-27T18:08:50.722 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-3_all.deb ... 2023-11-27T18:08:50.762 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-11-27T18:08:50.924 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-11-27T18:08:51.175 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-27T18:08:51.184 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-27T18:08:51.211 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../083-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-11-27T18:08:51.259 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-27T18:08:51.301 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-11-27T18:08:51.529 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-websocket. 2023-11-27T18:08:51.557 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../084-python3-websocket_1.2.3-1_all.deb ... 2023-11-27T18:08:51.602 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-11-27T18:08:51.620 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-11-27T18:08:51.862 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-11-27T18:08:51.924 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-27T18:08:51.953 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../085-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-11-27T18:08:51.990 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-27T18:08:52.121 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-11-27T18:08:52.364 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-27T18:08:52.571 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-27T18:08:52.587 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../086-ceph-mgr-k8sevents_18.0.0-7498-g369173db-1jammy_all.deb ... 2023-11-27T18:08:52.598 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-11-27T18:08:52.629 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:52.874 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-27T18:08:52.982 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-27T18:08:53.000 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-11-27T18:08:53.009 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../087-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-11-27T18:08:53.049 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-27T18:08:53.309 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-27T18:08:53.386 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-27T18:08:53.413 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../088-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-11-27T18:08:53.436 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-27T18:08:53.452 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-27T18:08:53.705 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package jq. 2023-11-27T18:08:53.721 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../089-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-11-27T18:08:53.730 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-11-27T18:08:53.755 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-11-27T18:08:53.974 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package socat. 2023-11-27T18:08:54.001 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../090-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-11-27T18:08:54.029 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-11-27T18:08:54.041 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-11-27T18:08:54.264 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-11-27T18:08:54.353 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package xmlstarlet. 2023-11-27T18:08:54.380 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../091-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-11-27T18:08:54.419 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-11-27T18:08:54.651 INFO:teuthology.orchestra.run.smithi091.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-11-27T18:08:54.874 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-test. 2023-11-27T18:08:54.900 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-27T18:08:54.901 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../092-ceph-test_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:08:55.026 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-11-27T18:08:55.049 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-test (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:55.419 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-11-27T18:08:55.687 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-portend (3.0.0-1) ... 2023-11-27T18:08:55.946 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-27T18:08:56.064 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-11-27T18:08:56.382 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-11-27T18:08:56.691 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-27T18:08:56.959 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-11-27T18:08:57.093 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-rsa (4.8-1) ... 2023-11-27T18:08:57.320 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-volume. 2023-11-27T18:08:57.348 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../093-ceph-volume_18.0.0-7498-g369173db-1jammy_all.deb ... 2023-11-27T18:08:57.369 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-11-27T18:08:57.386 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-volume (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:57.645 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-27T18:08:57.741 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-27T18:08:57.768 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../094-cephfs-mirror_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:08:57.807 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking cephfs-mirror (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:57.905 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-11-27T18:08:58.102 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-colorama. 2023-11-27T18:08:58.119 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../095-python3-colorama_0.4.4-1_all.deb ... 2023-11-27T18:08:58.152 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-11-27T18:08:58.281 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-27T18:08:58.372 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package cephfs-shell. 2023-11-27T18:08:58.385 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../096-cephfs-shell_18.0.0-7498-g369173db-1jammy_all.deb ... 2023-11-27T18:08:58.422 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking cephfs-shell (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:58.566 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-11-27T18:08:58.683 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package cephfs-top. 2023-11-27T18:08:58.707 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../097-cephfs-top_18.0.0-7498-g369173db-1jammy_all.deb ... 2023-11-27T18:08:58.750 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking cephfs-top (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:58.902 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-27T18:08:59.011 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-27T18:08:59.027 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up librados2 (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:59.039 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../098-libcephfs-dev_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:08:59.098 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libcephfs-dev (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:59.153 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up librgw2 (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:59.271 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libsqlite3-mod-ceph (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:59.474 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package nvme-cli. 2023-11-27T18:08:59.500 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../099-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-11-27T18:08:59.533 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up librgw2-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:59.539 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-11-27T18:08:59.659 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libcephfs2 (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:59.785 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libradosstriper1 (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:08:59.894 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-27T18:08:59.911 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../100-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-11-27T18:08:59.919 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-11-27T18:08:59.953 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-11-27T18:09:00.204 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up librados2-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:00.305 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up librbd1 (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:00.356 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-iniconfig. 2023-11-27T18:09:00.372 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../101-python3-iniconfig_1.1.1-2_all.deb ... 2023-11-27T18:09:00.406 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-11-27T18:09:00.406 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libcephfs2-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:00.524 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-mgr-modules-core (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:00.650 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-fuse (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:00.701 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pastescript. 2023-11-27T18:09:00.728 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../102-python3-pastescript_2.0.2-4_all.deb ... 2023-11-27T18:09:00.767 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-27T18:09:00.862 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-27T18:09:00.862 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-27T18:09:01.088 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pluggy. 2023-11-27T18:09:01.115 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../103-python3-pluggy_0.13.0-7.1_all.deb ... 2023-11-27T18:09:01.154 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-11-27T18:09:01.418 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libradosstriper1-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:01.474 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-psutil. 2023-11-27T18:09:01.501 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../104-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-11-27T18:09:01.541 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-11-27T18:09:01.561 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libcephfs-dev (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:01.687 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-fuse-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:01.813 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-rados (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:01.887 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-py. 2023-11-27T18:09:01.915 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../105-python3-py_1.10.0-1_all.deb ... 2023-11-27T18:09:01.939 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up cephfs-top (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:01.954 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-py (1.10.0-1) ... 2023-11-27T18:09:02.040 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-27T18:09:02.232 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pygments. 2023-11-27T18:09:02.260 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../106-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-11-27T18:09:02.290 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-11-27T18:09:02.745 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-27T18:09:02.773 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-11-27T18:09:02.811 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-11-27T18:09:03.131 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-toml. 2023-11-27T18:09:03.159 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../108-python3-toml_0.10.2-1_all.deb ... 2023-11-27T18:09:03.194 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up librbd1-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:03.197 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-11-27T18:09:03.320 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-rbd (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:03.421 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up rbd-fuse (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:03.458 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pytest. 2023-11-27T18:09:03.486 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../109-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-11-27T18:09:03.516 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-11-27T18:09:03.522 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up rbd-nbd (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:03.632 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-rgw (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:03.757 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-cephfs (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:03.870 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-simplejson. 2023-11-27T18:09:03.898 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../110-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-11-27T18:09:03.937 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-11-27T18:09:04.128 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up rbd-nbd-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:04.207 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-27T18:09:04.235 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../111-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-11-27T18:09:04.265 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-11-27T18:09:04.451 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up cephfs-shell (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:04.577 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up rbd-fuse-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:04.704 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-common (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:04.969 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package radosgw. 2023-11-27T18:09:04.997 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../112-radosgw_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:09:05.035 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking radosgw (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:05.187 INFO:teuthology.orchestra.run.smithi091.stdout:Adding group ceph....done 2023-11-27T18:09:05.548 INFO:teuthology.orchestra.run.smithi091.stdout:Adding system user ceph....done 2023-11-27T18:09:05.674 INFO:teuthology.orchestra.run.smithi091.stdout:Setting system user ceph properties....done 2023-11-27T18:09:05.688 INFO:teuthology.orchestra.run.smithi091.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-27T18:09:05.805 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package rbd-fuse. 2023-11-27T18:09:05.819 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-27T18:09:05.833 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../113-rbd-fuse_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:09:05.872 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking rbd-fuse (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:06.162 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-27T18:09:06.217 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package rbd-mirror. 2023-11-27T18:09:06.244 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../114-rbd-mirror_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:09:06.283 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking rbd-mirror (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:06.688 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up cephfs-mirror (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:06.694 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package rbd-nbd. 2023-11-27T18:09:06.710 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../115-rbd-nbd_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:09:06.757 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking rbd-nbd (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:06.875 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-27T18:09:06.876 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-27T18:09:06.988 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-common-dbg. 2023-11-27T18:09:07.005 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../116-ceph-common-dbg_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:09:07.038 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-common-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:07.381 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-test (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:07.482 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up radosgw (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:07.951 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-27T18:09:07.951 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-27T18:09:08.442 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-base (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:08.800 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-27T18:09:09.318 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-mds (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:09.554 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-27T18:09:09.554 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-27T18:09:10.045 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-common-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:10.171 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up rbd-mirror (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:10.364 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2023-11-27T18:09:10.364 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2023-11-27T18:09:10.864 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-mgr (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:11.073 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-27T18:09:11.073 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-27T18:09:11.582 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-mds-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:11.708 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up radosgw-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:11.868 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-test-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:11.993 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-osd (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:12.310 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-27T18:09:12.310 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-27T18:09:12.870 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-mgr-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:12.971 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-osd-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:13.106 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up rbd-mirror-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:13.231 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-mgr-k8sevents (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:13.357 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:13.508 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-mon (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:13.722 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-27T18:09:13.722 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-27T18:09:14.059 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-fuse-dbg. 2023-11-27T18:09:14.075 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../117-ceph-fuse-dbg_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:09:14.117 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-fuse-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:14.251 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-mgr-cephadm (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:14.402 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:14.520 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-mds-dbg. 2023-11-27T18:09:14.528 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-mgr-dashboard (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:14.537 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../118-ceph-mds-dbg_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:09:14.569 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-mds-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:14.713 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-mon-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:14.839 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-volume (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:15.175 INFO:teuthology.orchestra.run.smithi091.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-27T18:09:15.756 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-mgr-dbg. 2023-11-27T18:09:15.783 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../119-ceph-mgr-dbg_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:09:15.822 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-mgr-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:15.909 INFO:teuthology.orchestra.run.smithi091.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-27T18:09:16.368 INFO:teuthology.orchestra.run.smithi091.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-27T18:09:16.370 DEBUG:teuthology.orchestra.run.smithi091:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-27T18:09:16.424 INFO:teuthology.orchestra.run.smithi091.stdout:Reading package lists... 2023-11-27T18:09:16.474 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-mon-dbg. 2023-11-27T18:09:16.490 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../120-ceph-mon-dbg_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:09:16.532 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-mon-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:16.606 INFO:teuthology.orchestra.run.smithi091.stdout:Building dependency tree... 2023-11-27T18:09:16.607 INFO:teuthology.orchestra.run.smithi091.stdout:Reading state information... 2023-11-27T18:09:16.755 INFO:teuthology.orchestra.run.smithi091.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-11-27T18:09:16.755 INFO:teuthology.orchestra.run.smithi091.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-11-27T18:09:16.755 INFO:teuthology.orchestra.run.smithi091.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-11-27T18:09:16.756 INFO:teuthology.orchestra.run.smithi091.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-11-27T18:09:16.756 INFO:teuthology.orchestra.run.smithi091.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-11-27T18:09:16.756 INFO:teuthology.orchestra.run.smithi091.stdout:The following packages were automatically installed and are no longer required: 2023-11-27T18:09:16.756 INFO:teuthology.orchestra.run.smithi091.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-27T18:09:16.756 INFO:teuthology.orchestra.run.smithi091.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-27T18:09:16.756 INFO:teuthology.orchestra.run.smithi091.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-27T18:09:16.756 INFO:teuthology.orchestra.run.smithi091.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-27T18:09:16.756 INFO:teuthology.orchestra.run.smithi091.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-27T18:09:16.756 INFO:teuthology.orchestra.run.smithi091.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-27T18:09:16.757 INFO:teuthology.orchestra.run.smithi091.stdout:The following additional packages will be installed: 2023-11-27T18:09:16.757 INFO:teuthology.orchestra.run.smithi091.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-11-27T18:09:16.757 INFO:teuthology.orchestra.run.smithi091.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-11-27T18:09:16.757 INFO:teuthology.orchestra.run.smithi091.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-11-27T18:09:16.757 INFO:teuthology.orchestra.run.smithi091.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-11-27T18:09:16.757 INFO:teuthology.orchestra.run.smithi091.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-27T18:09:16.758 INFO:teuthology.orchestra.run.smithi091.stdout:Suggested packages: 2023-11-27T18:09:16.758 INFO:teuthology.orchestra.run.smithi091.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-11-27T18:09:16.758 INFO:teuthology.orchestra.run.smithi091.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-11-27T18:09:16.758 INFO:teuthology.orchestra.run.smithi091.stdout: libengine-pkcs11-openssl 2023-11-27T18:09:16.792 INFO:teuthology.orchestra.run.smithi091.stdout:The following NEW packages will be installed: 2023-11-27T18:09:16.793 INFO:teuthology.orchestra.run.smithi091.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-11-27T18:09:16.793 INFO:teuthology.orchestra.run.smithi091.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-11-27T18:09:16.793 INFO:teuthology.orchestra.run.smithi091.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-11-27T18:09:16.793 INFO:teuthology.orchestra.run.smithi091.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-11-27T18:09:16.793 INFO:teuthology.orchestra.run.smithi091.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-11-27T18:09:16.794 INFO:teuthology.orchestra.run.smithi091.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-11-27T18:09:16.794 INFO:teuthology.orchestra.run.smithi091.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-27T18:09:16.794 INFO:teuthology.orchestra.run.smithi091.stdout:The following packages will be upgraded: 2023-11-27T18:09:16.797 INFO:teuthology.orchestra.run.smithi091.stdout: libssl3 2023-11-27T18:09:16.975 INFO:teuthology.orchestra.run.smithi091.stdout:1 upgraded, 39 newly installed, 0 to remove and 260 not upgraded. 2023-11-27T18:09:16.975 INFO:teuthology.orchestra.run.smithi091.stdout:Need to get 54.6 MB of archives. 2023-11-27T18:09:16.975 INFO:teuthology.orchestra.run.smithi091.stdout:After this operation, 202 MB of additional disk space will be used. 2023-11-27T18:09:16.975 INFO:teuthology.orchestra.run.smithi091.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-11-27T18:09:17.443 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-osd-dbg. 2023-11-27T18:09:17.453 INFO:teuthology.orchestra.run.smithi091.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-11-27T18:09:17.460 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../121-ceph-osd-dbg_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:09:17.501 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-osd-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:17.710 INFO:teuthology.orchestra.run.smithi091.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-11-27T18:09:17.745 INFO:teuthology.orchestra.run.smithi091.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-11-27T18:09:17.747 INFO:teuthology.orchestra.run.smithi091.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-11-27T18:09:17.752 INFO:teuthology.orchestra.run.smithi091.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-11-27T18:09:17.755 INFO:teuthology.orchestra.run.smithi091.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-11-27T18:09:17.756 INFO:teuthology.orchestra.run.smithi091.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-11-27T18:09:17.759 INFO:teuthology.orchestra.run.smithi091.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-11-27T18:09:17.762 INFO:teuthology.orchestra.run.smithi091.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-11-27T18:09:17.927 INFO:teuthology.orchestra.run.smithi091.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-11-27T18:09:17.927 INFO:teuthology.orchestra.run.smithi091.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-11-27T18:09:18.183 INFO:teuthology.orchestra.run.smithi091.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-11-27T18:09:19.265 INFO:teuthology.orchestra.run.smithi091.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-11-27T18:09:19.269 INFO:teuthology.orchestra.run.smithi091.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-11-27T18:09:19.270 INFO:teuthology.orchestra.run.smithi091.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-11-27T18:09:19.276 INFO:teuthology.orchestra.run.smithi091.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-11-27T18:09:19.277 INFO:teuthology.orchestra.run.smithi091.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-11-27T18:09:19.288 INFO:teuthology.orchestra.run.smithi091.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-11-27T18:09:19.291 INFO:teuthology.orchestra.run.smithi091.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-11-27T18:09:19.306 INFO:teuthology.orchestra.run.smithi091.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-11-27T18:09:19.470 INFO:teuthology.orchestra.run.smithi091.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-11-27T18:09:20.199 INFO:teuthology.orchestra.run.smithi091.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-11-27T18:09:20.200 INFO:teuthology.orchestra.run.smithi091.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-11-27T18:09:20.228 INFO:teuthology.orchestra.run.smithi091.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-11-27T18:09:20.304 INFO:teuthology.orchestra.run.smithi091.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-11-27T18:09:20.313 INFO:teuthology.orchestra.run.smithi091.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-11-27T18:09:20.314 INFO:teuthology.orchestra.run.smithi091.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-11-27T18:09:20.315 INFO:teuthology.orchestra.run.smithi091.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-11-27T18:09:20.316 INFO:teuthology.orchestra.run.smithi091.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-11-27T18:09:20.343 INFO:teuthology.orchestra.run.smithi091.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-11-27T18:09:20.346 INFO:teuthology.orchestra.run.smithi091.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-11-27T18:09:20.696 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-test-dbg. 2023-11-27T18:09:20.724 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../122-ceph-test-dbg_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:09:20.754 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-test-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:21.019 INFO:teuthology.orchestra.run.smithi091.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-11-27T18:09:21.102 INFO:teuthology.orchestra.run.smithi091.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-11-27T18:09:21.102 INFO:teuthology.orchestra.run.smithi091.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-11-27T18:09:21.102 INFO:teuthology.orchestra.run.smithi091.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-11-27T18:09:21.197 INFO:teuthology.orchestra.run.smithi091.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-11-27T18:09:21.213 INFO:teuthology.orchestra.run.smithi091.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-11-27T18:09:21.663 INFO:teuthology.orchestra.run.smithi091.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-11-27T18:09:21.665 INFO:teuthology.orchestra.run.smithi091.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-11-27T18:09:22.073 INFO:teuthology.orchestra.run.smithi091.stdout:Preconfiguring packages ... 2023-11-27T18:09:22.230 INFO:teuthology.orchestra.run.smithi091.stdout:Fetched 54.6 MB in 5s (11.2 MB/s) 2023-11-27T18:09:22.368 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package flex. 2023-11-27T18:09:22.468 INFO:teuthology.orchestra.run.smithi091.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173168 files and directories currently installed.) 2023-11-27T18:09:22.475 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-11-27T18:09:22.525 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking flex (2.6.4-8build2) ... 2023-11-27T18:09:23.115 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-27T18:09:23.264 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-11-27T18:09:23.682 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-27T18:09:24.223 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package bison. 2023-11-27T18:09:24.324 INFO:teuthology.orchestra.run.smithi091.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173241 files and directories currently installed.) 2023-11-27T18:09:24.330 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-11-27T18:09:24.384 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-11-27T18:09:24.787 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-27T18:09:24.814 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-11-27T18:09:24.879 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-11-27T18:09:25.215 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package dump. 2023-11-27T18:09:25.242 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-11-27T18:09:25.281 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking dump (0.4b47-3) ... 2023-11-27T18:09:25.551 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package indent. 2023-11-27T18:09:25.567 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-11-27T18:09:25.602 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-27T18:09:25.853 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-27T18:09:25.869 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-11-27T18:09:25.937 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-27T18:09:26.240 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-27T18:09:26.268 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-11-27T18:09:26.308 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-27T18:09:26.617 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-27T18:09:26.633 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-11-27T18:09:26.676 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-11-27T18:09:26.929 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libfl2:amd64. 2023-11-27T18:09:26.945 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-11-27T18:09:26.979 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-11-27T18:09:27.231 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-11-27T18:09:27.259 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-11-27T18:09:27.298 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-27T18:09:27.559 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libjson-perl. 2023-11-27T18:09:27.575 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-11-27T18:09:27.618 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-11-27T18:09:27.912 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libllvm14:amd64. 2023-11-27T18:09:27.939 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-11-27T18:09:27.979 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-27T18:09:29.606 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-27T18:09:29.633 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-27T18:09:29.672 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-27T18:09:29.854 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libcephfs2-dbg. 2023-11-27T18:09:29.867 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../123-libcephfs2-dbg_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:09:29.895 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libcephfs2-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:30.018 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-27T18:09:30.045 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-27T18:09:30.085 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-27T18:09:30.290 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package librados2-dbg. 2023-11-27T18:09:30.317 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../124-librados2-dbg_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:09:30.356 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking librados2-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:30.429 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-27T18:09:30.456 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-27T18:09:30.495 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-27T18:09:30.781 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-27T18:09:30.809 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-11-27T18:09:30.840 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-27T18:09:31.150 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-27T18:09:31.178 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-11-27T18:09:31.217 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-27T18:09:31.409 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libradosstriper1-dbg. 2023-11-27T18:09:31.424 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../125-libradosstriper1-dbg_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:09:31.467 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libradosstriper1-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:31.578 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-27T18:09:31.606 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-27T18:09:31.644 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-27T18:09:31.870 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package librbd1-dbg. 2023-11-27T18:09:31.900 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../126-librbd1-dbg_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:09:31.936 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking librbd1-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:31.940 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-27T18:09:31.968 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-27T18:09:31.997 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-27T18:09:32.258 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-27T18:09:32.274 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-27T18:09:32.310 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-27T18:09:32.543 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-27T18:09:32.560 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-27T18:09:32.602 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-27T18:09:33.122 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-27T18:09:35.483 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package librgw2-dbg. 2023-11-27T18:09:35.484 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../127-librgw2-dbg_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:09:35.484 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking librgw2-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:35.484 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package radosgw-dbg. 2023-11-27T18:09:35.485 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../128-radosgw-dbg_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:09:35.485 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking radosgw-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:35.487 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-11-27T18:09:35.487 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-11-27T18:09:35.488 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package modemmanager. 2023-11-27T18:09:35.488 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-27T18:09:35.488 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-27T18:09:35.488 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package network-manager. 2023-11-27T18:09:35.488 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-11-27T18:09:35.488 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-11-27T18:09:35.488 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ppp. 2023-11-27T18:09:35.488 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-11-27T18:09:35.488 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-11-27T18:09:35.843 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package pptp-linux. 2023-11-27T18:09:35.859 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-11-27T18:09:35.910 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-11-27T18:09:36.162 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-27T18:09:36.178 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-11-27T18:09:36.220 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-11-27T18:09:36.507 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-27T18:09:36.535 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-11-27T18:09:36.573 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking postgresql-client-common (238) ... 2023-11-27T18:09:36.893 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package postgresql-client-14. 2023-11-27T18:09:36.921 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-27T18:09:36.960 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-27T18:09:37.548 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package postgresql-common. 2023-11-27T18:09:37.577 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-11-27T18:09:37.633 INFO:teuthology.orchestra.run.smithi091.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-27T18:09:37.654 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking postgresql-common (238) ... 2023-11-27T18:09:38.072 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package postgresql-14. 2023-11-27T18:09:38.100 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-27T18:09:38.133 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-27T18:09:38.453 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package rbd-fuse-dbg. 2023-11-27T18:09:38.480 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../129-rbd-fuse-dbg_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:09:38.519 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking rbd-fuse-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:38.788 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package rbd-mirror-dbg. 2023-11-27T18:09:38.804 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../130-rbd-mirror-dbg_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:09:38.838 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking rbd-mirror-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:39.399 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package postgresql. 2023-11-27T18:09:39.416 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-11-27T18:09:39.457 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking postgresql (14+238) ... 2023-11-27T18:09:39.684 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package postgresql-client. 2023-11-27T18:09:39.701 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-11-27T18:09:39.743 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking postgresql-client (14+238) ... 2023-11-27T18:09:39.965 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package rbd-nbd-dbg. 2023-11-27T18:09:39.981 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../131-rbd-nbd-dbg_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T18:09:39.987 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-27T18:09:40.015 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-11-27T18:09:40.024 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking rbd-nbd-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:40.054 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking postgresql-contrib (14+238) ... 2023-11-27T18:09:40.345 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-11-27T18:09:40.372 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package tcl8.6. 2023-11-27T18:09:40.400 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-11-27T18:09:40.441 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-27T18:09:40.596 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-27T18:09:40.717 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package tcl. 2023-11-27T18:09:40.722 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-11-27T18:09:40.745 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-11-27T18:09:40.788 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-11-27T18:09:40.981 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-11-27T18:09:41.078 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package wpasupplicant. 2023-11-27T18:09:41.106 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-11-27T18:09:41.136 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-27T18:09:41.372 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-11-27T18:09:41.498 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-27T18:09:41.517 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-11-27T18:09:41.556 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-11-27T18:09:41.903 INFO:teuthology.orchestra.run.smithi094.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-11-27T18:09:41.936 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-27T18:09:41.962 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-11-27T18:09:42.059 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-27T18:09:42.110 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up cephadm (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:42.421 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up postgresql-client-common (238) ... 2023-11-27T18:09:42.632 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up flex (2.6.4-8build2) ... 2023-11-27T18:09:42.758 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-27T18:09:42.893 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-27T18:09:42.908 INFO:teuthology.orchestra.run.smithi094.stdout:Adding system user cephadm....done 2023-11-27T18:09:43.052 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-11-27T18:09:43.186 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-27T18:09:43.203 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-27T18:09:43.346 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-27T18:09:43.557 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-11-27T18:09:43.853 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-11-27T18:09:43.904 INFO:teuthology.orchestra.run.smithi091.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-27T18:09:43.971 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-11-27T18:09:44.010 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-27T18:09:44.222 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-27T18:09:44.439 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-27T18:09:44.439 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-27T18:09:44.482 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-11-27T18:09:44.608 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-py (1.10.0-1) ... 2023-11-27T18:09:44.902 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-11-27T18:09:44.996 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-11-27T18:09:45.147 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-27T18:09:45.262 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-11-27T18:09:45.273 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-11-27T18:09:45.399 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-11-27T18:09:45.513 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-11-27T18:09:45.525 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-11-27T18:09:45.685 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-27T18:09:45.765 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-11-27T18:09:45.813 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-11-27T18:09:46.032 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-11-27T18:09:46.292 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-11-27T18:09:46.527 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-11-27T18:09:46.541 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-27T18:09:46.692 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up dump (0.4b47-3) ... 2023-11-27T18:09:46.778 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-ceph-argparse (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:46.785 INFO:teuthology.orchestra.run.smithi091.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-27T18:09:46.852 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-27T18:09:46.987 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-27T18:09:47.037 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-27T18:09:47.163 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-11-27T18:09:47.190 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up tcl (8.6.11+1build2) ... 2023-11-27T18:09:47.338 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libjson-perl (4.04000-1) ... 2023-11-27T18:09:47.423 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-11-27T18:09:47.481 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-11-27T18:09:47.571 INFO:teuthology.orchestra.run.smithi091.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-11-27T18:09:47.641 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-27T18:09:47.674 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-27T18:09:47.767 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-27T18:09:47.800 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-11-27T18:09:47.952 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-27T18:09:48.095 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-27T18:09:48.151 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-27T18:09:48.237 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-11-27T18:09:48.286 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-11-27T18:09:48.439 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up postgresql-client (14+238) ... 2023-11-27T18:09:48.554 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-11-27T18:09:48.590 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-11-27T18:09:48.822 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-11-27T18:09:49.085 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:09:49.085 INFO:teuthology.orchestra.run.smithi091.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-27T18:09:49.085 INFO:teuthology.orchestra.run.smithi091.stdout:which means they are currently configured by ifupdown: 2023-11-27T18:09:49.085 INFO:teuthology.orchestra.run.smithi091.stdout:- enp3s0f1 2023-11-27T18:09:49.085 INFO:teuthology.orchestra.run.smithi091.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-27T18:09:49.085 INFO:teuthology.orchestra.run.smithi091.stdout:remove their configuration from /etc/network/interfaces. 2023-11-27T18:09:49.085 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:09:49.131 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-11-27T18:09:49.198 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-27T18:09:49.551 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-27T18:09:49.783 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-11-27T18:09:49.906 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-27T18:09:50.051 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-11-27T18:09:50.169 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-11-27T18:09:50.270 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-27T18:09:50.450 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-27T18:09:50.554 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-11-27T18:09:50.594 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-27T18:09:50.881 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-11-27T18:09:50.931 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-11-27T18:09:51.154 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up postgresql-common (238) ... 2023-11-27T18:09:51.190 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-11-27T18:09:51.559 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-27T18:09:51.860 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-11-27T18:09:52.069 INFO:teuthology.orchestra.run.smithi091.stdout:Adding user postgres to group ssl-cert 2023-11-27T18:09:52.161 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-27T18:09:52.292 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:09:52.292 INFO:teuthology.orchestra.run.smithi091.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-27T18:09:52.469 INFO:teuthology.orchestra.run.smithi091.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-27T18:09:52.469 INFO:teuthology.orchestra.run.smithi091.stdout:Removing obsolete dictionary files: 2023-11-27T18:09:52.496 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-11-27T18:09:52.747 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-11-27T18:09:52.873 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-ceph-common (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:09:53.049 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-27T18:09:53.183 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-idna (3.3-1) ... 2023-11-27T18:09:53.492 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-27T18:09:53.497 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-27T18:09:53.828 INFO:teuthology.orchestra.run.smithi091.stdout:Creating new PostgreSQL cluster 14/main ... 2023-11-27T18:09:53.846 INFO:teuthology.orchestra.run.smithi091.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-11-27T18:09:53.893 INFO:teuthology.orchestra.run.smithi091.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-27T18:09:53.894 INFO:teuthology.orchestra.run.smithi091.stdout:This user must also own the server process. 2023-11-27T18:09:53.894 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:09:53.894 INFO:teuthology.orchestra.run.smithi091.stdout:The database cluster will be initialized with locale "en_US". 2023-11-27T18:09:53.894 INFO:teuthology.orchestra.run.smithi091.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-27T18:09:53.894 INFO:teuthology.orchestra.run.smithi091.stdout:The default text search configuration will be set to "english". 2023-11-27T18:09:53.894 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:09:53.894 INFO:teuthology.orchestra.run.smithi091.stdout:Data page checksums are disabled. 2023-11-27T18:09:53.895 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:09:53.895 INFO:teuthology.orchestra.run.smithi091.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-11-27T18:09:53.895 INFO:teuthology.orchestra.run.smithi091.stdout:creating subdirectories ... ok 2023-11-27T18:09:53.895 INFO:teuthology.orchestra.run.smithi091.stdout:selecting dynamic shared memory implementation ... posix 2023-11-27T18:09:53.907 INFO:teuthology.orchestra.run.smithi091.stdout:selecting default max_connections ... 100 2023-11-27T18:09:53.924 INFO:teuthology.orchestra.run.smithi091.stdout:selecting default shared_buffers ... 128MB 2023-11-27T18:09:53.934 INFO:teuthology.orchestra.run.smithi091.stdout:selecting default time zone ... Etc/UTC 2023-11-27T18:09:53.935 INFO:teuthology.orchestra.run.smithi091.stdout:creating configuration files ... ok 2023-11-27T18:09:54.045 INFO:teuthology.orchestra.run.smithi091.stdout:running bootstrap script ... ok 2023-11-27T18:09:54.615 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-27T18:09:54.679 INFO:teuthology.orchestra.run.smithi091.stdout:performing post-bootstrap initialization ... ok 2023-11-27T18:09:54.750 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-toml (0.10.2-1) ... 2023-11-27T18:09:55.009 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-27T18:09:55.144 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-11-27T18:09:55.270 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-27T18:09:55.392 INFO:teuthology.orchestra.run.smithi091.stdout:syncing data to disk ... ok 2023-11-27T18:09:55.563 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-11-27T18:09:55.805 INFO:teuthology.orchestra.run.smithi091.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-27T18:09:55.832 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-11-27T18:09:56.082 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-27T18:09:56.209 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-11-27T18:09:56.509 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-11-27T18:09:56.769 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-11-27T18:09:57.021 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-11-27T18:09:57.271 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-27T18:09:57.523 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-11-27T18:09:57.790 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-27T18:09:57.893 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-11-27T18:09:58.184 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-27T18:09:58.294 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-27T18:09:58.587 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-11-27T18:09:58.637 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-27T18:09:58.763 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up postgresql-contrib (14+238) ... 2023-11-27T18:09:58.888 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-11-27T18:09:58.888 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up postgresql (14+238) ... 2023-11-27T18:09:59.015 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-27T18:09:59.141 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-27T18:09:59.147 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-11-27T18:09:59.404 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-27T18:09:59.404 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-27T18:09:59.567 INFO:teuthology.orchestra.run.smithi094.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-11-27T18:09:59.809 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-27T18:09:59.918 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-11-27T18:09:59.994 INFO:teuthology.orchestra.run.smithi091.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-27T18:10:00.279 INFO:teuthology.orchestra.run.smithi091.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-27T18:10:00.295 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-11-27T18:10:00.422 INFO:teuthology.orchestra.run.smithi091.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-27T18:10:00.538 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-portend (3.0.0-1) ... 2023-11-27T18:10:00.789 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-27T18:10:00.915 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-11-27T18:10:01.233 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-11-27T18:10:01.517 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-27T18:10:01.751 INFO:teuthology.orchestra.run.smithi091.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-11-27T18:10:01.777 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-11-27T18:10:02.033 INFO:teuthology.orchestra.run.smithi091.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-27T18:10:02.336 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-rsa (4.8-1) ... 2023-11-27T18:10:02.605 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-11-27T18:10:02.715 INFO:teuthology.orchestra.run.smithi091.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-27T18:10:02.718 DEBUG:teuthology.parallel:result is None 2023-11-27T18:10:02.872 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-27T18:10:03.132 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-11-27T18:10:03.500 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-27T18:10:03.776 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-11-27T18:10:04.115 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-27T18:10:04.246 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up librados2 (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:10:04.372 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up librgw2 (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:10:04.498 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libsqlite3-mod-ceph (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:10:04.694 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up librgw2-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:10:04.820 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libcephfs2 (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:10:04.946 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libradosstriper1 (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:10:05.072 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-11-27T18:10:05.357 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up librados2-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:10:05.484 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up librbd1 (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:10:05.601 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libcephfs2-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:10:05.712 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-mgr-modules-core (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:10:05.812 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-fuse (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:10:06.012 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-27T18:10:06.012 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-27T18:10:06.547 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libradosstriper1-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:10:06.676 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libcephfs-dev (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:10:06.775 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-fuse-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:10:06.876 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-rados (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:10:07.052 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up cephfs-top (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:10:07.153 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-27T18:10:08.374 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up librbd1-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:10:08.500 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-rbd (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:10:08.618 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up rbd-fuse (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:10:08.719 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up rbd-nbd (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:10:08.837 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-rgw (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:10:08.955 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-cephfs (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:10:09.081 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up rbd-nbd-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:10:09.207 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up cephfs-shell (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:10:09.333 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up rbd-fuse-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:10:09.459 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-common (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:10:09.937 INFO:teuthology.orchestra.run.smithi094.stdout:Adding group ceph....done 2023-11-27T18:10:10.345 INFO:teuthology.orchestra.run.smithi094.stdout:Adding system user ceph....done 2023-11-27T18:10:10.514 INFO:teuthology.orchestra.run.smithi094.stdout:Setting system user ceph properties....done 2023-11-27T18:10:10.525 INFO:teuthology.orchestra.run.smithi094.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-27T18:10:10.659 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-27T18:10:10.990 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-27T18:10:18.564 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up cephfs-mirror (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:10:18.564 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-27T18:10:18.564 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-27T18:10:18.564 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-test (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:10:18.564 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up radosgw (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:10:18.564 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-27T18:10:18.564 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-27T18:10:18.564 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-base (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:10:18.564 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-27T18:10:18.565 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-mds (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:10:18.565 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-27T18:10:18.565 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-27T18:10:18.565 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-common-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:10:18.565 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up rbd-mirror (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:10:18.565 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2023-11-27T18:10:18.565 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2023-11-27T18:10:18.565 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-mgr (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:10:18.565 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-27T18:10:18.565 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-27T18:10:18.565 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-mds-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:10:18.565 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up radosgw-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:10:18.565 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-test-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:10:18.566 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-osd (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:10:18.566 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-27T18:10:18.566 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-27T18:10:18.566 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-mgr-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:10:18.582 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-osd-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:10:18.583 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up rbd-mirror-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:10:18.583 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-mgr-k8sevents (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:10:18.583 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:10:18.583 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-mon (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:10:18.663 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-27T18:10:18.663 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-27T18:10:19.211 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-mgr-cephadm (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:10:19.346 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:10:19.497 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-mgr-dashboard (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:10:19.650 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-mon-dbg (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:10:19.774 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-volume (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T18:10:20.119 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-27T18:10:20.793 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-27T18:10:21.249 INFO:teuthology.orchestra.run.smithi094.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-27T18:10:21.252 DEBUG:teuthology.orchestra.run.smithi094:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-27T18:10:21.312 INFO:teuthology.orchestra.run.smithi094.stdout:Reading package lists... 2023-11-27T18:10:21.499 INFO:teuthology.orchestra.run.smithi094.stdout:Building dependency tree... 2023-11-27T18:10:21.500 INFO:teuthology.orchestra.run.smithi094.stdout:Reading state information... 2023-11-27T18:10:21.661 INFO:teuthology.orchestra.run.smithi094.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-11-27T18:10:21.661 INFO:teuthology.orchestra.run.smithi094.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-11-27T18:10:21.661 INFO:teuthology.orchestra.run.smithi094.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-11-27T18:10:21.661 INFO:teuthology.orchestra.run.smithi094.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-11-27T18:10:21.661 INFO:teuthology.orchestra.run.smithi094.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-11-27T18:10:21.661 INFO:teuthology.orchestra.run.smithi094.stdout:The following packages were automatically installed and are no longer required: 2023-11-27T18:10:21.661 INFO:teuthology.orchestra.run.smithi094.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-27T18:10:21.661 INFO:teuthology.orchestra.run.smithi094.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-27T18:10:21.661 INFO:teuthology.orchestra.run.smithi094.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-27T18:10:21.662 INFO:teuthology.orchestra.run.smithi094.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-27T18:10:21.663 INFO:teuthology.orchestra.run.smithi094.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-27T18:10:21.663 INFO:teuthology.orchestra.run.smithi094.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-27T18:10:21.663 INFO:teuthology.orchestra.run.smithi094.stdout:The following additional packages will be installed: 2023-11-27T18:10:21.663 INFO:teuthology.orchestra.run.smithi094.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-11-27T18:10:21.663 INFO:teuthology.orchestra.run.smithi094.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-11-27T18:10:21.663 INFO:teuthology.orchestra.run.smithi094.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-11-27T18:10:21.663 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-11-27T18:10:21.663 INFO:teuthology.orchestra.run.smithi094.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-27T18:10:21.664 INFO:teuthology.orchestra.run.smithi094.stdout:Suggested packages: 2023-11-27T18:10:21.664 INFO:teuthology.orchestra.run.smithi094.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-11-27T18:10:21.664 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-11-27T18:10:21.664 INFO:teuthology.orchestra.run.smithi094.stdout: libengine-pkcs11-openssl 2023-11-27T18:10:21.700 INFO:teuthology.orchestra.run.smithi094.stdout:The following NEW packages will be installed: 2023-11-27T18:10:21.701 INFO:teuthology.orchestra.run.smithi094.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-11-27T18:10:21.701 INFO:teuthology.orchestra.run.smithi094.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-11-27T18:10:21.701 INFO:teuthology.orchestra.run.smithi094.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-11-27T18:10:21.701 INFO:teuthology.orchestra.run.smithi094.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-11-27T18:10:21.701 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-11-27T18:10:21.702 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-11-27T18:10:21.702 INFO:teuthology.orchestra.run.smithi094.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-27T18:10:21.703 INFO:teuthology.orchestra.run.smithi094.stdout:The following packages will be upgraded: 2023-11-27T18:10:21.704 INFO:teuthology.orchestra.run.smithi094.stdout: libssl3 2023-11-27T18:10:21.752 INFO:teuthology.orchestra.run.smithi094.stdout:1 upgraded, 39 newly installed, 0 to remove and 260 not upgraded. 2023-11-27T18:10:21.752 INFO:teuthology.orchestra.run.smithi094.stdout:Need to get 54.6 MB of archives. 2023-11-27T18:10:21.752 INFO:teuthology.orchestra.run.smithi094.stdout:After this operation, 202 MB of additional disk space will be used. 2023-11-27T18:10:21.752 INFO:teuthology.orchestra.run.smithi094.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-11-27T18:10:21.850 INFO:teuthology.orchestra.run.smithi094.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-11-27T18:10:21.911 INFO:teuthology.orchestra.run.smithi094.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-11-27T18:10:21.924 INFO:teuthology.orchestra.run.smithi094.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-11-27T18:10:21.925 INFO:teuthology.orchestra.run.smithi094.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-11-27T18:10:21.927 INFO:teuthology.orchestra.run.smithi094.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-11-27T18:10:21.929 INFO:teuthology.orchestra.run.smithi094.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-11-27T18:10:21.929 INFO:teuthology.orchestra.run.smithi094.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-11-27T18:10:21.931 INFO:teuthology.orchestra.run.smithi094.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-11-27T18:10:21.932 INFO:teuthology.orchestra.run.smithi094.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-11-27T18:10:21.933 INFO:teuthology.orchestra.run.smithi094.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-11-27T18:10:21.933 INFO:teuthology.orchestra.run.smithi094.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-11-27T18:10:21.948 INFO:teuthology.orchestra.run.smithi094.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-11-27T18:10:22.234 INFO:teuthology.orchestra.run.smithi094.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-11-27T18:10:22.295 INFO:teuthology.orchestra.run.smithi094.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-11-27T18:10:22.313 INFO:teuthology.orchestra.run.smithi094.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-11-27T18:10:22.315 INFO:teuthology.orchestra.run.smithi094.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-11-27T18:10:22.315 INFO:teuthology.orchestra.run.smithi094.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-11-27T18:10:22.320 INFO:teuthology.orchestra.run.smithi094.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-11-27T18:10:22.321 INFO:teuthology.orchestra.run.smithi094.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-11-27T18:10:22.329 INFO:teuthology.orchestra.run.smithi094.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-11-27T18:10:22.330 INFO:teuthology.orchestra.run.smithi094.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-11-27T18:10:22.349 INFO:teuthology.orchestra.run.smithi094.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-11-27T18:10:22.350 INFO:teuthology.orchestra.run.smithi094.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-11-27T18:10:22.359 INFO:teuthology.orchestra.run.smithi094.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-11-27T18:10:22.378 INFO:teuthology.orchestra.run.smithi094.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-11-27T18:10:22.382 INFO:teuthology.orchestra.run.smithi094.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-11-27T18:10:22.382 INFO:teuthology.orchestra.run.smithi094.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-11-27T18:10:22.382 INFO:teuthology.orchestra.run.smithi094.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-11-27T18:10:22.382 INFO:teuthology.orchestra.run.smithi094.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-11-27T18:10:22.392 INFO:teuthology.orchestra.run.smithi094.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-11-27T18:10:22.393 INFO:teuthology.orchestra.run.smithi094.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-11-27T18:10:22.600 INFO:teuthology.orchestra.run.smithi094.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-11-27T18:10:22.600 INFO:teuthology.orchestra.run.smithi094.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-11-27T18:10:22.600 INFO:teuthology.orchestra.run.smithi094.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-11-27T18:10:22.600 INFO:teuthology.orchestra.run.smithi094.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-11-27T18:10:22.601 INFO:teuthology.orchestra.run.smithi094.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-11-27T18:10:22.601 INFO:teuthology.orchestra.run.smithi094.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-11-27T18:10:22.613 INFO:teuthology.orchestra.run.smithi094.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-11-27T18:10:22.613 INFO:teuthology.orchestra.run.smithi094.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-11-27T18:10:23.013 INFO:teuthology.orchestra.run.smithi094.stdout:Preconfiguring packages ... 2023-11-27T18:10:23.163 INFO:teuthology.orchestra.run.smithi094.stdout:Fetched 54.6 MB in 1s (60.4 MB/s) 2023-11-27T18:10:23.267 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package flex. 2023-11-27T18:10:23.333 INFO:teuthology.orchestra.run.smithi094.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173168 files and directories currently installed.) 2023-11-27T18:10:23.337 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-11-27T18:10:23.374 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking flex (2.6.4-8build2) ... 2023-11-27T18:10:23.974 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-27T18:10:24.155 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-11-27T18:10:24.567 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-27T18:10:25.072 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package bison. 2023-11-27T18:10:25.173 INFO:teuthology.orchestra.run.smithi094.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173241 files and directories currently installed.) 2023-11-27T18:10:25.178 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-11-27T18:10:25.232 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-11-27T18:10:25.642 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-27T18:10:25.670 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-11-27T18:10:25.708 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-11-27T18:10:26.061 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package dump. 2023-11-27T18:10:26.089 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-11-27T18:10:26.128 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking dump (0.4b47-3) ... 2023-11-27T18:10:26.398 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package indent. 2023-11-27T18:10:26.414 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-11-27T18:10:26.448 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-27T18:10:26.692 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-27T18:10:26.719 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-11-27T18:10:26.758 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-27T18:10:27.087 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-27T18:10:27.114 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-11-27T18:10:27.153 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-27T18:10:27.440 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-27T18:10:27.467 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-11-27T18:10:27.506 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-11-27T18:10:27.801 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libfl2:amd64. 2023-11-27T18:10:27.829 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-11-27T18:10:27.867 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-11-27T18:10:28.237 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-11-27T18:10:28.265 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-11-27T18:10:28.304 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-27T18:10:28.557 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libjson-perl. 2023-11-27T18:10:28.573 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-11-27T18:10:28.615 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-11-27T18:10:28.918 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libllvm14:amd64. 2023-11-27T18:10:28.946 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-11-27T18:10:28.993 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-27T18:10:30.729 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-27T18:10:30.756 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-27T18:10:30.795 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-27T18:10:31.023 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-27T18:10:31.039 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-27T18:10:31.073 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-27T18:10:31.384 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-27T18:10:31.411 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-27T18:10:31.451 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-27T18:10:31.794 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-27T18:10:31.822 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-11-27T18:10:31.861 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-27T18:10:32.189 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-27T18:10:32.218 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-11-27T18:10:32.264 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-27T18:10:32.550 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-27T18:10:32.583 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-27T18:10:32.616 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-27T18:10:32.927 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-27T18:10:32.941 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-27T18:10:32.985 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-27T18:10:33.772 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-27T18:10:33.787 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-27T18:10:33.830 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-27T18:10:34.074 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-27T18:10:34.090 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-27T18:10:34.132 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-27T18:10:34.677 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-27T18:10:34.702 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-11-27T18:10:34.744 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-11-27T18:10:35.113 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package modemmanager. 2023-11-27T18:10:35.141 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-27T18:10:35.179 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-27T18:10:35.744 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package network-manager. 2023-11-27T18:10:35.772 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-11-27T18:10:35.818 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-11-27T18:10:36.342 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ppp. 2023-11-27T18:10:36.369 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-11-27T18:10:36.677 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-11-27T18:10:36.938 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package pptp-linux. 2023-11-27T18:10:36.953 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-11-27T18:10:36.987 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-11-27T18:10:37.207 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-27T18:10:37.223 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-11-27T18:10:37.265 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-11-27T18:10:37.568 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-27T18:10:37.595 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-11-27T18:10:37.634 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking postgresql-client-common (238) ... 2023-11-27T18:10:37.938 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package postgresql-client-14. 2023-11-27T18:10:37.965 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-27T18:10:38.004 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-27T18:10:38.617 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package postgresql-common. 2023-11-27T18:10:38.645 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-11-27T18:10:38.871 INFO:teuthology.orchestra.run.smithi094.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-27T18:10:38.910 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking postgresql-common (238) ... 2023-11-27T18:10:39.277 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package postgresql-14. 2023-11-27T18:10:39.305 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-27T18:10:39.347 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-27T18:10:40.597 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package postgresql. 2023-11-27T18:10:40.613 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-11-27T18:10:40.654 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking postgresql (14+238) ... 2023-11-27T18:10:40.898 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package postgresql-client. 2023-11-27T18:10:40.926 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-11-27T18:10:40.973 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking postgresql-client (14+238) ... 2023-11-27T18:10:41.235 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-27T18:10:41.263 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-11-27T18:10:41.308 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking postgresql-contrib (14+238) ... 2023-11-27T18:10:41.594 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package tcl8.6. 2023-11-27T18:10:41.622 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-11-27T18:10:41.661 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-27T18:10:41.896 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package tcl. 2023-11-27T18:10:41.912 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-11-27T18:10:41.960 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-11-27T18:10:42.324 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package wpasupplicant. 2023-11-27T18:10:42.352 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-11-27T18:10:42.391 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-27T18:10:42.744 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-27T18:10:42.761 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-11-27T18:10:42.803 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-11-27T18:10:43.139 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-27T18:10:43.167 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-11-27T18:10:43.206 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-27T18:10:43.483 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up postgresql-client-common (238) ... 2023-11-27T18:10:43.695 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up flex (2.6.4-8build2) ... 2023-11-27T18:10:43.821 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-27T18:10:43.946 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-27T18:10:44.107 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-11-27T18:10:44.216 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-27T18:10:44.341 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-27T18:10:44.824 INFO:teuthology.orchestra.run.smithi094.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-27T18:10:44.905 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-27T18:10:45.266 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-27T18:10:45.266 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-27T18:10:45.800 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-11-27T18:10:45.917 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-27T18:10:46.043 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-11-27T18:10:46.278 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-11-27T18:10:46.403 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-11-27T18:10:46.529 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-27T18:10:46.655 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-11-27T18:10:47.227 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-27T18:10:47.353 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up dump (0.4b47-3) ... 2023-11-27T18:10:47.462 INFO:teuthology.orchestra.run.smithi094.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-27T18:10:47.529 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-27T18:10:47.680 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-27T18:10:47.806 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up tcl (8.6.11+1build2) ... 2023-11-27T18:10:47.916 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libjson-perl (4.04000-1) ... 2023-11-27T18:10:48.018 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-11-27T18:10:48.089 INFO:teuthology.orchestra.run.smithi094.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-11-27T18:10:48.160 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-27T18:10:48.285 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-27T18:10:48.462 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-27T18:10:48.588 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-27T18:10:48.713 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-11-27T18:10:48.882 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up postgresql-client (14+238) ... 2023-11-27T18:10:48.991 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-11-27T18:10:49.452 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-11-27T18:10:49.452 INFO:teuthology.orchestra.run.smithi094.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-27T18:10:49.452 INFO:teuthology.orchestra.run.smithi094.stdout:which means they are currently configured by ifupdown: 2023-11-27T18:10:49.452 INFO:teuthology.orchestra.run.smithi094.stdout:- enp3s0f1 2023-11-27T18:10:49.452 INFO:teuthology.orchestra.run.smithi094.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-27T18:10:49.452 INFO:teuthology.orchestra.run.smithi094.stdout:remove their configuration from /etc/network/interfaces. 2023-11-27T18:10:49.452 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-11-27T18:10:49.566 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-27T18:10:49.907 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-27T18:10:50.258 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-27T18:10:50.835 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-27T18:10:50.978 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-27T18:10:51.095 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-11-27T18:10:51.213 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up postgresql-common (238) ... 2023-11-27T18:10:52.121 INFO:teuthology.orchestra.run.smithi094.stdout:Adding user postgres to group ssl-cert 2023-11-27T18:10:52.347 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-11-27T18:10:52.347 INFO:teuthology.orchestra.run.smithi094.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-27T18:10:52.542 INFO:teuthology.orchestra.run.smithi094.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-27T18:10:52.542 INFO:teuthology.orchestra.run.smithi094.stdout:Removing obsolete dictionary files: 2023-11-27T18:10:53.161 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-27T18:10:53.597 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-27T18:10:53.938 INFO:teuthology.orchestra.run.smithi094.stdout:Creating new PostgreSQL cluster 14/main ... 2023-11-27T18:10:53.953 INFO:teuthology.orchestra.run.smithi094.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-11-27T18:10:53.997 INFO:teuthology.orchestra.run.smithi094.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-27T18:10:53.997 INFO:teuthology.orchestra.run.smithi094.stdout:This user must also own the server process. 2023-11-27T18:10:53.997 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-11-27T18:10:53.997 INFO:teuthology.orchestra.run.smithi094.stdout:The database cluster will be initialized with locale "en_US". 2023-11-27T18:10:53.997 INFO:teuthology.orchestra.run.smithi094.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-27T18:10:53.997 INFO:teuthology.orchestra.run.smithi094.stdout:The default text search configuration will be set to "english". 2023-11-27T18:10:53.997 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-11-27T18:10:53.997 INFO:teuthology.orchestra.run.smithi094.stdout:Data page checksums are disabled. 2023-11-27T18:10:53.998 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-11-27T18:10:53.998 INFO:teuthology.orchestra.run.smithi094.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-11-27T18:10:53.998 INFO:teuthology.orchestra.run.smithi094.stdout:creating subdirectories ... ok 2023-11-27T18:10:53.998 INFO:teuthology.orchestra.run.smithi094.stdout:selecting dynamic shared memory implementation ... posix 2023-11-27T18:10:54.012 INFO:teuthology.orchestra.run.smithi094.stdout:selecting default max_connections ... 100 2023-11-27T18:10:54.032 INFO:teuthology.orchestra.run.smithi094.stdout:selecting default shared_buffers ... 128MB 2023-11-27T18:10:54.042 INFO:teuthology.orchestra.run.smithi094.stdout:selecting default time zone ... Etc/UTC 2023-11-27T18:10:54.043 INFO:teuthology.orchestra.run.smithi094.stdout:creating configuration files ... ok 2023-11-27T18:10:54.157 INFO:teuthology.orchestra.run.smithi094.stdout:running bootstrap script ... ok 2023-11-27T18:10:54.805 INFO:teuthology.orchestra.run.smithi094.stdout:performing post-bootstrap initialization ... ok 2023-11-27T18:10:55.567 INFO:teuthology.orchestra.run.smithi094.stdout:syncing data to disk ... ok 2023-11-27T18:10:55.998 INFO:teuthology.orchestra.run.smithi094.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-27T18:10:58.829 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-27T18:10:58.938 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up postgresql-contrib (14+238) ... 2023-11-27T18:10:59.064 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up postgresql (14+238) ... 2023-11-27T18:10:59.190 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-27T18:10:59.300 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-27T18:10:59.531 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-27T18:10:59.531 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-27T18:11:00.160 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-27T18:11:00.446 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-27T18:11:00.589 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-27T18:11:01.908 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-11-27T18:11:02.008 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-27T18:11:02.614 INFO:teuthology.orchestra.run.smithi094.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-27T18:11:02.618 DEBUG:teuthology.parallel:result is None 2023-11-27T18:11:02.619 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=369173db14b6995b2bd07c60ec5f63d01cf21631 2023-11-27T18:11:02.766 DEBUG:teuthology.orchestra.run.smithi091:> dpkg-query -W -f '${Version}' ceph 2023-11-27T18:11:02.786 INFO:teuthology.orchestra.run.smithi091.stdout:18.0.0-7498-g369173db-1jammy 2023-11-27T18:11:02.787 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7498-g369173db-1jammy 2023-11-27T18:11:02.787 INFO:teuthology.task.install:The correct ceph version 18.0.0-7498-g369173db-1jammy is installed. 2023-11-27T18:11:02.787 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=369173db14b6995b2bd07c60ec5f63d01cf21631 2023-11-27T18:11:03.006 DEBUG:teuthology.orchestra.run.smithi094:> dpkg-query -W -f '${Version}' ceph 2023-11-27T18:11:03.026 INFO:teuthology.orchestra.run.smithi094.stdout:18.0.0-7498-g369173db-1jammy 2023-11-27T18:11:03.026 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7498-g369173db-1jammy 2023-11-27T18:11:03.026 INFO:teuthology.task.install:The correct ceph version 18.0.0-7498-g369173db-1jammy is installed. 2023-11-27T18:11:03.026 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-27T18:11:03.027 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T18:11:03.027 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-27T18:11:03.040 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-11-27T18:11:03.040 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-27T18:11:03.082 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-27T18:11:03.082 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T18:11:03.082 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd of=/usr/bin/daemon-helper 2023-11-27T18:11:03.095 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-27T18:11:03.149 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-11-27T18:11:03.149 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/usr/bin/daemon-helper 2023-11-27T18:11:03.163 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-27T18:11:03.222 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-27T18:11:03.222 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T18:11:03.222 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-27T18:11:03.236 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-27T18:11:03.292 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-11-27T18:11:03.292 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-27T18:11:03.349 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-27T18:11:03.409 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-27T18:11:03.409 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T18:11:03.409 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd of=/usr/bin/stdin-killer 2023-11-27T18:11:03.424 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-27T18:11:03.484 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-11-27T18:11:03.485 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/usr/bin/stdin-killer 2023-11-27T18:11:03.499 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-27T18:11:03.554 INFO:teuthology.run_tasks:Running task ceph... 2023-11-27T18:11:03.628 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-27T18:11:03.628 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod 777 /var/log/ceph 2023-11-27T18:11:03.631 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 777 /var/log/ceph 2023-11-27T18:11:03.643 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-27T18:11:03.644 DEBUG:teuthology.orchestra.run.smithi091:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-27T18:11:03.688 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-27T18:11:03.701 INFO:tasks.ceph:Creating extra log directories... 2023-11-27T18:11:03.702 DEBUG:teuthology.orchestra.run.smithi091:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-27T18:11:03.746 DEBUG:teuthology.orchestra.run.smithi094:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-27T18:11:03.769 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-27T18:11:03.770 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-27T18:11:03.770 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-27T18:11:03.770 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T18:11:03.770 DEBUG:teuthology.orchestra.run.smithi091:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-27T18:11:03.805 DEBUG:teuthology.orchestra.run.smithi091:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-27T18:11:03.877 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-11-27T18:11:03.877 DEBUG:teuthology.orchestra.run.smithi094:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-27T18:11:03.884 DEBUG:teuthology.orchestra.run.smithi094:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-27T18:11:03.965 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-27T18:11:03.965 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-27T18:11:03.965 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7467937', 'branch': 'wip-yuri10-testing-2023-11-22-1112', 'description': 'fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/valgrind}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7467937', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-yuri10-testing-2023-11-22-1112'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631', 'valgrind': {'exit_on_first_error': False, 'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'ceph-fuse': {'client.0': {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri10-testing-2023-11-22-1112', 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 8541, 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-yuri10-testing-2023-11-22-1112', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi091.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBKVdsiaKfK7JJRWmw0yxYjamAJInhD3MWIycbQ+vulPgVrKu4kAo0dhMzI1Ga0/Ctpp+DMJ+tgefRpK6crNKE0=', 'smithi094.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE2j367sZ/iH6ILWHVsfKU/p16P680VfV/kF7Gk3UXlGjFhS2L7n8rWr/ODyDwDq2P+YJDYM5ZB0XDVzlqsQVUU='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631', 'valgrind': {'exit_on_first_error': False, 'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}, 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/dbench.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '2442239d2653456406c25ae0c71b689c8f2657b6', 'timestamp': '2023-11-27_17:14:24', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-11-27T18:11:03.966 DEBUG:teuthology.orchestra.run.smithi091:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-27T18:11:03.969 DEBUG:teuthology.orchestra.run.smithi094:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-27T18:11:04.007 DEBUG:teuthology.orchestra.run.smithi091:> sudo install -d -m0777 -- /var/run/ceph 2023-11-27T18:11:04.020 DEBUG:teuthology.orchestra.run.smithi094:> sudo install -d -m0777 -- /var/run/ceph 2023-11-27T18:11:04.062 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T18:11:04.062 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/scratch_devs of=/dev/stdout 2023-11-27T18:11:04.079 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-27T18:11:04.079 DEBUG:teuthology.orchestra.run.smithi091:> stat /dev/vg_nvme/lv_1 2023-11-27T18:11:04.127 INFO:teuthology.orchestra.run.smithi091.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-27T18:11:04.127 INFO:teuthology.orchestra.run.smithi091.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-27T18:11:04.128 INFO:teuthology.orchestra.run.smithi091.stdout:Device: 5h/5d Inode: 879 Links: 1 2023-11-27T18:11:04.128 INFO:teuthology.orchestra.run.smithi091.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-27T18:11:04.128 INFO:teuthology.orchestra.run.smithi091.stdout:Access: 2023-11-27 17:55:24.737564537 +0000 2023-11-27T18:11:04.128 INFO:teuthology.orchestra.run.smithi091.stdout:Modify: 2023-11-27 17:55:24.349568002 +0000 2023-11-27T18:11:04.129 INFO:teuthology.orchestra.run.smithi091.stdout:Change: 2023-11-27 17:55:24.349568002 +0000 2023-11-27T18:11:04.129 INFO:teuthology.orchestra.run.smithi091.stdout: Birth: - 2023-11-27T18:11:04.129 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-27T18:11:04.183 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records in 2023-11-27T18:11:04.184 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records out 2023-11-27T18:11:04.184 INFO:teuthology.orchestra.run.smithi091.stderr:512 bytes copied, 0.000446727 s, 1.1 MB/s 2023-11-27T18:11:04.186 DEBUG:teuthology.orchestra.run.smithi091:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-27T18:11:04.232 DEBUG:teuthology.orchestra.run.smithi091:> stat /dev/vg_nvme/lv_2 2023-11-27T18:11:04.278 INFO:teuthology.orchestra.run.smithi091.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-27T18:11:04.278 INFO:teuthology.orchestra.run.smithi091.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-27T18:11:04.278 INFO:teuthology.orchestra.run.smithi091.stdout:Device: 5h/5d Inode: 900 Links: 1 2023-11-27T18:11:04.278 INFO:teuthology.orchestra.run.smithi091.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-27T18:11:04.279 INFO:teuthology.orchestra.run.smithi091.stdout:Access: 2023-11-27 17:55:25.333559213 +0000 2023-11-27T18:11:04.279 INFO:teuthology.orchestra.run.smithi091.stdout:Modify: 2023-11-27 17:55:24.993562250 +0000 2023-11-27T18:11:04.279 INFO:teuthology.orchestra.run.smithi091.stdout:Change: 2023-11-27 17:55:24.993562250 +0000 2023-11-27T18:11:04.279 INFO:teuthology.orchestra.run.smithi091.stdout: Birth: - 2023-11-27T18:11:04.279 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-27T18:11:04.334 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records in 2023-11-27T18:11:04.334 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records out 2023-11-27T18:11:04.335 INFO:teuthology.orchestra.run.smithi091.stderr:512 bytes copied, 0.000415606 s, 1.2 MB/s 2023-11-27T18:11:04.335 DEBUG:teuthology.orchestra.run.smithi091:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-27T18:11:04.384 DEBUG:teuthology.orchestra.run.smithi091:> stat /dev/vg_nvme/lv_3 2023-11-27T18:11:04.430 INFO:teuthology.orchestra.run.smithi091.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-27T18:11:04.431 INFO:teuthology.orchestra.run.smithi091.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-27T18:11:04.431 INFO:teuthology.orchestra.run.smithi091.stdout:Device: 5h/5d Inode: 919 Links: 1 2023-11-27T18:11:04.431 INFO:teuthology.orchestra.run.smithi091.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-27T18:11:04.431 INFO:teuthology.orchestra.run.smithi091.stdout:Access: 2023-11-27 17:55:25.981553425 +0000 2023-11-27T18:11:04.431 INFO:teuthology.orchestra.run.smithi091.stdout:Modify: 2023-11-27 17:55:25.561557176 +0000 2023-11-27T18:11:04.431 INFO:teuthology.orchestra.run.smithi091.stdout:Change: 2023-11-27 17:55:25.561557176 +0000 2023-11-27T18:11:04.431 INFO:teuthology.orchestra.run.smithi091.stdout: Birth: - 2023-11-27T18:11:04.431 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-27T18:11:04.485 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records in 2023-11-27T18:11:04.485 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records out 2023-11-27T18:11:04.485 INFO:teuthology.orchestra.run.smithi091.stderr:512 bytes copied, 0.000424283 s, 1.2 MB/s 2023-11-27T18:11:04.486 DEBUG:teuthology.orchestra.run.smithi091:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-27T18:11:04.540 DEBUG:teuthology.orchestra.run.smithi091:> stat /dev/vg_nvme/lv_4 2023-11-27T18:11:04.586 INFO:teuthology.orchestra.run.smithi091.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-27T18:11:04.586 INFO:teuthology.orchestra.run.smithi091.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-27T18:11:04.587 INFO:teuthology.orchestra.run.smithi091.stdout:Device: 5h/5d Inode: 936 Links: 1 2023-11-27T18:11:04.587 INFO:teuthology.orchestra.run.smithi091.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-27T18:11:04.587 INFO:teuthology.orchestra.run.smithi091.stdout:Access: 2023-11-27 17:55:26.601547887 +0000 2023-11-27T18:11:04.587 INFO:teuthology.orchestra.run.smithi091.stdout:Modify: 2023-11-27 17:55:26.241551103 +0000 2023-11-27T18:11:04.587 INFO:teuthology.orchestra.run.smithi091.stdout:Change: 2023-11-27 17:55:26.241551103 +0000 2023-11-27T18:11:04.587 INFO:teuthology.orchestra.run.smithi091.stdout: Birth: - 2023-11-27T18:11:04.587 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-27T18:11:04.641 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records in 2023-11-27T18:11:04.641 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records out 2023-11-27T18:11:04.641 INFO:teuthology.orchestra.run.smithi091.stderr:512 bytes copied, 0.000317455 s, 1.6 MB/s 2023-11-27T18:11:04.642 DEBUG:teuthology.orchestra.run.smithi091:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-27T18:11:04.692 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-27T18:11:04.692 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-11-27T18:11:04.692 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/scratch_devs of=/dev/stdout 2023-11-27T18:11:04.698 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-27T18:11:04.698 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_1 2023-11-27T18:11:04.746 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-27T18:11:04.746 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-27T18:11:04.747 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 5h/5d Inode: 883 Links: 1 2023-11-27T18:11:04.747 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-27T18:11:04.747 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2023-11-27 17:55:17.062375786 +0000 2023-11-27T18:11:04.747 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2023-11-27 17:55:16.730378747 +0000 2023-11-27T18:11:04.747 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2023-11-27 17:55:16.730378747 +0000 2023-11-27T18:11:04.747 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: - 2023-11-27T18:11:04.747 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-27T18:11:04.800 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2023-11-27T18:11:04.801 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2023-11-27T18:11:04.801 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.000311085 s, 1.6 MB/s 2023-11-27T18:11:04.802 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-27T18:11:04.852 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_2 2023-11-27T18:11:04.902 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-27T18:11:04.902 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-27T18:11:04.902 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 5h/5d Inode: 898 Links: 1 2023-11-27T18:11:04.902 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-27T18:11:04.902 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2023-11-27 17:55:17.274373894 +0000 2023-11-27T18:11:04.902 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2023-11-27 17:55:17.270373930 +0000 2023-11-27T18:11:04.902 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2023-11-27 17:55:17.270373930 +0000 2023-11-27T18:11:04.902 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: - 2023-11-27T18:11:04.903 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-27T18:11:04.956 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2023-11-27T18:11:04.956 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2023-11-27T18:11:04.956 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.000312487 s, 1.6 MB/s 2023-11-27T18:11:04.957 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-27T18:11:05.008 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_3 2023-11-27T18:11:05.058 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-27T18:11:05.058 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-27T18:11:05.059 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 5h/5d Inode: 912 Links: 1 2023-11-27T18:11:05.059 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-27T18:11:05.059 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2023-11-27 17:55:18.250365187 +0000 2023-11-27T18:11:05.059 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2023-11-27 17:55:17.874368542 +0000 2023-11-27T18:11:05.060 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2023-11-27 17:55:17.874368542 +0000 2023-11-27T18:11:05.060 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: - 2023-11-27T18:11:05.060 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-27T18:11:05.116 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2023-11-27T18:11:05.116 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2023-11-27T18:11:05.116 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.000273765 s, 1.9 MB/s 2023-11-27T18:11:05.117 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-27T18:11:05.172 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_4 2023-11-27T18:11:05.218 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-27T18:11:05.218 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-27T18:11:05.218 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 5h/5d Inode: 935 Links: 1 2023-11-27T18:11:05.219 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-27T18:11:05.219 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2023-11-27 17:55:18.502362940 +0000 2023-11-27T18:11:05.219 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2023-11-27 17:55:18.498362975 +0000 2023-11-27T18:11:05.219 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2023-11-27 17:55:18.498362975 +0000 2023-11-27T18:11:05.219 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: - 2023-11-27T18:11:05.219 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-27T18:11:05.272 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2023-11-27T18:11:05.273 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2023-11-27T18:11:05.273 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.000310246 s, 1.7 MB/s 2023-11-27T18:11:05.274 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-27T18:11:05.323 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-27T18:11:05.324 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi091.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi094.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-27T18:11:05.324 INFO:tasks.ceph:Generating config... 2023-11-27T18:11:05.325 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-27T18:11:05.325 INFO:tasks.ceph:[client] debug client = 20 2023-11-27T18:11:05.325 INFO:tasks.ceph:[client] debug ms = 1 2023-11-27T18:11:05.325 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-27T18:11:05.325 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-27T18:11:05.325 INFO:tasks.ceph:[global] mds beacon grace = 60 2023-11-27T18:11:05.325 INFO:tasks.ceph:[global] mds heartbeat grace = 60 2023-11-27T18:11:05.326 INFO:tasks.ceph:[global] osd heartbeat grace = 60 2023-11-27T18:11:05.326 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-27T18:11:05.326 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-11-27T18:11:05.326 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-27T18:11:05.326 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-27T18:11:05.326 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-27T18:11:05.326 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-27T18:11:05.326 INFO:tasks.ceph:[mds] mds valgrind exit = True 2023-11-27T18:11:05.326 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-27T18:11:05.326 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-27T18:11:05.326 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-27T18:11:05.326 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-27T18:11:05.326 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-27T18:11:05.327 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-27T18:11:05.327 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-27T18:11:05.327 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-27T18:11:05.327 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-27T18:11:05.327 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-27T18:11:05.327 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2023-11-27T18:11:05.327 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-27T18:11:05.327 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2023-11-27T18:11:05.327 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-27T18:11:05.327 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-11-27T18:11:05.327 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-11-27T18:11:05.327 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-27T18:11:05.327 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-27T18:11:05.327 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-11-27T18:11:05.328 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-27T18:11:05.328 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-27T18:11:05.328 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-27T18:11:05.328 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-27T18:11:05.328 INFO:tasks.ceph:[osd] osd fast shutdown = False 2023-11-27T18:11:05.328 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-27T18:11:05.328 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-27T18:11:05.328 INFO:tasks.ceph:Setting up mon.a... 2023-11-27T18:11:05.328 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-27T18:11:05.363 INFO:teuthology.orchestra.run.smithi091.stdout:creating /etc/ceph/ceph.keyring 2023-11-27T18:11:05.383 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-27T18:11:05.459 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-27T18:11:05.514 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.91'), ('mon.b', '172.21.15.94'), ('mon.c', '[v2:172.21.15.94:3301,v1:172.21.15.94:6790]')] 2023-11-27T18:11:05.515 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.91,172.21.15.94,[v2:172.21.15.94:3301,v1:172.21.15.94:6790]', 'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-27T18:11:05.515 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T18:11:05.516 DEBUG:teuthology.orchestra.run.smithi091:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-27T18:11:05.564 DEBUG:teuthology.orchestra.run.smithi091:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.91 --add b 172.21.15.94 --addv c '[v2:172.21.15.94:3301,v1:172.21.15.94:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-27T18:11:05.648 INFO:teuthology.orchestra.run.smithi091.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-27T18:11:05.648 INFO:teuthology.orchestra.run.smithi091.stdout:monmaptool: generated fsid 08c8ebbf-7936-4c41-a995-d5600de2d072 2023-11-27T18:11:05.649 INFO:teuthology.orchestra.run.smithi091.stdout:setting min_mon_release = quincy 2023-11-27T18:11:05.649 INFO:teuthology.orchestra.run.smithi091.stdout:epoch 0 2023-11-27T18:11:05.649 INFO:teuthology.orchestra.run.smithi091.stdout:fsid 08c8ebbf-7936-4c41-a995-d5600de2d072 2023-11-27T18:11:05.649 INFO:teuthology.orchestra.run.smithi091.stdout:last_changed 2023-11-27T18:11:05.651898+0000 2023-11-27T18:11:05.650 INFO:teuthology.orchestra.run.smithi091.stdout:created 2023-11-27T18:11:05.651898+0000 2023-11-27T18:11:05.650 INFO:teuthology.orchestra.run.smithi091.stdout:min_mon_release 17 (quincy) 2023-11-27T18:11:05.650 INFO:teuthology.orchestra.run.smithi091.stdout:election_strategy: 1 2023-11-27T18:11:05.650 INFO:teuthology.orchestra.run.smithi091.stdout:0: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.a 2023-11-27T18:11:05.651 INFO:teuthology.orchestra.run.smithi091.stdout:1: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.b 2023-11-27T18:11:05.651 INFO:teuthology.orchestra.run.smithi091.stdout:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2023-11-27T18:11:05.651 INFO:teuthology.orchestra.run.smithi091.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-27T18:11:05.653 DEBUG:teuthology.orchestra.run.smithi091:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-27T18:11:05.699 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 08c8ebbf-7936-4c41-a995-d5600de2d072... 2023-11-27T18:11:05.700 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-27T18:11:05.744 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-27T18:11:05.772 INFO:teuthology.orchestra.run.smithi091.stdout:[global] 2023-11-27T18:11:05.772 INFO:teuthology.orchestra.run.smithi091.stdout: chdir = "" 2023-11-27T18:11:05.772 INFO:teuthology.orchestra.run.smithi091.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-27T18:11:05.772 INFO:teuthology.orchestra.run.smithi091.stdout: auth supported = cephx 2023-11-27T18:11:05.773 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:11:05.773 INFO:teuthology.orchestra.run.smithi091.stdout: filestore xattr use omap = true 2023-11-27T18:11:05.773 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:11:05.773 INFO:teuthology.orchestra.run.smithi091.stdout: mon clock drift allowed = 1.000 2023-11-27T18:11:05.773 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:11:05.773 INFO:teuthology.orchestra.run.smithi091.stdout: osd crush chooseleaf type = 0 2023-11-27T18:11:05.773 INFO:teuthology.orchestra.run.smithi091.stdout: auth debug = true 2023-11-27T18:11:05.773 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:11:05.773 INFO:teuthology.orchestra.run.smithi091.stdout: ms die on old message = true 2023-11-27T18:11:05.773 INFO:teuthology.orchestra.run.smithi091.stdout: ms die on bug = true 2023-11-27T18:11:05.773 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:11:05.773 INFO:teuthology.orchestra.run.smithi091.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-27T18:11:05.774 INFO:teuthology.orchestra.run.smithi091.stdout: mon pg warn max object skew = 0 2023-11-27T18:11:05.774 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:11:05.774 INFO:teuthology.orchestra.run.smithi091.stdout: # disable pg_autoscaler by default for new pools 2023-11-27T18:11:05.774 INFO:teuthology.orchestra.run.smithi091.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-27T18:11:05.774 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:11:05.774 INFO:teuthology.orchestra.run.smithi091.stdout: osd pool default size = 2 2023-11-27T18:11:05.774 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:11:05.774 INFO:teuthology.orchestra.run.smithi091.stdout: mon osd allow primary affinity = true 2023-11-27T18:11:05.774 INFO:teuthology.orchestra.run.smithi091.stdout: mon osd allow pg remap = true 2023-11-27T18:11:05.774 INFO:teuthology.orchestra.run.smithi091.stdout: mon warn on legacy crush tunables = false 2023-11-27T18:11:05.774 INFO:teuthology.orchestra.run.smithi091.stdout: mon warn on crush straw calc version zero = false 2023-11-27T18:11:05.774 INFO:teuthology.orchestra.run.smithi091.stdout: mon warn on no sortbitwise = false 2023-11-27T18:11:05.775 INFO:teuthology.orchestra.run.smithi091.stdout: mon warn on osd down out interval zero = false 2023-11-27T18:11:05.775 INFO:teuthology.orchestra.run.smithi091.stdout: mon warn on too few osds = false 2023-11-27T18:11:05.775 INFO:teuthology.orchestra.run.smithi091.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-27T18:11:05.775 INFO:teuthology.orchestra.run.smithi091.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-27T18:11:05.775 INFO:teuthology.orchestra.run.smithi091.stdout: mon_allow_pool_size_one = true 2023-11-27T18:11:05.775 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:11:05.775 INFO:teuthology.orchestra.run.smithi091.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-27T18:11:05.775 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:11:05.775 INFO:teuthology.orchestra.run.smithi091.stdout: osd default data pool replay window = 5 2023-11-27T18:11:05.775 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:11:05.775 INFO:teuthology.orchestra.run.smithi091.stdout: mon allow pool delete = true 2023-11-27T18:11:05.775 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:11:05.776 INFO:teuthology.orchestra.run.smithi091.stdout: mon cluster log file level = debug 2023-11-27T18:11:05.776 INFO:teuthology.orchestra.run.smithi091.stdout: debug asserts on shutdown = true 2023-11-27T18:11:05.776 INFO:teuthology.orchestra.run.smithi091.stdout: mon health detail to clog = false 2023-11-27T18:11:05.776 INFO:teuthology.orchestra.run.smithi091.stdout: mon host = "172.21.15.91,172.21.15.94,[v2:172.21.15.94:3301,v1:172.21.15.94:6790]" 2023-11-27T18:11:05.776 INFO:teuthology.orchestra.run.smithi091.stdout: mds beacon grace = 60 2023-11-27T18:11:05.776 INFO:teuthology.orchestra.run.smithi091.stdout: mds heartbeat grace = 60 2023-11-27T18:11:05.776 INFO:teuthology.orchestra.run.smithi091.stdout: osd heartbeat grace = 60 2023-11-27T18:11:05.776 INFO:teuthology.orchestra.run.smithi091.stdout: fsid = 08c8ebbf-7936-4c41-a995-d5600de2d072 2023-11-27T18:11:05.776 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:11:05.776 INFO:teuthology.orchestra.run.smithi091.stdout:[osd] 2023-11-27T18:11:05.776 INFO:teuthology.orchestra.run.smithi091.stdout: osd journal size = 100 2023-11-27T18:11:05.776 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:11:05.777 INFO:teuthology.orchestra.run.smithi091.stdout: osd scrub load threshold = 5.0 2023-11-27T18:11:05.777 INFO:teuthology.orchestra.run.smithi091.stdout: osd scrub max interval = 600 2023-11-27T18:11:05.777 INFO:teuthology.orchestra.run.smithi091.stdout: osd mclock profile = high_recovery_ops 2023-11-27T18:11:05.777 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:11:05.777 INFO:teuthology.orchestra.run.smithi091.stdout: osd recover clone overlap = true 2023-11-27T18:11:05.777 INFO:teuthology.orchestra.run.smithi091.stdout: osd recovery max chunk = 1048576 2023-11-27T18:11:05.777 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:11:05.777 INFO:teuthology.orchestra.run.smithi091.stdout: osd debug shutdown = true 2023-11-27T18:11:05.777 INFO:teuthology.orchestra.run.smithi091.stdout: osd debug op order = true 2023-11-27T18:11:05.777 INFO:teuthology.orchestra.run.smithi091.stdout: osd debug verify stray on activate = true 2023-11-27T18:11:05.777 INFO:teuthology.orchestra.run.smithi091.stdout: osd debug trim objects = true 2023-11-27T18:11:05.777 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:11:05.777 INFO:teuthology.orchestra.run.smithi091.stdout: osd open classes on start = true 2023-11-27T18:11:05.777 INFO:teuthology.orchestra.run.smithi091.stdout: osd debug pg log writeout = true 2023-11-27T18:11:05.778 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:11:05.778 INFO:teuthology.orchestra.run.smithi091.stdout: osd deep scrub update digest min age = 30 2023-11-27T18:11:05.778 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:11:05.778 INFO:teuthology.orchestra.run.smithi091.stdout: osd map max advance = 10 2023-11-27T18:11:05.778 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:11:05.778 INFO:teuthology.orchestra.run.smithi091.stdout: journal zero on create = true 2023-11-27T18:11:05.778 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:11:05.778 INFO:teuthology.orchestra.run.smithi091.stdout: filestore ondisk finisher threads = 3 2023-11-27T18:11:05.778 INFO:teuthology.orchestra.run.smithi091.stdout: filestore apply finisher threads = 3 2023-11-27T18:11:05.778 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:11:05.778 INFO:teuthology.orchestra.run.smithi091.stdout: bdev debug aio = true 2023-11-27T18:11:05.779 INFO:teuthology.orchestra.run.smithi091.stdout: osd debug misdirected ops = true 2023-11-27T18:11:05.779 INFO:teuthology.orchestra.run.smithi091.stdout: bluestore block size = 96636764160 2023-11-27T18:11:05.779 INFO:teuthology.orchestra.run.smithi091.stdout: bluestore compression mode = aggressive 2023-11-27T18:11:05.779 INFO:teuthology.orchestra.run.smithi091.stdout: bluestore fsck on mount = True 2023-11-27T18:11:05.779 INFO:teuthology.orchestra.run.smithi091.stdout: debug bluefs = 20 2023-11-27T18:11:05.779 INFO:teuthology.orchestra.run.smithi091.stdout: debug bluestore = 20 2023-11-27T18:11:05.779 INFO:teuthology.orchestra.run.smithi091.stdout: debug ms = 1 2023-11-27T18:11:05.779 INFO:teuthology.orchestra.run.smithi091.stdout: debug osd = 20 2023-11-27T18:11:05.779 INFO:teuthology.orchestra.run.smithi091.stdout: debug rocksdb = 10 2023-11-27T18:11:05.779 INFO:teuthology.orchestra.run.smithi091.stdout: mon osd backfillfull_ratio = 0.85 2023-11-27T18:11:05.779 INFO:teuthology.orchestra.run.smithi091.stdout: mon osd full ratio = 0.9 2023-11-27T18:11:05.780 INFO:teuthology.orchestra.run.smithi091.stdout: mon osd nearfull ratio = 0.8 2023-11-27T18:11:05.780 INFO:teuthology.orchestra.run.smithi091.stdout: osd failsafe full ratio = 0.95 2023-11-27T18:11:05.780 INFO:teuthology.orchestra.run.smithi091.stdout: osd fast shutdown = False 2023-11-27T18:11:05.780 INFO:teuthology.orchestra.run.smithi091.stdout: osd objectstore = bluestore 2023-11-27T18:11:05.780 INFO:teuthology.orchestra.run.smithi091.stdout: osd op complaint time = 180 2023-11-27T18:11:05.780 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:11:05.780 INFO:teuthology.orchestra.run.smithi091.stdout:[mgr] 2023-11-27T18:11:05.780 INFO:teuthology.orchestra.run.smithi091.stdout: debug ms = 1 2023-11-27T18:11:05.780 INFO:teuthology.orchestra.run.smithi091.stdout: debug mgr = 20 2023-11-27T18:11:05.780 INFO:teuthology.orchestra.run.smithi091.stdout: debug mon = 20 2023-11-27T18:11:05.780 INFO:teuthology.orchestra.run.smithi091.stdout: debug auth = 20 2023-11-27T18:11:05.780 INFO:teuthology.orchestra.run.smithi091.stdout: mon reweight min pgs per osd = 4 2023-11-27T18:11:05.781 INFO:teuthology.orchestra.run.smithi091.stdout: mon reweight min bytes per osd = 10 2023-11-27T18:11:05.781 INFO:teuthology.orchestra.run.smithi091.stdout: mgr/telemetry/nag = false 2023-11-27T18:11:05.781 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:11:05.781 INFO:teuthology.orchestra.run.smithi091.stdout:[mon] 2023-11-27T18:11:05.781 INFO:teuthology.orchestra.run.smithi091.stdout: debug ms = 1 2023-11-27T18:11:05.781 INFO:teuthology.orchestra.run.smithi091.stdout: debug mon = 20 2023-11-27T18:11:05.781 INFO:teuthology.orchestra.run.smithi091.stdout: debug paxos = 20 2023-11-27T18:11:05.781 INFO:teuthology.orchestra.run.smithi091.stdout: debug auth = 20 2023-11-27T18:11:05.781 INFO:teuthology.orchestra.run.smithi091.stdout: mon data avail warn = 5 2023-11-27T18:11:05.781 INFO:teuthology.orchestra.run.smithi091.stdout: mon mgr mkfs grace = 240 2023-11-27T18:11:05.781 INFO:teuthology.orchestra.run.smithi091.stdout: mon reweight min pgs per osd = 4 2023-11-27T18:11:05.782 INFO:teuthology.orchestra.run.smithi091.stdout: mon osd reporter subtree level = osd 2023-11-27T18:11:05.782 INFO:teuthology.orchestra.run.smithi091.stdout: mon osd prime pg temp = true 2023-11-27T18:11:05.782 INFO:teuthology.orchestra.run.smithi091.stdout: mon reweight min bytes per osd = 10 2023-11-27T18:11:05.782 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:11:05.782 INFO:teuthology.orchestra.run.smithi091.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-27T18:11:05.782 INFO:teuthology.orchestra.run.smithi091.stdout: auth mon ticket ttl = 660 # 11m 2023-11-27T18:11:05.782 INFO:teuthology.orchestra.run.smithi091.stdout: auth service ticket ttl = 240 # 4m 2023-11-27T18:11:05.782 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:11:05.782 INFO:teuthology.orchestra.run.smithi091.stdout: # don't complain about insecure global_id in the test suite 2023-11-27T18:11:05.782 INFO:teuthology.orchestra.run.smithi091.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-27T18:11:05.783 INFO:teuthology.orchestra.run.smithi091.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-27T18:11:05.783 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:11:05.783 INFO:teuthology.orchestra.run.smithi091.stdout: # 1m isn't quite enough 2023-11-27T18:11:05.783 INFO:teuthology.orchestra.run.smithi091.stdout: mon_down_mkfs_grace = 2m 2023-11-27T18:11:05.783 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:11:05.783 INFO:teuthology.orchestra.run.smithi091.stdout: mon_warn_on_filestore_osds = false 2023-11-27T18:11:05.783 INFO:teuthology.orchestra.run.smithi091.stdout: mon op complaint time = 120 2023-11-27T18:11:05.783 INFO:teuthology.orchestra.run.smithi091.stdout: mon osd crush smoke test = False 2023-11-27T18:11:05.783 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:11:05.783 INFO:teuthology.orchestra.run.smithi091.stdout:[client] 2023-11-27T18:11:05.784 INFO:teuthology.orchestra.run.smithi091.stdout: rgw cache enabled = true 2023-11-27T18:11:05.784 INFO:teuthology.orchestra.run.smithi091.stdout: rgw enable ops log = true 2023-11-27T18:11:05.784 INFO:teuthology.orchestra.run.smithi091.stdout: rgw enable usage log = true 2023-11-27T18:11:05.784 INFO:teuthology.orchestra.run.smithi091.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-27T18:11:05.784 INFO:teuthology.orchestra.run.smithi091.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-27T18:11:05.784 INFO:teuthology.orchestra.run.smithi091.stdout: client mount timeout = 600 2023-11-27T18:11:05.784 INFO:teuthology.orchestra.run.smithi091.stdout: debug client = 20 2023-11-27T18:11:05.784 INFO:teuthology.orchestra.run.smithi091.stdout: debug ms = 1 2023-11-27T18:11:05.784 INFO:teuthology.orchestra.run.smithi091.stdout: rados mon op timeout = 900 2023-11-27T18:11:05.785 INFO:teuthology.orchestra.run.smithi091.stdout: rados osd op timeout = 900 2023-11-27T18:11:05.785 INFO:teuthology.orchestra.run.smithi091.stdout:[mon.a] 2023-11-27T18:11:05.785 INFO:teuthology.orchestra.run.smithi091.stdout:[mon.b] 2023-11-27T18:11:05.785 INFO:teuthology.orchestra.run.smithi091.stdout:[mon.c] 2023-11-27T18:11:05.785 INFO:teuthology.orchestra.run.smithi091.stdout:[mds.a] 2023-11-27T18:11:05.785 INFO:teuthology.orchestra.run.smithi091.stdout:[mds.c] 2023-11-27T18:11:05.785 INFO:teuthology.orchestra.run.smithi091.stdout:[mds.e] 2023-11-27T18:11:05.785 INFO:teuthology.orchestra.run.smithi091.stdout:[mds.b] 2023-11-27T18:11:05.785 INFO:teuthology.orchestra.run.smithi091.stdout:[mds.d] 2023-11-27T18:11:05.785 INFO:teuthology.orchestra.run.smithi091.stdout:[mds.f] 2023-11-27T18:11:05.785 INFO:teuthology.orchestra.run.smithi091.stdout:[mds] 2023-11-27T18:11:05.786 INFO:teuthology.orchestra.run.smithi091.stdout: debug mds = 20 2023-11-27T18:11:05.786 INFO:teuthology.orchestra.run.smithi091.stdout: debug mds balancer = 20 2023-11-27T18:11:05.786 INFO:teuthology.orchestra.run.smithi091.stdout: debug ms = 1 2023-11-27T18:11:05.786 INFO:teuthology.orchestra.run.smithi091.stdout: mds debug frag = True 2023-11-27T18:11:05.786 INFO:teuthology.orchestra.run.smithi091.stdout: mds debug scatterstat = True 2023-11-27T18:11:05.786 INFO:teuthology.orchestra.run.smithi091.stdout: mds op complaint time = 180 2023-11-27T18:11:05.786 INFO:teuthology.orchestra.run.smithi091.stdout: mds valgrind exit = True 2023-11-27T18:11:05.786 INFO:teuthology.orchestra.run.smithi091.stdout: mds verify scatter = True 2023-11-27T18:11:05.786 INFO:teuthology.orchestra.run.smithi091.stdout: osd op complaint time = 180 2023-11-27T18:11:05.786 INFO:teuthology.orchestra.run.smithi091.stdout: rados mon op timeout = 900 2023-11-27T18:11:05.786 INFO:teuthology.orchestra.run.smithi091.stdout: rados osd op timeout = 900 2023-11-27T18:11:05.788 INFO:teuthology.orchestra.run.smithi094.stdout:[global] 2023-11-27T18:11:05.788 INFO:teuthology.orchestra.run.smithi094.stdout: chdir = "" 2023-11-27T18:11:05.788 INFO:teuthology.orchestra.run.smithi094.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-27T18:11:05.788 INFO:teuthology.orchestra.run.smithi094.stdout: auth supported = cephx 2023-11-27T18:11:05.789 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-11-27T18:11:05.789 INFO:teuthology.orchestra.run.smithi094.stdout: filestore xattr use omap = true 2023-11-27T18:11:05.789 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-11-27T18:11:05.789 INFO:teuthology.orchestra.run.smithi094.stdout: mon clock drift allowed = 1.000 2023-11-27T18:11:05.789 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-11-27T18:11:05.789 INFO:teuthology.orchestra.run.smithi094.stdout: osd crush chooseleaf type = 0 2023-11-27T18:11:05.789 INFO:teuthology.orchestra.run.smithi094.stdout: auth debug = true 2023-11-27T18:11:05.789 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-11-27T18:11:05.789 INFO:teuthology.orchestra.run.smithi094.stdout: ms die on old message = true 2023-11-27T18:11:05.789 INFO:teuthology.orchestra.run.smithi094.stdout: ms die on bug = true 2023-11-27T18:11:05.789 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-11-27T18:11:05.789 INFO:teuthology.orchestra.run.smithi094.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-27T18:11:05.790 INFO:teuthology.orchestra.run.smithi094.stdout: mon pg warn max object skew = 0 2023-11-27T18:11:05.790 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-11-27T18:11:05.790 INFO:teuthology.orchestra.run.smithi094.stdout: # disable pg_autoscaler by default for new pools 2023-11-27T18:11:05.790 INFO:teuthology.orchestra.run.smithi094.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-27T18:11:05.790 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-11-27T18:11:05.790 INFO:teuthology.orchestra.run.smithi094.stdout: osd pool default size = 2 2023-11-27T18:11:05.790 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-11-27T18:11:05.790 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd allow primary affinity = true 2023-11-27T18:11:05.790 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd allow pg remap = true 2023-11-27T18:11:05.790 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on legacy crush tunables = false 2023-11-27T18:11:05.790 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on crush straw calc version zero = false 2023-11-27T18:11:05.790 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on no sortbitwise = false 2023-11-27T18:11:05.791 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on osd down out interval zero = false 2023-11-27T18:11:05.791 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on too few osds = false 2023-11-27T18:11:05.791 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-27T18:11:05.791 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-27T18:11:05.791 INFO:teuthology.orchestra.run.smithi094.stdout: mon_allow_pool_size_one = true 2023-11-27T18:11:05.791 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-11-27T18:11:05.791 INFO:teuthology.orchestra.run.smithi094.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-27T18:11:05.791 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-11-27T18:11:05.791 INFO:teuthology.orchestra.run.smithi094.stdout: osd default data pool replay window = 5 2023-11-27T18:11:05.791 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-11-27T18:11:05.791 INFO:teuthology.orchestra.run.smithi094.stdout: mon allow pool delete = true 2023-11-27T18:11:05.791 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-11-27T18:11:05.792 INFO:teuthology.orchestra.run.smithi094.stdout: mon cluster log file level = debug 2023-11-27T18:11:05.792 INFO:teuthology.orchestra.run.smithi094.stdout: debug asserts on shutdown = true 2023-11-27T18:11:05.792 INFO:teuthology.orchestra.run.smithi094.stdout: mon health detail to clog = false 2023-11-27T18:11:05.792 INFO:teuthology.orchestra.run.smithi094.stdout: mon host = "172.21.15.91,172.21.15.94,[v2:172.21.15.94:3301,v1:172.21.15.94:6790]" 2023-11-27T18:11:05.792 INFO:teuthology.orchestra.run.smithi094.stdout: mds beacon grace = 60 2023-11-27T18:11:05.792 INFO:teuthology.orchestra.run.smithi094.stdout: mds heartbeat grace = 60 2023-11-27T18:11:05.792 INFO:teuthology.orchestra.run.smithi094.stdout: osd heartbeat grace = 60 2023-11-27T18:11:05.792 INFO:teuthology.orchestra.run.smithi094.stdout: fsid = 08c8ebbf-7936-4c41-a995-d5600de2d072 2023-11-27T18:11:05.792 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-11-27T18:11:05.792 INFO:teuthology.orchestra.run.smithi094.stdout:[osd] 2023-11-27T18:11:05.792 INFO:teuthology.orchestra.run.smithi094.stdout: osd journal size = 100 2023-11-27T18:11:05.792 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-11-27T18:11:05.792 INFO:teuthology.orchestra.run.smithi094.stdout: osd scrub load threshold = 5.0 2023-11-27T18:11:05.793 INFO:teuthology.orchestra.run.smithi094.stdout: osd scrub max interval = 600 2023-11-27T18:11:05.793 INFO:teuthology.orchestra.run.smithi094.stdout: osd mclock profile = high_recovery_ops 2023-11-27T18:11:05.793 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-11-27T18:11:05.793 INFO:teuthology.orchestra.run.smithi094.stdout: osd recover clone overlap = true 2023-11-27T18:11:05.793 INFO:teuthology.orchestra.run.smithi094.stdout: osd recovery max chunk = 1048576 2023-11-27T18:11:05.793 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-11-27T18:11:05.793 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug shutdown = true 2023-11-27T18:11:05.793 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug op order = true 2023-11-27T18:11:05.793 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug verify stray on activate = true 2023-11-27T18:11:05.793 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug trim objects = true 2023-11-27T18:11:05.793 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-11-27T18:11:05.793 INFO:teuthology.orchestra.run.smithi094.stdout: osd open classes on start = true 2023-11-27T18:11:05.793 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug pg log writeout = true 2023-11-27T18:11:05.793 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-11-27T18:11:05.794 INFO:teuthology.orchestra.run.smithi094.stdout: osd deep scrub update digest min age = 30 2023-11-27T18:11:05.794 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-11-27T18:11:05.794 INFO:teuthology.orchestra.run.smithi094.stdout: osd map max advance = 10 2023-11-27T18:11:05.794 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-11-27T18:11:05.794 INFO:teuthology.orchestra.run.smithi094.stdout: journal zero on create = true 2023-11-27T18:11:05.794 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-11-27T18:11:05.794 INFO:teuthology.orchestra.run.smithi094.stdout: filestore ondisk finisher threads = 3 2023-11-27T18:11:05.794 INFO:teuthology.orchestra.run.smithi094.stdout: filestore apply finisher threads = 3 2023-11-27T18:11:05.794 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-11-27T18:11:05.794 INFO:teuthology.orchestra.run.smithi094.stdout: bdev debug aio = true 2023-11-27T18:11:05.794 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug misdirected ops = true 2023-11-27T18:11:05.794 INFO:teuthology.orchestra.run.smithi094.stdout: bluestore block size = 96636764160 2023-11-27T18:11:05.794 INFO:teuthology.orchestra.run.smithi094.stdout: bluestore compression mode = aggressive 2023-11-27T18:11:05.794 INFO:teuthology.orchestra.run.smithi094.stdout: bluestore fsck on mount = True 2023-11-27T18:11:05.795 INFO:teuthology.orchestra.run.smithi094.stdout: debug bluefs = 20 2023-11-27T18:11:05.795 INFO:teuthology.orchestra.run.smithi094.stdout: debug bluestore = 20 2023-11-27T18:11:05.795 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2023-11-27T18:11:05.795 INFO:teuthology.orchestra.run.smithi094.stdout: debug osd = 20 2023-11-27T18:11:05.795 INFO:teuthology.orchestra.run.smithi094.stdout: debug rocksdb = 10 2023-11-27T18:11:05.795 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd backfillfull_ratio = 0.85 2023-11-27T18:11:05.795 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd full ratio = 0.9 2023-11-27T18:11:05.795 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd nearfull ratio = 0.8 2023-11-27T18:11:05.795 INFO:teuthology.orchestra.run.smithi094.stdout: osd failsafe full ratio = 0.95 2023-11-27T18:11:05.795 INFO:teuthology.orchestra.run.smithi094.stdout: osd fast shutdown = False 2023-11-27T18:11:05.795 INFO:teuthology.orchestra.run.smithi094.stdout: osd objectstore = bluestore 2023-11-27T18:11:05.795 INFO:teuthology.orchestra.run.smithi094.stdout: osd op complaint time = 180 2023-11-27T18:11:05.795 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-11-27T18:11:05.795 INFO:teuthology.orchestra.run.smithi094.stdout:[mgr] 2023-11-27T18:11:05.796 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2023-11-27T18:11:05.796 INFO:teuthology.orchestra.run.smithi094.stdout: debug mgr = 20 2023-11-27T18:11:05.796 INFO:teuthology.orchestra.run.smithi094.stdout: debug mon = 20 2023-11-27T18:11:05.796 INFO:teuthology.orchestra.run.smithi094.stdout: debug auth = 20 2023-11-27T18:11:05.796 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min pgs per osd = 4 2023-11-27T18:11:05.796 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min bytes per osd = 10 2023-11-27T18:11:05.796 INFO:teuthology.orchestra.run.smithi094.stdout: mgr/telemetry/nag = false 2023-11-27T18:11:05.796 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-11-27T18:11:05.796 INFO:teuthology.orchestra.run.smithi094.stdout:[mon] 2023-11-27T18:11:05.796 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2023-11-27T18:11:05.796 INFO:teuthology.orchestra.run.smithi094.stdout: debug mon = 20 2023-11-27T18:11:05.796 INFO:teuthology.orchestra.run.smithi094.stdout: debug paxos = 20 2023-11-27T18:11:05.796 INFO:teuthology.orchestra.run.smithi094.stdout: debug auth = 20 2023-11-27T18:11:05.797 INFO:teuthology.orchestra.run.smithi094.stdout: mon data avail warn = 5 2023-11-27T18:11:05.797 INFO:teuthology.orchestra.run.smithi094.stdout: mon mgr mkfs grace = 240 2023-11-27T18:11:05.797 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min pgs per osd = 4 2023-11-27T18:11:05.797 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd reporter subtree level = osd 2023-11-27T18:11:05.797 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd prime pg temp = true 2023-11-27T18:11:05.797 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min bytes per osd = 10 2023-11-27T18:11:05.797 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-11-27T18:11:05.797 INFO:teuthology.orchestra.run.smithi094.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-27T18:11:05.797 INFO:teuthology.orchestra.run.smithi094.stdout: auth mon ticket ttl = 660 # 11m 2023-11-27T18:11:05.797 INFO:teuthology.orchestra.run.smithi094.stdout: auth service ticket ttl = 240 # 4m 2023-11-27T18:11:05.797 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-11-27T18:11:05.797 INFO:teuthology.orchestra.run.smithi094.stdout: # don't complain about insecure global_id in the test suite 2023-11-27T18:11:05.798 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-27T18:11:05.798 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-27T18:11:05.798 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-11-27T18:11:05.798 INFO:teuthology.orchestra.run.smithi094.stdout: # 1m isn't quite enough 2023-11-27T18:11:05.798 INFO:teuthology.orchestra.run.smithi094.stdout: mon_down_mkfs_grace = 2m 2023-11-27T18:11:05.798 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-11-27T18:11:05.798 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_filestore_osds = false 2023-11-27T18:11:05.798 INFO:teuthology.orchestra.run.smithi094.stdout: mon op complaint time = 120 2023-11-27T18:11:05.798 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd crush smoke test = False 2023-11-27T18:11:05.798 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-11-27T18:11:05.798 INFO:teuthology.orchestra.run.smithi094.stdout:[client] 2023-11-27T18:11:05.798 INFO:teuthology.orchestra.run.smithi094.stdout: rgw cache enabled = true 2023-11-27T18:11:05.798 INFO:teuthology.orchestra.run.smithi094.stdout: rgw enable ops log = true 2023-11-27T18:11:05.799 INFO:teuthology.orchestra.run.smithi094.stdout: rgw enable usage log = true 2023-11-27T18:11:05.799 INFO:teuthology.orchestra.run.smithi094.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-27T18:11:05.799 INFO:teuthology.orchestra.run.smithi094.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-27T18:11:05.799 INFO:teuthology.orchestra.run.smithi094.stdout: client mount timeout = 600 2023-11-27T18:11:05.799 INFO:teuthology.orchestra.run.smithi094.stdout: debug client = 20 2023-11-27T18:11:05.799 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2023-11-27T18:11:05.799 INFO:teuthology.orchestra.run.smithi094.stdout: rados mon op timeout = 900 2023-11-27T18:11:05.799 INFO:teuthology.orchestra.run.smithi094.stdout: rados osd op timeout = 900 2023-11-27T18:11:05.799 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.a] 2023-11-27T18:11:05.799 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.b] 2023-11-27T18:11:05.799 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.c] 2023-11-27T18:11:05.799 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.a] 2023-11-27T18:11:05.799 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.c] 2023-11-27T18:11:05.800 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.e] 2023-11-27T18:11:05.800 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.b] 2023-11-27T18:11:05.800 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.d] 2023-11-27T18:11:05.800 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.f] 2023-11-27T18:11:05.800 INFO:teuthology.orchestra.run.smithi094.stdout:[mds] 2023-11-27T18:11:05.800 INFO:teuthology.orchestra.run.smithi094.stdout: debug mds = 20 2023-11-27T18:11:05.800 INFO:teuthology.orchestra.run.smithi094.stdout: debug mds balancer = 20 2023-11-27T18:11:05.800 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2023-11-27T18:11:05.800 INFO:teuthology.orchestra.run.smithi094.stdout: mds debug frag = True 2023-11-27T18:11:05.800 INFO:teuthology.orchestra.run.smithi094.stdout: mds debug scatterstat = True 2023-11-27T18:11:05.800 INFO:teuthology.orchestra.run.smithi094.stdout: mds op complaint time = 180 2023-11-27T18:11:05.800 INFO:teuthology.orchestra.run.smithi094.stdout: mds valgrind exit = True 2023-11-27T18:11:05.800 INFO:teuthology.orchestra.run.smithi094.stdout: mds verify scatter = True 2023-11-27T18:11:05.800 INFO:teuthology.orchestra.run.smithi094.stdout: osd op complaint time = 180 2023-11-27T18:11:05.801 INFO:teuthology.orchestra.run.smithi094.stdout: rados mon op timeout = 900 2023-11-27T18:11:05.801 INFO:teuthology.orchestra.run.smithi094.stdout: rados osd op timeout = 900 2023-11-27T18:11:05.801 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-27T18:11:05.801 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-27T18:11:05.877 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-27T18:11:05.877 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T18:11:05.877 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-27T18:11:05.882 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T18:11:05.882 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-27T18:11:05.930 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi091.front.sepia.ceph.com 2023-11-27T18:11:05.931 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T18:11:05.931 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-27T18:11:05.931 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-27T18:11:06.032 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T18:11:06.032 DEBUG:teuthology.orchestra.run.smithi091:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-27T18:11:06.078 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi094.front.sepia.ceph.com 2023-11-27T18:11:06.079 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-11-27T18:11:06.079 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-27T18:11:06.079 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-27T18:11:06.102 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-11-27T18:11:06.103 DEBUG:teuthology.orchestra.run.smithi094:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-27T18:11:06.151 INFO:tasks.ceph:Setting up mon nodes... 2023-11-27T18:11:06.151 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-27T18:11:06.151 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-27T18:11:06.194 INFO:teuthology.orchestra.run.smithi091.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-27T18:11:06.197 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-27T18:11:06.241 INFO:teuthology.orchestra.run.smithi094.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-27T18:11:06.256 INFO:tasks.ceph:Setting up mds nodes... 2023-11-27T18:11:06.256 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-27T18:11:06.299 INFO:teuthology.orchestra.run.smithi091.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-27T18:11:06.302 DEBUG:teuthology.orchestra.run.smithi091:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-27T18:11:06.359 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-11-27T18:11:06.443 INFO:teuthology.orchestra.run.smithi091.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-11-27T18:11:06.445 DEBUG:teuthology.orchestra.run.smithi091:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-11-27T18:11:06.507 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2023-11-27T18:11:06.588 INFO:teuthology.orchestra.run.smithi091.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2023-11-27T18:11:06.593 DEBUG:teuthology.orchestra.run.smithi091:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2023-11-27T18:11:06.650 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-27T18:11:06.696 INFO:teuthology.orchestra.run.smithi094.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-27T18:11:06.699 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-27T18:11:06.757 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-11-27T18:11:06.841 INFO:teuthology.orchestra.run.smithi094.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-11-27T18:11:06.844 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-11-27T18:11:06.897 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2023-11-27T18:11:06.979 INFO:teuthology.orchestra.run.smithi094.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2023-11-27T18:11:06.982 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2023-11-27T18:11:07.037 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-27T18:11:07.038 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-27T18:11:07.075 INFO:teuthology.orchestra.run.smithi091.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-27T18:11:07.086 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-27T18:11:07.086 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi091.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi094.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-27T18:11:07.087 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-27T18:11:07.143 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-27T18:11:07.143 INFO:tasks.ceph:role: osd.0 2023-11-27T18:11:07.143 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi091.front.sepia.ceph.com 2023-11-27T18:11:07.144 DEBUG:teuthology.orchestra.run.smithi091:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-27T18:11:07.205 INFO:teuthology.orchestra.run.smithi091.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-27T18:11:07.205 INFO:teuthology.orchestra.run.smithi091.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-27T18:11:07.205 INFO:teuthology.orchestra.run.smithi091.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-27T18:11:07.205 INFO:teuthology.orchestra.run.smithi091.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-27T18:11:07.206 INFO:teuthology.orchestra.run.smithi091.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-27T18:11:07.206 INFO:teuthology.orchestra.run.smithi091.stdout: = sunit=0 swidth=0 blks 2023-11-27T18:11:07.206 INFO:teuthology.orchestra.run.smithi091.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-27T18:11:07.206 INFO:teuthology.orchestra.run.smithi091.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-27T18:11:07.206 INFO:teuthology.orchestra.run.smithi091.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-27T18:11:07.206 INFO:teuthology.orchestra.run.smithi091.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-27T18:11:07.689 INFO:teuthology.orchestra.run.smithi091.stdout:Discarding blocks...Done. 2023-11-27T18:11:07.692 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi091.front.sepia.ceph.com -o noatime 2023-11-27T18:11:07.692 DEBUG:teuthology.orchestra.run.smithi091:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-27T18:11:07.837 DEBUG:teuthology.orchestra.run.smithi091:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-27T18:11:07.847 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T18:11:07.848 INFO:teuthology.orchestra.run.smithi091.stderr:sudo: /sbin/restorecon: command not found 2023-11-27T18:11:07.848 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-27T18:11:07.901 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-27T18:11:07.901 INFO:tasks.ceph:role: osd.1 2023-11-27T18:11:07.902 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi091.front.sepia.ceph.com 2023-11-27T18:11:07.902 DEBUG:teuthology.orchestra.run.smithi091:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-27T18:11:07.967 INFO:teuthology.orchestra.run.smithi091.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-27T18:11:07.967 INFO:teuthology.orchestra.run.smithi091.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-27T18:11:07.968 INFO:teuthology.orchestra.run.smithi091.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-27T18:11:07.968 INFO:teuthology.orchestra.run.smithi091.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-27T18:11:07.968 INFO:teuthology.orchestra.run.smithi091.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-27T18:11:07.968 INFO:teuthology.orchestra.run.smithi091.stdout: = sunit=0 swidth=0 blks 2023-11-27T18:11:07.968 INFO:teuthology.orchestra.run.smithi091.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-27T18:11:07.968 INFO:teuthology.orchestra.run.smithi091.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-27T18:11:07.968 INFO:teuthology.orchestra.run.smithi091.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-27T18:11:07.969 INFO:teuthology.orchestra.run.smithi091.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-27T18:11:08.396 INFO:teuthology.orchestra.run.smithi091.stdout:Discarding blocks...Done. 2023-11-27T18:11:08.398 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi091.front.sepia.ceph.com -o noatime 2023-11-27T18:11:08.399 DEBUG:teuthology.orchestra.run.smithi091:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-27T18:11:08.463 DEBUG:teuthology.orchestra.run.smithi091:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-27T18:11:08.514 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T18:11:08.515 INFO:teuthology.orchestra.run.smithi091.stderr:sudo: /sbin/restorecon: command not found 2023-11-27T18:11:08.516 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-27T18:11:08.568 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-27T18:11:08.568 INFO:tasks.ceph:role: osd.2 2023-11-27T18:11:08.568 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi091.front.sepia.ceph.com 2023-11-27T18:11:08.568 DEBUG:teuthology.orchestra.run.smithi091:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-27T18:11:08.629 INFO:teuthology.orchestra.run.smithi091.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-27T18:11:08.630 INFO:teuthology.orchestra.run.smithi091.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-27T18:11:08.630 INFO:teuthology.orchestra.run.smithi091.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-27T18:11:08.630 INFO:teuthology.orchestra.run.smithi091.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-27T18:11:08.630 INFO:teuthology.orchestra.run.smithi091.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-27T18:11:08.630 INFO:teuthology.orchestra.run.smithi091.stdout: = sunit=0 swidth=0 blks 2023-11-27T18:11:08.630 INFO:teuthology.orchestra.run.smithi091.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-27T18:11:08.630 INFO:teuthology.orchestra.run.smithi091.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-27T18:11:08.630 INFO:teuthology.orchestra.run.smithi091.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-27T18:11:08.631 INFO:teuthology.orchestra.run.smithi091.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-27T18:11:09.084 INFO:teuthology.orchestra.run.smithi091.stdout:Discarding blocks...Done. 2023-11-27T18:11:09.087 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi091.front.sepia.ceph.com -o noatime 2023-11-27T18:11:09.087 DEBUG:teuthology.orchestra.run.smithi091:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-27T18:11:09.180 DEBUG:teuthology.orchestra.run.smithi091:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-27T18:11:09.190 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T18:11:09.191 INFO:teuthology.orchestra.run.smithi091.stderr:sudo: /sbin/restorecon: command not found 2023-11-27T18:11:09.191 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-27T18:11:09.248 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-27T18:11:09.248 INFO:tasks.ceph:role: osd.3 2023-11-27T18:11:09.248 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi091.front.sepia.ceph.com 2023-11-27T18:11:09.249 DEBUG:teuthology.orchestra.run.smithi091:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-27T18:11:09.311 INFO:teuthology.orchestra.run.smithi091.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-27T18:11:09.311 INFO:teuthology.orchestra.run.smithi091.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-27T18:11:09.311 INFO:teuthology.orchestra.run.smithi091.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-27T18:11:09.311 INFO:teuthology.orchestra.run.smithi091.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-27T18:11:09.311 INFO:teuthology.orchestra.run.smithi091.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-27T18:11:09.311 INFO:teuthology.orchestra.run.smithi091.stdout: = sunit=0 swidth=0 blks 2023-11-27T18:11:09.311 INFO:teuthology.orchestra.run.smithi091.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-27T18:11:09.311 INFO:teuthology.orchestra.run.smithi091.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-27T18:11:09.312 INFO:teuthology.orchestra.run.smithi091.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-27T18:11:09.312 INFO:teuthology.orchestra.run.smithi091.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-27T18:11:09.777 INFO:teuthology.orchestra.run.smithi091.stdout:Discarding blocks...Done. 2023-11-27T18:11:09.779 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi091.front.sepia.ceph.com -o noatime 2023-11-27T18:11:09.779 DEBUG:teuthology.orchestra.run.smithi091:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-27T18:11:09.904 DEBUG:teuthology.orchestra.run.smithi091:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-27T18:11:09.914 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T18:11:09.914 INFO:teuthology.orchestra.run.smithi091.stderr:sudo: /sbin/restorecon: command not found 2023-11-27T18:11:09.915 DEBUG:teuthology.orchestra.run.smithi091:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-27T18:11:10.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:10.039+0000 7f93b9ecb640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-27T18:11:10.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:10.043+0000 7f93b9ecb640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-27T18:11:10.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:10.043+0000 7f93b9ecb640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-27T18:11:10.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:10.043+0000 7f93b9ecb640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-27T18:11:10.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:10.043+0000 7f93b9ecb640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-27T18:11:10.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:10.051+0000 7f93b9ecb640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-27T18:11:13.092 DEBUG:teuthology.orchestra.run.smithi091:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-27T18:11:13.106 DEBUG:teuthology.orchestra.run.smithi091:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-27T18:11:13.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:13.191+0000 7fda598f0640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-27T18:11:13.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:13.191+0000 7fda598f0640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-27T18:11:13.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:13.191+0000 7fda598f0640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-27T18:11:13.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:13.191+0000 7fda598f0640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-27T18:11:13.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:13.191+0000 7fda598f0640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-27T18:11:13.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:13.191+0000 7fda598f0640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-27T18:11:16.205 DEBUG:teuthology.orchestra.run.smithi091:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-27T18:11:16.258 DEBUG:teuthology.orchestra.run.smithi091:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-27T18:11:16.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:16.339+0000 7f640f831640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-27T18:11:16.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:16.339+0000 7f640f831640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-27T18:11:16.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:16.339+0000 7f640f831640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-27T18:11:16.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:16.343+0000 7f640f831640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-27T18:11:16.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:16.343+0000 7f640f831640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-27T18:11:16.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:16.343+0000 7f640f831640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-27T18:11:19.342 DEBUG:teuthology.orchestra.run.smithi091:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-27T18:11:19.399 DEBUG:teuthology.orchestra.run.smithi091:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-27T18:11:19.483 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:19.483+0000 7f339c51f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-27T18:11:19.483 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:19.483+0000 7f339c51f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-27T18:11:19.484 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:19.483+0000 7f339c51f640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-27T18:11:19.484 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:19.483+0000 7f339c51f640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-27T18:11:19.484 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:19.483+0000 7f339c51f640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-27T18:11:19.484 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:19.483+0000 7f339c51f640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-27T18:11:22.491 DEBUG:teuthology.orchestra.run.smithi091:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-27T18:11:22.546 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-27T18:11:22.560 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-27T18:11:22.560 INFO:tasks.ceph:role: osd.4 2023-11-27T18:11:22.560 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi094.front.sepia.ceph.com 2023-11-27T18:11:22.560 DEBUG:teuthology.orchestra.run.smithi094:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-27T18:11:22.614 INFO:teuthology.orchestra.run.smithi094.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-27T18:11:22.614 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-27T18:11:22.614 INFO:teuthology.orchestra.run.smithi094.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-27T18:11:22.615 INFO:teuthology.orchestra.run.smithi094.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-27T18:11:22.615 INFO:teuthology.orchestra.run.smithi094.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-27T18:11:22.615 INFO:teuthology.orchestra.run.smithi094.stdout: = sunit=0 swidth=0 blks 2023-11-27T18:11:22.615 INFO:teuthology.orchestra.run.smithi094.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-27T18:11:22.615 INFO:teuthology.orchestra.run.smithi094.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-27T18:11:22.615 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-27T18:11:22.615 INFO:teuthology.orchestra.run.smithi094.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-27T18:11:22.642 INFO:teuthology.orchestra.run.smithi094.stdout:Discarding blocks...Done. 2023-11-27T18:11:22.644 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi094.front.sepia.ceph.com -o noatime 2023-11-27T18:11:22.644 DEBUG:teuthology.orchestra.run.smithi094:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-27T18:11:22.701 DEBUG:teuthology.orchestra.run.smithi094:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-27T18:11:22.755 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T18:11:22.755 INFO:teuthology.orchestra.run.smithi094.stderr:sudo: /sbin/restorecon: command not found 2023-11-27T18:11:22.755 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-27T18:11:22.808 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-27T18:11:22.808 INFO:tasks.ceph:role: osd.5 2023-11-27T18:11:22.808 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi094.front.sepia.ceph.com 2023-11-27T18:11:22.808 DEBUG:teuthology.orchestra.run.smithi094:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-27T18:11:22.860 INFO:teuthology.orchestra.run.smithi094.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-27T18:11:22.860 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-27T18:11:22.861 INFO:teuthology.orchestra.run.smithi094.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-27T18:11:22.861 INFO:teuthology.orchestra.run.smithi094.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-27T18:11:22.861 INFO:teuthology.orchestra.run.smithi094.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-27T18:11:22.861 INFO:teuthology.orchestra.run.smithi094.stdout: = sunit=0 swidth=0 blks 2023-11-27T18:11:22.861 INFO:teuthology.orchestra.run.smithi094.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-27T18:11:22.861 INFO:teuthology.orchestra.run.smithi094.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-27T18:11:22.861 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-27T18:11:22.861 INFO:teuthology.orchestra.run.smithi094.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-27T18:11:22.897 INFO:teuthology.orchestra.run.smithi094.stdout:Discarding blocks...Done. 2023-11-27T18:11:22.898 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi094.front.sepia.ceph.com -o noatime 2023-11-27T18:11:22.898 DEBUG:teuthology.orchestra.run.smithi094:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-27T18:11:22.963 DEBUG:teuthology.orchestra.run.smithi094:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-27T18:11:23.017 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T18:11:23.017 INFO:teuthology.orchestra.run.smithi094.stderr:sudo: /sbin/restorecon: command not found 2023-11-27T18:11:23.017 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-27T18:11:23.078 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-27T18:11:23.078 INFO:tasks.ceph:role: osd.6 2023-11-27T18:11:23.078 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi094.front.sepia.ceph.com 2023-11-27T18:11:23.078 DEBUG:teuthology.orchestra.run.smithi094:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-27T18:11:23.135 INFO:teuthology.orchestra.run.smithi094.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-27T18:11:23.135 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-27T18:11:23.135 INFO:teuthology.orchestra.run.smithi094.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-27T18:11:23.135 INFO:teuthology.orchestra.run.smithi094.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-27T18:11:23.135 INFO:teuthology.orchestra.run.smithi094.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-27T18:11:23.136 INFO:teuthology.orchestra.run.smithi094.stdout: = sunit=0 swidth=0 blks 2023-11-27T18:11:23.136 INFO:teuthology.orchestra.run.smithi094.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-27T18:11:23.136 INFO:teuthology.orchestra.run.smithi094.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-27T18:11:23.136 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-27T18:11:23.136 INFO:teuthology.orchestra.run.smithi094.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-27T18:11:23.163 INFO:teuthology.orchestra.run.smithi094.stdout:Discarding blocks...Done. 2023-11-27T18:11:23.165 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi094.front.sepia.ceph.com -o noatime 2023-11-27T18:11:23.165 DEBUG:teuthology.orchestra.run.smithi094:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-27T18:11:23.224 DEBUG:teuthology.orchestra.run.smithi094:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-27T18:11:23.275 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T18:11:23.275 INFO:teuthology.orchestra.run.smithi094.stderr:sudo: /sbin/restorecon: command not found 2023-11-27T18:11:23.276 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-27T18:11:23.328 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-27T18:11:23.328 INFO:tasks.ceph:role: osd.7 2023-11-27T18:11:23.329 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi094.front.sepia.ceph.com 2023-11-27T18:11:23.329 DEBUG:teuthology.orchestra.run.smithi094:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-27T18:11:23.379 INFO:teuthology.orchestra.run.smithi094.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-27T18:11:23.380 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-27T18:11:23.380 INFO:teuthology.orchestra.run.smithi094.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-27T18:11:23.380 INFO:teuthology.orchestra.run.smithi094.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-27T18:11:23.380 INFO:teuthology.orchestra.run.smithi094.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-27T18:11:23.380 INFO:teuthology.orchestra.run.smithi094.stdout: = sunit=0 swidth=0 blks 2023-11-27T18:11:23.380 INFO:teuthology.orchestra.run.smithi094.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-27T18:11:23.380 INFO:teuthology.orchestra.run.smithi094.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-27T18:11:23.380 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-27T18:11:23.380 INFO:teuthology.orchestra.run.smithi094.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-27T18:11:23.412 INFO:teuthology.orchestra.run.smithi094.stdout:Discarding blocks...Done. 2023-11-27T18:11:23.413 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi094.front.sepia.ceph.com -o noatime 2023-11-27T18:11:23.414 DEBUG:teuthology.orchestra.run.smithi094:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-27T18:11:23.473 DEBUG:teuthology.orchestra.run.smithi094:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-27T18:11:23.522 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T18:11:23.523 INFO:teuthology.orchestra.run.smithi094.stderr:sudo: /sbin/restorecon: command not found 2023-11-27T18:11:23.523 DEBUG:teuthology.orchestra.run.smithi094:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-27T18:11:23.639 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:11:23.638+0000 7fbe7e09a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-27T18:11:23.639 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:11:23.638+0000 7fbe7e09a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-27T18:11:23.639 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:11:23.638+0000 7fbe7e09a640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-27T18:11:23.639 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:11:23.638+0000 7fbe7e09a640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-27T18:11:23.640 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:11:23.638+0000 7fbe7e09a640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-27T18:11:23.640 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:11:23.638+0000 7fbe7e09a640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-27T18:11:26.639 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-27T18:11:26.654 DEBUG:teuthology.orchestra.run.smithi094:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-27T18:11:26.741 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:11:26.738+0000 7f1a9be2e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-27T18:11:26.741 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:11:26.738+0000 7f1a9be2e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-27T18:11:26.741 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:11:26.738+0000 7f1a9be2e640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-27T18:11:26.742 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:11:26.738+0000 7f1a9be2e640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-27T18:11:26.742 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:11:26.738+0000 7f1a9be2e640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-27T18:11:26.742 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:11:26.738+0000 7f1a9be2e640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-27T18:11:29.758 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-27T18:11:29.814 DEBUG:teuthology.orchestra.run.smithi094:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-27T18:11:29.897 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:11:29.894+0000 7fae7e986640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-27T18:11:29.897 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:11:29.894+0000 7fae7e986640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-27T18:11:29.897 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:11:29.894+0000 7fae7e986640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-27T18:11:29.897 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:11:29.894+0000 7fae7e986640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-27T18:11:29.897 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:11:29.894+0000 7fae7e986640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-27T18:11:29.897 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:11:29.894+0000 7fae7e986640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-27T18:11:32.898 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-27T18:11:32.955 DEBUG:teuthology.orchestra.run.smithi094:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-27T18:11:33.039 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:11:33.038+0000 7f813607c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-27T18:11:33.039 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:11:33.038+0000 7f813607c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-27T18:11:33.039 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:11:33.038+0000 7f813607c640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-27T18:11:33.039 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:11:33.038+0000 7f813607c640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-27T18:11:33.039 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:11:33.038+0000 7f813607c640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-27T18:11:33.040 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:11:33.038+0000 7f813607c640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-27T18:11:33.967 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:11:33.970 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:11:36.050 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-27T18:11:36.063 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-27T18:11:36.063 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T18:11:36.063 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-27T18:11:36.078 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T18:11:36.078 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-27T18:11:36.134 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T18:11:36.135 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-11-27T18:11:36.190 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T18:11:36.190 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2023-11-27T18:11:36.246 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T18:11:36.246 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-27T18:11:36.301 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T18:11:36.301 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-27T18:11:36.356 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T18:11:36.357 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-27T18:11:36.409 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T18:11:36.409 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-27T18:11:36.461 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-11-27T18:11:36.461 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-27T18:11:36.475 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-11-27T18:11:36.475 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-27T18:11:36.530 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-11-27T18:11:36.530 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-11-27T18:11:36.585 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-11-27T18:11:36.585 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2023-11-27T18:11:36.639 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-11-27T18:11:36.639 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-27T18:11:36.693 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-11-27T18:11:36.693 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-27T18:11:36.750 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-11-27T18:11:36.750 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-27T18:11:36.804 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-11-27T18:11:36.805 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-27T18:11:36.858 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T18:11:36.858 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-27T18:11:36.864 INFO:tasks.ceph:Adding keys to all mons... 2023-11-27T18:11:36.864 DEBUG:teuthology.orchestra.run.smithi091:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-27T18:11:36.907 DEBUG:teuthology.orchestra.run.smithi094:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-27T18:11:36.917 INFO:teuthology.orchestra.run.smithi091.stdout:[mgr.y] 2023-11-27T18:11:36.917 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQC622RlRUnOCxAAGwCPI2YpHxeFUw4sg5gdwA== 2023-11-27T18:11:36.917 INFO:teuthology.orchestra.run.smithi091.stdout:[mds.a] 2023-11-27T18:11:36.917 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQC622RlEpcPEhAAqTnM9UALu29ABXqAH5HIPw== 2023-11-27T18:11:36.917 INFO:teuthology.orchestra.run.smithi091.stdout:[mds.c] 2023-11-27T18:11:36.917 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQC622RlloCkGhAAQsqVtt7aPUVt29Nl5P+iYA== 2023-11-27T18:11:36.917 INFO:teuthology.orchestra.run.smithi091.stdout:[mds.e] 2023-11-27T18:11:36.917 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQC622Rlh21IIxAAOLyyqqQ4mqtikc4zwlVGag== 2023-11-27T18:11:36.917 INFO:teuthology.orchestra.run.smithi091.stdout:[osd.0] 2023-11-27T18:11:36.917 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQC+22RlejiCAhAAddDG9BgyYwJM7KoZhyYaoQ== 2023-11-27T18:11:36.918 INFO:teuthology.orchestra.run.smithi091.stdout:[osd.1] 2023-11-27T18:11:36.918 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQDB22RlQG+UCxAA5v9N5xCwUfIbF3Q2agL6Hg== 2023-11-27T18:11:36.918 INFO:teuthology.orchestra.run.smithi091.stdout:[osd.2] 2023-11-27T18:11:36.918 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQDE22RloOyTFBAAmy7EXjmElUoifYWNIIcbtw== 2023-11-27T18:11:36.918 INFO:teuthology.orchestra.run.smithi091.stdout:[osd.3] 2023-11-27T18:11:36.918 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQDH22RlhdIFHRAABt9STA+qxIQ/lPkZUw6Iyg== 2023-11-27T18:11:36.918 INFO:teuthology.orchestra.run.smithi091.stdout:[mgr.x] 2023-11-27T18:11:36.918 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQC622Rl+DN0DhAAIblGFRbzCbunV+oxrrxYTQ== 2023-11-27T18:11:36.918 INFO:teuthology.orchestra.run.smithi091.stdout:[mds.b] 2023-11-27T18:11:36.918 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQC622RlDBaaKRAAkyLAXcLe8/ELpRAihXH5fg== 2023-11-27T18:11:36.918 INFO:teuthology.orchestra.run.smithi091.stdout:[mds.d] 2023-11-27T18:11:36.918 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQC622Rll3o/MhAArBb2HMn5QUBMXHR5fj3W/A== 2023-11-27T18:11:36.919 INFO:teuthology.orchestra.run.smithi091.stdout:[mds.f] 2023-11-27T18:11:36.919 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQC622RlRKxyOhAA6i8DABx5A+TWxvo82KJe0Q== 2023-11-27T18:11:36.919 INFO:teuthology.orchestra.run.smithi091.stdout:[osd.4] 2023-11-27T18:11:36.919 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQDL22RlcdcrJhAA4GHptNDQZaMmYzIqoOPsGw== 2023-11-27T18:11:36.919 INFO:teuthology.orchestra.run.smithi091.stdout:[osd.5] 2023-11-27T18:11:36.919 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQDO22Rli6I1LBAA5XBvYXCAtuAgjLiPAxiOAw== 2023-11-27T18:11:36.919 INFO:teuthology.orchestra.run.smithi091.stdout:[osd.6] 2023-11-27T18:11:36.919 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQDR22RlKbqDNRAAgXbqqkoZSSEDDKoIKNTSOw== 2023-11-27T18:11:36.919 INFO:teuthology.orchestra.run.smithi091.stdout:[osd.7] 2023-11-27T18:11:36.919 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQDV22Rli4hmAhAAjDDWCMnMVOBP6Q/wazVISw== 2023-11-27T18:11:36.919 INFO:teuthology.orchestra.run.smithi091.stdout:[client.0] 2023-11-27T18:11:36.919 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQC722RlJ/27BBAAZX+C4ImbnTFoeEacV6mZCQ== 2023-11-27T18:11:36.923 INFO:teuthology.orchestra.run.smithi094.stdout:[mgr.y] 2023-11-27T18:11:36.924 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQC622RlRUnOCxAAGwCPI2YpHxeFUw4sg5gdwA== 2023-11-27T18:11:36.924 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.a] 2023-11-27T18:11:36.924 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQC622RlEpcPEhAAqTnM9UALu29ABXqAH5HIPw== 2023-11-27T18:11:36.924 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.c] 2023-11-27T18:11:36.925 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQC622RlloCkGhAAQsqVtt7aPUVt29Nl5P+iYA== 2023-11-27T18:11:36.925 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.e] 2023-11-27T18:11:36.925 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQC622Rlh21IIxAAOLyyqqQ4mqtikc4zwlVGag== 2023-11-27T18:11:36.925 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.0] 2023-11-27T18:11:36.925 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQC+22RlejiCAhAAddDG9BgyYwJM7KoZhyYaoQ== 2023-11-27T18:11:36.925 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.1] 2023-11-27T18:11:36.925 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQDB22RlQG+UCxAA5v9N5xCwUfIbF3Q2agL6Hg== 2023-11-27T18:11:36.925 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.2] 2023-11-27T18:11:36.925 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQDE22RloOyTFBAAmy7EXjmElUoifYWNIIcbtw== 2023-11-27T18:11:36.925 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.3] 2023-11-27T18:11:36.925 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQDH22RlhdIFHRAABt9STA+qxIQ/lPkZUw6Iyg== 2023-11-27T18:11:36.926 INFO:teuthology.orchestra.run.smithi094.stdout:[mgr.x] 2023-11-27T18:11:36.926 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQC622Rl+DN0DhAAIblGFRbzCbunV+oxrrxYTQ== 2023-11-27T18:11:36.926 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.b] 2023-11-27T18:11:36.926 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQC622RlDBaaKRAAkyLAXcLe8/ELpRAihXH5fg== 2023-11-27T18:11:36.926 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.d] 2023-11-27T18:11:36.926 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQC622Rll3o/MhAArBb2HMn5QUBMXHR5fj3W/A== 2023-11-27T18:11:36.926 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.f] 2023-11-27T18:11:36.926 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQC622RlRKxyOhAA6i8DABx5A+TWxvo82KJe0Q== 2023-11-27T18:11:36.926 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.4] 2023-11-27T18:11:36.926 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQDL22RlcdcrJhAA4GHptNDQZaMmYzIqoOPsGw== 2023-11-27T18:11:36.926 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.5] 2023-11-27T18:11:36.926 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQDO22Rli6I1LBAA5XBvYXCAtuAgjLiPAxiOAw== 2023-11-27T18:11:36.926 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.6] 2023-11-27T18:11:36.927 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQDR22RlKbqDNRAAgXbqqkoZSSEDDKoIKNTSOw== 2023-11-27T18:11:36.927 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.7] 2023-11-27T18:11:36.927 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQDV22Rli4hmAhAAjDDWCMnMVOBP6Q/wazVISw== 2023-11-27T18:11:36.927 INFO:teuthology.orchestra.run.smithi094.stdout:[client.0] 2023-11-27T18:11:36.927 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQC722RlJ/27BBAAZX+C4ImbnTFoeEacV6mZCQ== 2023-11-27T18:11:36.927 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-27T18:11:36.967 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-27T18:11:37.012 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-27T18:11:37.059 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-27T18:11:37.106 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-27T18:11:37.151 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-27T18:11:37.200 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-27T18:11:37.202 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-27T18:11:37.243 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T18:11:37.287 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T18:11:37.326 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T18:11:37.368 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T18:11:37.409 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T18:11:37.447 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T18:11:37.488 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T18:11:37.535 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T18:11:37.579 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-27T18:11:37.615 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-27T18:11:37.660 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-27T18:11:37.699 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-27T18:11:37.743 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-27T18:11:37.783 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-27T18:11:37.834 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-27T18:11:37.836 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-27T18:11:37.883 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T18:11:37.919 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T18:11:37.970 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T18:11:38.003 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T18:11:38.061 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T18:11:38.088 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T18:11:38.142 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T18:11:38.167 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T18:11:38.225 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-27T18:11:38.251 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-27T18:11:38.311 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-27T18:11:38.312 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-27T18:11:38.325 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-27T18:11:38.422 DEBUG:teuthology.orchestra.run.smithi091:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-27T18:11:38.433 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-27T18:11:38.447 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-27T18:11:38.545 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-27T18:11:38.557 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-27T18:11:38.611 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-27T18:11:38.703 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-27T18:11:38.714 DEBUG:teuthology.orchestra.run.smithi091:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-27T18:11:38.716 DEBUG:teuthology.orchestra.run.smithi094:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-27T18:11:38.762 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-27T18:11:38.762 DEBUG:tasks.ceph_manager:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-11-27T18:11:38.762 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-27T18:11:38.763 DEBUG:teuthology.orchestra.run.smithi091:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2023-11-27T18:11:38.767 INFO:tasks.ceph.mon.a:Started 2023-11-27T18:11:38.767 DEBUG:tasks.ceph_manager:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-11-27T18:11:38.768 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-27T18:11:38.768 DEBUG:teuthology.orchestra.run.smithi094:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2023-11-27T18:11:38.807 INFO:tasks.ceph.mon.b:Started 2023-11-27T18:11:38.807 DEBUG:tasks.ceph_manager:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-11-27T18:11:38.807 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-27T18:11:38.807 DEBUG:teuthology.orchestra.run.smithi094:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2023-11-27T18:11:38.810 INFO:tasks.ceph.mon.c:Started 2023-11-27T18:11:38.810 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-27T18:11:38.810 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-27T18:11:38.810 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2023-11-27T18:11:38.812 INFO:tasks.ceph.mgr.y:Started 2023-11-27T18:11:38.813 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-27T18:11:38.813 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2023-11-27T18:11:38.815 INFO:tasks.ceph.mgr.x:Started 2023-11-27T18:11:38.815 INFO:tasks.ceph:Setting crush tunables to default 2023-11-27T18:11:38.815 DEBUG:teuthology.orchestra.run.smithi091:> sudo ceph --cluster ceph osd crush tunables default 2023-11-27T18:11:38.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:38.927+0000 7f812e26b640 1 Processor -- start 2023-11-27T18:11:38.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:38.927+0000 7f812e26b640 1 -- start start 2023-11-27T18:11:38.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:38.927+0000 7f812e26b640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f81280ccbe0 0x7f81280c7a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:11:38.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:38.927+0000 7f812e26b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f812806b6a0 0x7f81280c35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:11:38.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:38.927+0000 7f812e26b640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81280cd470 con 0x7f81280ccfc0 2023-11-27T18:11:38.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:38.927+0000 7f812e26b640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f812815a410 con 0x7f812806b6a0 2023-11-27T18:11:38.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:38.927+0000 7f812e26b640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81281594d0 con 0x7f81280ccbe0 2023-11-27T18:11:38.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:38.927+0000 7f81277fe640 1 -- >> v2:172.21.15.94:3300/0 conn(0x7f812806b6a0 msgr2=0x7f81280c35b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.94:3300/0 2023-11-27T18:11:38.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:38.927+0000 7f8127fff640 1 -- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f81280ccbe0 msgr2=0x7f81280c7a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.94:3301/0 2023-11-27T18:11:38.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:38.927+0000 7f812c808640 1 -- >> v1:172.21.15.94:6789/0 conn(0x7f81280ccfc0 legacy=0x7f812806bf50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.94:6789/0 2023-11-27T18:11:38.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:38.927+0000 7f81277fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f812806b6a0 0x7f81280c35b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-27T18:11:38.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:38.927+0000 7f8127fff640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f81280ccbe0 0x7f81280c7a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-27T18:11:39.130 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:39.131+0000 7f81277fe640 1 -- >> v2:172.21.15.94:3300/0 conn(0x7f812806b6a0 msgr2=0x7f81280c35b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.94:3300/0 2023-11-27T18:11:39.130 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:39.131+0000 7f8127fff640 1 -- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f81280ccbe0 msgr2=0x7f81280c7a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.94:3301/0 2023-11-27T18:11:39.130 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:39.131+0000 7f812c808640 1 -- >> v1:172.21.15.94:6789/0 conn(0x7f81280ccfc0 legacy=0x7f812806bf50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.94:6789/0 2023-11-27T18:11:39.131 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:39.131+0000 7f81277fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f812806b6a0 0x7f81280c35b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-27T18:11:39.131 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:39.131+0000 7f8127fff640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f81280ccbe0 0x7f81280c7a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-27T18:11:39.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:39.535+0000 7f81277fe640 1 -- >> v2:172.21.15.94:3300/0 conn(0x7f812806b6a0 msgr2=0x7f81280c35b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.94:3300/0 2023-11-27T18:11:39.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:39.535+0000 7f812c808640 1 -- >> v1:172.21.15.94:6789/0 conn(0x7f81280ccfc0 legacy=0x7f812806bf50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.94:6789/0 2023-11-27T18:11:39.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:39.535+0000 7f8127fff640 1 -- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f81280ccbe0 msgr2=0x7f81280c7a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.94:3301/0 2023-11-27T18:11:39.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:39.535+0000 7f81277fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f812806b6a0 0x7f81280c35b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-27T18:11:39.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:39.535+0000 7f8127fff640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f81280ccbe0 0x7f81280c7a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-27T18:11:40.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:40.339+0000 7f81277fe640 1 -- >> v2:172.21.15.94:3300/0 conn(0x7f812806b6a0 msgr2=0x7f81280c35b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.94:3300/0 2023-11-27T18:11:40.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:40.339+0000 7f8127fff640 1 -- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f81280ccbe0 msgr2=0x7f81280c7a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.94:3301/0 2023-11-27T18:11:40.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:40.339+0000 7f812c808640 1 -- >> v1:172.21.15.94:6789/0 conn(0x7f81280ccfc0 legacy=0x7f812806bf50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.94:6789/0 2023-11-27T18:11:40.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:40.339+0000 7f81277fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f812806b6a0 0x7f81280c35b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-27T18:11:40.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:40.339+0000 7f8127fff640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f81280ccbe0 0x7f81280c7a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-27T18:11:41.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:41.927+0000 7f8125ffb640 1 -- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f81280ccbe0 msgr2=0x7f81280c7a50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-27T18:11:41.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:41.927+0000 7f8125ffb640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f81280ccbe0 0x7f81280c7a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:11:41.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:41.927+0000 7f8125ffb640 1 -- >> v2:172.21.15.94:3300/0 conn(0x7f812806b6a0 msgr2=0x7f81280c35b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-27T18:11:41.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:41.927+0000 7f8125ffb640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f812806b6a0 0x7f81280c35b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:11:41.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:41.927+0000 7f8125ffb640 1 -- >> v1:172.21.15.94:6789/0 conn(0x7f81280ccfc0 legacy=0x7f812806bf50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-27T18:11:41.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:41.927+0000 7f8125ffb640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f81080036d0 0x7f8108005b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:11:41.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:41.927+0000 7f8125ffb640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8128159790 con 0x7f81080061a0 2023-11-27T18:11:41.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:41.927+0000 7f8125ffb640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f812815a410 con 0x7f81080036d0 2023-11-27T18:11:41.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:41.931+0000 7f8127fff640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7f81080036d0 msgr2=0x7f8108005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-27T18:11:41.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:41.931+0000 7f8127fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f81080036d0 0x7f8108005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-27T18:11:41.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:41.931+0000 7f81277fe640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7f81080061a0 legacy=0x7f8108008660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-27T18:11:42.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:42.135+0000 7f8127fff640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7f81080036d0 msgr2=0x7f8108005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-27T18:11:42.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:42.135+0000 7f81277fe640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7f81080061a0 legacy=0x7f8108008660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-27T18:11:42.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:42.135+0000 7f8127fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f81080036d0 0x7f8108005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-27T18:11:42.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:42.539+0000 7f8127fff640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7f81080036d0 msgr2=0x7f8108005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-27T18:11:42.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:42.539+0000 7f81277fe640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7f81080061a0 legacy=0x7f8108008660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-27T18:11:42.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:42.539+0000 7f8127fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f81080036d0 0x7f8108005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-27T18:11:43.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:43.343+0000 7f8127fff640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7f81080036d0 msgr2=0x7f8108005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-27T18:11:43.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:43.343+0000 7f81277fe640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7f81080061a0 legacy=0x7f8108008660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-27T18:11:43.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:43.343+0000 7f8127fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f81080036d0 0x7f8108005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-27T18:11:44.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:44.930+0000 7f8125ffb640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7f81080036d0 msgr2=0x7f8108005b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-27T18:11:44.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:44.930+0000 7f8125ffb640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f81080036d0 0x7f8108005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:11:44.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:44.930+0000 7f8125ffb640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7f81080061a0 legacy=0x7f8108008660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-27T18:11:44.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:44.930+0000 7f812c808640 1 -- reap_dead start 2023-11-27T18:11:44.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:44.930+0000 7f8125ffb640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f810800aa90 0x7f8108005b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:11:44.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:44.930+0000 7f8125ffb640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8108008790 0x7f810800d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:11:44.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:44.930+0000 7f8125ffb640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81280cd470 con 0x7f8108009f00 2023-11-27T18:11:44.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:44.930+0000 7f8125ffb640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f812815a410 con 0x7f810800aa90 2023-11-27T18:11:44.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:44.930+0000 7f8125ffb640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81281594d0 con 0x7f8108008790 2023-11-27T18:11:44.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:44.930+0000 7f8127fff640 1 -- >> v1:172.21.15.94:6789/0 conn(0x7f8108009f00 legacy=0x7f810800a2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.94:6789/0 2023-11-27T18:11:44.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:44.930+0000 7f81277fe640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7f810800aa90 msgr2=0x7f8108005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-27T18:11:44.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:44.930+0000 7f812c808640 1 -- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8108008790 msgr2=0x7f810800d0f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.94:3301/0 2023-11-27T18:11:44.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:44.930+0000 7f812c808640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8108008790 0x7f810800d0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-27T18:11:44.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:44.930+0000 7f81277fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f810800aa90 0x7f8108005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-27T18:11:45.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:45.134+0000 7f81277fe640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7f810800aa90 msgr2=0x7f8108005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-27T18:11:45.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:45.134+0000 7f81277fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f810800aa90 0x7f8108005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-27T18:11:45.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:45.134+0000 7f812c808640 1 -- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8108008790 msgr2=0x7f810800d0f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.94:3301/0 2023-11-27T18:11:45.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:45.134+0000 7f8127fff640 1 -- >> v1:172.21.15.94:6789/0 conn(0x7f8108009f00 legacy=0x7f810800a2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.94:6789/0 2023-11-27T18:11:45.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:45.134+0000 7f812c808640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8108008790 0x7f810800d0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-27T18:11:45.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:45.538+0000 7f81277fe640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7f810800aa90 msgr2=0x7f8108005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-27T18:11:45.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:45.538+0000 7f812c808640 1 -- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8108008790 msgr2=0x7f810800d0f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.94:3301/0 2023-11-27T18:11:45.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:45.538+0000 7f81277fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f810800aa90 0x7f8108005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-27T18:11:45.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:45.538+0000 7f8127fff640 1 -- >> v1:172.21.15.94:6789/0 conn(0x7f8108009f00 legacy=0x7f810800a2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.94:6789/0 2023-11-27T18:11:45.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:45.538+0000 7f812c808640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8108008790 0x7f810800d0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-27T18:11:46.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:46.342+0000 7f81277fe640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7f810800aa90 msgr2=0x7f8108005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-27T18:11:46.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:46.342+0000 7f812c808640 1 -- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8108008790 msgr2=0x7f810800d0f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.94:3301/0 2023-11-27T18:11:46.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:46.342+0000 7f81277fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f810800aa90 0x7f8108005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-27T18:11:46.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:46.342+0000 7f812c808640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8108008790 0x7f810800d0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-27T18:11:46.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:46.342+0000 7f8127fff640 1 -- >> v1:172.21.15.94:6789/0 conn(0x7f8108009f00 legacy=0x7f810800a2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.94:6789/0 2023-11-27T18:11:47.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:47.930+0000 7f8125ffb640 1 -- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8108008790 msgr2=0x7f810800d0f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-27T18:11:47.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:47.930+0000 7f8125ffb640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8108008790 0x7f810800d0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:11:47.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:47.930+0000 7f8125ffb640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7f810800aa90 msgr2=0x7f8108005b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-27T18:11:47.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:47.930+0000 7f8125ffb640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f810800aa90 0x7f8108005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:11:47.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:47.930+0000 7f8125ffb640 1 -- >> v1:172.21.15.94:6789/0 conn(0x7f8108009f00 legacy=0x7f810800a2e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-27T18:11:47.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:47.930+0000 7f8125ffb640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f810800d680 0x7f810800da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:11:47.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:47.930+0000 7f8125ffb640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8128159790 con 0x7f810800e160 2023-11-27T18:11:47.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:47.930+0000 7f8125ffb640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f812815a410 con 0x7f810800d680 2023-11-27T18:11:47.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:47.930+0000 7f81277fe640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7f810800e160 legacy=0x7f8108012830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-27T18:11:47.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:47.930+0000 7f8127fff640 1 -- >> v2:172.21.15.94:3300/0 conn(0x7f810800d680 msgr2=0x7f810800da90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.94:3300/0 2023-11-27T18:11:47.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:47.930+0000 7f8127fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f810800d680 0x7f810800da90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-27T18:11:48.135 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:48.134+0000 7f81277fe640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7f810800e160 legacy=0x7f8108012830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-27T18:11:48.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:48.134+0000 7f8127fff640 1 -- >> v2:172.21.15.94:3300/0 conn(0x7f810800d680 msgr2=0x7f810800da90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.94:3300/0 2023-11-27T18:11:48.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:48.134+0000 7f8127fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f810800d680 0x7f810800da90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-27T18:11:48.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:48.538+0000 7f81277fe640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7f810800e160 legacy=0x7f8108012830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-27T18:11:48.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:48.538+0000 7f8127fff640 1 -- >> v2:172.21.15.94:3300/0 conn(0x7f810800d680 msgr2=0x7f810800da90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.94:3300/0 2023-11-27T18:11:48.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:48.538+0000 7f8127fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f810800d680 0x7f810800da90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-27T18:11:48.664 INFO:tasks.ceph.mon.b.smithi094.stderr:==00:00:00:09.689 38305== Warning: unimplemented fcntl command: 1036 2023-11-27T18:11:48.667 INFO:tasks.ceph.mon.c.smithi094.stderr:==00:00:00:09.691 38307== Warning: unimplemented fcntl command: 1036 2023-11-27T18:11:48.686 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:00:09.766 38308== Warning: unimplemented fcntl command: 1036 2023-11-27T18:11:49.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:49.342+0000 7f81277fe640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7f810800e160 legacy=0x7f8108012830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-27T18:11:49.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:49.342+0000 7f8127fff640 1 -- >> v2:172.21.15.94:3300/0 conn(0x7f810800d680 msgr2=0x7f810800da90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.94:3300/0 2023-11-27T18:11:49.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:49.342+0000 7f8127fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f810800d680 0x7f810800da90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-27T18:11:49.500 INFO:tasks.ceph.mon.b.smithi094.stderr:==00:00:00:10.524 38305== Warning: unimplemented fcntl command: 1036 2023-11-27T18:11:49.501 INFO:tasks.ceph.mon.c.smithi094.stderr:==00:00:00:10.526 38307== Warning: unimplemented fcntl command: 1036 2023-11-27T18:11:49.511 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:00:10.591 38308== Warning: unimplemented fcntl command: 1036 2023-11-27T18:11:50.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:50.930+0000 7f8125ffb640 1 -- >> v2:172.21.15.94:3300/0 conn(0x7f810800d680 msgr2=0x7f810800da90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-27T18:11:50.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:50.930+0000 7f8125ffb640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f810800d680 0x7f810800da90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:11:50.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:50.930+0000 7f8125ffb640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7f810800e160 legacy=0x7f8108012830 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-27T18:11:50.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:50.930+0000 7f812c808640 1 -- reap_dead start 2023-11-27T18:11:50.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:50.930+0000 7f8125ffb640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8108008790 0x7f810800da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:11:50.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:50.930+0000 7f8125ffb640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81280cd470 con 0x7f810800a440 2023-11-27T18:11:50.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:50.930+0000 7f8125ffb640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8128159790 con 0x7f8108009f60 2023-11-27T18:11:50.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:50.930+0000 7f8125ffb640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f812815a410 con 0x7f8108008790 2023-11-27T18:11:50.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:50.930+0000 7f81277fe640 1 -- >> v1:172.21.15.94:6789/0 conn(0x7f8108009f60 legacy=0x7f8108008d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.94:6789/0 2023-11-27T18:11:50.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:50.930+0000 7f8127fff640 1 -- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8108008790 msgr2=0x7f810800da60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.94:3301/0 2023-11-27T18:11:50.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:50.930+0000 7f8127fff640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8108008790 0x7f810800da60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-27T18:11:50.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:50.930+0000 7f812c808640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7f810800a440 legacy=0x7f81080094a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-27T18:11:51.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:51.134+0000 7f812c808640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7f810800a440 legacy=0x7f81080094a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-27T18:11:51.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:51.134+0000 7f8127fff640 1 -- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8108008790 msgr2=0x7f810800da60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.94:3301/0 2023-11-27T18:11:51.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:51.134+0000 7f81277fe640 1 -- >> v1:172.21.15.94:6789/0 conn(0x7f8108009f60 legacy=0x7f8108008d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.94:6789/0 2023-11-27T18:11:51.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:51.134+0000 7f8127fff640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8108008790 0x7f810800da60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-27T18:11:51.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:51.538+0000 7f812c808640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7f810800a440 legacy=0x7f81080094a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-27T18:11:51.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:51.538+0000 7f81277fe640 1 -- >> v1:172.21.15.94:6789/0 conn(0x7f8108009f60 legacy=0x7f8108008d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.94:6789/0 2023-11-27T18:11:51.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:51.538+0000 7f8127fff640 1 -- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8108008790 msgr2=0x7f810800da60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.94:3301/0 2023-11-27T18:11:51.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:51.538+0000 7f8127fff640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8108008790 0x7f810800da60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-27T18:11:52.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:52.354+0000 7f8127fff640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8108008790 0x7f810800da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:11:52.355 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:52.354+0000 7f8127fff640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8108008790 0x7f810800da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.91:39860/0 (socket says 172.21.15.91:39860) 2023-11-27T18:11:52.355 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:52.354+0000 7f8127fff640 1 -- 172.21.15.91:0/3789206174 learned_addr learned my addr 172.21.15.91:0/3789206174 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:11:52.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:52.382+0000 7f8127fff640 1 -- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8108008790 msgr2=0x7f810800da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-27T18:11:52.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:52.382+0000 7f8127fff640 1 -- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8108008790 msgr2=0x7f810800da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T18:11:52.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:52.382+0000 7f8127fff640 1 --2- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8108008790 0x7f810800da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T18:11:52.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:52.382+0000 7f8127fff640 1 --2- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8108008790 0x7f810800da60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-27T18:11:53.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:53.930+0000 7f8125ffb640 1 -- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8108008790 msgr2=0x7f810800da60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-27T18:11:53.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:53.930+0000 7f8125ffb640 1 --2- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8108008790 0x7f810800da60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:11:53.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:53.930+0000 7f8125ffb640 1 -- 172.21.15.91:0/3789206174 >> v1:172.21.15.94:6789/0 conn(0x7f8108009f60 legacy=0x7f8108008d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:11:53.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:53.930+0000 7f8125ffb640 1 -- 172.21.15.91:0/3789206174 >> v1:172.21.15.91:6789/0 conn(0x7f810800a440 legacy=0x7f81080094a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:11:53.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:53.930+0000 7f8125ffb640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f810800d130 0x7f8108005ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:11:53.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:53.930+0000 7f8125ffb640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 0x7f8108015040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:11:53.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:53.930+0000 7f8125ffb640 1 -- 172.21.15.91:0/3789206174 --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f812815a410 con 0x7f810800d130 2023-11-27T18:11:53.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:53.930+0000 7f8125ffb640 1 -- 172.21.15.91:0/3789206174 --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81281594d0 con 0x7f8108010820 2023-11-27T18:11:53.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:53.958+0000 7f8127fff640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f810800d130 0x7f8108005ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:11:53.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:53.962+0000 7f8127fff640 1 -- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f810800d130 msgr2=0x7f8108005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-27T18:11:53.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:53.962+0000 7f8127fff640 1 -- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f810800d130 msgr2=0x7f8108005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T18:11:53.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:53.962+0000 7f8127fff640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f810800d130 0x7f8108005ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T18:11:53.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:53.962+0000 7f8127fff640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f810800d130 0x7f8108005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-27T18:11:54.017 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:54.014+0000 7f81277fe640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 0x7f8108015040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:11:54.018 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:54.018+0000 7f81277fe640 1 -- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 msgr2=0x7f8108015040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-27T18:11:54.018 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:54.018+0000 7f81277fe640 1 -- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 msgr2=0x7f8108015040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T18:11:54.018 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:54.018+0000 7f81277fe640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 0x7f8108015040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T18:11:54.018 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:54.018+0000 7f81277fe640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 0x7f8108015040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-27T18:11:54.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:54.166+0000 7f8127fff640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f810800d130 0x7f8108005ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:11:54.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:54.166+0000 7f8127fff640 1 -- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f810800d130 msgr2=0x7f8108005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-27T18:11:54.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:54.166+0000 7f8127fff640 1 -- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f810800d130 msgr2=0x7f8108005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T18:11:54.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:54.166+0000 7f8127fff640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f810800d130 0x7f8108005ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T18:11:54.170 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:54.170+0000 7f8127fff640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f810800d130 0x7f8108005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-27T18:11:54.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:54.222+0000 7f81277fe640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 0x7f8108015040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:11:54.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:54.230+0000 7f81277fe640 1 -- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 msgr2=0x7f8108015040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-27T18:11:54.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:54.230+0000 7f81277fe640 1 -- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 msgr2=0x7f8108015040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T18:11:54.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:54.230+0000 7f81277fe640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 0x7f8108015040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T18:11:54.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:54.230+0000 7f81277fe640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 0x7f8108015040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-27T18:11:54.574 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:54.574+0000 7f8127fff640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f810800d130 0x7f8108005ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:11:54.577 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:54.574+0000 7f8127fff640 1 -- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f810800d130 msgr2=0x7f8108005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-27T18:11:54.577 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:54.574+0000 7f8127fff640 1 -- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f810800d130 msgr2=0x7f8108005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T18:11:54.577 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:54.574+0000 7f8127fff640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f810800d130 0x7f8108005ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T18:11:54.577 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:54.574+0000 7f8127fff640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f810800d130 0x7f8108005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-27T18:11:54.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:54.638+0000 7f81277fe640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 0x7f8108015040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:11:54.642 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:54.642+0000 7f81277fe640 1 -- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 msgr2=0x7f8108015040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-27T18:11:54.642 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:54.642+0000 7f81277fe640 1 -- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 msgr2=0x7f8108015040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T18:11:54.642 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:54.642+0000 7f81277fe640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 0x7f8108015040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T18:11:54.642 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:54.642+0000 7f81277fe640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 0x7f8108015040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-27T18:11:55.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:55.378+0000 7f8127fff640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f810800d130 0x7f8108005ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:11:55.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:55.382+0000 7f8127fff640 1 -- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f810800d130 msgr2=0x7f8108005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-27T18:11:55.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:55.382+0000 7f8127fff640 1 -- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f810800d130 msgr2=0x7f8108005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T18:11:55.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:55.382+0000 7f8127fff640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f810800d130 0x7f8108005ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T18:11:55.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:55.382+0000 7f8127fff640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f810800d130 0x7f8108005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-27T18:11:55.447 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:55.446+0000 7f81277fe640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 0x7f8108015040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:11:55.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:55.450+0000 7f81277fe640 1 -- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 msgr2=0x7f8108015040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-27T18:11:55.451 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:55.450+0000 7f81277fe640 1 -- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 msgr2=0x7f8108015040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T18:11:55.451 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:55.450+0000 7f81277fe640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 0x7f8108015040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T18:11:55.451 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:55.450+0000 7f81277fe640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 0x7f8108015040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-27T18:11:56.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:56.930+0000 7f8125ffb640 1 -- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 msgr2=0x7f8108015040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-27T18:11:56.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:56.930+0000 7f8125ffb640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 0x7f8108015040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:11:56.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:56.930+0000 7f8125ffb640 1 -- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f810800d130 msgr2=0x7f8108005ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-27T18:11:56.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:56.930+0000 7f8125ffb640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f810800d130 0x7f8108005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:11:56.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:56.930+0000 7f8125ffb640 1 --2- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8108008790 0x7f810800da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:11:56.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:56.930+0000 7f812c808640 1 -- 172.21.15.91:0/3789206174 reap_dead start 2023-11-27T18:11:56.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:56.930+0000 7f8125ffb640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 0x7f8108015040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:11:56.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:56.930+0000 7f8125ffb640 1 -- 172.21.15.91:0/3789206174 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8108009bb0 con 0x7f810800a440 2023-11-27T18:11:56.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:56.930+0000 7f8125ffb640 1 -- 172.21.15.91:0/3789206174 --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f812815a410 con 0x7f8108010820 2023-11-27T18:11:56.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:56.930+0000 7f8125ffb640 1 -- 172.21.15.91:0/3789206174 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81281594d0 con 0x7f8108008790 2023-11-27T18:11:56.936 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:56.930+0000 7f8127fff640 1 --2- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8108008790 0x7f810800da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:11:56.936 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:56.930+0000 7f812c808640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 0x7f8108015040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:11:56.937 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:56.934+0000 7f8127fff640 1 -- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8108008790 msgr2=0x7f810800da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-27T18:11:56.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:56.934+0000 7f8127fff640 1 -- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8108008790 msgr2=0x7f810800da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T18:11:56.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:56.934+0000 7f8127fff640 1 --2- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8108008790 0x7f810800da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T18:11:56.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:56.934+0000 7f8127fff640 1 --2- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8108008790 0x7f810800da60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-27T18:11:56.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:56.934+0000 7f812c808640 1 -- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 msgr2=0x7f8108015040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-27T18:11:56.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:56.934+0000 7f812c808640 1 -- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 msgr2=0x7f8108015040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T18:11:56.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:56.934+0000 7f812c808640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 0x7f8108015040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T18:11:56.939 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:56.934+0000 7f812c808640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 0x7f8108015040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-27T18:11:57.139 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:57.138+0000 7f8127fff640 1 --2- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8108008790 0x7f810800da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:11:57.139 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:57.138+0000 7f812c808640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 0x7f8108015040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:11:57.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:57.138+0000 7f812c808640 1 -- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 msgr2=0x7f8108015040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-27T18:11:57.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:57.138+0000 7f812c808640 1 -- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 msgr2=0x7f8108015040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T18:11:57.142 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:57.138+0000 7f812c808640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 0x7f8108015040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T18:11:57.142 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:57.142+0000 7f812c808640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 0x7f8108015040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-27T18:11:57.142 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:57.142+0000 7f8127fff640 1 -- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8108008790 msgr2=0x7f810800da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-27T18:11:57.143 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:57.142+0000 7f8127fff640 1 -- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8108008790 msgr2=0x7f810800da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T18:11:57.143 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:57.142+0000 7f8127fff640 1 --2- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8108008790 0x7f810800da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T18:11:57.143 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:57.142+0000 7f8127fff640 1 --2- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8108008790 0x7f810800da60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-27T18:11:57.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:57.546+0000 7f8127fff640 1 --2- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8108008790 0x7f810800da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:11:57.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:57.546+0000 7f812c808640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 0x7f8108015040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:11:57.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:57.546+0000 7f8127fff640 1 -- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8108008790 msgr2=0x7f810800da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-27T18:11:57.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:57.546+0000 7f8127fff640 1 -- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8108008790 msgr2=0x7f810800da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T18:11:57.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:57.546+0000 7f8127fff640 1 --2- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8108008790 0x7f810800da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T18:11:57.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:57.546+0000 7f8127fff640 1 --2- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8108008790 0x7f810800da60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-27T18:11:57.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:57.550+0000 7f812c808640 1 -- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 msgr2=0x7f8108015040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-27T18:11:57.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:57.550+0000 7f812c808640 1 -- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 msgr2=0x7f8108015040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T18:11:57.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:57.550+0000 7f812c808640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 0x7f8108015040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T18:11:57.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:57.550+0000 7f812c808640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 0x7f8108015040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-27T18:11:58.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:58.350+0000 7f8127fff640 1 --2- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8108008790 0x7f810800da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:11:58.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:58.354+0000 7f8127fff640 1 -- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8108008790 msgr2=0x7f810800da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-27T18:11:58.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:58.354+0000 7f8127fff640 1 -- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8108008790 msgr2=0x7f810800da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T18:11:58.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:58.354+0000 7f8127fff640 1 --2- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8108008790 0x7f810800da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T18:11:58.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:58.354+0000 7f8127fff640 1 --2- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8108008790 0x7f810800da60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-27T18:11:58.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:58.354+0000 7f812c808640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 0x7f8108015040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:11:58.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:58.358+0000 7f812c808640 1 -- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 msgr2=0x7f8108015040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-27T18:11:58.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:58.358+0000 7f812c808640 1 -- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 msgr2=0x7f8108015040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T18:11:58.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:58.358+0000 7f812c808640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 0x7f8108015040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T18:11:58.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:58.358+0000 7f812c808640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 0x7f8108015040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-27T18:11:59.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:59.930+0000 7f8125ffb640 1 -- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8108008790 msgr2=0x7f810800da60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-27T18:11:59.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:59.930+0000 7f8125ffb640 1 --2- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8108008790 0x7f810800da60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:11:59.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:59.930+0000 7f8125ffb640 1 -- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 msgr2=0x7f8108015040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-27T18:11:59.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:59.930+0000 7f8125ffb640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 0x7f8108015040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:11:59.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:59.930+0000 7f8125ffb640 1 -- 172.21.15.91:0/3789206174 >> v1:172.21.15.91:6789/0 conn(0x7f810800a440 legacy=0x7f81080094a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:11:59.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:59.930+0000 7f8125ffb640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f8108005ac0 0x7f8108015580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:11:59.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:59.930+0000 7f8125ffb640 1 -- 172.21.15.91:0/3789206174 --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8108009f10 con 0x7f810800d130 2023-11-27T18:11:59.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:59.930+0000 7f8125ffb640 1 -- 172.21.15.91:0/3789206174 --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f812815a410 con 0x7f8108005ac0 2023-11-27T18:11:59.937 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:59.934+0000 7f81277fe640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f8108005ac0 0x7f8108015580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:11:59.943 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:59.938+0000 7f81277fe640 1 -- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f8108005ac0 msgr2=0x7f8108015580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-27T18:11:59.943 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:59.938+0000 7f81277fe640 1 -- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f8108005ac0 msgr2=0x7f8108015580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T18:11:59.943 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:59.938+0000 7f81277fe640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f8108005ac0 0x7f8108015580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T18:11:59.943 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:11:59.938+0000 7f81277fe640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f8108005ac0 0x7f8108015580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-27T18:12:00.144 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:00.142+0000 7f81277fe640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f8108005ac0 0x7f8108015580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:00.145 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:00.146+0000 7f81277fe640 1 -- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f8108005ac0 msgr2=0x7f8108015580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-27T18:12:00.145 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:00.146+0000 7f81277fe640 1 -- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f8108005ac0 msgr2=0x7f8108015580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T18:12:00.146 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:00.146+0000 7f81277fe640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f8108005ac0 0x7f8108015580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T18:12:00.146 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:00.146+0000 7f81277fe640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f8108005ac0 0x7f8108015580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-27T18:12:00.591 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:00.590+0000 7f81277fe640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f8108005ac0 0x7f8108015580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:00.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:00.610+0000 7f81277fe640 1 -- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f8108005ac0 msgr2=0x7f8108015580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-27T18:12:00.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:00.610+0000 7f81277fe640 1 -- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f8108005ac0 msgr2=0x7f8108015580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T18:12:00.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:00.610+0000 7f81277fe640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f8108005ac0 0x7f8108015580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T18:12:00.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:00.610+0000 7f81277fe640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f8108005ac0 0x7f8108015580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-27T18:12:01.415 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:01.414+0000 7f81277fe640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f8108005ac0 0x7f8108015580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:01.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:01.418+0000 7f81277fe640 1 -- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f8108005ac0 msgr2=0x7f8108015580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-27T18:12:01.419 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:01.418+0000 7f81277fe640 1 -- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f8108005ac0 msgr2=0x7f8108015580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T18:12:01.419 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:01.418+0000 7f81277fe640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f8108005ac0 0x7f8108015580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T18:12:01.419 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:01.418+0000 7f81277fe640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f8108005ac0 0x7f8108015580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-27T18:12:02.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:02.930+0000 7f8125ffb640 1 -- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f8108005ac0 msgr2=0x7f8108015580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-27T18:12:02.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:02.930+0000 7f8125ffb640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f8108005ac0 0x7f8108015580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:02.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:02.930+0000 7f8125ffb640 1 -- 172.21.15.91:0/3789206174 >> v1:172.21.15.94:6789/0 conn(0x7f810800d130 legacy=0x7f8108008d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:02.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:02.930+0000 7f8125ffb640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f8108005ac0 0x7f8108015580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:02.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:02.930+0000 7f812c808640 1 -- 172.21.15.91:0/3789206174 reap_dead start 2023-11-27T18:12:02.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:02.930+0000 7f8125ffb640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 0x7f8108015040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:02.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:02.930+0000 7f8125ffb640 1 -- 172.21.15.91:0/3789206174 --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f810800a0a0 con 0x7f8108015ac0 2023-11-27T18:12:02.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:02.930+0000 7f8125ffb640 1 -- 172.21.15.91:0/3789206174 --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f812815a410 con 0x7f8108005ac0 2023-11-27T18:12:02.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:02.930+0000 7f8125ffb640 1 -- 172.21.15.91:0/3789206174 --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81281594d0 con 0x7f8108010820 2023-11-27T18:12:02.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:02.934+0000 7f8127fff640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f8108005ac0 0x7f8108015580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:02.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:02.934+0000 7f812c808640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 0x7f8108015040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:02.936 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:02.934+0000 7f8127fff640 1 -- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f8108005ac0 msgr2=0x7f8108015580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-27T18:12:02.936 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:02.934+0000 7f8127fff640 1 -- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f8108005ac0 msgr2=0x7f8108015580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T18:12:02.936 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:02.934+0000 7f8127fff640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f8108005ac0 0x7f8108015580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T18:12:02.937 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:02.934+0000 7f8127fff640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f8108005ac0 0x7f8108015580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-27T18:12:02.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:02.942+0000 7f812c808640 1 -- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 msgr2=0x7f8108015040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-27T18:12:02.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:02.942+0000 7f812c808640 1 -- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 msgr2=0x7f8108015040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T18:12:02.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:02.942+0000 7f812c808640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 0x7f8108015040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T18:12:02.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:02.942+0000 7f812c808640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 0x7f8108015040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-27T18:12:03.139 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:03.138+0000 7f8127fff640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f8108005ac0 0x7f8108015580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:03.147 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:03.142+0000 7f8127fff640 1 -- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f8108005ac0 msgr2=0x7f8108015580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-27T18:12:03.147 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:03.142+0000 7f8127fff640 1 -- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f8108005ac0 msgr2=0x7f8108015580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T18:12:03.147 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:03.142+0000 7f8127fff640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f8108005ac0 0x7f8108015580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T18:12:03.147 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:03.142+0000 7f8127fff640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f8108005ac0 0x7f8108015580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-27T18:12:03.147 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:03.146+0000 7f812c808640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 0x7f8108015040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:03.150 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:03.150+0000 7f812c808640 1 -- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 msgr2=0x7f8108015040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-27T18:12:03.151 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:03.150+0000 7f812c808640 1 -- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 msgr2=0x7f8108015040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T18:12:03.151 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:03.150+0000 7f812c808640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 0x7f8108015040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T18:12:03.151 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:03.150+0000 7f812c808640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 0x7f8108015040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-27T18:12:03.547 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:03.546+0000 7f8127fff640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f8108005ac0 0x7f8108015580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:03.549 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:03.546+0000 7f8127fff640 1 -- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f8108005ac0 msgr2=0x7f8108015580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-27T18:12:03.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:03.546+0000 7f8127fff640 1 -- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f8108005ac0 msgr2=0x7f8108015580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T18:12:03.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:03.546+0000 7f8127fff640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f8108005ac0 0x7f8108015580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T18:12:03.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:03.550+0000 7f8127fff640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f8108005ac0 0x7f8108015580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-27T18:12:03.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:03.554+0000 7f812c808640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 0x7f8108015040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:03.557 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:03.558+0000 7f812c808640 1 -- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 msgr2=0x7f8108015040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-27T18:12:03.558 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:03.558+0000 7f812c808640 1 -- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 msgr2=0x7f8108015040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T18:12:03.558 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:03.558+0000 7f812c808640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 0x7f8108015040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T18:12:03.558 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:03.558+0000 7f812c808640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 0x7f8108015040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-27T18:12:04.023 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:12:04.027 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:12:04.355 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:04.354+0000 7f8127fff640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f8108005ac0 0x7f8108015580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:04.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:04.358+0000 7f8127fff640 1 -- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f8108005ac0 msgr2=0x7f8108015580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-27T18:12:04.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:04.358+0000 7f8127fff640 1 -- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f8108005ac0 msgr2=0x7f8108015580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T18:12:04.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:04.358+0000 7f8127fff640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f8108005ac0 0x7f8108015580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T18:12:04.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:04.358+0000 7f8127fff640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f8108005ac0 0x7f8108015580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-27T18:12:04.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:04.362+0000 7f812c808640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 0x7f8108015040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:04.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:04.366+0000 7f812c808640 1 -- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 msgr2=0x7f8108015040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-27T18:12:04.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:04.366+0000 7f812c808640 1 -- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 msgr2=0x7f8108015040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T18:12:04.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:04.366+0000 7f812c808640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 0x7f8108015040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T18:12:04.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:04.366+0000 7f812c808640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 0x7f8108015040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-27T18:12:05.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:05.930+0000 7f8125ffb640 1 -- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 msgr2=0x7f8108015040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-27T18:12:05.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:05.930+0000 7f8125ffb640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.94:3300/0 conn(0x7f8108010820 0x7f8108015040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:05.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:05.930+0000 7f8125ffb640 1 -- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f8108005ac0 msgr2=0x7f8108015580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-27T18:12:05.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:05.930+0000 7f8125ffb640 1 --2- 172.21.15.91:0/3789206174 >> v2:172.21.15.91:3300/0 conn(0x7f8108005ac0 0x7f8108015580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:05.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:05.930+0000 7f8125ffb640 1 -- 172.21.15.91:0/3789206174 >> v1:172.21.15.94:6789/0 conn(0x7f8108015ac0 legacy=0x7f8108017eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:05.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:05.930+0000 7f8125ffb640 1 --2- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f810800da60 0x7f81080094a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:05.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:05.930+0000 7f8125ffb640 1 -- 172.21.15.91:0/3789206174 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f810800a440 con 0x7f8108008790 2023-11-27T18:12:05.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:05.930+0000 7f8125ffb640 1 -- 172.21.15.91:0/3789206174 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f812815a410 con 0x7f810800da60 2023-11-27T18:12:05.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:05.934+0000 7f81277fe640 1 --2- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f810800da60 0x7f81080094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:05.936 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:05.934+0000 7f81277fe640 1 -- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f810800da60 msgr2=0x7f81080094a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-27T18:12:05.936 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:05.934+0000 7f81277fe640 1 -- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f810800da60 msgr2=0x7f81080094a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T18:12:05.936 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:05.934+0000 7f81277fe640 1 --2- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f810800da60 0x7f81080094a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T18:12:05.936 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:05.934+0000 7f81277fe640 1 --2- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f810800da60 0x7f81080094a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-27T18:12:06.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:06.158+0000 7f81277fe640 1 --2- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f810800da60 0x7f81080094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:06.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:06.162+0000 7f81277fe640 1 -- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f810800da60 msgr2=0x7f81080094a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-27T18:12:06.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:06.162+0000 7f81277fe640 1 -- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f810800da60 msgr2=0x7f81080094a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T18:12:06.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:06.162+0000 7f81277fe640 1 --2- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f810800da60 0x7f81080094a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T18:12:06.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:06.162+0000 7f81277fe640 1 --2- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f810800da60 0x7f81080094a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-27T18:12:06.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:06.570+0000 7f81277fe640 1 --2- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f810800da60 0x7f81080094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:06.576 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:06.574+0000 7f81277fe640 1 -- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f810800da60 msgr2=0x7f81080094a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-27T18:12:06.576 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:06.574+0000 7f81277fe640 1 -- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f810800da60 msgr2=0x7f81080094a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T18:12:06.576 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:06.574+0000 7f81277fe640 1 --2- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f810800da60 0x7f81080094a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T18:12:06.577 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:06.574+0000 7f81277fe640 1 --2- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f810800da60 0x7f81080094a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-27T18:12:07.549 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:07.546+0000 7f81277fe640 1 --2- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f810800da60 0x7f81080094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:07.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:07.798+0000 7f81277fe640 1 -- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f810800da60 msgr2=0x7f81080094a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-27T18:12:07.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:07.798+0000 7f81277fe640 1 -- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f810800da60 msgr2=0x7f81080094a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T18:12:07.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:07.798+0000 7f81277fe640 1 --2- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f810800da60 0x7f81080094a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T18:12:07.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:07.798+0000 7f81277fe640 1 --2- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f810800da60 0x7f81080094a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-27T18:12:08.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.470+0000 7f8126ffd640 1 -- 172.21.15.91:0/3789206174 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3552305183 0 0) 0x7f810800a440 con 0x7f8108008790 2023-11-27T18:12:08.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.470+0000 7f8126ffd640 1 -- 172.21.15.91:0/3789206174 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8114003530 con 0x7f8108008790 2023-11-27T18:12:08.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.526+0000 7f8126ffd640 1 -- 172.21.15.91:0/3789206174 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 481901636 0 0) 0x7f8114003530 con 0x7f8108008790 2023-11-27T18:12:08.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.526+0000 7f8126ffd640 1 -- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f810800da60 msgr2=0x7f81080094a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-27T18:12:08.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.526+0000 7f8126ffd640 1 --2- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f810800da60 0x7f81080094a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:08.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.526+0000 7f8126ffd640 1 -- 172.21.15.91:0/3789206174 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81080099e0 con 0x7f8108008790 2023-11-27T18:12:08.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.526+0000 7f8126ffd640 1 -- 172.21.15.91:0/3789206174 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3378743932 0 0) 0x7f8118017860 con 0x7f8108008790 2023-11-27T18:12:08.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.526+0000 7f8126ffd640 1 -- 172.21.15.91:0/3789206174 >> v1:172.21.15.91:6789/0 conn(0x7f8108008790 legacy=0x7f8108008d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:08.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.526+0000 7f812c808640 1 -- 172.21.15.91:0/3789206174 reap_dead start 2023-11-27T18:12:08.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.526+0000 7f8126ffd640 1 --2- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8114003980 0x7f8114003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:08.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.526+0000 7f8126ffd640 1 --2- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81140047d0 0x7f8114004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:08.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.526+0000 7f8126ffd640 1 --2- 172.21.15.91:0/3789206174 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f81140051e0 0x7f811400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:08.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.526+0000 7f8126ffd640 1 -- 172.21.15.91:0/3789206174 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812815a410 con 0x7f81140051e0 2023-11-27T18:12:08.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.526+0000 7f8126ffd640 1 -- 172.21.15.91:0/3789206174 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811400c110 con 0x7f81140047d0 2023-11-27T18:12:08.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.526+0000 7f8126ffd640 1 -- 172.21.15.91:0/3789206174 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f811400c2d0 con 0x7f8114003980 2023-11-27T18:12:08.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.598+0000 7f81277fe640 1 --2- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81140047d0 0x7f8114004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:08.644 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.642+0000 7f8127fff640 1 --2- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8114003980 0x7f8114003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:08.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.654+0000 7f8127fff640 1 -- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81140047d0 msgr2=0x7f8114004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:12:08.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.654+0000 7f8127fff640 1 --2- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81140047d0 0x7f8114004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:08.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.654+0000 7f8127fff640 1 -- 172.21.15.91:0/3789206174 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f81140051e0 msgr2=0x7f811400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:12:08.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.654+0000 7f8127fff640 1 --2- 172.21.15.91:0/3789206174 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f81140051e0 0x7f811400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:08.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.654+0000 7f8127fff640 1 -- 172.21.15.91:0/3789206174 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8114003530 con 0x7f8114003980 2023-11-27T18:12:08.673 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.670+0000 7f8127fff640 1 --2- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8114003980 0x7f8114003d80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8118000c10 tx=0x7f811801ce90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=550f454466dd7126 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:12:08.769 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.766+0000 7f8126ffd640 1 -- 172.21.15.91:0/3789206174 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81180aad10 con 0x7f8114003980 2023-11-27T18:12:08.769 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.766+0000 7f8126ffd640 1 -- 172.21.15.91:0/3789206174 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811801e040 con 0x7f8114003980 2023-11-27T18:12:08.769 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.766+0000 7f8126ffd640 1 -- 172.21.15.91:0/3789206174 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81180b2680 con 0x7f8114003980 2023-11-27T18:12:08.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.766+0000 7f812e26b640 1 -- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8114003980 msgr2=0x7f8114003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:08.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.766+0000 7f812e26b640 1 --2- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8114003980 0x7f8114003d80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8118000c10 tx=0x7f811801ce90 comp rx=0 tx=0).stop 2023-11-27T18:12:08.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.770+0000 7f812e26b640 1 -- 172.21.15.91:0/3789206174 shutdown_connections 2023-11-27T18:12:08.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.770+0000 7f812e26b640 1 --2- 172.21.15.91:0/3789206174 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f81140051e0 0x7f811400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:08.771 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.770+0000 7f812e26b640 1 --2- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81140047d0 0x7f8114004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:08.771 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.770+0000 7f812e26b640 1 --2- 172.21.15.91:0/3789206174 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8114003980 0x7f8114003d80 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:08.771 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.770+0000 7f812e26b640 1 -- 172.21.15.91:0/3789206174 >> 172.21.15.91:0/3789206174 conn(0x7f812806a520 msgr2=0x7f812806a930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:12:08.771 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.770+0000 7f812e26b640 1 -- 172.21.15.91:0/3789206174 shutdown_connections 2023-11-27T18:12:08.771 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.770+0000 7f812e26b640 1 -- 172.21.15.91:0/3789206174 wait complete. 2023-11-27T18:12:08.772 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.770+0000 7f812e26b640 1 Processor -- start 2023-11-27T18:12:08.772 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.770+0000 7f812e26b640 1 -- start start 2023-11-27T18:12:08.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.774+0000 7f812e26b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8114003980 0x7f812814af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:08.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.774+0000 7f812e26b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81140047d0 0x7f81280cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:08.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.774+0000 7f812e26b640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f81140051e0 0x7f8128149230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:08.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.774+0000 7f812e26b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81280c6370 con 0x7f8114003980 2023-11-27T18:12:08.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.774+0000 7f812e26b640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81281eed40 con 0x7f81140047d0 2023-11-27T18:12:08.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.774+0000 7f812e26b640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81281ef000 con 0x7f81140051e0 2023-11-27T18:12:08.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.774+0000 7f81277fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81140047d0 0x7f81280cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:08.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.774+0000 7f81277fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81140047d0 0x7f81280cb5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.91:47188/0 (socket says 172.21.15.91:47188) 2023-11-27T18:12:08.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.774+0000 7f81277fe640 1 -- 172.21.15.91:0/1887625202 learned_addr learned my addr 172.21.15.91:0/1887625202 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:12:08.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.794+0000 7f81277fe640 1 -- 172.21.15.91:0/1887625202 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f81140051e0 msgr2=0x7f8128149230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:08.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.794+0000 7f81277fe640 1 --2- 172.21.15.91:0/1887625202 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f81140051e0 0x7f8128149230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:08.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.794+0000 7f81277fe640 1 -- 172.21.15.91:0/1887625202 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8114003980 msgr2=0x7f812814af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:08.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.794+0000 7f81277fe640 1 --2- 172.21.15.91:0/1887625202 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8114003980 0x7f812814af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:08.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.794+0000 7f81277fe640 1 -- 172.21.15.91:0/1887625202 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81281ef2e0 con 0x7f81140047d0 2023-11-27T18:12:08.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.798+0000 7f81277fe640 1 --2- 172.21.15.91:0/1887625202 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81140047d0 0x7f81280cb5a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8108006580 tx=0x7f811000d820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:12:08.857 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.854+0000 7f8124ff9640 1 -- 172.21.15.91:0/1887625202 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81100187f0 con 0x7f81140047d0 2023-11-27T18:12:08.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.854+0000 7f8124ff9640 1 -- 172.21.15.91:0/1887625202 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8110013040 con 0x7f81140047d0 2023-11-27T18:12:08.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.854+0000 7f8124ff9640 1 -- 172.21.15.91:0/1887625202 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8110018b50 con 0x7f81140047d0 2023-11-27T18:12:08.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.858+0000 7f812e26b640 1 -- 172.21.15.91:0/1887625202 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81281ef5c0 con 0x7f81140047d0 2023-11-27T18:12:08.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.858+0000 7f812e26b640 1 -- 172.21.15.91:0/1887625202 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81281efb80 con 0x7f81140047d0 2023-11-27T18:12:08.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:08.858+0000 7f812e26b640 1 -- 172.21.15.91:0/1887625202 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f812804e850 con 0x7f81140047d0 2023-11-27T18:12:09.011 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T18:12:09.010+0000 7f5f5adcb180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-27T18:12:09.145 INFO:tasks.ceph.mgr.x.smithi094.stderr:2023-11-27T18:12:09.141+0000 7fb1c49de180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-27T18:12:09.150 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:09.150+0000 7f8124ff9640 1 -- 172.21.15.91:0/1887625202 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f8110009030 con 0x7f81140047d0 2023-11-27T18:12:09.162 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:09.162+0000 7f8124ff9640 1 -- 172.21.15.91:0/1887625202 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f8110005e40 con 0x7f81140047d0 2023-11-27T18:12:09.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:09.162+0000 7f8124ff9640 1 -- 172.21.15.91:0/1887625202 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7f811002c7e0 con 0x7f81140047d0 2023-11-27T18:12:09.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:09.234+0000 7f812e26b640 1 -- 172.21.15.91:0/1887625202 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f81280c8570 con 0x7f81140047d0 2023-11-27T18:12:09.546 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T18:12:09.546+0000 7f5f5adcb180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-27T18:12:09.738 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T18:12:09.738+0000 7f5f5adcb180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-27T18:12:09.758 INFO:tasks.ceph.mgr.x.smithi094.stderr:2023-11-27T18:12:09.757+0000 7fb1c49de180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-27T18:12:09.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:09.942+0000 7f8124ff9640 1 -- 172.21.15.91:0/1887625202 <== mon.1 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f811002c980 con 0x7f81140047d0 2023-11-27T18:12:09.945 INFO:teuthology.orchestra.run.smithi091.stderr:adjusted tunables profile to default 2023-11-27T18:12:09.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:09.946+0000 7f812e26b640 1 -- 172.21.15.91:0/1887625202 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81140047d0 msgr2=0x7f81280cb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:09.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:09.946+0000 7f812e26b640 1 --2- 172.21.15.91:0/1887625202 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81140047d0 0x7f81280cb5a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8108006580 tx=0x7f811000d820 comp rx=0 tx=0).stop 2023-11-27T18:12:09.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:09.946+0000 7f812e26b640 1 -- 172.21.15.91:0/1887625202 shutdown_connections 2023-11-27T18:12:09.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:09.946+0000 7f812e26b640 1 --2- 172.21.15.91:0/1887625202 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f81140051e0 0x7f8128149230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:09.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:09.946+0000 7f812e26b640 1 --2- 172.21.15.91:0/1887625202 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81140047d0 0x7f81280cb5a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:09.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:09.946+0000 7f812e26b640 1 --2- 172.21.15.91:0/1887625202 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8114003980 0x7f812814af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:09.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:09.946+0000 7f812e26b640 1 -- 172.21.15.91:0/1887625202 >> 172.21.15.91:0/1887625202 conn(0x7f812806a520 msgr2=0x7f81280712b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:12:09.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:09.946+0000 7f812e26b640 1 -- 172.21.15.91:0/1887625202 shutdown_connections 2023-11-27T18:12:09.948 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:09.946+0000 7f812e26b640 1 -- 172.21.15.91:0/1887625202 wait complete. 2023-11-27T18:12:09.972 INFO:tasks.ceph:check_enable_crimson: False 2023-11-27T18:12:09.972 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-27T18:12:09.972 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T18:12:09.973 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-27T18:12:09.986 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T18:12:09.986 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-27T18:12:10.010 INFO:tasks.ceph.mgr.x.smithi094.stderr:2023-11-27T18:12:10.009+0000 7fb1c49de180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-27T18:12:10.039 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T18:12:10.039 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-27T18:12:10.097 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T18:12:10.098 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-27T18:12:10.152 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-11-27T18:12:10.152 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-27T18:12:10.166 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-11-27T18:12:10.166 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-27T18:12:10.221 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-11-27T18:12:10.221 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-27T18:12:10.277 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-11-27T18:12:10.277 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-27T18:12:10.320 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T18:12:10.318+0000 7f5f5adcb180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-27T18:12:10.334 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --cluster ceph osd new 8ad53c08-dd19-4ae6-87c5-fa15bea3b4ad 0 2023-11-27T18:12:10.374 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T18:12:10.374+0000 7f5f5adcb180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-27T18:12:10.427 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T18:12:10.426+0000 7f5f5adcb180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-27T18:12:10.500 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:10.497+0000 7f330e88d640 1 Processor -- start 2023-11-27T18:12:10.500 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:10.497+0000 7f330e88d640 1 -- start start 2023-11-27T18:12:10.500 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:10.497+0000 7f330e88d640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f33080ccbe0 0x7f33080cd070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:10.501 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:10.497+0000 7f330e88d640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33080c9f80 con 0x7f33080c7c50 2023-11-27T18:12:10.501 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:10.497+0000 7f330e88d640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33080c9090 con 0x7f3308151730 2023-11-27T18:12:10.501 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:10.497+0000 7f330e88d640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33080b13c0 con 0x7f33080ccbe0 2023-11-27T18:12:10.501 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:10.501+0000 7f330ce2a640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f33080ccbe0 0x7f33080cd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:10.502 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:10.501+0000 7f3307fff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f3308151730 0x7f330815b240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:36158/0 (socket says 172.21.15.94:36158) 2023-11-27T18:12:10.502 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:10.501+0000 7f3307fff640 1 -- 172.21.15.94:0/3751693371 learned_addr learned my addr 172.21.15.94:0/3751693371 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-11-27T18:12:10.504 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T18:12:10.502+0000 7f5f5adcb180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-27T18:12:10.505 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:10.501+0000 7f330ce2a640 1 -- 172.21.15.94:0/3751693371 >> v1:172.21.15.94:6789/0 conn(0x7f3308151730 legacy=0x7f330815b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:10.505 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:10.501+0000 7f330ce2a640 1 -- 172.21.15.94:0/3751693371 >> v1:172.21.15.91:6789/0 conn(0x7f33080c7c50 legacy=0x7f33080b0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:10.505 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:10.501+0000 7f330ce2a640 1 -- 172.21.15.94:0/3751693371 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33080c9370 con 0x7f33080ccbe0 2023-11-27T18:12:10.512 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:10.505+0000 7f330ce2a640 1 --2- 172.21.15.94:0/3751693371 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f33080ccbe0 0x7f33080cd070 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f32f8009dc0 tx=0x7f32f801f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d83c50635e95958e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:12:10.515 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:10.513+0000 7f3306ffd640 1 -- 172.21.15.94:0/3751693371 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f80af600 con 0x7f33080ccbe0 2023-11-27T18:12:10.515 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:10.513+0000 7f3306ffd640 1 -- 172.21.15.94:0/3751693371 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f80ab050 con 0x7f33080ccbe0 2023-11-27T18:12:10.515 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:10.513+0000 7f3306ffd640 1 -- 172.21.15.94:0/3751693371 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f80af980 con 0x7f33080ccbe0 2023-11-27T18:12:10.515 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:10.513+0000 7f330e88d640 1 -- 172.21.15.94:0/3751693371 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f33080ccbe0 msgr2=0x7f33080cd070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:10.516 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:10.513+0000 7f330e88d640 1 --2- 172.21.15.94:0/3751693371 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f33080ccbe0 0x7f33080cd070 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f32f8009dc0 tx=0x7f32f801f150 comp rx=0 tx=0).stop 2023-11-27T18:12:10.516 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:10.513+0000 7f330e88d640 1 -- 172.21.15.94:0/3751693371 shutdown_connections 2023-11-27T18:12:10.516 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:10.513+0000 7f330e88d640 1 --2- 172.21.15.94:0/3751693371 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f33080ccbe0 0x7f33080cd070 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:10.516 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:10.513+0000 7f330e88d640 1 -- 172.21.15.94:0/3751693371 >> 172.21.15.94:0/3751693371 conn(0x7f330806a520 msgr2=0x7f330806a930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:12:10.517 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:10.513+0000 7f330e88d640 1 -- 172.21.15.94:0/3751693371 shutdown_connections 2023-11-27T18:12:10.517 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:10.513+0000 7f330e88d640 1 -- 172.21.15.94:0/3751693371 wait complete. 2023-11-27T18:12:10.518 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:10.513+0000 7f330e88d640 1 Processor -- start 2023-11-27T18:12:10.519 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:10.513+0000 7f330e88d640 1 -- start start 2023-11-27T18:12:10.519 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:10.513+0000 7f330e88d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f33080c7c50 0x7f33080cb730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:10.519 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:10.513+0000 7f330e88d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f33080ccbe0 0x7f3308154640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:10.519 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:10.513+0000 7f330e88d640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3308151730 0x7f33081468e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:10.520 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:10.513+0000 7f330e88d640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33081ee430 con 0x7f33080ccbe0 2023-11-27T18:12:10.521 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:10.517+0000 7f330e88d640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33081ed8b0 con 0x7f33080c7c50 2023-11-27T18:12:10.521 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:10.517+0000 7f330e88d640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33081edb90 con 0x7f3308151730 2023-11-27T18:12:10.521 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:10.517+0000 7f330ce2a640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3308151730 0x7f33081468e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:10.521 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:10.517+0000 7f3307fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f33080c7c50 0x7f33080cb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:10.522 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:10.517+0000 7f3307fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f33080c7c50 0x7f33080cb730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:45822/0 (socket says 172.21.15.94:45822) 2023-11-27T18:12:10.522 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:10.517+0000 7f3307fff640 1 -- 172.21.15.94:0/2800665421 learned_addr learned my addr 172.21.15.94:0/2800665421 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-11-27T18:12:10.522 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:10.517+0000 7f33077fe640 1 --2- 172.21.15.94:0/2800665421 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f33080ccbe0 0x7f3308154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:10.523 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:10.521+0000 7f330ce2a640 1 -- 172.21.15.94:0/2800665421 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f33080c7c50 msgr2=0x7f33080cb730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:10.523 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:10.521+0000 7f330ce2a640 1 --2- 172.21.15.94:0/2800665421 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f33080c7c50 0x7f33080cb730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:10.523 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:10.521+0000 7f330ce2a640 1 -- 172.21.15.94:0/2800665421 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f33080ccbe0 msgr2=0x7f3308154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:10.524 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:10.521+0000 7f330ce2a640 1 --2- 172.21.15.94:0/2800665421 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f33080ccbe0 0x7f3308154640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:10.524 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:10.521+0000 7f330ce2a640 1 -- 172.21.15.94:0/2800665421 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f8009a70 con 0x7f3308151730 2023-11-27T18:12:10.524 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:10.521+0000 7f330ce2a640 1 --2- 172.21.15.94:0/2800665421 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3308151730 0x7f33081468e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f32f80af000 tx=0x7f32f801bef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:12:10.528 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:10.525+0000 7f3304ff9640 1 -- 172.21.15.94:0/2800665421 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f80afdf0 con 0x7f3308151730 2023-11-27T18:12:10.528 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:10.525+0000 7f3304ff9640 1 -- 172.21.15.94:0/2800665421 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f80ba420 con 0x7f3308151730 2023-11-27T18:12:10.529 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:10.525+0000 7f3304ff9640 1 -- 172.21.15.94:0/2800665421 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f80ba7d0 con 0x7f3308151730 2023-11-27T18:12:10.529 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:10.525+0000 7f330e88d640 1 -- 172.21.15.94:0/2800665421 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33081ede70 con 0x7f3308151730 2023-11-27T18:12:10.529 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:10.525+0000 7f330e88d640 1 -- 172.21.15.94:0/2800665421 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3308151ef0 con 0x7f3308151730 2023-11-27T18:12:10.529 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:10.525+0000 7f330e88d640 1 -- 172.21.15.94:0/2800665421 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f330804e850 con 0x7f3308151730 2023-11-27T18:12:10.538 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:10.533+0000 7f3304ff9640 1 -- 172.21.15.94:0/2800665421 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f32f80bacb0 con 0x7f3308151730 2023-11-27T18:12:10.538 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:10.533+0000 7f3304ff9640 1 -- 172.21.15.94:0/2800665421 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f32f80c3410 con 0x7f3308151730 2023-11-27T18:12:10.558 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T18:12:10.558+0000 7f5f5adcb180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-27T18:12:10.635 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T18:12:10.634+0000 7f5f5adcb180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-27T18:12:10.643 INFO:tasks.ceph.mgr.x.smithi094.stderr:2023-11-27T18:12:10.641+0000 7fb1c49de180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-27T18:12:10.686 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T18:12:10.686+0000 7f5f5adcb180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-27T18:12:10.703 INFO:tasks.ceph.mgr.x.smithi094.stderr:2023-11-27T18:12:10.701+0000 7fb1c49de180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-27T18:12:10.728 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:10.725+0000 7f3304ff9640 1 -- 172.21.15.94:0/2800665421 <== mon.2 v2:172.21.15.94:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7f32f80be030 con 0x7f3308151730 2023-11-27T18:12:10.759 INFO:tasks.ceph.mgr.x.smithi094.stderr:2023-11-27T18:12:10.757+0000 7fb1c49de180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-27T18:12:10.804 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:10.801+0000 7f330e88d640 1 -- 172.21.15.94:0/2800665421 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8ad53c08-dd19-4ae6-87c5-fa15bea3b4ad", "id": 0} v 0) v1 -- 0x7f33080c3e00 con 0x7f3308151730 2023-11-27T18:12:10.827 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T18:12:10.826+0000 7f5f5adcb180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-27T18:12:10.840 INFO:tasks.ceph.mgr.x.smithi094.stderr:2023-11-27T18:12:10.837+0000 7fb1c49de180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-27T18:12:10.888 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T18:12:10.886+0000 7f5f5adcb180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-27T18:12:10.895 INFO:tasks.ceph.mgr.x.smithi094.stderr:2023-11-27T18:12:10.893+0000 7fb1c49de180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-27T18:12:10.973 INFO:tasks.ceph.mgr.x.smithi094.stderr:2023-11-27T18:12:10.969+0000 7fb1c49de180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-27T18:12:11.025 INFO:tasks.ceph.mgr.x.smithi094.stderr:2023-11-27T18:12:11.021+0000 7fb1c49de180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-27T18:12:11.209 INFO:tasks.ceph.mgr.x.smithi094.stderr:2023-11-27T18:12:11.205+0000 7fb1c49de180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-27T18:12:11.266 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.265+0000 7f3304ff9640 1 -- 172.21.15.94:0/2800665421 <== mon.2 v2:172.21.15.94:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8ad53c08-dd19-4ae6-87c5-fa15bea3b4ad", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f32f80b4070 con 0x7f3308151730 2023-11-27T18:12:11.267 INFO:teuthology.orchestra.run.smithi094.stdout:0 2023-11-27T18:12:11.269 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.265+0000 7f330e88d640 1 -- 172.21.15.94:0/2800665421 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3308151730 msgr2=0x7f33081468e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:11.269 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.265+0000 7f330e88d640 1 --2- 172.21.15.94:0/2800665421 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3308151730 0x7f33081468e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f32f80af000 tx=0x7f32f801bef0 comp rx=0 tx=0).stop 2023-11-27T18:12:11.270 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.265+0000 7f330e88d640 1 -- 172.21.15.94:0/2800665421 shutdown_connections 2023-11-27T18:12:11.270 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.265+0000 7f330e88d640 1 --2- 172.21.15.94:0/2800665421 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3308151730 0x7f33081468e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:11.270 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.265+0000 7f330e88d640 1 --2- 172.21.15.94:0/2800665421 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f33080ccbe0 0x7f3308154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:11.270 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.265+0000 7f330e88d640 1 --2- 172.21.15.94:0/2800665421 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f33080c7c50 0x7f33080cb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:11.270 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.265+0000 7f330e88d640 1 -- 172.21.15.94:0/2800665421 >> 172.21.15.94:0/2800665421 conn(0x7f330806a520 msgr2=0x7f330814ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:12:11.270 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.265+0000 7f330e88d640 1 -- 172.21.15.94:0/2800665421 shutdown_connections 2023-11-27T18:12:11.270 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.265+0000 7f330e88d640 1 -- 172.21.15.94:0/2800665421 wait complete. 2023-11-27T18:12:11.286 INFO:tasks.ceph.mgr.x.smithi094.stderr:2023-11-27T18:12:11.285+0000 7fb1c49de180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-27T18:12:11.289 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --cluster ceph osd new f8b5f147-ed29-4329-a787-a12cc34a2569 1 2023-11-27T18:12:11.408 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.405+0000 7f43b477f640 1 Processor -- start 2023-11-27T18:12:11.408 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.405+0000 7f43b477f640 1 -- start start 2023-11-27T18:12:11.409 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.405+0000 7f43b477f640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f43ac0c4ef0 0x7f43ac15aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:11.409 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.405+0000 7f43b477f640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f43ac151970 0x7f43ac161df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:11.409 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.405+0000 7f43b477f640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43ac066b90 con 0x7f43ac0c52d0 2023-11-27T18:12:11.409 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.405+0000 7f43b477f640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43ac157470 con 0x7f43ac0c4ef0 2023-11-27T18:12:11.409 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.405+0000 7f43b477f640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac158440 con 0x7f43ac151970 2023-11-27T18:12:11.410 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.409+0000 7f43b251b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f43ac0c4ef0 0x7f43ac15aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:11.410 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.409+0000 7f43b2d1c640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f43ac151970 0x7f43ac161df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:11.410 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.409+0000 7f43b251b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f43ac0c4ef0 0x7f43ac15aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:45830/0 (socket says 172.21.15.94:45830) 2023-11-27T18:12:11.410 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.409+0000 7f43b251b640 1 -- 172.21.15.94:0/1192051058 learned_addr learned my addr 172.21.15.94:0/1192051058 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-11-27T18:12:11.413 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.409+0000 7f43b2d1c640 1 -- 172.21.15.94:0/1192051058 >> v2:172.21.15.94:3300/0 conn(0x7f43ac0c4ef0 msgr2=0x7f43ac15aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:12:11.413 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.409+0000 7f43b2d1c640 1 --2- 172.21.15.94:0/1192051058 >> v2:172.21.15.94:3300/0 conn(0x7f43ac0c4ef0 0x7f43ac15aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:11.413 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.409+0000 7f43b2d1c640 1 -- 172.21.15.94:0/1192051058 >> v1:172.21.15.94:6789/0 conn(0x7f43ac0c52d0 legacy=0x7f43ac151260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:11.413 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.409+0000 7f43b2d1c640 1 -- 172.21.15.94:0/1192051058 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43ac06bda0 con 0x7f43ac151970 2023-11-27T18:12:11.416 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.413+0000 7f43b2d1c640 1 --2- 172.21.15.94:0/1192051058 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f43ac151970 0x7f43ac161df0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f43a4009d90 tx=0x7f43a401f130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=718e6784b2247686 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:12:11.421 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.421+0000 7f43b1519640 1 -- 172.21.15.94:0/1192051058 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a40af600 con 0x7f43ac151970 2023-11-27T18:12:11.422 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.421+0000 7f43b1519640 1 -- 172.21.15.94:0/1192051058 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a40ab050 con 0x7f43ac151970 2023-11-27T18:12:11.422 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.421+0000 7f43b1519640 1 -- 172.21.15.94:0/1192051058 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a40af980 con 0x7f43ac151970 2023-11-27T18:12:11.422 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.421+0000 7f43b477f640 1 -- 172.21.15.94:0/1192051058 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f43ac151970 msgr2=0x7f43ac161df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:11.422 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.421+0000 7f43b477f640 1 --2- 172.21.15.94:0/1192051058 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f43ac151970 0x7f43ac161df0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f43a4009d90 tx=0x7f43a401f130 comp rx=0 tx=0).stop 2023-11-27T18:12:11.423 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.421+0000 7f43b477f640 1 -- 172.21.15.94:0/1192051058 shutdown_connections 2023-11-27T18:12:11.423 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.421+0000 7f43b477f640 1 --2- 172.21.15.94:0/1192051058 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f43ac151970 0x7f43ac161df0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:11.423 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.421+0000 7f43b477f640 1 --2- 172.21.15.94:0/1192051058 >> v2:172.21.15.94:3300/0 conn(0x7f43ac0c4ef0 0x7f43ac15aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:11.423 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.421+0000 7f43b477f640 1 -- 172.21.15.94:0/1192051058 >> 172.21.15.94:0/1192051058 conn(0x7f43ac071820 msgr2=0x7f43ac071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:12:11.423 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.421+0000 7f43b477f640 1 -- 172.21.15.94:0/1192051058 shutdown_connections 2023-11-27T18:12:11.423 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.421+0000 7f43b477f640 1 -- 172.21.15.94:0/1192051058 wait complete. 2023-11-27T18:12:11.423 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.421+0000 7f43b477f640 1 Processor -- start 2023-11-27T18:12:11.424 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.421+0000 7f43b477f640 1 -- start start 2023-11-27T18:12:11.424 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.421+0000 7f43b477f640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f43ac0c4ef0 0x7f43ac147880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:11.424 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.421+0000 7f43b477f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f43ac0c52d0 0x7f43ac1ecce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:11.424 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.421+0000 7f43b477f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f43ac151970 0x7f43ac14f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:11.424 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.421+0000 7f43b477f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac1484a0 con 0x7f43ac0c52d0 2023-11-27T18:12:11.424 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.421+0000 7f43b477f640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac152af0 con 0x7f43ac151970 2023-11-27T18:12:11.424 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.421+0000 7f43b477f640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac148f30 con 0x7f43ac0c4ef0 2023-11-27T18:12:11.425 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.421+0000 7f43b2d1c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f43ac151970 0x7f43ac14f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:11.425 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.421+0000 7f43b251b640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f43ac0c4ef0 0x7f43ac147880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:11.425 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.421+0000 7f43b2d1c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f43ac151970 0x7f43ac14f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:45840/0 (socket says 172.21.15.94:45840) 2023-11-27T18:12:11.425 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.421+0000 7f43b2d1c640 1 -- 172.21.15.94:0/899667677 learned_addr learned my addr 172.21.15.94:0/899667677 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-11-27T18:12:11.426 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.425+0000 7f43b1d1a640 1 --2- 172.21.15.94:0/899667677 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f43ac0c52d0 0x7f43ac1ecce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:11.429 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.425+0000 7f43b2d1c640 1 -- 172.21.15.94:0/899667677 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f43ac0c4ef0 msgr2=0x7f43ac147880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:11.429 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.425+0000 7f43b2d1c640 1 --2- 172.21.15.94:0/899667677 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f43ac0c4ef0 0x7f43ac147880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:11.429 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.425+0000 7f43b2d1c640 1 -- 172.21.15.94:0/899667677 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f43ac0c52d0 msgr2=0x7f43ac1ecce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:11.429 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.425+0000 7f43b2d1c640 1 --2- 172.21.15.94:0/899667677 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f43ac0c52d0 0x7f43ac1ecce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:11.429 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.425+0000 7f43b2d1c640 1 -- 172.21.15.94:0/899667677 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a4009a70 con 0x7f43ac151970 2023-11-27T18:12:11.430 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.429+0000 7f43b2d1c640 1 --2- 172.21.15.94:0/899667677 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f43ac151970 0x7f43ac14f880 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f43a40b2040 tx=0x7f43a401bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:12:11.433 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.429+0000 7f43a2ffd640 1 -- 172.21.15.94:0/899667677 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a4009450 con 0x7f43ac151970 2023-11-27T18:12:11.433 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.429+0000 7f43b477f640 1 -- 172.21.15.94:0/899667677 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43ac152d20 con 0x7f43ac151970 2023-11-27T18:12:11.433 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.429+0000 7f43b477f640 1 -- 172.21.15.94:0/899667677 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43ac1532c0 con 0x7f43ac151970 2023-11-27T18:12:11.433 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.433+0000 7f43b477f640 1 -- 172.21.15.94:0/899667677 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43ac153500 con 0x7f43ac151970 2023-11-27T18:12:11.434 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.433+0000 7f43a2ffd640 1 -- 172.21.15.94:0/899667677 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a40c7460 con 0x7f43ac151970 2023-11-27T18:12:11.434 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.433+0000 7f43a2ffd640 1 -- 172.21.15.94:0/899667677 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a40c77d0 con 0x7f43ac151970 2023-11-27T18:12:11.510 INFO:tasks.ceph.mgr.y.smithi091.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-11-27T18:12:11.510 INFO:tasks.ceph.mgr.y.smithi091.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-11-27T18:12:11.510 INFO:tasks.ceph.mgr.y.smithi091.stderr: from numpy import show_config as show_numpy_config 2023-11-27T18:12:11.559 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.557+0000 7f43a2ffd640 1 -- 172.21.15.94:0/899667677 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f43a40b6050 con 0x7f43ac151970 2023-11-27T18:12:11.559 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.557+0000 7f43a2ffd640 1 -- 172.21.15.94:0/899667677 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f43a40b97c0 con 0x7f43ac151970 2023-11-27T18:12:11.562 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.557+0000 7f43a2ffd640 1 -- 172.21.15.94:0/899667677 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7f43ac153500 con 0x7f43ac151970 2023-11-27T18:12:11.577 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T18:12:11.574+0000 7f5f5adcb180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-27T18:12:11.666 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.665+0000 7f43b477f640 1 -- 172.21.15.94:0/899667677 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f8b5f147-ed29-4329-a787-a12cc34a2569", "id": 1} v 0) v1 -- 0x7f43ac04e850 con 0x7f43ac151970 2023-11-27T18:12:11.762 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T18:12:11.762+0000 7f5f5adcb180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-27T18:12:11.910 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.909+0000 7f43a2ffd640 1 -- 172.21.15.94:0/899667677 <== mon.1 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f8b5f147-ed29-4329-a787-a12cc34a2569", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f43a40d50b0 con 0x7f43ac151970 2023-11-27T18:12:11.910 INFO:teuthology.orchestra.run.smithi094.stdout:1 2023-11-27T18:12:11.912 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.909+0000 7f43b477f640 1 -- 172.21.15.94:0/899667677 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f43ac151970 msgr2=0x7f43ac14f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:11.912 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.909+0000 7f43b477f640 1 --2- 172.21.15.94:0/899667677 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f43ac151970 0x7f43ac14f880 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f43a40b2040 tx=0x7f43a401bed0 comp rx=0 tx=0).stop 2023-11-27T18:12:11.912 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.909+0000 7f43b477f640 1 -- 172.21.15.94:0/899667677 shutdown_connections 2023-11-27T18:12:11.912 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.909+0000 7f43b477f640 1 --2- 172.21.15.94:0/899667677 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f43ac151970 0x7f43ac14f880 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:11.912 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.909+0000 7f43b477f640 1 --2- 172.21.15.94:0/899667677 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f43ac0c52d0 0x7f43ac1ecce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:11.913 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.909+0000 7f43b477f640 1 --2- 172.21.15.94:0/899667677 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f43ac0c4ef0 0x7f43ac147880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:11.913 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.909+0000 7f43b477f640 1 -- 172.21.15.94:0/899667677 >> 172.21.15.94:0/899667677 conn(0x7f43ac071820 msgr2=0x7f43ac06b330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:12:11.913 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.909+0000 7f43b477f640 1 -- 172.21.15.94:0/899667677 shutdown_connections 2023-11-27T18:12:11.913 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:11.909+0000 7f43b477f640 1 -- 172.21.15.94:0/899667677 wait complete. 2023-11-27T18:12:11.933 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --cluster ceph osd new c3029f9a-1c48-4f5d-983a-172a614d8795 2 2023-11-27T18:12:11.943 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T18:12:11.942+0000 7f5f5adcb180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-27T18:12:11.965 INFO:tasks.ceph.mgr.x.smithi094.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-11-27T18:12:11.965 INFO:tasks.ceph.mgr.x.smithi094.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-11-27T18:12:11.965 INFO:tasks.ceph.mgr.x.smithi094.stderr: from numpy import show_config as show_numpy_config 2023-11-27T18:12:12.008 INFO:tasks.ceph.mgr.x.smithi094.stderr:2023-11-27T18:12:12.005+0000 7fb1c49de180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-27T18:12:12.014 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T18:12:12.014+0000 7f5f5adcb180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-27T18:12:12.046 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.045+0000 7f9acd9bb640 1 Processor -- start 2023-11-27T18:12:12.046 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.045+0000 7f9acd9bb640 1 -- start start 2023-11-27T18:12:12.047 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.045+0000 7f9acd9bb640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f9ac80c52d0 0x7f9ac8151260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:12.047 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.045+0000 7f9acd9bb640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9ac806b860 0x7f9ac81517a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:12.047 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.045+0000 7f9acd9bb640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ac8066b90 con 0x7f9ac80c4ef0 2023-11-27T18:12:12.047 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.045+0000 7f9acd9bb640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ac8157470 con 0x7f9ac80c52d0 2023-11-27T18:12:12.047 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.045+0000 7f9acd9bb640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac8158440 con 0x7f9ac806b860 2023-11-27T18:12:12.048 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.045+0000 7f9ac6ffd640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f9ac80c4ef0 0x7f9ac815aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:36186/0 (socket says 172.21.15.94:36186) 2023-11-27T18:12:12.048 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.045+0000 7f9ac6ffd640 1 -- 172.21.15.94:0/2101284357 learned_addr learned my addr 172.21.15.94:0/2101284357 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-11-27T18:12:12.049 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.045+0000 7f9ac67fc640 1 --2- 172.21.15.94:0/2101284357 >> v2:172.21.15.91:3300/0 conn(0x7f9ac80c52d0 0x7f9ac8151260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:12.055 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.053+0000 7f9ac77fe640 1 --2- 172.21.15.94:0/2101284357 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9ac806b860 0x7f9ac81517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:12.055 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.053+0000 7f9ac67fc640 1 -- 172.21.15.94:0/2101284357 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9ac806b860 msgr2=0x7f9ac81517a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:12:12.055 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.053+0000 7f9ac67fc640 1 --2- 172.21.15.94:0/2101284357 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9ac806b860 0x7f9ac81517a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:12.055 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.053+0000 7f9ac67fc640 1 -- 172.21.15.94:0/2101284357 >> v1:172.21.15.94:6789/0 conn(0x7f9ac80c4ef0 legacy=0x7f9ac815aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:12.055 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.053+0000 7f9ac67fc640 1 -- 172.21.15.94:0/2101284357 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac806bda0 con 0x7f9ac80c52d0 2023-11-27T18:12:12.062 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.061+0000 7f9ac67fc640 1 --2- 172.21.15.94:0/2101284357 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9ac80c52d0 0x7f9ac8151260 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9abc0097c0 tx=0x7f9abc01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc51ce8acc59a38a server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:12:12.080 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.077+0000 7f9ac5ffb640 1 -- 172.21.15.94:0/2101284357 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc0a8970 con 0x7f9ac80c52d0 2023-11-27T18:12:12.080 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.077+0000 7f9ac5ffb640 1 -- 172.21.15.94:0/2101284357 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9abc0a8ad0 con 0x7f9ac80c52d0 2023-11-27T18:12:12.080 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.077+0000 7f9ac5ffb640 1 -- 172.21.15.94:0/2101284357 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc0a8e60 con 0x7f9ac80c52d0 2023-11-27T18:12:12.081 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.077+0000 7f9acd9bb640 1 -- 172.21.15.94:0/2101284357 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9ac80c52d0 msgr2=0x7f9ac8151260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:12.081 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.077+0000 7f9acd9bb640 1 --2- 172.21.15.94:0/2101284357 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9ac80c52d0 0x7f9ac8151260 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9abc0097c0 tx=0x7f9abc01ec70 comp rx=0 tx=0).stop 2023-11-27T18:12:12.081 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.077+0000 7f9acd9bb640 1 -- 172.21.15.94:0/2101284357 shutdown_connections 2023-11-27T18:12:12.081 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.077+0000 7f9acd9bb640 1 --2- 172.21.15.94:0/2101284357 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9ac806b860 0x7f9ac81517a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:12.081 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.077+0000 7f9acd9bb640 1 --2- 172.21.15.94:0/2101284357 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9ac80c52d0 0x7f9ac8151260 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:12.081 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.077+0000 7f9acd9bb640 1 -- 172.21.15.94:0/2101284357 >> 172.21.15.94:0/2101284357 conn(0x7f9ac8071820 msgr2=0x7f9ac8071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:12:12.082 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.077+0000 7f9acd9bb640 1 -- 172.21.15.94:0/2101284357 shutdown_connections 2023-11-27T18:12:12.082 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.077+0000 7f9acd9bb640 1 -- 172.21.15.94:0/2101284357 wait complete. 2023-11-27T18:12:12.082 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.081+0000 7f9acd9bb640 1 Processor -- start 2023-11-27T18:12:12.083 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.081+0000 7f9acd9bb640 1 -- start start 2023-11-27T18:12:12.083 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.081+0000 7f9acd9bb640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9ac806b860 0x7f9ac81f0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:12.083 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.081+0000 7f9acd9bb640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9ac80c4ef0 0x7f9ac814add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:12.083 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.081+0000 7f9acd9bb640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9ac80c52d0 0x7f9ac81ed670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:12.083 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.081+0000 7f9acd9bb640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac8152110 con 0x7f9ac806b860 2023-11-27T18:12:12.083 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.081+0000 7f9acd9bb640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac81f12e0 con 0x7f9ac80c4ef0 2023-11-27T18:12:12.083 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.081+0000 7f9acd9bb640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac8152340 con 0x7f9ac80c52d0 2023-11-27T18:12:12.084 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.081+0000 7f9ac67fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9ac80c4ef0 0x7f9ac814add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:12.084 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.081+0000 7f9ac77fe640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9ac80c52d0 0x7f9ac81ed670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:12.084 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.081+0000 7f9ac67fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9ac80c4ef0 0x7f9ac814add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:45852/0 (socket says 172.21.15.94:45852) 2023-11-27T18:12:12.084 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.081+0000 7f9ac67fc640 1 -- 172.21.15.94:0/3872462658 learned_addr learned my addr 172.21.15.94:0/3872462658 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-11-27T18:12:12.084 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.081+0000 7f9ac77fe640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9ac80c52d0 0x7f9ac81ed670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.94:37094/0 (socket says 172.21.15.94:37094) 2023-11-27T18:12:12.087 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.085+0000 7f9ac67fc640 1 -- 172.21.15.94:0/3872462658 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9ac80c52d0 msgr2=0x7f9ac81ed670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:12.087 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.085+0000 7f9ac67fc640 1 --2- 172.21.15.94:0/3872462658 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9ac80c52d0 0x7f9ac81ed670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:12.087 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.085+0000 7f9ac67fc640 1 -- 172.21.15.94:0/3872462658 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9ac806b860 msgr2=0x7f9ac81f0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:12.087 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.085+0000 7f9ac67fc640 1 --2- 172.21.15.94:0/3872462658 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9ac806b860 0x7f9ac81f0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:12.087 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.085+0000 7f9ac67fc640 1 -- 172.21.15.94:0/3872462658 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9abc009420 con 0x7f9ac80c4ef0 2023-11-27T18:12:12.089 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.085+0000 7f9ac67fc640 1 --2- 172.21.15.94:0/3872462658 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9ac80c4ef0 0x7f9ac814add0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9abc01b880 tx=0x7f9abc01ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:12:12.094 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.093+0000 7f9aaffff640 1 -- 172.21.15.94:0/3872462658 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc0b1e70 con 0x7f9ac80c4ef0 2023-11-27T18:12:12.094 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.093+0000 7f9aaffff640 1 -- 172.21.15.94:0/3872462658 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9abc0b9410 con 0x7f9ac80c4ef0 2023-11-27T18:12:12.094 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.093+0000 7f9aaffff640 1 -- 172.21.15.94:0/3872462658 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc0b97c0 con 0x7f9ac80c4ef0 2023-11-27T18:12:12.094 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.093+0000 7f9acd9bb640 1 -- 172.21.15.94:0/3872462658 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ac8152620 con 0x7f9ac80c4ef0 2023-11-27T18:12:12.094 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.093+0000 7f9acd9bb640 1 -- 172.21.15.94:0/3872462658 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ac8152be0 con 0x7f9ac80c4ef0 2023-11-27T18:12:12.095 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.093+0000 7f9acd9bb640 1 -- 172.21.15.94:0/3872462658 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ac804e850 con 0x7f9ac80c4ef0 2023-11-27T18:12:12.097 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.093+0000 7f9aaffff640 1 -- 172.21.15.94:0/3872462658 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f9abc0b7040 con 0x7f9ac80c4ef0 2023-11-27T18:12:12.152 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T18:12:12.150+0000 7f5f5adcb180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-27T18:12:12.189 INFO:tasks.ceph.mgr.x.smithi094.stderr:2023-11-27T18:12:12.185+0000 7fb1c49de180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-27T18:12:12.255 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.253+0000 7f9aaffff640 1 -- 172.21.15.94:0/3872462658 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f9abc0b9ca0 con 0x7f9ac80c4ef0 2023-11-27T18:12:12.255 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.253+0000 7f9aaffff640 1 -- 172.21.15.94:0/3872462658 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7f9abc0b5070 con 0x7f9ac80c4ef0 2023-11-27T18:12:12.327 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.325+0000 7f9acd9bb640 1 -- 172.21.15.94:0/3872462658 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c3029f9a-1c48-4f5d-983a-172a614d8795", "id": 2} v 0) v1 -- 0x7f9ac814dca0 con 0x7f9ac80c4ef0 2023-11-27T18:12:12.372 INFO:tasks.ceph.mgr.x.smithi094.stderr:2023-11-27T18:12:12.369+0000 7fb1c49de180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-27T18:12:12.444 INFO:tasks.ceph.mgr.x.smithi094.stderr:2023-11-27T18:12:12.441+0000 7fb1c49de180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-27T18:12:12.581 INFO:tasks.ceph.mgr.x.smithi094.stderr:2023-11-27T18:12:12.577+0000 7fb1c49de180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-27T18:12:12.734 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.729+0000 7f9aaffff640 1 -- 172.21.15.94:0/3872462658 <== mon.1 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c3029f9a-1c48-4f5d-983a-172a614d8795", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9abc0cec00 con 0x7f9ac80c4ef0 2023-11-27T18:12:12.735 INFO:teuthology.orchestra.run.smithi094.stdout:2 2023-11-27T18:12:12.736 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.729+0000 7f9acd9bb640 1 -- 172.21.15.94:0/3872462658 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9ac80c4ef0 msgr2=0x7f9ac814add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:12.736 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.729+0000 7f9acd9bb640 1 --2- 172.21.15.94:0/3872462658 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9ac80c4ef0 0x7f9ac814add0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9abc01b880 tx=0x7f9abc01ba10 comp rx=0 tx=0).stop 2023-11-27T18:12:12.736 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.729+0000 7f9acd9bb640 1 -- 172.21.15.94:0/3872462658 shutdown_connections 2023-11-27T18:12:12.736 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.729+0000 7f9acd9bb640 1 --2- 172.21.15.94:0/3872462658 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9ac80c52d0 0x7f9ac81ed670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:12.736 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.729+0000 7f9acd9bb640 1 --2- 172.21.15.94:0/3872462658 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9ac80c4ef0 0x7f9ac814add0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:12.736 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.729+0000 7f9acd9bb640 1 --2- 172.21.15.94:0/3872462658 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9ac806b860 0x7f9ac81f0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:12.736 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.733+0000 7f9acd9bb640 1 -- 172.21.15.94:0/3872462658 >> 172.21.15.94:0/3872462658 conn(0x7f9ac8071820 msgr2=0x7f9ac806fc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:12:12.736 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.733+0000 7f9acd9bb640 1 -- 172.21.15.94:0/3872462658 shutdown_connections 2023-11-27T18:12:12.736 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.733+0000 7f9acd9bb640 1 -- 172.21.15.94:0/3872462658 wait complete. 2023-11-27T18:12:12.757 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --cluster ceph osd new ab4b6fb2-0126-491b-9224-54a6badc5da3 3 2023-11-27T18:12:12.789 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T18:12:12.786+0000 7f5f5adcb180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-27T18:12:12.864 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T18:12:12.862+0000 7f5f5adcb180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-27T18:12:12.917 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.913+0000 7f1de1ee7640 1 Processor -- start 2023-11-27T18:12:12.917 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.913+0000 7f1de1ee7640 1 -- start start 2023-11-27T18:12:12.919 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.917+0000 7f1de1ee7640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1ddc151630 0x7f1ddc072040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:12.919 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.917+0000 7f1de1ee7640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1ddc066360 0x7f1ddc072580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:12.922 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.917+0000 7f1de1ee7640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f1ddc06b7d0 0x7f1ddc1579d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:12.923 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.917+0000 7f1de1ee7640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ddc1575b0 con 0x7f1ddc06b7d0 2023-11-27T18:12:12.923 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.917+0000 7f1de1ee7640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ddc15b8a0 con 0x7f1ddc151630 2023-11-27T18:12:12.923 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.917+0000 7f1de1ee7640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ddc151a10 con 0x7f1ddc066360 2023-11-27T18:12:12.923 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.917+0000 7f1ddb7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1ddc151630 0x7f1ddc072040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:12.924 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.917+0000 7f1ddaffd640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1ddc066360 0x7f1ddc072580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:12.924 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.917+0000 7f1ddaffd640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1ddc066360 0x7f1ddc072580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.94:37100/0 (socket says 172.21.15.94:37100) 2023-11-27T18:12:12.924 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.917+0000 7f1ddb7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1ddc151630 0x7f1ddc072040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:45868/0 (socket says 172.21.15.94:45868) 2023-11-27T18:12:12.924 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.917+0000 7f1ddaffd640 1 -- 172.21.15.94:0/828319053 learned_addr learned my addr 172.21.15.94:0/828319053 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-11-27T18:12:12.926 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.917+0000 7f1ddbfff640 1 --2- 172.21.15.94:0/828319053 >> v2:172.21.15.91:3300/0 conn(0x7f1ddc06b7d0 0x7f1ddc1579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:12.926 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.921+0000 7f1ddaffd640 1 -- 172.21.15.94:0/828319053 >> v2:172.21.15.94:3300/0 conn(0x7f1ddc151630 msgr2=0x7f1ddc072040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:12:12.926 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.921+0000 7f1ddaffd640 1 --2- 172.21.15.94:0/828319053 >> v2:172.21.15.94:3300/0 conn(0x7f1ddc151630 0x7f1ddc072040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:12.926 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.921+0000 7f1ddaffd640 1 -- 172.21.15.94:0/828319053 >> v2:172.21.15.91:3300/0 conn(0x7f1ddc06b7d0 msgr2=0x7f1ddc1579d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:12:12.927 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.921+0000 7f1ddaffd640 1 --2- 172.21.15.94:0/828319053 >> v2:172.21.15.91:3300/0 conn(0x7f1ddc06b7d0 0x7f1ddc1579d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:12.927 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.921+0000 7f1ddaffd640 1 -- 172.21.15.94:0/828319053 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ddc15ad40 con 0x7f1ddc066360 2023-11-27T18:12:12.928 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.921+0000 7f1ddaffd640 1 --2- 172.21.15.94:0/828319053 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1ddc066360 0x7f1ddc072580 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc06e140 tx=0x7f1dcc01c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=316d15991b963f39 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:12:12.929 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.925+0000 7f1dda7fc640 1 -- 172.21.15.94:0/828319053 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc0ac600 con 0x7f1ddc066360 2023-11-27T18:12:12.930 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.925+0000 7f1dda7fc640 1 -- 172.21.15.94:0/828319053 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dcc0a8050 con 0x7f1ddc066360 2023-11-27T18:12:12.930 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.925+0000 7f1dda7fc640 1 -- 172.21.15.94:0/828319053 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc0ac980 con 0x7f1ddc066360 2023-11-27T18:12:12.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.925+0000 7f1de1ee7640 1 -- 172.21.15.94:0/828319053 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1ddc066360 msgr2=0x7f1ddc072580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:12.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.925+0000 7f1de1ee7640 1 --2- 172.21.15.94:0/828319053 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1ddc066360 0x7f1ddc072580 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc06e140 tx=0x7f1dcc01c4d0 comp rx=0 tx=0).stop 2023-11-27T18:12:12.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.925+0000 7f1de1ee7640 1 -- 172.21.15.94:0/828319053 shutdown_connections 2023-11-27T18:12:12.932 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.925+0000 7f1de1ee7640 1 --2- 172.21.15.94:0/828319053 >> v2:172.21.15.91:3300/0 conn(0x7f1ddc06b7d0 0x7f1ddc1579d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:12.936 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.925+0000 7f1de1ee7640 1 --2- 172.21.15.94:0/828319053 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1ddc066360 0x7f1ddc072580 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:12.936 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.925+0000 7f1de1ee7640 1 --2- 172.21.15.94:0/828319053 >> v2:172.21.15.94:3300/0 conn(0x7f1ddc151630 0x7f1ddc072040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:12.936 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.925+0000 7f1de1ee7640 1 -- 172.21.15.94:0/828319053 >> 172.21.15.94:0/828319053 conn(0x7f1ddc071520 msgr2=0x7f1ddc071930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:12:12.936 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.925+0000 7f1de1ee7640 1 -- 172.21.15.94:0/828319053 shutdown_connections 2023-11-27T18:12:12.936 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.925+0000 7f1de1ee7640 1 -- 172.21.15.94:0/828319053 wait complete. 2023-11-27T18:12:12.938 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.929+0000 7f1de1ee7640 1 Processor -- start 2023-11-27T18:12:12.938 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.929+0000 7f1de1ee7640 1 -- start start 2023-11-27T18:12:12.938 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.929+0000 7f1de1ee7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1ddc066360 0x7f1ddc1452a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:12.938 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.929+0000 7f1de1ee7640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1ddc06b7d0 0x7f1ddc13cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:12.939 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.929+0000 7f1de1ee7640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1ddc151630 0x7f1ddc142d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:12.939 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.929+0000 7f1de1ee7640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ddc134c50 con 0x7f1ddc06b7d0 2023-11-27T18:12:12.939 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.929+0000 7f1de1ee7640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ddc159e50 con 0x7f1ddc066360 2023-11-27T18:12:12.939 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.929+0000 7f1de1ee7640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ddc158fa0 con 0x7f1ddc151630 2023-11-27T18:12:12.939 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.929+0000 7f1ddbfff640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1ddc151630 0x7f1ddc142d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:12.941 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.929+0000 7f1ddb7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1ddc066360 0x7f1ddc1452a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:12.941 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.929+0000 7f1ddbfff640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1ddc151630 0x7f1ddc142d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.94:37112/0 (socket says 172.21.15.94:37112) 2023-11-27T18:12:12.941 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.929+0000 7f1ddbfff640 1 -- 172.21.15.94:0/2934099569 learned_addr learned my addr 172.21.15.94:0/2934099569 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-11-27T18:12:12.941 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.929+0000 7f1ddaffd640 1 --2- 172.21.15.94:0/2934099569 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1ddc06b7d0 0x7f1ddc13cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:12.941 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.933+0000 7f1ddb7fe640 1 -- 172.21.15.94:0/2934099569 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1ddc151630 msgr2=0x7f1ddc142d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:12.941 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.933+0000 7f1ddb7fe640 1 --2- 172.21.15.94:0/2934099569 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1ddc151630 0x7f1ddc142d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:12.941 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.933+0000 7f1ddb7fe640 1 -- 172.21.15.94:0/2934099569 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1ddc06b7d0 msgr2=0x7f1ddc13cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:12.942 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.933+0000 7f1ddb7fe640 1 --2- 172.21.15.94:0/2934099569 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1ddc06b7d0 0x7f1ddc13cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:12.942 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.933+0000 7f1ddb7fe640 1 -- 172.21.15.94:0/2934099569 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dcc0094d0 con 0x7f1ddc066360 2023-11-27T18:12:12.942 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.933+0000 7f1ddbfff640 1 --2- 172.21.15.94:0/2934099569 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1ddc151630 0x7f1ddc142d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T18:12:12.942 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.937+0000 7f1ddb7fe640 1 --2- 172.21.15.94:0/2934099569 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1ddc066360 0x7f1ddc1452a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1dd000e870 tx=0x7f1dd000ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:12:12.944 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.941+0000 7f1dc3fff640 1 -- 172.21.15.94:0/2934099569 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd00095d0 con 0x7f1ddc066360 2023-11-27T18:12:12.944 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.941+0000 7f1dc3fff640 1 -- 172.21.15.94:0/2934099569 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd000c940 con 0x7f1ddc066360 2023-11-27T18:12:12.944 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.941+0000 7f1dc3fff640 1 -- 172.21.15.94:0/2934099569 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd000ccb0 con 0x7f1ddc066360 2023-11-27T18:12:12.945 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.941+0000 7f1de1ee7640 1 -- 172.21.15.94:0/2934099569 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ddc159240 con 0x7f1ddc066360 2023-11-27T18:12:12.945 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.941+0000 7f1de1ee7640 1 -- 172.21.15.94:0/2934099569 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ddc159800 con 0x7f1ddc066360 2023-11-27T18:12:12.946 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:12.945+0000 7f1de1ee7640 1 -- 172.21.15.94:0/2934099569 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ddc04e850 con 0x7f1ddc066360 2023-11-27T18:12:13.035 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T18:12:13.034+0000 7f5f5adcb180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-27T18:12:13.057 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.053+0000 7f1dc3fff640 1 -- 172.21.15.94:0/2934099569 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f1dd00059a0 con 0x7f1ddc066360 2023-11-27T18:12:13.057 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.053+0000 7f1dc3fff640 1 -- 172.21.15.94:0/2934099569 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f1dd0013900 con 0x7f1ddc066360 2023-11-27T18:12:13.057 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.053+0000 7f1dc3fff640 1 -- 172.21.15.94:0/2934099569 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7f1dd0021060 con 0x7f1ddc066360 2023-11-27T18:12:13.108 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T18:12:13.106+0000 7f5f5adcb180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-27T18:12:13.124 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.121+0000 7f1de1ee7640 1 -- 172.21.15.94:0/2934099569 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ab4b6fb2-0126-491b-9224-54a6badc5da3", "id": 3} v 0) v1 -- 0x7f1ddc0c5260 con 0x7f1ddc066360 2023-11-27T18:12:13.228 INFO:tasks.ceph.mgr.x.smithi094.stderr:2023-11-27T18:12:13.225+0000 7fb1c49de180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-27T18:12:13.307 INFO:tasks.ceph.mgr.x.smithi094.stderr:2023-11-27T18:12:13.305+0000 7fb1c49de180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-27T18:12:13.392 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.389+0000 7f1dc3fff640 1 -- 172.21.15.94:0/2934099569 <== mon.1 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ab4b6fb2-0126-491b-9224-54a6badc5da3", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1dd0017070 con 0x7f1ddc066360 2023-11-27T18:12:13.393 INFO:teuthology.orchestra.run.smithi094.stdout:3 2023-11-27T18:12:13.394 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.393+0000 7f1de1ee7640 1 -- 172.21.15.94:0/2934099569 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1ddc066360 msgr2=0x7f1ddc1452a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:13.394 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.393+0000 7f1de1ee7640 1 --2- 172.21.15.94:0/2934099569 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1ddc066360 0x7f1ddc1452a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1dd000e870 tx=0x7f1dd000ed30 comp rx=0 tx=0).stop 2023-11-27T18:12:13.394 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.393+0000 7f1de1ee7640 1 -- 172.21.15.94:0/2934099569 shutdown_connections 2023-11-27T18:12:13.394 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.393+0000 7f1de1ee7640 1 --2- 172.21.15.94:0/2934099569 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1ddc151630 0x7f1ddc142d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:13.395 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.393+0000 7f1de1ee7640 1 --2- 172.21.15.94:0/2934099569 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1ddc06b7d0 0x7f1ddc13cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:13.395 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.393+0000 7f1de1ee7640 1 --2- 172.21.15.94:0/2934099569 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1ddc066360 0x7f1ddc1452a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:13.395 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.393+0000 7f1de1ee7640 1 -- 172.21.15.94:0/2934099569 >> 172.21.15.94:0/2934099569 conn(0x7f1ddc071520 msgr2=0x7f1ddc14eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:12:13.395 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.393+0000 7f1de1ee7640 1 -- 172.21.15.94:0/2934099569 shutdown_connections 2023-11-27T18:12:13.395 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.393+0000 7f1de1ee7640 1 -- 172.21.15.94:0/2934099569 wait complete. 2023-11-27T18:12:13.405 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T18:12:13.406+0000 7f5f5adcb180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-27T18:12:13.413 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --cluster ceph osd new 695071a8-2de8-4cba-bf20-050021a03bb4 4 2023-11-27T18:12:13.467 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T18:12:13.466+0000 7f5f5adcb180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-27T18:12:13.495 INFO:tasks.ceph.mgr.x.smithi094.stderr:2023-11-27T18:12:13.493+0000 7fb1c49de180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-27T18:12:13.554 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.553+0000 7fe7d2471640 1 Processor -- start 2023-11-27T18:12:13.554 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.553+0000 7fe7d2471640 1 -- start start 2023-11-27T18:12:13.555 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.553+0000 7fe7d2471640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fe7cc06f060 0x7fe7cc0c6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:13.555 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.553+0000 7fe7d2471640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe7cc06e6c0 0x7fe7cc06ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:13.555 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.553+0000 7fe7d2471640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7cc06d6b0 con 0x7fe7cc1517e0 2023-11-27T18:12:13.555 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.553+0000 7fe7d2471640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7cc06b170 con 0x7fe7cc06f060 2023-11-27T18:12:13.555 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.553+0000 7fe7d2471640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7cc151bc0 con 0x7fe7cc06e6c0 2023-11-27T18:12:13.555 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.553+0000 7fe7d0a0e640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe7cc06e6c0 0x7fe7cc06ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:13.556 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.553+0000 7fe7cbfff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fe7cc1517e0 0x7fe7cc06a520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:36200/0 (socket says 172.21.15.94:36200) 2023-11-27T18:12:13.556 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.553+0000 7fe7cbfff640 1 -- 172.21.15.94:0/8319669 learned_addr learned my addr 172.21.15.94:0/8319669 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-11-27T18:12:13.559 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.557+0000 7fe7d0a0e640 1 -- 172.21.15.94:0/8319669 >> v2:172.21.15.91:3300/0 conn(0x7fe7cc06f060 msgr2=0x7fe7cc0c6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:12:13.559 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.557+0000 7fe7d0a0e640 1 --2- 172.21.15.94:0/8319669 >> v2:172.21.15.91:3300/0 conn(0x7fe7cc06f060 0x7fe7cc0c6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:13.559 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.557+0000 7fe7d0a0e640 1 -- 172.21.15.94:0/8319669 >> v1:172.21.15.94:6789/0 conn(0x7fe7cc1517e0 legacy=0x7fe7cc06a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:13.559 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.557+0000 7fe7d0a0e640 1 -- 172.21.15.94:0/8319669 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7cc158250 con 0x7fe7cc06e6c0 2023-11-27T18:12:13.562 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.561+0000 7fe7d0a0e640 1 --2- 172.21.15.94:0/8319669 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe7cc06e6c0 0x7fe7cc06ac30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4009d90 tx=0x7fe7c401c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bef7e0730b84ccf7 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:12:13.567 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.565+0000 7fe7cb7fe640 1 -- 172.21.15.94:0/8319669 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c40a5a10 con 0x7fe7cc06e6c0 2023-11-27T18:12:13.567 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.565+0000 7fe7cb7fe640 1 -- 172.21.15.94:0/8319669 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c40a5b70 con 0x7fe7cc06e6c0 2023-11-27T18:12:13.567 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.565+0000 7fe7cb7fe640 1 -- 172.21.15.94:0/8319669 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c40ad440 con 0x7fe7cc06e6c0 2023-11-27T18:12:13.567 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.565+0000 7fe7d2471640 1 -- 172.21.15.94:0/8319669 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe7cc06e6c0 msgr2=0x7fe7cc06ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:13.567 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.565+0000 7fe7d2471640 1 --2- 172.21.15.94:0/8319669 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe7cc06e6c0 0x7fe7cc06ac30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4009d90 tx=0x7fe7c401c950 comp rx=0 tx=0).stop 2023-11-27T18:12:13.568 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.565+0000 7fe7d2471640 1 -- 172.21.15.94:0/8319669 shutdown_connections 2023-11-27T18:12:13.568 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.565+0000 7fe7d2471640 1 --2- 172.21.15.94:0/8319669 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe7cc06e6c0 0x7fe7cc06ac30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:13.568 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.565+0000 7fe7d2471640 1 --2- 172.21.15.94:0/8319669 >> v2:172.21.15.91:3300/0 conn(0x7fe7cc06f060 0x7fe7cc0c6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:13.568 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.565+0000 7fe7d2471640 1 -- 172.21.15.94:0/8319669 >> 172.21.15.94:0/8319669 conn(0x7fe7cc0c8aa0 msgr2=0x7fe7cc0c8e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:12:13.568 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.565+0000 7fe7d2471640 1 -- 172.21.15.94:0/8319669 shutdown_connections 2023-11-27T18:12:13.568 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.565+0000 7fe7d2471640 1 -- 172.21.15.94:0/8319669 wait complete. 2023-11-27T18:12:13.570 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.565+0000 7fe7d2471640 1 Processor -- start 2023-11-27T18:12:13.570 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.565+0000 7fe7d2471640 1 -- start start 2023-11-27T18:12:13.570 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.565+0000 7fe7d2471640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe7cc06e6c0 0x7fe7cc0c4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:13.570 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.565+0000 7fe7d2471640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe7cc06f060 0x7fe7cc14ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:13.570 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.565+0000 7fe7d2471640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe7cc1517e0 0x7fe7cc14e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:13.570 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.565+0000 7fe7d2471640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7cc1f3e50 con 0x7fe7cc06e6c0 2023-11-27T18:12:13.570 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.565+0000 7fe7d2471640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7cc13b8a0 con 0x7fe7cc06f060 2023-11-27T18:12:13.570 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.565+0000 7fe7d2471640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7cc141a00 con 0x7fe7cc1517e0 2023-11-27T18:12:13.570 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.569+0000 7fe7c3fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe7cc06f060 0x7fe7cc14ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:13.570 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.569+0000 7fe7d0a0e640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe7cc1517e0 0x7fe7cc14e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:13.571 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.569+0000 7fe7c3fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe7cc06f060 0x7fe7cc14ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:45882/0 (socket says 172.21.15.94:45882) 2023-11-27T18:12:13.571 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.569+0000 7fe7c3fff640 1 -- 172.21.15.94:0/1311194118 learned_addr learned my addr 172.21.15.94:0/1311194118 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-11-27T18:12:13.574 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.569+0000 7fe7c3fff640 1 -- 172.21.15.94:0/1311194118 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe7cc1517e0 msgr2=0x7fe7cc14e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:13.574 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.573+0000 7fe7c3fff640 1 --2- 172.21.15.94:0/1311194118 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe7cc1517e0 0x7fe7cc14e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:13.574 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.573+0000 7fe7c3fff640 1 -- 172.21.15.94:0/1311194118 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe7cc06e6c0 msgr2=0x7fe7cc0c4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:13.574 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.573+0000 7fe7c3fff640 1 --2- 172.21.15.94:0/1311194118 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe7cc06e6c0 0x7fe7cc0c4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:13.574 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.573+0000 7fe7c3fff640 1 -- 172.21.15.94:0/1311194118 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c4009a70 con 0x7fe7cc06f060 2023-11-27T18:12:13.579 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.573+0000 7fe7c3fff640 1 --2- 172.21.15.94:0/1311194118 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe7cc06f060 0x7fe7cc14ae90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe7b400b550 tx=0x7fe7b400ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:12:13.580 INFO:tasks.ceph.mgr.x.smithi094.stderr:2023-11-27T18:12:13.577+0000 7fb1c49de180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-27T18:12:13.581 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.577+0000 7fe7c97fa640 1 -- 172.21.15.94:0/1311194118 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b4010870 con 0x7fe7cc06f060 2023-11-27T18:12:13.581 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.577+0000 7fe7d2471640 1 -- 172.21.15.94:0/1311194118 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7cc141cc0 con 0x7fe7cc06f060 2023-11-27T18:12:13.581 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.577+0000 7fe7d2471640 1 -- 172.21.15.94:0/1311194118 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7cc1f3ae0 con 0x7fe7cc06f060 2023-11-27T18:12:13.581 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.577+0000 7fe7c97fa640 1 -- 172.21.15.94:0/1311194118 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b40109d0 con 0x7fe7cc06f060 2023-11-27T18:12:13.581 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.577+0000 7fe7c97fa640 1 -- 172.21.15.94:0/1311194118 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b4010d40 con 0x7fe7cc06f060 2023-11-27T18:12:13.581 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.577+0000 7fe7d2471640 1 -- 172.21.15.94:0/1311194118 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7b0005260 con 0x7fe7cc06f060 2023-11-27T18:12:13.701 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.697+0000 7fe7c97fa640 1 -- 172.21.15.94:0/1311194118 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7fe7b4019450 con 0x7fe7cc06f060 2023-11-27T18:12:13.701 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.697+0000 7fe7c97fa640 1 -- 172.21.15.94:0/1311194118 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fe7b4023c20 con 0x7fe7cc06f060 2023-11-27T18:12:13.701 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.697+0000 7fe7c97fa640 1 -- 172.21.15.94:0/1311194118 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7fe7b4038ce0 con 0x7fe7cc06f060 2023-11-27T18:12:13.769 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:13.765+0000 7fe7d2471640 1 -- 172.21.15.94:0/1311194118 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd new", "uuid": "695071a8-2de8-4cba-bf20-050021a03bb4", "id": 4} v 0) v1 -- 0x7fe7b00050d0 con 0x7fe7cc06f060 2023-11-27T18:12:13.876 INFO:tasks.ceph.mgr.x.smithi094.stderr:2023-11-27T18:12:13.873+0000 7fb1c49de180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-27T18:12:13.939 INFO:tasks.ceph.mgr.x.smithi094.stderr:2023-11-27T18:12:13.937+0000 7fb1c49de180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-27T18:12:14.163 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:14.161+0000 7fe7c97fa640 1 -- 172.21.15.94:0/1311194118 <== mon.1 v2:172.21.15.94:3300/0 7 ==== mgrmap(e 2) v1 ==== 43033+0+0 (secure 0 0 0) 0x7fe7b4023710 con 0x7fe7cc06f060 2023-11-27T18:12:14.497 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T18:12:14.498+0000 7f5f55d83640 -1 mgr handle_mgr_map I was active but no longer am 2023-11-27T18:12:14.757 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T18:12:14.758+0000 7efdfbad1180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-27T18:12:14.886 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:14.885+0000 7fe7c97fa640 1 -- 172.21.15.94:0/1311194118 <== mon.1 v2:172.21.15.94:3300/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "695071a8-2de8-4cba-bf20-050021a03bb4", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe7b400dd30 con 0x7fe7cc06f060 2023-11-27T18:12:14.887 INFO:teuthology.orchestra.run.smithi094.stdout:4 2023-11-27T18:12:14.888 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:14.885+0000 7fe7d2471640 1 -- 172.21.15.94:0/1311194118 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe7cc06f060 msgr2=0x7fe7cc14ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:14.888 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:14.885+0000 7fe7d2471640 1 --2- 172.21.15.94:0/1311194118 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe7cc06f060 0x7fe7cc14ae90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe7b400b550 tx=0x7fe7b400ba10 comp rx=0 tx=0).stop 2023-11-27T18:12:14.888 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:14.885+0000 7fe7d2471640 1 -- 172.21.15.94:0/1311194118 shutdown_connections 2023-11-27T18:12:14.888 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:14.885+0000 7fe7d2471640 1 --2- 172.21.15.94:0/1311194118 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe7cc1517e0 0x7fe7cc14e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:14.889 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:14.885+0000 7fe7d2471640 1 --2- 172.21.15.94:0/1311194118 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe7cc06f060 0x7fe7cc14ae90 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:14.889 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:14.885+0000 7fe7d2471640 1 --2- 172.21.15.94:0/1311194118 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe7cc06e6c0 0x7fe7cc0c4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:14.889 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:14.885+0000 7fe7d2471640 1 -- 172.21.15.94:0/1311194118 >> 172.21.15.94:0/1311194118 conn(0x7fe7cc0c8aa0 msgr2=0x7fe7cc06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:12:14.889 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:14.885+0000 7fe7d2471640 1 -- 172.21.15.94:0/1311194118 shutdown_connections 2023-11-27T18:12:14.889 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:14.885+0000 7fe7d2471640 1 -- 172.21.15.94:0/1311194118 wait complete. 2023-11-27T18:12:14.912 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --cluster ceph osd new ca01da14-a700-4845-8db2-f5e3370677e6 5 2023-11-27T18:12:15.060 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:15.057+0000 7fa709fe9640 1 Processor -- start 2023-11-27T18:12:15.060 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:15.057+0000 7fa709fe9640 1 -- start start 2023-11-27T18:12:15.061 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:15.057+0000 7fa709fe9640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa704153750 0x7fa70406a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:15.061 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:15.057+0000 7fa709fe9640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa70406f840 0x7fa70415cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:15.061 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:15.057+0000 7fa709fe9640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7040c75b0 con 0x7fa704066560 2023-11-27T18:12:15.062 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:15.057+0000 7fa709fe9640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa70415d720 con 0x7fa70406f840 2023-11-27T18:12:15.062 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:15.057+0000 7fa709fe9640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7040720e0 con 0x7fa704153750 2023-11-27T18:12:15.076 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:15.073+0000 7fa702ffd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa70406f840 0x7fa70415cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:15.078 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:15.073+0000 7fa702ffd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa70406f840 0x7fa70415cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35336/0 (socket says 172.21.15.94:35336) 2023-11-27T18:12:15.078 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:15.073+0000 7fa702ffd640 1 -- 172.21.15.94:0/752692032 learned_addr learned my addr 172.21.15.94:0/752692032 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-11-27T18:12:15.079 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:15.077+0000 7fa702ffd640 1 -- 172.21.15.94:0/752692032 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa704153750 msgr2=0x7fa70406a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:12:15.079 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:15.077+0000 7fa702ffd640 1 --2- 172.21.15.94:0/752692032 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa704153750 0x7fa70406a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:15.079 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:15.077+0000 7fa702ffd640 1 -- 172.21.15.94:0/752692032 >> v1:172.21.15.91:6789/0 conn(0x7fa704066560 legacy=0x7fa70415d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:12:15.079 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:15.077+0000 7fa702ffd640 1 -- 172.21.15.94:0/752692032 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7040c7280 con 0x7fa70406f840 2023-11-27T18:12:15.084 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:15.081+0000 7fa702ffd640 1 --2- 172.21.15.94:0/752692032 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa70406f840 0x7fa70415cad0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec009870 tx=0x7fa6ec01ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9f0b9668e786ac2 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:12:15.089 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:15.085+0000 7fa7027fc640 1 -- 172.21.15.94:0/752692032 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec0a89b0 con 0x7fa70406f840 2023-11-27T18:12:15.089 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:15.085+0000 7fa7027fc640 1 -- 172.21.15.94:0/752692032 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6ec0a8b10 con 0x7fa70406f840 2023-11-27T18:12:15.090 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:15.085+0000 7fa7027fc640 1 -- 172.21.15.94:0/752692032 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec0a8ea0 con 0x7fa70406f840 2023-11-27T18:12:15.090 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:15.089+0000 7fa709fe9640 1 -- 172.21.15.94:0/752692032 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa70406f840 msgr2=0x7fa70415cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:15.090 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:15.089+0000 7fa709fe9640 1 --2- 172.21.15.94:0/752692032 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa70406f840 0x7fa70415cad0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec009870 tx=0x7fa6ec01ecf0 comp rx=0 tx=0).stop 2023-11-27T18:12:15.091 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:15.089+0000 7fa709fe9640 1 -- 172.21.15.94:0/752692032 shutdown_connections 2023-11-27T18:12:15.091 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:15.089+0000 7fa709fe9640 1 --2- 172.21.15.94:0/752692032 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa70406f840 0x7fa70415cad0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:15.091 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:15.089+0000 7fa709fe9640 1 --2- 172.21.15.94:0/752692032 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa704153750 0x7fa70406a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:15.091 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:15.089+0000 7fa709fe9640 1 -- 172.21.15.94:0/752692032 >> 172.21.15.94:0/752692032 conn(0x7fa704071520 msgr2=0x7fa704071930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:12:15.091 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:15.089+0000 7fa709fe9640 1 -- 172.21.15.94:0/752692032 shutdown_connections 2023-11-27T18:12:15.091 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:15.089+0000 7fa709fe9640 1 -- 172.21.15.94:0/752692032 wait complete. 2023-11-27T18:12:15.091 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:15.089+0000 7fa709fe9640 1 Processor -- start 2023-11-27T18:12:15.092 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:15.089+0000 7fa709fe9640 1 -- start start 2023-11-27T18:12:15.092 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:15.089+0000 7fa709fe9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa704066560 0x7fa7041568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:15.092 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:15.089+0000 7fa709fe9640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa70406f840 0x7fa70415bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:15.092 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:15.089+0000 7fa709fe9640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa704153750 0x7fa7041ef900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:15.093 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:15.089+0000 7fa709fe9640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7041f3580 con 0x7fa70406f840 2023-11-27T18:12:15.093 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:15.089+0000 7fa709fe9640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa704149440 con 0x7fa704066560 2023-11-27T18:12:15.093 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:15.089+0000 7fa709fe9640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7041ef470 con 0x7fa704153750 2023-11-27T18:12:15.093 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:15.089+0000 7fa703fff640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa704153750 0x7fa7041ef900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:15.093 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:15.089+0000 7fa703fff640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa704153750 0x7fa7041ef900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.94:38510/0 (socket says 172.21.15.94:38510) 2023-11-27T18:12:15.093 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:15.089+0000 7fa703fff640 1 -- 172.21.15.94:0/3907050860 learned_addr learned my addr 172.21.15.94:0/3907050860 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-11-27T18:12:15.097 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:15.093+0000 7fa703fff640 1 -- 172.21.15.94:0/3907050860 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa704066560 msgr2=0x7fa7041568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:15.097 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:15.093+0000 7fa703fff640 1 --2- 172.21.15.94:0/3907050860 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa704066560 0x7fa7041568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:15.097 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:15.093+0000 7fa703fff640 1 -- 172.21.15.94:0/3907050860 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa70406f840 msgr2=0x7fa70415bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:15.098 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:15.093+0000 7fa703fff640 1 --2- 172.21.15.94:0/3907050860 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa70406f840 0x7fa70415bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:15.098 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:15.093+0000 7fa703fff640 1 -- 172.21.15.94:0/3907050860 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6ec0094d0 con 0x7fa704153750 2023-11-27T18:12:15.099 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:15.097+0000 7fa703fff640 1 --2- 172.21.15.94:0/3907050860 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa704153750 0x7fa7041ef900 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa6f400c780 tx=0x7fa6f400cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:12:15.103 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:15.101+0000 7fa6fbfff640 1 -- 172.21.15.94:0/3907050860 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f4003d90 con 0x7fa704153750 2023-11-27T18:12:15.103 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:15.101+0000 7fa6fbfff640 1 -- 172.21.15.94:0/3907050860 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f400ce90 con 0x7fa704153750 2023-11-27T18:12:15.103 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:15.101+0000 7fa6fbfff640 1 -- 172.21.15.94:0/3907050860 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f40052b0 con 0x7fa704153750 2023-11-27T18:12:15.104 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:15.101+0000 7fa709fe9640 1 -- 172.21.15.94:0/3907050860 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7041ef170 con 0x7fa704153750 2023-11-27T18:12:15.104 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:15.101+0000 7fa709fe9640 1 -- 172.21.15.94:0/3907050860 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7041f32a0 con 0x7fa704153750 2023-11-27T18:12:15.104 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:15.101+0000 7fa709fe9640 1 -- 172.21.15.94:0/3907050860 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa70404e850 con 0x7fa704153750 2023-11-27T18:12:15.166 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T18:12:15.166+0000 7efdfbad1180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-27T18:12:15.226 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:15.225+0000 7fa6fbfff640 1 -- 172.21.15.94:0/3907050860 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 2) v1 ==== 43033+0+0 (secure 0 0 0) 0x7fa6f4006b20 con 0x7fa704153750 2023-11-27T18:12:15.246 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:15.237+0000 7fa6fbfff640 1 -- 172.21.15.94:0/3907050860 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fa6f40196d0 con 0x7fa704153750 2023-11-27T18:12:15.246 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:15.237+0000 7fa6fbfff640 1 -- 172.21.15.94:0/3907050860 <== mon.2 v2:172.21.15.94:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7fa6f40194f0 con 0x7fa704153750 2023-11-27T18:12:15.304 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T18:12:15.302+0000 7efdfbad1180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-27T18:12:15.327 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:15.325+0000 7fa709fe9640 1 -- 172.21.15.94:0/3907050860 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ca01da14-a700-4845-8db2-f5e3370677e6", "id": 5} v 0) v1 -- 0x7fa7040c63a0 con 0x7fa704153750 2023-11-27T18:12:15.732 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T18:12:15.730+0000 7efdfbad1180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-27T18:12:15.747 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:15.745+0000 7fa6fbfff640 1 -- 172.21.15.94:0/3907050860 <== mon.2 v2:172.21.15.94:3301/0 7 ==== mgrmap(e 3) v1 ==== 85702+0+0 (secure 0 0 0) 0x7fa6f401acb0 con 0x7fa704153750 2023-11-27T18:12:15.783 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T18:12:15.782+0000 7efdfbad1180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-27T18:12:15.832 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T18:12:15.830+0000 7efdfbad1180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-27T18:12:15.908 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T18:12:15.906+0000 7efdfbad1180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-27T18:12:15.958 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T18:12:15.958+0000 7efdfbad1180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-27T18:12:16.033 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T18:12:16.030+0000 7efdfbad1180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-27T18:12:16.034 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.033+0000 7fa6fbfff640 1 -- 172.21.15.94:0/3907050860 <== mon.2 v2:172.21.15.94:3301/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ca01da14-a700-4845-8db2-f5e3370677e6", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa6f4053120 con 0x7fa704153750 2023-11-27T18:12:16.035 INFO:teuthology.orchestra.run.smithi094.stdout:5 2023-11-27T18:12:16.036 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.033+0000 7fa709fe9640 1 -- 172.21.15.94:0/3907050860 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa704153750 msgr2=0x7fa7041ef900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:16.036 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.033+0000 7fa709fe9640 1 --2- 172.21.15.94:0/3907050860 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa704153750 0x7fa7041ef900 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa6f400c780 tx=0x7fa6f400cc40 comp rx=0 tx=0).stop 2023-11-27T18:12:16.036 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.033+0000 7fa709fe9640 1 -- 172.21.15.94:0/3907050860 shutdown_connections 2023-11-27T18:12:16.036 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.033+0000 7fa709fe9640 1 --2- 172.21.15.94:0/3907050860 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa704153750 0x7fa7041ef900 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:16.036 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.033+0000 7fa709fe9640 1 --2- 172.21.15.94:0/3907050860 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa70406f840 0x7fa70415bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:16.036 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.033+0000 7fa709fe9640 1 --2- 172.21.15.94:0/3907050860 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa704066560 0x7fa7041568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:16.036 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.033+0000 7fa709fe9640 1 -- 172.21.15.94:0/3907050860 >> 172.21.15.94:0/3907050860 conn(0x7fa704071520 msgr2=0x7fa7041526a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:12:16.037 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.033+0000 7fa709fe9640 1 -- 172.21.15.94:0/3907050860 shutdown_connections 2023-11-27T18:12:16.037 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.033+0000 7fa709fe9640 1 -- 172.21.15.94:0/3907050860 wait complete. 2023-11-27T18:12:16.058 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --cluster ceph osd new 4784bc77-6c33-4e47-abba-d37484982f77 6 2023-11-27T18:12:16.082 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T18:12:16.082+0000 7efdfbad1180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-27T18:12:16.179 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.177+0000 7f48a10f4640 1 Processor -- start 2023-11-27T18:12:16.179 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.177+0000 7f48a10f4640 1 -- start start 2023-11-27T18:12:16.180 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.177+0000 7f48a10f4640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f489c150260 0x7f489c0c9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:16.180 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.177+0000 7f48a10f4640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f489c0c7cc0 0x7f489c0c8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:16.180 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.177+0000 7f48a10f4640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f489c156d00 con 0x7f489c0c0fc0 2023-11-27T18:12:16.180 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.177+0000 7f48a10f4640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f489c0c7830 con 0x7f489c0c7cc0 2023-11-27T18:12:16.181 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.177+0000 7f48a10f4640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f489c157230 con 0x7f489c150260 2023-11-27T18:12:16.203 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.201+0000 7f489a59c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f489c0c7cc0 0x7f489c0c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:16.204 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.201+0000 7f489b59e640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f489c0c0fc0 0x7f489c0c1450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.94:44900/0 (socket says 172.21.15.94:44900) 2023-11-27T18:12:16.204 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.201+0000 7f489b59e640 1 -- 172.21.15.94:0/1445175165 learned_addr learned my addr 172.21.15.94:0/1445175165 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-11-27T18:12:16.211 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.209+0000 7f489a59c640 1 -- 172.21.15.94:0/1445175165 >> v2:172.21.15.94:3300/0 conn(0x7f489c150260 msgr2=0x7f489c0c9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:12:16.211 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.209+0000 7f489a59c640 1 --2- 172.21.15.94:0/1445175165 >> v2:172.21.15.94:3300/0 conn(0x7f489c150260 0x7f489c0c9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:16.213 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.209+0000 7f489a59c640 1 -- 172.21.15.94:0/1445175165 >> v1:172.21.15.91:6789/0 conn(0x7f489c0c0fc0 legacy=0x7f489c0c1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:16.214 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.209+0000 7f489a59c640 1 -- 172.21.15.94:0/1445175165 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f489c0c6e60 con 0x7f489c0c7cc0 2023-11-27T18:12:16.214 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T18:12:16.214+0000 7efdfbad1180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-27T18:12:16.223 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.217+0000 7f489a59c640 1 --2- 172.21.15.94:0/1445175165 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f489c0c7cc0 0x7f489c0c8100 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f489c071cb0 tx=0x7f489001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37e5a7da2d48114c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:12:16.235 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.233+0000 7f4899d9b640 1 -- 172.21.15.94:0/1445175165 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48900ab660 con 0x7f489c0c7cc0 2023-11-27T18:12:16.235 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.233+0000 7f4899d9b640 1 -- 172.21.15.94:0/1445175165 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48900ab7c0 con 0x7f489c0c7cc0 2023-11-27T18:12:16.235 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.233+0000 7f4899d9b640 1 -- 172.21.15.94:0/1445175165 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48900abb50 con 0x7f489c0c7cc0 2023-11-27T18:12:16.237 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.233+0000 7f48a10f4640 1 -- 172.21.15.94:0/1445175165 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f489c0c7cc0 msgr2=0x7f489c0c8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:16.237 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.233+0000 7f48a10f4640 1 --2- 172.21.15.94:0/1445175165 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f489c0c7cc0 0x7f489c0c8100 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f489c071cb0 tx=0x7f489001c460 comp rx=0 tx=0).stop 2023-11-27T18:12:16.237 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.233+0000 7f48a10f4640 1 -- 172.21.15.94:0/1445175165 shutdown_connections 2023-11-27T18:12:16.237 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.233+0000 7f48a10f4640 1 --2- 172.21.15.94:0/1445175165 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f489c0c7cc0 0x7f489c0c8100 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:16.237 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.233+0000 7f48a10f4640 1 --2- 172.21.15.94:0/1445175165 >> v2:172.21.15.94:3300/0 conn(0x7f489c150260 0x7f489c0c9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:16.237 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.233+0000 7f48a10f4640 1 -- 172.21.15.94:0/1445175165 >> 172.21.15.94:0/1445175165 conn(0x7f489c0c8aa0 msgr2=0x7f489c0c8e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:12:16.238 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.233+0000 7f48a10f4640 1 -- 172.21.15.94:0/1445175165 shutdown_connections 2023-11-27T18:12:16.238 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.233+0000 7f48a10f4640 1 -- 172.21.15.94:0/1445175165 wait complete. 2023-11-27T18:12:16.239 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.237+0000 7f48a10f4640 1 Processor -- start 2023-11-27T18:12:16.239 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.237+0000 7f48a10f4640 1 -- start start 2023-11-27T18:12:16.242 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.241+0000 7f48a10f4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f489c0c0fc0 0x7f489c13d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:16.242 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.241+0000 7f48a10f4640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f489c0c7cc0 0x7f489c1f3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:16.242 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.241+0000 7f48a10f4640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f489c150260 0x7f489c06a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:16.242 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.241+0000 7f48a10f4640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489c1381b0 con 0x7f489c0c7cc0 2023-11-27T18:12:16.243 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.241+0000 7f48a10f4640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489c14dcd0 con 0x7f489c0c0fc0 2023-11-27T18:12:16.243 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.241+0000 7f48a10f4640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f489c1385d0 con 0x7f489c150260 2023-11-27T18:12:16.243 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.241+0000 7f489ad9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f489c0c0fc0 0x7f489c13d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:16.244 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.241+0000 7f489ad9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f489c0c0fc0 0x7f489c13d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35364/0 (socket says 172.21.15.94:35364) 2023-11-27T18:12:16.244 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.241+0000 7f489ad9d640 1 -- 172.21.15.94:0/1432102441 learned_addr learned my addr 172.21.15.94:0/1432102441 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-11-27T18:12:16.249 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.245+0000 7f489ad9d640 1 -- 172.21.15.94:0/1432102441 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f489c150260 msgr2=0x7f489c06a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:16.249 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.245+0000 7f489ad9d640 1 --2- 172.21.15.94:0/1432102441 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f489c150260 0x7f489c06a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:16.249 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.245+0000 7f489ad9d640 1 -- 172.21.15.94:0/1432102441 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f489c0c7cc0 msgr2=0x7f489c1f3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:16.249 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.245+0000 7f489ad9d640 1 --2- 172.21.15.94:0/1432102441 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f489c0c7cc0 0x7f489c1f3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:16.249 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.245+0000 7f489ad9d640 1 -- 172.21.15.94:0/1432102441 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4890009420 con 0x7f489c0c0fc0 2023-11-27T18:12:16.252 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.249+0000 7f489ad9d640 1 --2- 172.21.15.94:0/1432102441 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f489c0c0fc0 0x7f489c13d860 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f488c00b550 tx=0x7f488c00ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:12:16.258 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.257+0000 7f48837fe640 1 -- 172.21.15.94:0/1432102441 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488c010870 con 0x7f489c0c0fc0 2023-11-27T18:12:16.258 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.257+0000 7f48837fe640 1 -- 172.21.15.94:0/1432102441 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f488c0109f0 con 0x7f489c0c0fc0 2023-11-27T18:12:16.258 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.257+0000 7f48837fe640 1 -- 172.21.15.94:0/1432102441 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488c010da0 con 0x7f489c0c0fc0 2023-11-27T18:12:16.258 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.257+0000 7f48a10f4640 1 -- 172.21.15.94:0/1432102441 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f489c138a00 con 0x7f489c0c0fc0 2023-11-27T18:12:16.258 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.257+0000 7f48a10f4640 1 -- 172.21.15.94:0/1432102441 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f489c137af0 con 0x7f489c0c0fc0 2023-11-27T18:12:16.259 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.257+0000 7f48a10f4640 1 -- 172.21.15.94:0/1432102441 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f489c04e850 con 0x7f489c0c0fc0 2023-11-27T18:12:16.271 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T18:12:16.266+0000 7efdfbad1180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-27T18:12:16.424 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.421+0000 7f48837fe640 1 -- 172.21.15.94:0/1432102441 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 3) v1 ==== 85702+0+0 (secure 0 0 0) 0x7f488c023480 con 0x7f489c0c0fc0 2023-11-27T18:12:16.442 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.441+0000 7f48837fe640 1 -- 172.21.15.94:0/1432102441 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f488c055af0 con 0x7f489c0c0fc0 2023-11-27T18:12:16.443 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.441+0000 7f48837fe640 1 -- 172.21.15.94:0/1432102441 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7f488c051560 con 0x7f489c0c0fc0 2023-11-27T18:12:16.501 INFO:tasks.ceph.mgr.y.smithi091.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-11-27T18:12:16.501 INFO:tasks.ceph.mgr.y.smithi091.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-11-27T18:12:16.501 INFO:tasks.ceph.mgr.y.smithi091.stderr: from numpy import show_config as show_numpy_config 2023-11-27T18:12:16.508 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T18:12:16.506+0000 7efdfbad1180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-27T18:12:16.522 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.521+0000 7f48a10f4640 1 -- 172.21.15.94:0/1432102441 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4784bc77-6c33-4e47-abba-d37484982f77", "id": 6} v 0) v1 -- 0x7f489c0b1a10 con 0x7f489c0c0fc0 2023-11-27T18:12:16.632 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T18:12:16.630+0000 7efdfbad1180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-27T18:12:16.741 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T18:12:16.738+0000 7efdfbad1180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-27T18:12:22.951 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.829+0000 7f48837fe640 1 -- 172.21.15.94:0/1432102441 <== mon.1 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4784bc77-6c33-4e47-abba-d37484982f77", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f488c01e0b0 con 0x7f489c0c0fc0 2023-11-27T18:12:22.951 INFO:teuthology.orchestra.run.smithi094.stdout:6 2023-11-27T18:12:22.953 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T18:12:16.798+0000 7efdfbad1180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-27T18:12:22.953 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T18:12:16.922+0000 7efdfbad1180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-27T18:12:22.953 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T18:12:17.398+0000 7efdfbad1180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-27T18:12:22.953 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T18:12:17.474+0000 7efdfbad1180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-27T18:12:22.954 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T18:12:17.602+0000 7efdfbad1180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-27T18:12:22.954 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T18:12:17.674+0000 7efdfbad1180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-27T18:12:22.954 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T18:12:17.950+0000 7efdfbad1180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-27T18:12:22.954 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T18:12:18.002+0000 7efdfbad1180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-27T18:12:22.954 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T18:12:21.174+0000 7efda3259640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-27T18:12:22.955 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.829+0000 7f48a10f4640 1 -- 172.21.15.94:0/1432102441 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f489c0c0fc0 msgr2=0x7f489c13d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:22.955 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.829+0000 7f48a10f4640 1 --2- 172.21.15.94:0/1432102441 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f489c0c0fc0 0x7f489c13d860 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f488c00b550 tx=0x7f488c00ba10 comp rx=0 tx=0).stop 2023-11-27T18:12:22.955 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.829+0000 7f48a10f4640 1 -- 172.21.15.94:0/1432102441 shutdown_connections 2023-11-27T18:12:22.955 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.829+0000 7f48a10f4640 1 --2- 172.21.15.94:0/1432102441 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f489c150260 0x7f489c06a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:22.955 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.829+0000 7f48a10f4640 1 --2- 172.21.15.94:0/1432102441 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f489c0c7cc0 0x7f489c1f3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:22.955 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.829+0000 7f48a10f4640 1 --2- 172.21.15.94:0/1432102441 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f489c0c0fc0 0x7f489c13d860 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:22.955 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.829+0000 7f48a10f4640 1 -- 172.21.15.94:0/1432102441 >> 172.21.15.94:0/1432102441 conn(0x7f489c0c8aa0 msgr2=0x7f489c070160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:12:22.955 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.829+0000 7f48a10f4640 1 -- 172.21.15.94:0/1432102441 shutdown_connections 2023-11-27T18:12:22.955 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:16.829+0000 7f48a10f4640 1 -- 172.21.15.94:0/1432102441 wait complete. 2023-11-27T18:12:22.955 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --cluster ceph osd new b954cf3f-4a4f-4a75-9f90-014f72c16d15 7 2023-11-27T18:12:23.093 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.089+0000 7fce5ca74640 1 Processor -- start 2023-11-27T18:12:23.093 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.089+0000 7fce5ca74640 1 -- start start 2023-11-27T18:12:23.094 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.093+0000 7fce5ca74640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fce5815b550 0x7fce58157230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:23.094 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.093+0000 7fce5ca74640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fce580c8be0 0x7fce58157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:23.094 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.093+0000 7fce5ca74640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce5815a820 con 0x7fce58151650 2023-11-27T18:12:23.094 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.093+0000 7fce5ca74640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce580b0410 con 0x7fce5815b550 2023-11-27T18:12:23.094 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.093+0000 7fce5ca74640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce5815b0c0 con 0x7fce580c8be0 2023-11-27T18:12:23.095 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.093+0000 7fce56d9d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fce580c8be0 0x7fce58157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:23.095 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.093+0000 7fce56d9d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fce580c8be0 0x7fce58157770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35380/0 (socket says 172.21.15.94:35380) 2023-11-27T18:12:23.095 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.093+0000 7fce56d9d640 1 -- 172.21.15.94:0/734116961 learned_addr learned my addr 172.21.15.94:0/734116961 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-11-27T18:12:23.095 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.093+0000 7fce55d9b640 1 --2- 172.21.15.94:0/734116961 >> v2:172.21.15.91:3300/0 conn(0x7fce5815b550 0x7fce58157230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:23.097 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.093+0000 7fce56d9d640 1 -- 172.21.15.94:0/734116961 >> v2:172.21.15.91:3300/0 conn(0x7fce5815b550 msgr2=0x7fce58157230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:12:23.098 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.093+0000 7fce56d9d640 1 --2- 172.21.15.94:0/734116961 >> v2:172.21.15.91:3300/0 conn(0x7fce5815b550 0x7fce58157230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:23.098 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.097+0000 7fce56d9d640 1 -- 172.21.15.94:0/734116961 >> v1:172.21.15.91:6789/0 conn(0x7fce58151650 legacy=0x7fce580c1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:12:23.098 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.097+0000 7fce56d9d640 1 -- 172.21.15.94:0/734116961 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce58157d50 con 0x7fce580c8be0 2023-11-27T18:12:23.101 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.097+0000 7fce56d9d640 1 --2- 172.21.15.94:0/734116961 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce580c8be0 0x7fce58157770 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fce580c8560 tx=0x7fce5001c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b295a8f034b869bf server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:12:23.105 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.105+0000 7fce5559a640 1 -- 172.21.15.94:0/734116961 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce500a57c0 con 0x7fce580c8be0 2023-11-27T18:12:23.106 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.105+0000 7fce5559a640 1 -- 172.21.15.94:0/734116961 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce500a5920 con 0x7fce580c8be0 2023-11-27T18:12:23.106 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.105+0000 7fce5559a640 1 -- 172.21.15.94:0/734116961 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce500a5cb0 con 0x7fce580c8be0 2023-11-27T18:12:23.106 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.105+0000 7fce5ca74640 1 -- 172.21.15.94:0/734116961 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce580c8be0 msgr2=0x7fce58157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:23.107 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.105+0000 7fce5ca74640 1 --2- 172.21.15.94:0/734116961 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce580c8be0 0x7fce58157770 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fce580c8560 tx=0x7fce5001c900 comp rx=0 tx=0).stop 2023-11-27T18:12:23.107 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.105+0000 7fce5ca74640 1 -- 172.21.15.94:0/734116961 shutdown_connections 2023-11-27T18:12:23.107 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.105+0000 7fce5ca74640 1 --2- 172.21.15.94:0/734116961 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce580c8be0 0x7fce58157770 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:23.107 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.105+0000 7fce5ca74640 1 --2- 172.21.15.94:0/734116961 >> v2:172.21.15.91:3300/0 conn(0x7fce5815b550 0x7fce58157230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:23.107 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.105+0000 7fce5ca74640 1 -- 172.21.15.94:0/734116961 >> 172.21.15.94:0/734116961 conn(0x7fce580709f0 msgr2=0x7fce58070e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:12:23.107 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.105+0000 7fce5ca74640 1 -- 172.21.15.94:0/734116961 shutdown_connections 2023-11-27T18:12:23.107 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.105+0000 7fce5ca74640 1 -- 172.21.15.94:0/734116961 wait complete. 2023-11-27T18:12:23.108 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.105+0000 7fce5ca74640 1 Processor -- start 2023-11-27T18:12:23.108 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.105+0000 7fce5ca74640 1 -- start start 2023-11-27T18:12:23.109 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.105+0000 7fce5ca74640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fce580c8be0 0x7fce5814d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:23.109 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.105+0000 7fce5ca74640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce58151650 0x7fce58142970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:23.109 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.105+0000 7fce5ca74640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fce5815b550 0x7fce58142eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:23.109 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.105+0000 7fce5ca74640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce581424c0 con 0x7fce5815b550 2023-11-27T18:12:23.109 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.105+0000 7fce5ca74640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce581f2390 con 0x7fce58151650 2023-11-27T18:12:23.109 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.105+0000 7fce5ca74640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce581f2670 con 0x7fce580c8be0 2023-11-27T18:12:23.110 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.109+0000 7fce55d9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce58151650 0x7fce58142970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:23.110 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.109+0000 7fce5659c640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fce580c8be0 0x7fce5814d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:23.110 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.109+0000 7fce55d9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce58151650 0x7fce58142970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35384/0 (socket says 172.21.15.94:35384) 2023-11-27T18:12:23.110 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.109+0000 7fce55d9b640 1 -- 172.21.15.94:0/1145865285 learned_addr learned my addr 172.21.15.94:0/1145865285 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-11-27T18:12:23.112 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.109+0000 7fce56d9d640 1 --2- 172.21.15.94:0/1145865285 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fce5815b550 0x7fce58142eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:23.113 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.109+0000 7fce55d9b640 1 -- 172.21.15.94:0/1145865285 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fce580c8be0 msgr2=0x7fce5814d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:23.113 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.109+0000 7fce55d9b640 1 --2- 172.21.15.94:0/1145865285 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fce580c8be0 0x7fce5814d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:23.113 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.109+0000 7fce55d9b640 1 -- 172.21.15.94:0/1145865285 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fce5815b550 msgr2=0x7fce58142eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:23.113 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.109+0000 7fce55d9b640 1 --2- 172.21.15.94:0/1145865285 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fce5815b550 0x7fce58142eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:23.113 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.109+0000 7fce55d9b640 1 -- 172.21.15.94:0/1145865285 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce50009b30 con 0x7fce58151650 2023-11-27T18:12:23.116 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.113+0000 7fce55d9b640 1 --2- 172.21.15.94:0/1145865285 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce58151650 0x7fce58142970 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fce4c00d7d0 tx=0x7fce4c00dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:12:23.118 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.117+0000 7fce46ffd640 1 -- 172.21.15.94:0/1145865285 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4c00b6c0 con 0x7fce58151650 2023-11-27T18:12:23.119 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.117+0000 7fce5ca74640 1 -- 172.21.15.94:0/1145865285 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce581f2950 con 0x7fce58151650 2023-11-27T18:12:23.119 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.117+0000 7fce5ca74640 1 -- 172.21.15.94:0/1145865285 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce5814ce50 con 0x7fce58151650 2023-11-27T18:12:23.120 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.117+0000 7fce5ca74640 1 -- 172.21.15.94:0/1145865285 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce5804e850 con 0x7fce58151650 2023-11-27T18:12:23.120 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.117+0000 7fce46ffd640 1 -- 172.21.15.94:0/1145865285 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce4c00b820 con 0x7fce58151650 2023-11-27T18:12:23.121 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.117+0000 7fce46ffd640 1 -- 172.21.15.94:0/1145865285 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4c00bb90 con 0x7fce58151650 2023-11-27T18:12:23.405 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.401+0000 7fce46ffd640 1 -- 172.21.15.94:0/1145865285 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 85935+0+0 (secure 0 0 0) 0x7fce4c00bcf0 con 0x7fce58151650 2023-11-27T18:12:23.406 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.405+0000 7fce46ffd640 1 --2- 172.21.15.94:0/1145865285 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fce38066760 0x7fce38068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:23.406 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.405+0000 7fce5659c640 1 --2- 172.21.15.94:0/1145865285 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fce38066760 0x7fce38068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:23.407 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.405+0000 7fce5659c640 1 --2- 172.21.15.94:0/1145865285 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fce38066760 0x7fce38068c20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fce48007fd0 tx=0x7fce48009040 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:12:23.421 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.417+0000 7fce46ffd640 1 -- 172.21.15.94:0/1145865285 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fce4c055f90 con 0x7fce58151650 2023-11-27T18:12:23.421 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.417+0000 7fce46ffd640 1 -- 172.21.15.94:0/1145865285 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fce4c0522d0 con 0x7fce58151650 2023-11-27T18:12:23.591 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.589+0000 7fce5ca74640 1 -- 172.21.15.94:0/1145865285 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b954cf3f-4a4f-4a75-9f90-014f72c16d15", "id": 7} v 0) v1 -- 0x7fce580c85e0 con 0x7fce58151650 2023-11-27T18:12:23.902 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.901+0000 7fce46ffd640 1 -- 172.21.15.94:0/1145865285 <== mon.1 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b954cf3f-4a4f-4a75-9f90-014f72c16d15", "id": 7}]=0 v11) v1 ==== 112+0+2 (secure 0 0 0) 0x7fce4c0558f0 con 0x7fce58151650 2023-11-27T18:12:23.903 INFO:teuthology.orchestra.run.smithi094.stdout:7 2023-11-27T18:12:23.907 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.905+0000 7fce5ca74640 1 -- 172.21.15.94:0/1145865285 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fce38066760 msgr2=0x7fce38068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:23.907 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.905+0000 7fce5ca74640 1 --2- 172.21.15.94:0/1145865285 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fce38066760 0x7fce38068c20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fce48007fd0 tx=0x7fce48009040 comp rx=0 tx=0).stop 2023-11-27T18:12:23.907 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.905+0000 7fce5ca74640 1 -- 172.21.15.94:0/1145865285 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce58151650 msgr2=0x7fce58142970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:23.907 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.905+0000 7fce5ca74640 1 --2- 172.21.15.94:0/1145865285 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce58151650 0x7fce58142970 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fce4c00d7d0 tx=0x7fce4c00dc90 comp rx=0 tx=0).stop 2023-11-27T18:12:23.907 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.905+0000 7fce5ca74640 1 -- 172.21.15.94:0/1145865285 shutdown_connections 2023-11-27T18:12:23.907 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.905+0000 7fce5ca74640 1 --2- 172.21.15.94:0/1145865285 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fce38066760 0x7fce38068c20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:23.907 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.905+0000 7fce5ca74640 1 --2- 172.21.15.94:0/1145865285 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fce5815b550 0x7fce58142eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:23.907 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.905+0000 7fce5ca74640 1 --2- 172.21.15.94:0/1145865285 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce58151650 0x7fce58142970 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:23.907 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.905+0000 7fce5ca74640 1 --2- 172.21.15.94:0/1145865285 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fce580c8be0 0x7fce5814d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:23.907 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.905+0000 7fce5ca74640 1 -- 172.21.15.94:0/1145865285 >> 172.21.15.94:0/1145865285 conn(0x7fce580709f0 msgr2=0x7fce580c77a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:12:23.908 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.905+0000 7fce5ca74640 1 -- 172.21.15.94:0/1145865285 shutdown_connections 2023-11-27T18:12:23.908 INFO:teuthology.orchestra.run.smithi094.stderr:2023-11-27T18:12:23.905+0000 7fce5ca74640 1 -- 172.21.15.94:0/1145865285 wait complete. 2023-11-27T18:12:23.928 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-27T18:12:23.928 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 0 2023-11-27T18:12:23.931 INFO:tasks.ceph.osd.0:Started 2023-11-27T18:12:23.931 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-27T18:12:23.931 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 1 2023-11-27T18:12:23.933 INFO:tasks.ceph.osd.1:Started 2023-11-27T18:12:23.934 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-27T18:12:23.934 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 2 2023-11-27T18:12:23.937 INFO:tasks.ceph.osd.2:Started 2023-11-27T18:12:23.937 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-27T18:12:23.937 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 3 2023-11-27T18:12:23.940 INFO:tasks.ceph.osd.3:Started 2023-11-27T18:12:23.940 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-27T18:12:23.941 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 4 2023-11-27T18:12:23.943 INFO:tasks.ceph.osd.4:Started 2023-11-27T18:12:23.943 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-27T18:12:23.944 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 5 2023-11-27T18:12:23.945 INFO:tasks.ceph.osd.5:Started 2023-11-27T18:12:23.946 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-27T18:12:23.946 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 6 2023-11-27T18:12:23.949 INFO:tasks.ceph.osd.6:Started 2023-11-27T18:12:23.949 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-27T18:12:23.949 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 7 2023-11-27T18:12:23.951 INFO:tasks.ceph.osd.7:Started 2023-11-27T18:12:23.951 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T18:12:24.084 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.082+0000 7f378b161640 1 Processor -- start 2023-11-27T18:12:24.084 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.082+0000 7f378b161640 1 -- start start 2023-11-27T18:12:24.086 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.082+0000 7f378b161640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f378415a260 0x7f378415cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:24.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.082+0000 7f378b161640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37840c3cd0 con 0x7f3784153a60 2023-11-27T18:12:24.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.082+0000 7f378b161640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37840c3710 con 0x7f37840c2dd0 2023-11-27T18:12:24.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.082+0000 7f378b161640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3784159e40 con 0x7f378415a260 2023-11-27T18:12:24.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.082+0000 7f37896fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f37840c2dd0 0x7f378406b630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.91:53370/0 (socket says 172.21.15.91:53370) 2023-11-27T18:12:24.089 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.082+0000 7f37896fe640 1 -- 172.21.15.91:0/2017866683 learned_addr learned my addr 172.21.15.91:0/2017866683 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:12:24.089 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.086+0000 7f37837fe640 1 -- 172.21.15.91:0/2017866683 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1569572671 0 0) 0x7f37840c3710 con 0x7f37840c2dd0 2023-11-27T18:12:24.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.086+0000 7f37837fe640 1 -- 172.21.15.91:0/2017866683 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f376c003530 con 0x7f37840c2dd0 2023-11-27T18:12:24.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.090+0000 7f37837fe640 1 -- 172.21.15.91:0/2017866683 <== mon.1 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 794511390 0 0) 0x7f376c003530 con 0x7f37840c2dd0 2023-11-27T18:12:24.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.090+0000 7f37837fe640 1 -- 172.21.15.91:0/2017866683 >> v2:172.21.15.91:3300/0 conn(0x7f378415a260 msgr2=0x7f378415cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:12:24.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.090+0000 7f37837fe640 1 --2- 172.21.15.91:0/2017866683 >> v2:172.21.15.91:3300/0 conn(0x7f378415a260 0x7f378415cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:24.093 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.090+0000 7f37837fe640 1 -- 172.21.15.91:0/2017866683 >> v1:172.21.15.91:6789/0 conn(0x7f3784153a60 legacy=0x7f37840c7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:12:24.094 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.090+0000 7f37837fe640 1 -- 172.21.15.91:0/2017866683 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37840c39f0 con 0x7f37840c2dd0 2023-11-27T18:12:24.094 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.090+0000 7f37837fe640 1 -- 172.21.15.91:0/2017866683 <== mon.1 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3378743932 0 0) 0x7f3774001680 con 0x7f37840c2dd0 2023-11-27T18:12:24.094 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.090+0000 7f37837fe640 1 -- 172.21.15.91:0/2017866683 >> v1:172.21.15.94:6789/0 conn(0x7f37840c2dd0 legacy=0x7f378406b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:24.095 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.090+0000 7f37837fe640 1 --2- 172.21.15.91:0/2017866683 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f376c0039d0 0x7f376c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:24.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.090+0000 7f37837fe640 1 --2- 172.21.15.91:0/2017866683 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f376c0047d0 0x7f376c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:24.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.090+0000 7f37837fe640 1 --2- 172.21.15.91:0/2017866683 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f376c0052b0 0x7f376c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:24.098 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.090+0000 7f37837fe640 1 -- 172.21.15.91:0/2017866683 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3784159e40 con 0x7f376c0039d0 2023-11-27T18:12:24.098 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.090+0000 7f37837fe640 1 -- 172.21.15.91:0/2017866683 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376c00c1f0 con 0x7f376c0047d0 2023-11-27T18:12:24.098 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.090+0000 7f37837fe640 1 -- 172.21.15.91:0/2017866683 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f376c00c3b0 con 0x7f376c0052b0 2023-11-27T18:12:24.098 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.090+0000 7f37896fe640 1 --2- 172.21.15.91:0/2017866683 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f376c0052b0 0x7f376c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:24.101 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.094+0000 7f3783fff640 1 --2- 172.21.15.91:0/2017866683 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f376c0047d0 0x7f376c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:24.101 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.094+0000 7f37896fe640 1 -- 172.21.15.91:0/2017866683 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f376c0047d0 msgr2=0x7f376c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:12:24.101 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.094+0000 7f37896fe640 1 --2- 172.21.15.91:0/2017866683 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f376c0047d0 0x7f376c004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:24.101 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.094+0000 7f37896fe640 1 -- 172.21.15.91:0/2017866683 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f376c0039d0 msgr2=0x7f376c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:12:24.102 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.094+0000 7f37896fe640 1 --2- 172.21.15.91:0/2017866683 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f376c0039d0 0x7f376c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:24.102 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.094+0000 7f37896fe640 1 -- 172.21.15.91:0/2017866683 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f376c003530 con 0x7f376c0052b0 2023-11-27T18:12:24.102 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.098+0000 7f37896fe640 1 -- 172.21.15.91:0/2017866683 reap_dead start 2023-11-27T18:12:24.102 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.098+0000 7f37896fe640 1 --2- 172.21.15.91:0/2017866683 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f376c0052b0 0x7f376c00b990 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f377400c0e0 tx=0x7f377401f2b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=edd2bc439544bc18 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:12:24.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.102+0000 7f37837fe640 1 -- 172.21.15.91:0/2017866683 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37740a8dd0 con 0x7f376c0052b0 2023-11-27T18:12:24.109 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.102+0000 7f37837fe640 1 -- 172.21.15.91:0/2017866683 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37740058e0 con 0x7f376c0052b0 2023-11-27T18:12:24.109 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.102+0000 7f37837fe640 1 -- 172.21.15.91:0/2017866683 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3774005c90 con 0x7f376c0052b0 2023-11-27T18:12:24.109 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.102+0000 7f378b161640 1 -- 172.21.15.91:0/2017866683 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f376c0052b0 msgr2=0x7f376c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:24.110 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.102+0000 7f378b161640 1 --2- 172.21.15.91:0/2017866683 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f376c0052b0 0x7f376c00b990 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f377400c0e0 tx=0x7f377401f2b0 comp rx=0 tx=0).stop 2023-11-27T18:12:24.110 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.102+0000 7f378b161640 1 -- 172.21.15.91:0/2017866683 shutdown_connections 2023-11-27T18:12:24.110 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.102+0000 7f378b161640 1 --2- 172.21.15.91:0/2017866683 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f376c0052b0 0x7f376c00b990 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:24.110 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.102+0000 7f378b161640 1 -- 172.21.15.91:0/2017866683 >> 172.21.15.91:0/2017866683 conn(0x7f378406a520 msgr2=0x7f378406a930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:12:24.110 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.102+0000 7f378b161640 1 -- 172.21.15.91:0/2017866683 shutdown_connections 2023-11-27T18:12:24.110 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.102+0000 7f378b161640 1 -- 172.21.15.91:0/2017866683 wait complete. 2023-11-27T18:12:24.110 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.106+0000 7f378b161640 1 Processor -- start 2023-11-27T18:12:24.110 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.106+0000 7f378b161640 1 -- start start 2023-11-27T18:12:24.110 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.106+0000 7f378b161640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f376c0052b0 0x7f3784073980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:24.110 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.106+0000 7f378b161640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37840c6e80 0x7f378414b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:24.110 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.106+0000 7f378b161640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f37840ccac0 0x7f378414bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:24.110 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.106+0000 7f378b161640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37840c5740 con 0x7f37840ccac0 2023-11-27T18:12:24.110 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.106+0000 7f378b161640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37841eef00 con 0x7f37840c6e80 2023-11-27T18:12:24.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.106+0000 7f378b161640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37841ef110 con 0x7f376c0052b0 2023-11-27T18:12:24.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.106+0000 7f3783fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37840c6e80 0x7f378414b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:24.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.106+0000 7f3783fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37840c6e80 0x7f378414b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.91:47314/0 (socket says 172.21.15.91:47314) 2023-11-27T18:12:24.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.106+0000 7f3783fff640 1 -- 172.21.15.91:0/3529662826 learned_addr learned my addr 172.21.15.91:0/3529662826 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:12:24.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.106+0000 7f3788efd640 1 --2- 172.21.15.91:0/3529662826 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f376c0052b0 0x7f3784073980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:24.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.110+0000 7f3783fff640 1 -- 172.21.15.91:0/3529662826 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f376c0052b0 msgr2=0x7f3784073980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:24.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.110+0000 7f3783fff640 1 --2- 172.21.15.91:0/3529662826 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f376c0052b0 0x7f3784073980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:24.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.110+0000 7f3783fff640 1 -- 172.21.15.91:0/3529662826 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f37840ccac0 msgr2=0x7f378414bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:24.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.110+0000 7f3783fff640 1 --2- 172.21.15.91:0/3529662826 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f37840ccac0 0x7f378414bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:24.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.110+0000 7f3783fff640 1 -- 172.21.15.91:0/3529662826 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37841ef3f0 con 0x7f37840c6e80 2023-11-27T18:12:24.114 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.114+0000 7f3783fff640 1 --2- 172.21.15.91:0/3529662826 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37840c6e80 0x7f378414b650 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f377800cb80 tx=0x7f377800a4c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:12:24.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.118+0000 7f37817fa640 1 -- 172.21.15.91:0/3529662826 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377800abd0 con 0x7f37840c6e80 2023-11-27T18:12:24.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.118+0000 7f37817fa640 1 -- 172.21.15.91:0/3529662826 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377800ad30 con 0x7f37840c6e80 2023-11-27T18:12:24.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.118+0000 7f37817fa640 1 -- 172.21.15.91:0/3529662826 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377800aea0 con 0x7f37840c6e80 2023-11-27T18:12:24.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.118+0000 7f378b161640 1 -- 172.21.15.91:0/3529662826 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37841ef6d0 con 0x7f37840c6e80 2023-11-27T18:12:24.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.118+0000 7f378b161640 1 -- 172.21.15.91:0/3529662826 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37841efc90 con 0x7f37840c6e80 2023-11-27T18:12:24.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.118+0000 7f378b161640 1 -- 172.21.15.91:0/3529662826 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37841524a0 con 0x7f37840c6e80 2023-11-27T18:12:24.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.398+0000 7f37817fa640 1 -- 172.21.15.91:0/3529662826 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 85935+0+0 (secure 0 0 0) 0x7f3778003bc0 con 0x7f37840c6e80 2023-11-27T18:12:24.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.398+0000 7f37817fa640 1 --2- 172.21.15.91:0/3529662826 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f37700667e0 0x7f3770068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:24.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.398+0000 7f3788efd640 1 --2- 172.21.15.91:0/3529662826 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f37700667e0 0x7f3770068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:24.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.402+0000 7f3788efd640 1 --2- 172.21.15.91:0/3529662826 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f37700667e0 0x7f3770068ca0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f377c007fd0 tx=0x7f377c009040 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:12:24.433 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.434+0000 7f37817fa640 1 -- 172.21.15.91:0/3529662826 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f3778055030 con 0x7f37840c6e80 2023-11-27T18:12:24.434 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.434+0000 7f37817fa640 1 -- 172.21.15.91:0/3529662826 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f3778051370 con 0x7f37840c6e80 2023-11-27T18:12:24.583 INFO:tasks.ceph.osd.7.smithi094.stderr:2023-11-27T18:12:24.581+0000 7fea77bc7640 -1 Falling back to public interface 2023-11-27T18:12:24.594 INFO:tasks.ceph.osd.2.smithi091.stderr:2023-11-27T18:12:24.594+0000 7f2ebd382640 -1 Falling back to public interface 2023-11-27T18:12:24.601 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.602+0000 7f378b161640 1 -- 172.21.15.91:0/3529662826 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f378404e930 con 0x7f37840c6e80 2023-11-27T18:12:24.610 INFO:tasks.ceph.osd.0.smithi091.stderr:2023-11-27T18:12:24.610+0000 7f4e0a433640 -1 Falling back to public interface 2023-11-27T18:12:24.611 INFO:tasks.ceph.osd.4.smithi094.stderr:2023-11-27T18:12:24.609+0000 7f685d25b640 -1 Falling back to public interface 2023-11-27T18:12:24.619 INFO:tasks.ceph.osd.3.smithi091.stderr:2023-11-27T18:12:24.618+0000 7f65b950b640 -1 Falling back to public interface 2023-11-27T18:12:24.624 INFO:tasks.ceph.osd.1.smithi091.stderr:2023-11-27T18:12:24.622+0000 7f612c7d7640 -1 Falling back to public interface 2023-11-27T18:12:24.627 INFO:tasks.ceph.osd.5.smithi094.stderr:2023-11-27T18:12:24.625+0000 7ff5ae8ae640 -1 Falling back to public interface 2023-11-27T18:12:24.635 INFO:tasks.ceph.osd.6.smithi094.stderr:2023-11-27T18:12:24.633+0000 7fd53403f640 -1 Falling back to public interface 2023-11-27T18:12:24.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.698+0000 7f37817fa640 1 -- 172.21.15.91:0/3529662826 <== mon.1 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f377801e020 con 0x7f37840c6e80 2023-11-27T18:12:24.700 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:12:24.700 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":11,"fsid":"08c8ebbf-7936-4c41-a995-d5600de2d072","created":"2023-11-27T18:12:06.484593+0000","modified":"2023-11-27T18:12:23.622113+0000","last_up_change":"0.000000","last_in_change":"2023-11-27T18:12:23.622113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8ad53c08-dd19-4ae6-87c5-fa15bea3b4ad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f8b5f147-ed29-4329-a787-a12cc34a2569","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c3029f9a-1c48-4f5d-983a-172a614d8795","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ab4b6fb2-0126-491b-9224-54a6badc5da3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"695071a8-2de8-4cba-bf20-050021a03bb4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ca01da14-a700-4845-8db2-f5e3370677e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4784bc77-6c33-4e47-abba-d37484982f77","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b954cf3f-4a4f-4a75-9f90-014f72c16d15","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T18:12:24.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.702+0000 7f378b161640 1 -- 172.21.15.91:0/3529662826 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f37700667e0 msgr2=0x7f3770068ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:24.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.702+0000 7f378b161640 1 --2- 172.21.15.91:0/3529662826 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f37700667e0 0x7f3770068ca0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f377c007fd0 tx=0x7f377c009040 comp rx=0 tx=0).stop 2023-11-27T18:12:24.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.702+0000 7f378b161640 1 -- 172.21.15.91:0/3529662826 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37840c6e80 msgr2=0x7f378414b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:24.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.702+0000 7f378b161640 1 --2- 172.21.15.91:0/3529662826 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37840c6e80 0x7f378414b650 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f377800cb80 tx=0x7f377800a4c0 comp rx=0 tx=0).stop 2023-11-27T18:12:24.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.702+0000 7f378b161640 1 -- 172.21.15.91:0/3529662826 shutdown_connections 2023-11-27T18:12:24.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.702+0000 7f378b161640 1 --2- 172.21.15.91:0/3529662826 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f37700667e0 0x7f3770068ca0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:24.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.702+0000 7f378b161640 1 --2- 172.21.15.91:0/3529662826 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f37840ccac0 0x7f378414bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:24.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.702+0000 7f378b161640 1 --2- 172.21.15.91:0/3529662826 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37840c6e80 0x7f378414b650 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:24.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.702+0000 7f378b161640 1 --2- 172.21.15.91:0/3529662826 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f376c0052b0 0x7f3784073980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:24.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.702+0000 7f378b161640 1 -- 172.21.15.91:0/3529662826 >> 172.21.15.91:0/3529662826 conn(0x7f378406a520 msgr2=0x7f3784158d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:12:24.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.702+0000 7f378b161640 1 -- 172.21.15.91:0/3529662826 shutdown_connections 2023-11-27T18:12:24.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:24.702+0000 7f378b161640 1 -- 172.21.15.91:0/3529662826 wait complete. 2023-11-27T18:12:24.722 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-27T18:12:24.722 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-27T18:12:25.529 DEBUG:teuthology.orchestra.run.smithi091:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-27T18:12:25.649 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.650+0000 7f1d52aa5640 1 Processor -- start 2023-11-27T18:12:25.649 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.650+0000 7f1d52aa5640 1 -- start start 2023-11-27T18:12:25.650 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.650+0000 7f1d52aa5640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f1d4c1504b0 0x7f1d4c156e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:25.650 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.650+0000 7f1d52aa5640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1d4c0bfed0 0x7f1d4c0c7670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:25.650 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.650+0000 7f1d52aa5640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d4c1569b0 con 0x7f1d4c159840 2023-11-27T18:12:25.651 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.650+0000 7f1d52aa5640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d4c159cb0 con 0x7f1d4c1504b0 2023-11-27T18:12:25.651 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.650+0000 7f1d52aa5640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d4c0c5110 con 0x7f1d4c0bfed0 2023-11-27T18:12:25.651 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.650+0000 7f1d50841640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f1d4c1504b0 0x7f1d4c156e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:25.651 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.650+0000 7f1d50841640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f1d4c1504b0 0x7f1d4c156e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:48116/0 (socket says 172.21.15.91:48116) 2023-11-27T18:12:25.651 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.650+0000 7f1d50841640 1 -- 172.21.15.91:0/1117189558 learned_addr learned my addr 172.21.15.91:0/1117189558 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:12:25.652 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.650+0000 7f1d51042640 1 --2- 172.21.15.91:0/1117189558 >> v2:172.21.15.94:3300/0 conn(0x7f1d4c0bfed0 0x7f1d4c0c7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:25.654 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.654+0000 7f1d50841640 1 -- 172.21.15.91:0/1117189558 >> v2:172.21.15.94:3300/0 conn(0x7f1d4c0bfed0 msgr2=0x7f1d4c0c7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:12:25.654 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.654+0000 7f1d50841640 1 --2- 172.21.15.91:0/1117189558 >> v2:172.21.15.94:3300/0 conn(0x7f1d4c0bfed0 0x7f1d4c0c7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:25.654 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.654+0000 7f1d50841640 1 -- 172.21.15.91:0/1117189558 >> v1:172.21.15.94:6789/0 conn(0x7f1d4c159840 legacy=0x7f1d4c0c6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:25.654 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.654+0000 7f1d50841640 1 -- 172.21.15.91:0/1117189558 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d4c0c7290 con 0x7f1d4c1504b0 2023-11-27T18:12:25.658 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.658+0000 7f1d50841640 1 --2- 172.21.15.91:0/1117189558 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1d4c1504b0 0x7f1d4c156e40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c072cf0 tx=0x7f1d400213c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=201d51e8c9644af2 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:12:25.663 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.662+0000 7f1d4b7fe640 1 -- 172.21.15.91:0/1117189558 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d400b1600 con 0x7f1d4c1504b0 2023-11-27T18:12:25.663 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.662+0000 7f1d4b7fe640 1 -- 172.21.15.91:0/1117189558 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d400ad050 con 0x7f1d4c1504b0 2023-11-27T18:12:25.663 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.662+0000 7f1d4b7fe640 1 -- 172.21.15.91:0/1117189558 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d400b1980 con 0x7f1d4c1504b0 2023-11-27T18:12:25.664 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.662+0000 7f1d52aa5640 1 -- 172.21.15.91:0/1117189558 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1d4c1504b0 msgr2=0x7f1d4c156e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:25.664 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.662+0000 7f1d52aa5640 1 --2- 172.21.15.91:0/1117189558 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1d4c1504b0 0x7f1d4c156e40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c072cf0 tx=0x7f1d400213c0 comp rx=0 tx=0).stop 2023-11-27T18:12:25.664 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.662+0000 7f1d52aa5640 1 -- 172.21.15.91:0/1117189558 shutdown_connections 2023-11-27T18:12:25.664 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.662+0000 7f1d52aa5640 1 --2- 172.21.15.91:0/1117189558 >> v2:172.21.15.94:3300/0 conn(0x7f1d4c0bfed0 0x7f1d4c0c7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:25.664 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.662+0000 7f1d52aa5640 1 --2- 172.21.15.91:0/1117189558 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1d4c1504b0 0x7f1d4c156e40 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:25.664 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.662+0000 7f1d52aa5640 1 -- 172.21.15.91:0/1117189558 >> 172.21.15.91:0/1117189558 conn(0x7f1d4c0cabe0 msgr2=0x7f1d4c0caff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:12:25.664 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.662+0000 7f1d52aa5640 1 -- 172.21.15.91:0/1117189558 shutdown_connections 2023-11-27T18:12:25.664 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.662+0000 7f1d52aa5640 1 -- 172.21.15.91:0/1117189558 wait complete. 2023-11-27T18:12:25.666 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.666+0000 7f1d52aa5640 1 Processor -- start 2023-11-27T18:12:25.670 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.666+0000 7f1d52aa5640 1 -- start start 2023-11-27T18:12:25.678 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.666+0000 7f1d52aa5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1d4c0bfed0 0x7f1d4c14ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:25.682 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.666+0000 7f1d52aa5640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1d4c1504b0 0x7f1d4c158550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:25.682 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.666+0000 7f1d52aa5640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1d4c159840 0x7f1d4c158a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:25.682 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.666+0000 7f1d52aa5640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c1eaa50 con 0x7f1d4c0bfed0 2023-11-27T18:12:25.683 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.666+0000 7f1d52aa5640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c1ead10 con 0x7f1d4c1504b0 2023-11-27T18:12:25.683 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.666+0000 7f1d52aa5640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c1eaff0 con 0x7f1d4c159840 2023-11-27T18:12:25.683 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.666+0000 7f1d50841640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1d4c0bfed0 0x7f1d4c14ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:25.683 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.666+0000 7f1d4bfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1d4c1504b0 0x7f1d4c158550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:25.684 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.666+0000 7f1d50841640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1d4c0bfed0 0x7f1d4c14ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:48124/0 (socket says 172.21.15.91:48124) 2023-11-27T18:12:25.684 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.666+0000 7f1d50841640 1 -- 172.21.15.91:0/1755667119 learned_addr learned my addr 172.21.15.91:0/1755667119 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:12:25.684 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.666+0000 7f1d51042640 1 --2- 172.21.15.91:0/1755667119 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1d4c159840 0x7f1d4c158a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:25.684 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.670+0000 7f1d50841640 1 -- 172.21.15.91:0/1755667119 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1d4c159840 msgr2=0x7f1d4c158a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:25.685 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.670+0000 7f1d50841640 1 --2- 172.21.15.91:0/1755667119 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1d4c159840 0x7f1d4c158a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:25.685 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.670+0000 7f1d50841640 1 -- 172.21.15.91:0/1755667119 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1d4c1504b0 msgr2=0x7f1d4c158550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:25.685 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.670+0000 7f1d50841640 1 --2- 172.21.15.91:0/1755667119 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1d4c1504b0 0x7f1d4c158550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:25.685 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.670+0000 7f1d50841640 1 -- 172.21.15.91:0/1755667119 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d4000b770 con 0x7f1d4c0bfed0 2023-11-27T18:12:25.686 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.674+0000 7f1d50841640 1 --2- 172.21.15.91:0/1755667119 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1d4c0bfed0 0x7f1d4c14ddf0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1d4001eff0 tx=0x7f1d4001e160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:12:25.687 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.678+0000 7f1d497fa640 1 -- 172.21.15.91:0/1755667119 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d400bb410 con 0x7f1d4c0bfed0 2023-11-27T18:12:25.688 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.678+0000 7f1d497fa640 1 -- 172.21.15.91:0/1755667119 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d400bb570 con 0x7f1d4c0bfed0 2023-11-27T18:12:25.688 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.678+0000 7f1d497fa640 1 -- 172.21.15.91:0/1755667119 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d400bb920 con 0x7f1d4c0bfed0 2023-11-27T18:12:25.688 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.678+0000 7f1d52aa5640 1 -- 172.21.15.91:0/1755667119 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d4c1eb2d0 con 0x7f1d4c0bfed0 2023-11-27T18:12:25.688 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.678+0000 7f1d52aa5640 1 -- 172.21.15.91:0/1755667119 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d4c1eb890 con 0x7f1d4c0bfed0 2023-11-27T18:12:25.689 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.678+0000 7f1d52aa5640 1 -- 172.21.15.91:0/1755667119 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d4c1583a0 con 0x7f1d4c0bfed0 2023-11-27T18:12:25.702 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.698+0000 7f1d497fa640 1 -- 172.21.15.91:0/1755667119 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 6) v1 ==== 85935+0+0 (secure 0 0 0) 0x7f1d400b8070 con 0x7f1d4c0bfed0 2023-11-27T18:12:25.703 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.698+0000 7f1d497fa640 1 --2- 172.21.15.91:0/1755667119 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f1d300667b0 0x7f1d30068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:25.703 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.698+0000 7f1d4bfff640 1 --2- 172.21.15.91:0/1755667119 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f1d300667b0 0x7f1d30068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:25.703 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.698+0000 7f1d4bfff640 1 --2- 172.21.15.91:0/1755667119 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f1d300667b0 0x7f1d30068c70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c0caa60 tx=0x7f1d38009040 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:12:25.983 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.982+0000 7f1d497fa640 1 -- 172.21.15.91:0/1755667119 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f1d400f5ca0 con 0x7f1d4c0bfed0 2023-11-27T18:12:25.984 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:25.982+0000 7f1d497fa640 1 -- 172.21.15.91:0/1755667119 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f1d400f1fe0 con 0x7f1d4c0bfed0 2023-11-27T18:12:26.132 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:26.130+0000 7f1d52aa5640 1 -- 172.21.15.91:0/1755667119 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d4c04e850 con 0x7f1d4c0bfed0 2023-11-27T18:12:26.209 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:26.210+0000 7f1d497fa640 1 -- 172.21.15.91:0/1755667119 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f1d400b6030 con 0x7f1d4c0bfed0 2023-11-27T18:12:26.209 INFO:teuthology.misc.health.smithi091.stdout: 2023-11-27T18:12:26.210 INFO:teuthology.misc.health.smithi091.stdout:{"epoch":11,"fsid":"08c8ebbf-7936-4c41-a995-d5600de2d072","created":"2023-11-27T18:12:06.484593+0000","modified":"2023-11-27T18:12:23.622113+0000","last_up_change":"0.000000","last_in_change":"2023-11-27T18:12:23.622113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8ad53c08-dd19-4ae6-87c5-fa15bea3b4ad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f8b5f147-ed29-4329-a787-a12cc34a2569","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c3029f9a-1c48-4f5d-983a-172a614d8795","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ab4b6fb2-0126-491b-9224-54a6badc5da3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"695071a8-2de8-4cba-bf20-050021a03bb4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ca01da14-a700-4845-8db2-f5e3370677e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4784bc77-6c33-4e47-abba-d37484982f77","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b954cf3f-4a4f-4a75-9f90-014f72c16d15","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T18:12:26.213 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:26.210+0000 7f1d52aa5640 1 -- 172.21.15.91:0/1755667119 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f1d300667b0 msgr2=0x7f1d30068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:26.213 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:26.210+0000 7f1d52aa5640 1 --2- 172.21.15.91:0/1755667119 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f1d300667b0 0x7f1d30068c70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c0caa60 tx=0x7f1d38009040 comp rx=0 tx=0).stop 2023-11-27T18:12:26.214 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:26.210+0000 7f1d52aa5640 1 -- 172.21.15.91:0/1755667119 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1d4c0bfed0 msgr2=0x7f1d4c14ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:26.214 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:26.210+0000 7f1d52aa5640 1 --2- 172.21.15.91:0/1755667119 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1d4c0bfed0 0x7f1d4c14ddf0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1d4001eff0 tx=0x7f1d4001e160 comp rx=0 tx=0).stop 2023-11-27T18:12:26.214 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:26.210+0000 7f1d52aa5640 1 -- 172.21.15.91:0/1755667119 shutdown_connections 2023-11-27T18:12:26.214 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:26.210+0000 7f1d52aa5640 1 --2- 172.21.15.91:0/1755667119 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f1d300667b0 0x7f1d30068c70 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:26.214 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:26.210+0000 7f1d52aa5640 1 --2- 172.21.15.91:0/1755667119 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1d4c159840 0x7f1d4c158a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:26.214 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:26.210+0000 7f1d52aa5640 1 --2- 172.21.15.91:0/1755667119 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1d4c1504b0 0x7f1d4c158550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:26.215 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:26.210+0000 7f1d52aa5640 1 --2- 172.21.15.91:0/1755667119 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1d4c0bfed0 0x7f1d4c14ddf0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:26.215 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:26.210+0000 7f1d52aa5640 1 -- 172.21.15.91:0/1755667119 >> 172.21.15.91:0/1755667119 conn(0x7f1d4c0cabe0 msgr2=0x7f1d4c0c7700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:12:26.215 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:26.214+0000 7f1d52aa5640 1 -- 172.21.15.91:0/1755667119 shutdown_connections 2023-11-27T18:12:26.215 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:26.214+0000 7f1d52aa5640 1 -- 172.21.15.91:0/1755667119 wait complete. 2023-11-27T18:12:26.230 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-27T18:12:27.921 INFO:tasks.ceph.osd.4.smithi094.stderr:2023-11-27T18:12:27.917+0000 7f685d25b640 -1 osd.4 0 log_to_monitors true 2023-11-27T18:12:28.350 INFO:tasks.ceph.osd.2.smithi091.stderr:2023-11-27T18:12:28.350+0000 7f2ebd382640 -1 osd.2 0 log_to_monitors true 2023-11-27T18:12:28.361 INFO:tasks.ceph.osd.7.smithi094.stderr:2023-11-27T18:12:28.361+0000 7fea77bc7640 -1 osd.7 0 log_to_monitors true 2023-11-27T18:12:28.469 INFO:tasks.ceph.osd.5.smithi094.stderr:2023-11-27T18:12:28.469+0000 7ff5ae8ae640 -1 osd.5 0 log_to_monitors true 2023-11-27T18:12:28.480 INFO:tasks.ceph.osd.0.smithi091.stderr:2023-11-27T18:12:28.478+0000 7f4e0a433640 -1 osd.0 0 log_to_monitors true 2023-11-27T18:12:28.489 INFO:tasks.ceph.osd.1.smithi091.stderr:2023-11-27T18:12:28.486+0000 7f612c7d7640 -1 osd.1 0 log_to_monitors true 2023-11-27T18:12:28.497 INFO:tasks.ceph.osd.3.smithi091.stderr:2023-11-27T18:12:28.498+0000 7f65b950b640 -1 osd.3 0 log_to_monitors true 2023-11-27T18:12:28.513 INFO:tasks.ceph.osd.6.smithi094.stderr:2023-11-27T18:12:28.513+0000 7fd53403f640 -1 osd.6 0 log_to_monitors true 2023-11-27T18:12:30.337 INFO:tasks.ceph.osd.4.smithi094.stderr:2023-11-27T18:12:30.337+0000 7f6859205640 -1 osd.4 0 waiting for initial osdmap 2023-11-27T18:12:30.402 INFO:tasks.ceph.osd.4.smithi094.stderr:2023-11-27T18:12:30.397+0000 7f6851040640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-27T18:12:31.877 INFO:tasks.ceph.osd.7.smithi094.stderr:2023-11-27T18:12:31.873+0000 7fea73b71640 -1 osd.7 0 waiting for initial osdmap 2023-11-27T18:12:31.958 INFO:tasks.ceph.osd.7.smithi094.stderr:2023-11-27T18:12:31.957+0000 7fea6b9ac640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-27T18:12:32.142 INFO:tasks.ceph.osd.5.smithi094.stderr:2023-11-27T18:12:32.141+0000 7ff5aa858640 -1 osd.5 0 waiting for initial osdmap 2023-11-27T18:12:32.148 INFO:tasks.ceph.osd.6.smithi094.stderr:2023-11-27T18:12:32.145+0000 7fd5307fb640 -1 osd.6 0 waiting for initial osdmap 2023-11-27T18:12:32.198 INFO:tasks.ceph.osd.5.smithi094.stderr:2023-11-27T18:12:32.193+0000 7ff5a2693640 -1 osd.5 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-27T18:12:32.219 INFO:tasks.ceph.osd.6.smithi094.stderr:2023-11-27T18:12:32.217+0000 7fd527e24640 -1 osd.6 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-27T18:12:32.335 INFO:tasks.ceph.osd.0.smithi091.stderr:2023-11-27T18:12:32.334+0000 7f4e063dd640 -1 osd.0 0 waiting for initial osdmap 2023-11-27T18:12:32.378 INFO:tasks.ceph.osd.0.smithi091.stderr:2023-11-27T18:12:32.378+0000 7f4dfe218640 -1 osd.0 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-27T18:12:32.506 INFO:tasks.ceph.osd.2.smithi091.stderr:2023-11-27T18:12:32.506+0000 7f2eb9b3e640 -1 osd.2 0 waiting for initial osdmap 2023-11-27T18:12:32.566 INFO:tasks.ceph.osd.1.smithi091.stderr:2023-11-27T18:12:32.566+0000 7f6128781640 -1 osd.1 0 waiting for initial osdmap 2023-11-27T18:12:32.569 INFO:tasks.ceph.osd.3.smithi091.stderr:2023-11-27T18:12:32.570+0000 7f65b54b5640 -1 osd.3 0 waiting for initial osdmap 2023-11-27T18:12:32.578 INFO:tasks.ceph.osd.2.smithi091.stderr:2023-11-27T18:12:32.578+0000 7f2eb1167640 -1 osd.2 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-27T18:12:32.602 INFO:tasks.ceph.osd.1.smithi091.stderr:2023-11-27T18:12:32.602+0000 7f61205bc640 -1 osd.1 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-27T18:12:32.670 INFO:tasks.ceph.osd.3.smithi091.stderr:2023-11-27T18:12:32.670+0000 7f65ad2f0640 -1 osd.3 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-27T18:12:33.040 DEBUG:teuthology.orchestra.run.smithi091:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-27T18:12:33.161 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.162+0000 7f8ad734b640 1 Processor -- start 2023-11-27T18:12:33.161 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.162+0000 7f8ad734b640 1 -- start start 2023-11-27T18:12:33.162 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.162+0000 7f8ad734b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f8ad0159d60 0x7f8ad015a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:33.162 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.162+0000 7f8ad734b640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ad01598d0 con 0x7f8ad0153af0 2023-11-27T18:12:33.162 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.162+0000 7f8ad734b640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ad0153ed0 con 0x7f8ad00b13f0 2023-11-27T18:12:33.162 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.162+0000 7f8ad734b640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ad00ca5f0 con 0x7f8ad0159d60 2023-11-27T18:12:33.165 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.166+0000 7f8ad48e6640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f8ad00b13f0 0x7f8ad00ce220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.91:49426/0 (socket says 172.21.15.91:49426) 2023-11-27T18:12:33.165 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.166+0000 7f8ad48e6640 1 -- 172.21.15.91:0/4192314256 learned_addr learned my addr 172.21.15.91:0/4192314256 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:12:33.224 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.222+0000 7f8ac3fff640 1 -- 172.21.15.91:0/4192314256 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2648274161 0 0) 0x7f8ad0153ed0 con 0x7f8ad00b13f0 2023-11-27T18:12:33.225 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.222+0000 7f8ac3fff640 1 -- 172.21.15.91:0/4192314256 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8abc003530 con 0x7f8ad00b13f0 2023-11-27T18:12:33.233 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.234+0000 7f8ad58e8640 1 --2- 172.21.15.91:0/4192314256 >> v2:172.21.15.91:3300/0 conn(0x7f8ad0159d60 0x7f8ad015a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:33.263 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.262+0000 7f8ac3fff640 1 -- 172.21.15.91:0/4192314256 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 508576844 0 0) 0x7f8ad01598d0 con 0x7f8ad0153af0 2023-11-27T18:12:33.263 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.262+0000 7f8ac3fff640 1 -- 172.21.15.91:0/4192314256 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ad0153ed0 con 0x7f8ad0153af0 2023-11-27T18:12:33.270 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.270+0000 7f8ad58e8640 1 -- 172.21.15.91:0/4192314256 >> v1:172.21.15.94:6789/0 conn(0x7f8ad00b13f0 legacy=0x7f8ad00ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:33.270 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.270+0000 7f8ad58e8640 1 -- 172.21.15.91:0/4192314256 >> v1:172.21.15.91:6789/0 conn(0x7f8ad0153af0 legacy=0x7f8ad00c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:33.271 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.270+0000 7f8ad58e8640 1 -- 172.21.15.91:0/4192314256 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad00cd430 con 0x7f8ad0159d60 2023-11-27T18:12:33.428 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.426+0000 7f8ad58e8640 1 --2- 172.21.15.91:0/4192314256 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8ad0159d60 0x7f8ad015a1f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8009d90 tx=0x7f8ac801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=554d50cd38b3e200 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:12:33.486 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.486+0000 7f8ac3fff640 1 -- 172.21.15.91:0/4192314256 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac80a5870 con 0x7f8ad0159d60 2023-11-27T18:12:33.486 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.486+0000 7f8ac3fff640 1 -- 172.21.15.91:0/4192314256 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac80a59d0 con 0x7f8ad0159d60 2023-11-27T18:12:33.487 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.486+0000 7f8ac3fff640 1 -- 172.21.15.91:0/4192314256 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac80a5d60 con 0x7f8ad0159d60 2023-11-27T18:12:33.488 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.486+0000 7f8ad734b640 1 -- 172.21.15.91:0/4192314256 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8ad0159d60 msgr2=0x7f8ad015a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:33.488 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.486+0000 7f8ad734b640 1 --2- 172.21.15.91:0/4192314256 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8ad0159d60 0x7f8ad015a1f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8009d90 tx=0x7f8ac801c8c0 comp rx=0 tx=0).stop 2023-11-27T18:12:33.488 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.486+0000 7f8ad734b640 1 -- 172.21.15.91:0/4192314256 shutdown_connections 2023-11-27T18:12:33.488 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.486+0000 7f8ad734b640 1 --2- 172.21.15.91:0/4192314256 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8ad0159d60 0x7f8ad015a1f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:33.488 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.486+0000 7f8ad734b640 1 -- 172.21.15.91:0/4192314256 >> 172.21.15.91:0/4192314256 conn(0x7f8ad00b08d0 msgr2=0x7f8ad00b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:12:33.489 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.486+0000 7f8ad734b640 1 -- 172.21.15.91:0/4192314256 shutdown_connections 2023-11-27T18:12:33.489 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.486+0000 7f8ad734b640 1 -- 172.21.15.91:0/4192314256 wait complete. 2023-11-27T18:12:33.491 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.490+0000 7f8ad734b640 1 Processor -- start 2023-11-27T18:12:33.491 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.490+0000 7f8ad734b640 1 -- start start 2023-11-27T18:12:33.492 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.490+0000 7f8ad734b640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8ad00b13f0 0x7f8ad0155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:33.492 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.490+0000 7f8ad734b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8ad0153af0 0x7f8ad0149d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:33.492 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.490+0000 7f8ad734b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8ad0159d60 0x7f8ad0156100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:33.492 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.490+0000 7f8ad734b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad00c8830 con 0x7f8ad0159d60 2023-11-27T18:12:33.492 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.490+0000 7f8ad734b640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad0154100 con 0x7f8ad0153af0 2023-11-27T18:12:33.493 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.490+0000 7f8ad734b640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad0154370 con 0x7f8ad00b13f0 2023-11-27T18:12:33.493 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.494+0000 7f8ad58e8640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8ad0159d60 0x7f8ad0156100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:33.493 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.494+0000 7f8ad58e8640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8ad0159d60 0x7f8ad0156100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:60550/0 (socket says 172.21.15.91:60550) 2023-11-27T18:12:33.494 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.494+0000 7f8ad58e8640 1 -- 172.21.15.91:0/581185681 learned_addr learned my addr 172.21.15.91:0/581185681 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:12:33.498 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.498+0000 7f8ad58e8640 1 -- 172.21.15.91:0/581185681 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8ad00b13f0 msgr2=0x7f8ad0155410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:33.498 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.498+0000 7f8ad58e8640 1 --2- 172.21.15.91:0/581185681 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8ad00b13f0 0x7f8ad0155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:33.498 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.498+0000 7f8ad58e8640 1 -- 172.21.15.91:0/581185681 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8ad0153af0 msgr2=0x7f8ad0149d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:33.498 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.498+0000 7f8ad58e8640 1 --2- 172.21.15.91:0/581185681 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8ad0153af0 0x7f8ad0149d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:33.499 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.498+0000 7f8ad58e8640 1 -- 172.21.15.91:0/581185681 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac8009a70 con 0x7f8ad0159d60 2023-11-27T18:12:33.501 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.502+0000 7f8ad58e8640 1 --2- 172.21.15.91:0/581185681 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8ad0159d60 0x7f8ad0156100 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8009d90 tx=0x7f8ac8019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:12:33.505 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.502+0000 7f8ac1ffb640 1 -- 172.21.15.91:0/581185681 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac80ad640 con 0x7f8ad0159d60 2023-11-27T18:12:33.505 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.502+0000 7f8ac1ffb640 1 -- 172.21.15.91:0/581185681 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac80ad7a0 con 0x7f8ad0159d60 2023-11-27T18:12:33.505 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.502+0000 7f8ad734b640 1 -- 172.21.15.91:0/581185681 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ad0154650 con 0x7f8ad0159d60 2023-11-27T18:12:33.505 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.502+0000 7f8ac1ffb640 1 -- 172.21.15.91:0/581185681 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac80adb30 con 0x7f8ad0159d60 2023-11-27T18:12:33.505 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.502+0000 7f8ad734b640 1 -- 172.21.15.91:0/581185681 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ad0154c10 con 0x7f8ad0159d60 2023-11-27T18:12:33.506 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.506+0000 7f8ad734b640 1 -- 172.21.15.91:0/581185681 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ad004e850 con 0x7f8ad0159d60 2023-11-27T18:12:33.786 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.786+0000 7f8ac1ffb640 1 -- 172.21.15.91:0/581185681 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 6) v1 ==== 85935+0+0 (secure 0 0 0) 0x7f8ac80b4070 con 0x7f8ad0159d60 2023-11-27T18:12:33.787 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.786+0000 7f8ac1ffb640 1 --2- 172.21.15.91:0/581185681 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f8ab40667b0 0x7f8ab4068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:33.787 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.786+0000 7f8ad50e7640 1 --2- 172.21.15.91:0/581185681 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f8ab40667b0 0x7f8ab4068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:33.788 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.786+0000 7f8ad50e7640 1 --2- 172.21.15.91:0/581185681 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f8ab40667b0 0x7f8ab4068c70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8acc007fd0 tx=0x7f8acc007900 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:12:33.825 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.822+0000 7f8ac1ffb640 1 -- 172.21.15.91:0/581185681 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2511+0+0 (secure 0 0 0) 0x7f8ac80abe20 con 0x7f8ad0159d60 2023-11-27T18:12:33.825 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.826+0000 7f8ac1ffb640 1 -- 172.21.15.91:0/581185681 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f8ac80ecc80 con 0x7f8ad0159d60 2023-11-27T18:12:33.996 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:33.994+0000 7f8ad734b640 1 -- 172.21.15.91:0/581185681 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8ad00c6580 con 0x7f8ad0159d60 2023-11-27T18:12:34.127 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:12:34.130 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:12:34.272 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:34.270+0000 7f8ac1ffb640 1 -- 172.21.15.91:0/581185681 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+10837 (secure 0 0 0) 0x7f8ac80b2030 con 0x7f8ad0159d60 2023-11-27T18:12:34.272 INFO:teuthology.misc.health.smithi091.stdout: 2023-11-27T18:12:34.272 INFO:teuthology.misc.health.smithi091.stdout:{"epoch":16,"fsid":"08c8ebbf-7936-4c41-a995-d5600de2d072","created":"2023-11-27T18:12:06.484593+0000","modified":"2023-11-27T18:12:33.154694+0000","last_up_change":"2023-11-27T18:12:33.154694+0000","last_in_change":"2023-11-27T18:12:23.622113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8ad53c08-dd19-4ae6-87c5-fa15bea3b4ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6811","nonce":472303992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6813","nonce":472303992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6817","nonce":472303992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6815","nonce":472303992}]},"public_addr":"172.21.15.91:6811/472303992","cluster_addr":"172.21.15.91:6813/472303992","heartbeat_back_addr":"172.21.15.91:6817/472303992","heartbeat_front_addr":"172.21.15.91:6815/472303992","state":["exists","up"]},{"osd":1,"uuid":"f8b5f147-ed29-4329-a787-a12cc34a2569","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6827","nonce":12316911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6829","nonce":12316911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6833","nonce":12316911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6831","nonce":12316911}]},"public_addr":"172.21.15.91:6827/12316911","cluster_addr":"172.21.15.91:6829/12316911","heartbeat_back_addr":"172.21.15.91:6833/12316911","heartbeat_front_addr":"172.21.15.91:6831/12316911","state":["exists","up"]},{"osd":2,"uuid":"c3029f9a-1c48-4f5d-983a-172a614d8795","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6803","nonce":3776125919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6805","nonce":3776125919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6809","nonce":3776125919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6807","nonce":3776125919}]},"public_addr":"172.21.15.91:6803/3776125919","cluster_addr":"172.21.15.91:6805/3776125919","heartbeat_back_addr":"172.21.15.91:6809/3776125919","heartbeat_front_addr":"172.21.15.91:6807/3776125919","state":["exists","up"]},{"osd":3,"uuid":"ab4b6fb2-0126-491b-9224-54a6badc5da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6819","nonce":1297704794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6821","nonce":1297704794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6825","nonce":1297704794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6823","nonce":1297704794}]},"public_addr":"172.21.15.91:6819/1297704794","cluster_addr":"172.21.15.91:6821/1297704794","heartbeat_back_addr":"172.21.15.91:6825/1297704794","heartbeat_front_addr":"172.21.15.91:6823/1297704794","state":["exists","up"]},{"osd":4,"uuid":"695071a8-2de8-4cba-bf20-050021a03bb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6809","nonce":2501531833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6811","nonce":2501531833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6815","nonce":2501531833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6813","nonce":2501531833}]},"public_addr":"172.21.15.94:6809/2501531833","cluster_addr":"172.21.15.94:6811/2501531833","heartbeat_back_addr":"172.21.15.94:6815/2501531833","heartbeat_front_addr":"172.21.15.94:6813/2501531833","state":["exists","up"]},{"osd":5,"uuid":"ca01da14-a700-4845-8db2-f5e3370677e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6817","nonce":2448969592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6819","nonce":2448969592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6823","nonce":2448969592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6821","nonce":2448969592}]},"public_addr":"172.21.15.94:6817/2448969592","cluster_addr":"172.21.15.94:6819/2448969592","heartbeat_back_addr":"172.21.15.94:6823/2448969592","heartbeat_front_addr":"172.21.15.94:6821/2448969592","state":["exists","up"]},{"osd":6,"uuid":"4784bc77-6c33-4e47-abba-d37484982f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6825","nonce":3389553935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6827","nonce":3389553935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6831","nonce":3389553935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6829","nonce":3389553935}]},"public_addr":"172.21.15.94:6825/3389553935","cluster_addr":"172.21.15.94:6827/3389553935","heartbeat_back_addr":"172.21.15.94:6831/3389553935","heartbeat_front_addr":"172.21.15.94:6829/3389553935","state":["exists","up"]},{"osd":7,"uuid":"b954cf3f-4a4f-4a75-9f90-014f72c16d15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6801","nonce":1606498064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6803","nonce":1606498064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6807","nonce":1606498064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6805","nonce":1606498064}]},"public_addr":"172.21.15.94:6801/1606498064","cluster_addr":"172.21.15.94:6803/1606498064","heartbeat_back_addr":"172.21.15.94:6807/1606498064","heartbeat_front_addr":"172.21.15.94:6805/1606498064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T18:12:34.275 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:34.274+0000 7f8ad734b640 1 -- 172.21.15.91:0/581185681 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f8ab40667b0 msgr2=0x7f8ab4068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:34.275 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:34.274+0000 7f8ad734b640 1 --2- 172.21.15.91:0/581185681 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f8ab40667b0 0x7f8ab4068c70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8acc007fd0 tx=0x7f8acc007900 comp rx=0 tx=0).stop 2023-11-27T18:12:34.275 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:34.274+0000 7f8ad734b640 1 -- 172.21.15.91:0/581185681 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8ad0159d60 msgr2=0x7f8ad0156100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:34.275 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:34.274+0000 7f8ad734b640 1 --2- 172.21.15.91:0/581185681 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8ad0159d60 0x7f8ad0156100 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8009d90 tx=0x7f8ac8019660 comp rx=0 tx=0).stop 2023-11-27T18:12:34.275 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:34.274+0000 7f8ad734b640 1 -- 172.21.15.91:0/581185681 shutdown_connections 2023-11-27T18:12:34.275 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:34.274+0000 7f8ad734b640 1 --2- 172.21.15.91:0/581185681 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f8ab40667b0 0x7f8ab4068c70 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:34.275 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:34.274+0000 7f8ad734b640 1 --2- 172.21.15.91:0/581185681 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8ad0159d60 0x7f8ad0156100 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:34.276 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:34.274+0000 7f8ad734b640 1 --2- 172.21.15.91:0/581185681 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8ad0153af0 0x7f8ad0149d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:34.276 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:34.274+0000 7f8ad734b640 1 --2- 172.21.15.91:0/581185681 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8ad00b13f0 0x7f8ad0155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:34.276 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:34.274+0000 7f8ad734b640 1 -- 172.21.15.91:0/581185681 >> 172.21.15.91:0/581185681 conn(0x7f8ad00b08d0 msgr2=0x7f8ad00af8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:12:34.276 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:34.274+0000 7f8ad734b640 1 -- 172.21.15.91:0/581185681 shutdown_connections 2023-11-27T18:12:34.276 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T18:12:34.274+0000 7f8ad734b640 1 -- 172.21.15.91:0/581185681 wait complete. 2023-11-27T18:12:34.294 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-27T18:12:34.294 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-27T18:12:34.295 DEBUG:tasks.ceph_manager:running mds.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.a.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2023-11-27T18:12:34.295 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-27T18:12:34.295 DEBUG:teuthology.orchestra.run.smithi091:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i a 2023-11-27T18:12:34.297 INFO:tasks.ceph.mds.a:Started 2023-11-27T18:12:34.298 DEBUG:tasks.ceph_manager:running mds.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.c.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2023-11-27T18:12:34.298 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-27T18:12:34.298 DEBUG:teuthology.orchestra.run.smithi091:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i c 2023-11-27T18:12:34.300 INFO:tasks.ceph.mds.c:Started 2023-11-27T18:12:34.300 DEBUG:tasks.ceph_manager:running mds.e under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.e.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2023-11-27T18:12:34.300 INFO:tasks.ceph.mds.e:Restarting daemon 2023-11-27T18:12:34.300 DEBUG:teuthology.orchestra.run.smithi091:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i e 2023-11-27T18:12:34.302 INFO:tasks.ceph.mds.e:Started 2023-11-27T18:12:34.302 DEBUG:tasks.ceph_manager:running mds.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.b.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2023-11-27T18:12:34.303 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-27T18:12:34.303 DEBUG:teuthology.orchestra.run.smithi094:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i b 2023-11-27T18:12:34.304 INFO:tasks.ceph.mds.b:Started 2023-11-27T18:12:34.305 DEBUG:tasks.ceph_manager:running mds.d under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.d.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2023-11-27T18:12:34.305 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-27T18:12:34.305 DEBUG:teuthology.orchestra.run.smithi094:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i d 2023-11-27T18:12:34.309 INFO:tasks.ceph.mds.d:Started 2023-11-27T18:12:34.309 DEBUG:tasks.ceph_manager:running mds.f under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.f.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2023-11-27T18:12:34.309 INFO:tasks.ceph.mds.f:Restarting daemon 2023-11-27T18:12:34.310 DEBUG:teuthology.orchestra.run.smithi094:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i f 2023-11-27T18:12:34.313 INFO:tasks.ceph.mds.f:Started 2023-11-27T18:12:34.313 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-27T18:12:34.313 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T18:12:34.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.470+0000 7f6d70c29640 1 Processor -- start 2023-11-27T18:12:34.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.470+0000 7f6d70c29640 1 -- start start 2023-11-27T18:12:34.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.470+0000 7f6d70c29640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f6d6c1506d0 0x7f6d6c0c5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:34.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.470+0000 7f6d70c29640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6d6c06eff0 0x7f6d6c06b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:34.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.470+0000 7f6d70c29640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d6c06e8c0 con 0x7f6d6c0c2ca0 2023-11-27T18:12:34.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.470+0000 7f6d70c29640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d6c150ab0 con 0x7f6d6c1506d0 2023-11-27T18:12:34.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.470+0000 7f6d70c29640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d6c0c1060 con 0x7f6d6c06eff0 2023-11-27T18:12:34.480 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.478+0000 7f6d6a59c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f6d6c1506d0 0x7f6d6c0c5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:34.481 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.482+0000 7f6d6a59c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f6d6c1506d0 0x7f6d6c0c5fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:60562/0 (socket says 172.21.15.91:60562) 2023-11-27T18:12:34.481 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.482+0000 7f6d6a59c640 1 -- 172.21.15.91:0/3761507741 learned_addr learned my addr 172.21.15.91:0/3761507741 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:12:34.489 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.486+0000 7f6d6a59c640 1 -- 172.21.15.91:0/3761507741 >> v2:172.21.15.94:3300/0 conn(0x7f6d6c06eff0 msgr2=0x7f6d6c06b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:12:34.489 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.486+0000 7f6d6a59c640 1 --2- 172.21.15.91:0/3761507741 >> v2:172.21.15.94:3300/0 conn(0x7f6d6c06eff0 0x7f6d6c06b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:34.489 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.486+0000 7f6d6a59c640 1 -- 172.21.15.91:0/3761507741 >> v1:172.21.15.91:6789/0 conn(0x7f6d6c0c2ca0 legacy=0x7f6d6c0c7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:34.489 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.486+0000 7f6d6a59c640 1 -- 172.21.15.91:0/3761507741 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d6c0c1340 con 0x7f6d6c1506d0 2023-11-27T18:12:34.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.494+0000 7f6d6a59c640 1 --2- 172.21.15.91:0/3761507741 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6d6c1506d0 0x7f6d6c0c5fa0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c071ea0 tx=0x7f6d5c01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f664e36cd991259 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:12:34.500 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.498+0000 7f6d6959a640 1 -- 172.21.15.91:0/3761507741 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5c0a89f0 con 0x7f6d6c1506d0 2023-11-27T18:12:34.500 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.498+0000 7f6d6959a640 1 -- 172.21.15.91:0/3761507741 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d5c0a8b50 con 0x7f6d6c1506d0 2023-11-27T18:12:34.500 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.498+0000 7f6d6959a640 1 -- 172.21.15.91:0/3761507741 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5c0b0440 con 0x7f6d6c1506d0 2023-11-27T18:12:34.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.498+0000 7f6d70c29640 1 -- 172.21.15.91:0/3761507741 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6d6c1506d0 msgr2=0x7f6d6c0c5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:34.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.498+0000 7f6d70c29640 1 --2- 172.21.15.91:0/3761507741 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6d6c1506d0 0x7f6d6c0c5fa0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c071ea0 tx=0x7f6d5c01ecf0 comp rx=0 tx=0).stop 2023-11-27T18:12:34.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.498+0000 7f6d70c29640 1 -- 172.21.15.91:0/3761507741 shutdown_connections 2023-11-27T18:12:34.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.498+0000 7f6d70c29640 1 --2- 172.21.15.91:0/3761507741 >> v2:172.21.15.94:3300/0 conn(0x7f6d6c06eff0 0x7f6d6c06b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:34.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.498+0000 7f6d70c29640 1 --2- 172.21.15.91:0/3761507741 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6d6c1506d0 0x7f6d6c0c5fa0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:34.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.498+0000 7f6d70c29640 1 -- 172.21.15.91:0/3761507741 >> 172.21.15.91:0/3761507741 conn(0x7f6d6c0cbec0 msgr2=0x7f6d6c0cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:12:34.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.498+0000 7f6d70c29640 1 -- 172.21.15.91:0/3761507741 shutdown_connections 2023-11-27T18:12:34.502 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.498+0000 7f6d70c29640 1 -- 172.21.15.91:0/3761507741 wait complete. 2023-11-27T18:12:34.502 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.502+0000 7f6d70c29640 1 Processor -- start 2023-11-27T18:12:34.502 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.502+0000 7f6d70c29640 1 -- start start 2023-11-27T18:12:34.504 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.502+0000 7f6d70c29640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6d6c06eff0 0x7f6d6c151050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:34.504 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.502+0000 7f6d70c29640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6d6c0c2ca0 0x7f6d6c14fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:34.504 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.502+0000 7f6d70c29640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d6c1506d0 0x7f6d6c155970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:34.504 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.502+0000 7f6d70c29640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c14ffd0 con 0x7f6d6c0c2ca0 2023-11-27T18:12:34.504 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.502+0000 7f6d70c29640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c1edad0 con 0x7f6d6c1506d0 2023-11-27T18:12:34.504 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.502+0000 7f6d70c29640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c147530 con 0x7f6d6c06eff0 2023-11-27T18:12:34.504 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.502+0000 7f6d69d9b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6d6c0c2ca0 0x7f6d6c14fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:34.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.502+0000 7f6d69d9b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6d6c0c2ca0 0x7f6d6c14fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:60566/0 (socket says 172.21.15.91:60566) 2023-11-27T18:12:34.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.502+0000 7f6d69d9b640 1 -- 172.21.15.91:0/2616318004 learned_addr learned my addr 172.21.15.91:0/2616318004 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:12:34.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.506+0000 7f6d6a59c640 1 --2- 172.21.15.91:0/2616318004 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6d6c06eff0 0x7f6d6c151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:34.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.510+0000 7f6d69d9b640 1 -- 172.21.15.91:0/2616318004 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6d6c06eff0 msgr2=0x7f6d6c151050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:34.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.510+0000 7f6d69d9b640 1 --2- 172.21.15.91:0/2616318004 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6d6c06eff0 0x7f6d6c151050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:34.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.510+0000 7f6d69d9b640 1 -- 172.21.15.91:0/2616318004 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d6c1506d0 msgr2=0x7f6d6c155970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:34.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.510+0000 7f6d69d9b640 1 --2- 172.21.15.91:0/2616318004 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d6c1506d0 0x7f6d6c155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:34.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.510+0000 7f6d69d9b640 1 -- 172.21.15.91:0/2616318004 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d5c0094d0 con 0x7f6d6c0c2ca0 2023-11-27T18:12:34.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.522+0000 7f6d69d9b640 1 --2- 172.21.15.91:0/2616318004 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6d6c0c2ca0 0x7f6d6c14fa90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6d6000b480 tx=0x7f6d6000b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:12:34.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.538+0000 7f6d5affd640 1 -- 172.21.15.91:0/2616318004 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d60010870 con 0x7f6d6c0c2ca0 2023-11-27T18:12:34.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.538+0000 7f6d5affd640 1 -- 172.21.15.91:0/2616318004 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d600109f0 con 0x7f6d6c0c2ca0 2023-11-27T18:12:34.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.538+0000 7f6d5affd640 1 -- 172.21.15.91:0/2616318004 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d60010da0 con 0x7f6d6c0c2ca0 2023-11-27T18:12:34.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.538+0000 7f6d70c29640 1 -- 172.21.15.91:0/2616318004 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d6c147810 con 0x7f6d6c0c2ca0 2023-11-27T18:12:34.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.538+0000 7f6d70c29640 1 -- 172.21.15.91:0/2616318004 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d6c147dd0 con 0x7f6d6c0c2ca0 2023-11-27T18:12:34.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.538+0000 7f6d70c29640 1 -- 172.21.15.91:0/2616318004 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d6c067810 con 0x7f6d6c0c2ca0 2023-11-27T18:12:34.571 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.570+0000 7f6d5affd640 1 -- 172.21.15.91:0/2616318004 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 6) v1 ==== 85935+0+0 (secure 0 0 0) 0x7f6d60023480 con 0x7f6d6c0c2ca0 2023-11-27T18:12:34.571 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.570+0000 7f6d5affd640 1 --2- 172.21.15.91:0/2616318004 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f6d4c0667e0 0x7f6d4c068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:34.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.570+0000 7f6d6a59c640 1 --2- 172.21.15.91:0/2616318004 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f6d4c0667e0 0x7f6d4c068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:34.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.570+0000 7f6d6a59c640 1 --2- 172.21.15.91:0/2616318004 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f6d4c0667e0 0x7f6d4c068ca0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c0b2000 tx=0x7f6d5c0aa070 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:12:34.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.874+0000 7f6d5affd640 1 -- 172.21.15.91:0/2616318004 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f6d60055ba0 con 0x7f6d6c0c2ca0 2023-11-27T18:12:34.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:34.874+0000 7f6d5affd640 1 -- 172.21.15.91:0/2616318004 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f6d600517e0 con 0x7f6d6c0c2ca0 2023-11-27T18:12:35.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.050+0000 7f6d70c29640 1 -- 172.21.15.91:0/2616318004 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d6c0c7030 con 0x7f6d6c0c2ca0 2023-11-27T18:12:35.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.194+0000 7f6d5affd640 1 -- 172.21.15.91:0/2616318004 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+10837 (secure 0 0 0) 0x7f6d60014090 con 0x7f6d6c0c2ca0 2023-11-27T18:12:35.196 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:12:35.196 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":16,"fsid":"08c8ebbf-7936-4c41-a995-d5600de2d072","created":"2023-11-27T18:12:06.484593+0000","modified":"2023-11-27T18:12:33.154694+0000","last_up_change":"2023-11-27T18:12:33.154694+0000","last_in_change":"2023-11-27T18:12:23.622113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8ad53c08-dd19-4ae6-87c5-fa15bea3b4ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6811","nonce":472303992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6813","nonce":472303992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6817","nonce":472303992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6815","nonce":472303992}]},"public_addr":"172.21.15.91:6811/472303992","cluster_addr":"172.21.15.91:6813/472303992","heartbeat_back_addr":"172.21.15.91:6817/472303992","heartbeat_front_addr":"172.21.15.91:6815/472303992","state":["exists","up"]},{"osd":1,"uuid":"f8b5f147-ed29-4329-a787-a12cc34a2569","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6827","nonce":12316911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6829","nonce":12316911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6833","nonce":12316911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6831","nonce":12316911}]},"public_addr":"172.21.15.91:6827/12316911","cluster_addr":"172.21.15.91:6829/12316911","heartbeat_back_addr":"172.21.15.91:6833/12316911","heartbeat_front_addr":"172.21.15.91:6831/12316911","state":["exists","up"]},{"osd":2,"uuid":"c3029f9a-1c48-4f5d-983a-172a614d8795","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6803","nonce":3776125919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6805","nonce":3776125919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6809","nonce":3776125919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6807","nonce":3776125919}]},"public_addr":"172.21.15.91:6803/3776125919","cluster_addr":"172.21.15.91:6805/3776125919","heartbeat_back_addr":"172.21.15.91:6809/3776125919","heartbeat_front_addr":"172.21.15.91:6807/3776125919","state":["exists","up"]},{"osd":3,"uuid":"ab4b6fb2-0126-491b-9224-54a6badc5da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6819","nonce":1297704794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6821","nonce":1297704794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6825","nonce":1297704794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6823","nonce":1297704794}]},"public_addr":"172.21.15.91:6819/1297704794","cluster_addr":"172.21.15.91:6821/1297704794","heartbeat_back_addr":"172.21.15.91:6825/1297704794","heartbeat_front_addr":"172.21.15.91:6823/1297704794","state":["exists","up"]},{"osd":4,"uuid":"695071a8-2de8-4cba-bf20-050021a03bb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6809","nonce":2501531833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6811","nonce":2501531833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6815","nonce":2501531833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6813","nonce":2501531833}]},"public_addr":"172.21.15.94:6809/2501531833","cluster_addr":"172.21.15.94:6811/2501531833","heartbeat_back_addr":"172.21.15.94:6815/2501531833","heartbeat_front_addr":"172.21.15.94:6813/2501531833","state":["exists","up"]},{"osd":5,"uuid":"ca01da14-a700-4845-8db2-f5e3370677e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6817","nonce":2448969592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6819","nonce":2448969592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6823","nonce":2448969592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6821","nonce":2448969592}]},"public_addr":"172.21.15.94:6817/2448969592","cluster_addr":"172.21.15.94:6819/2448969592","heartbeat_back_addr":"172.21.15.94:6823/2448969592","heartbeat_front_addr":"172.21.15.94:6821/2448969592","state":["exists","up"]},{"osd":6,"uuid":"4784bc77-6c33-4e47-abba-d37484982f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6825","nonce":3389553935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6827","nonce":3389553935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6831","nonce":3389553935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6829","nonce":3389553935}]},"public_addr":"172.21.15.94:6825/3389553935","cluster_addr":"172.21.15.94:6827/3389553935","heartbeat_back_addr":"172.21.15.94:6831/3389553935","heartbeat_front_addr":"172.21.15.94:6829/3389553935","state":["exists","up"]},{"osd":7,"uuid":"b954cf3f-4a4f-4a75-9f90-014f72c16d15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6801","nonce":1606498064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6803","nonce":1606498064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6807","nonce":1606498064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6805","nonce":1606498064}]},"public_addr":"172.21.15.94:6801/1606498064","cluster_addr":"172.21.15.94:6803/1606498064","heartbeat_back_addr":"172.21.15.94:6807/1606498064","heartbeat_front_addr":"172.21.15.94:6805/1606498064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T18:12:35.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.198+0000 7f6d70c29640 1 -- 172.21.15.91:0/2616318004 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f6d4c0667e0 msgr2=0x7f6d4c068ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:35.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.198+0000 7f6d70c29640 1 --2- 172.21.15.91:0/2616318004 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f6d4c0667e0 0x7f6d4c068ca0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c0b2000 tx=0x7f6d5c0aa070 comp rx=0 tx=0).stop 2023-11-27T18:12:35.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.198+0000 7f6d70c29640 1 -- 172.21.15.91:0/2616318004 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6d6c0c2ca0 msgr2=0x7f6d6c14fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:35.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.198+0000 7f6d70c29640 1 --2- 172.21.15.91:0/2616318004 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6d6c0c2ca0 0x7f6d6c14fa90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6d6000b480 tx=0x7f6d6000b940 comp rx=0 tx=0).stop 2023-11-27T18:12:35.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.198+0000 7f6d70c29640 1 -- 172.21.15.91:0/2616318004 shutdown_connections 2023-11-27T18:12:35.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.198+0000 7f6d70c29640 1 --2- 172.21.15.91:0/2616318004 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f6d4c0667e0 0x7f6d4c068ca0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:35.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.198+0000 7f6d70c29640 1 --2- 172.21.15.91:0/2616318004 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d6c1506d0 0x7f6d6c155970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:35.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.198+0000 7f6d70c29640 1 --2- 172.21.15.91:0/2616318004 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6d6c0c2ca0 0x7f6d6c14fa90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:35.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.198+0000 7f6d70c29640 1 --2- 172.21.15.91:0/2616318004 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6d6c06eff0 0x7f6d6c151050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:35.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.198+0000 7f6d70c29640 1 -- 172.21.15.91:0/2616318004 >> 172.21.15.91:0/2616318004 conn(0x7f6d6c0cbec0 msgr2=0x7f6d6c0c90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:12:35.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.198+0000 7f6d70c29640 1 -- 172.21.15.91:0/2616318004 shutdown_connections 2023-11-27T18:12:35.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.198+0000 7f6d70c29640 1 -- 172.21.15.91:0/2616318004 wait complete. 2023-11-27T18:12:35.218 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2023-11-27T18:12:35.219 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T18:12:35.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.366+0000 7f6d846a2640 1 Processor -- start 2023-11-27T18:12:35.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.366+0000 7f6d846a2640 1 -- start start 2023-11-27T18:12:35.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.366+0000 7f6d846a2640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6d7c1506d0 0x7f6d7c0c5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:35.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.366+0000 7f6d846a2640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f6d7c06eff0 0x7f6d7c06b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:35.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.366+0000 7f6d846a2640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d7c06e8c0 con 0x7f6d7c0c2ca0 2023-11-27T18:12:35.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.366+0000 7f6d846a2640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d7c150ab0 con 0x7f6d7c06eff0 2023-11-27T18:12:35.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.366+0000 7f6d846a2640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d7c0c1060 con 0x7f6d7c1506d0 2023-11-27T18:12:35.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.366+0000 7f6d81c3d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f6d7c06eff0 0x7f6d7c06b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:35.369 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.370+0000 7f6d81c3d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f6d7c06eff0 0x7f6d7c06b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:60578/0 (socket says 172.21.15.91:60578) 2023-11-27T18:12:35.369 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.370+0000 7f6d81c3d640 1 -- 172.21.15.91:0/4064744943 learned_addr learned my addr 172.21.15.91:0/4064744943 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:12:35.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.370+0000 7f6d81c3d640 1 -- 172.21.15.91:0/4064744943 >> v2:172.21.15.94:3300/0 conn(0x7f6d7c1506d0 msgr2=0x7f6d7c0c5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:12:35.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.370+0000 7f6d81c3d640 1 --2- 172.21.15.91:0/4064744943 >> v2:172.21.15.94:3300/0 conn(0x7f6d7c1506d0 0x7f6d7c0c5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:35.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.370+0000 7f6d81c3d640 1 -- 172.21.15.91:0/4064744943 >> v1:172.21.15.94:6789/0 conn(0x7f6d7c0c2ca0 legacy=0x7f6d7c0c7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:12:35.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.370+0000 7f6d81c3d640 1 -- 172.21.15.91:0/4064744943 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d7c0c1340 con 0x7f6d7c06eff0 2023-11-27T18:12:35.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.374+0000 7f6d81c3d640 1 --2- 172.21.15.91:0/4064744943 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6d7c06eff0 0x7f6d7c06b630 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c0c7250 tx=0x7f6d6c01ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c2ec3a1f3a3d4d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:12:35.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.378+0000 7f6d8143c640 1 -- 172.21.15.91:0/4064744943 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6c0a89b0 con 0x7f6d7c06eff0 2023-11-27T18:12:35.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.378+0000 7f6d8143c640 1 -- 172.21.15.91:0/4064744943 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d6c0a8b10 con 0x7f6d7c06eff0 2023-11-27T18:12:35.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.378+0000 7f6d8143c640 1 -- 172.21.15.91:0/4064744943 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6c0a8ea0 con 0x7f6d7c06eff0 2023-11-27T18:12:35.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.382+0000 7f6d846a2640 1 -- 172.21.15.91:0/4064744943 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6d7c06eff0 msgr2=0x7f6d7c06b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:35.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.382+0000 7f6d846a2640 1 --2- 172.21.15.91:0/4064744943 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6d7c06eff0 0x7f6d7c06b630 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c0c7250 tx=0x7f6d6c01ecb0 comp rx=0 tx=0).stop 2023-11-27T18:12:35.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.382+0000 7f6d846a2640 1 -- 172.21.15.91:0/4064744943 shutdown_connections 2023-11-27T18:12:35.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.382+0000 7f6d846a2640 1 --2- 172.21.15.91:0/4064744943 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6d7c06eff0 0x7f6d7c06b630 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:35.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.382+0000 7f6d846a2640 1 --2- 172.21.15.91:0/4064744943 >> v2:172.21.15.94:3300/0 conn(0x7f6d7c1506d0 0x7f6d7c0c5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:35.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.382+0000 7f6d846a2640 1 -- 172.21.15.91:0/4064744943 >> 172.21.15.91:0/4064744943 conn(0x7f6d7c0cbec0 msgr2=0x7f6d7c0cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:12:35.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.382+0000 7f6d846a2640 1 -- 172.21.15.91:0/4064744943 shutdown_connections 2023-11-27T18:12:35.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.382+0000 7f6d846a2640 1 -- 172.21.15.91:0/4064744943 wait complete. 2023-11-27T18:12:35.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.382+0000 7f6d846a2640 1 Processor -- start 2023-11-27T18:12:35.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.382+0000 7f6d846a2640 1 -- start start 2023-11-27T18:12:35.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.382+0000 7f6d846a2640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6d7c06eff0 0x7f6d7c0c3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:35.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.382+0000 7f6d846a2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d7c0c2ca0 0x7f6d7c144da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:35.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.382+0000 7f6d846a2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6d7c1506d0 0x7f6d7c1ef2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:35.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.382+0000 7f6d846a2640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d7c0c4380 con 0x7f6d7c1506d0 2023-11-27T18:12:35.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.382+0000 7f6d846a2640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d7c1452e0 con 0x7f6d7c0c2ca0 2023-11-27T18:12:35.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.382+0000 7f6d846a2640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d7c0c39b0 con 0x7f6d7c06eff0 2023-11-27T18:12:35.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.386+0000 7f6d8243e640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6d7c06eff0 0x7f6d7c0c3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:35.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.386+0000 7f6d8243e640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6d7c06eff0 0x7f6d7c0c3e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.91:47848/0 (socket says 172.21.15.91:47848) 2023-11-27T18:12:35.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.386+0000 7f6d8243e640 1 -- 172.21.15.91:0/2687155730 learned_addr learned my addr 172.21.15.91:0/2687155730 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:12:35.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.386+0000 7f6d82c3f640 1 --2- 172.21.15.91:0/2687155730 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6d7c1506d0 0x7f6d7c1ef2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:35.389 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.390+0000 7f6d81c3d640 1 --2- 172.21.15.91:0/2687155730 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d7c0c2ca0 0x7f6d7c144da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:35.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.390+0000 7f6d8243e640 1 -- 172.21.15.91:0/2687155730 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d7c0c2ca0 msgr2=0x7f6d7c144da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:35.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.390+0000 7f6d8243e640 1 --2- 172.21.15.91:0/2687155730 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d7c0c2ca0 0x7f6d7c144da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:35.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.390+0000 7f6d8243e640 1 -- 172.21.15.91:0/2687155730 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6d7c1506d0 msgr2=0x7f6d7c1ef2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:35.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.390+0000 7f6d8243e640 1 --2- 172.21.15.91:0/2687155730 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6d7c1506d0 0x7f6d7c1ef2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:35.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.390+0000 7f6d8243e640 1 -- 172.21.15.91:0/2687155730 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d6c0094d0 con 0x7f6d7c06eff0 2023-11-27T18:12:35.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.394+0000 7f6d8243e640 1 --2- 172.21.15.91:0/2687155730 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6d7c06eff0 0x7f6d7c0c3e40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6d7800b440 tx=0x7f6d7800b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:12:35.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.398+0000 7f6d72ffd640 1 -- 172.21.15.91:0/2687155730 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d78011890 con 0x7f6d7c06eff0 2023-11-27T18:12:35.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.398+0000 7f6d72ffd640 1 -- 172.21.15.91:0/2687155730 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d78011a10 con 0x7f6d7c06eff0 2023-11-27T18:12:35.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.398+0000 7f6d72ffd640 1 -- 172.21.15.91:0/2687155730 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d78011dc0 con 0x7f6d7c06eff0 2023-11-27T18:12:35.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.398+0000 7f6d846a2640 1 -- 172.21.15.91:0/2687155730 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d7c1f0210 con 0x7f6d7c06eff0 2023-11-27T18:12:35.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.398+0000 7f6d846a2640 1 -- 172.21.15.91:0/2687155730 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d7c1eff30 con 0x7f6d7c06eff0 2023-11-27T18:12:35.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.398+0000 7f6d70ff9640 1 -- 172.21.15.91:0/2687155730 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d58005260 con 0x7f6d7c06eff0 2023-11-27T18:12:35.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.422+0000 7f6d72ffd640 1 -- 172.21.15.91:0/2687155730 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 6) v1 ==== 85935+0+0 (secure 0 0 0) 0x7f6d7801a400 con 0x7f6d7c06eff0 2023-11-27T18:12:35.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.422+0000 7f6d72ffd640 1 --2- 172.21.15.91:0/2687155730 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f6d600667b0 0x7f6d60068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:35.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.422+0000 7f6d81c3d640 1 --2- 172.21.15.91:0/2687155730 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f6d600667b0 0x7f6d60068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:35.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.422+0000 7f6d81c3d640 1 --2- 172.21.15.91:0/2687155730 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f6d600667b0 0x7f6d60068c70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c0b2000 tx=0x7f6d6c008040 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:12:35.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.426+0000 7f6d72ffd640 1 -- 172.21.15.91:0/2687155730 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f6d78056060 con 0x7f6d7c06eff0 2023-11-27T18:12:35.704 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.702+0000 7f6d72ffd640 1 -- 172.21.15.91:0/2687155730 <== mon.2 v2:172.21.15.94:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f6d78051ca0 con 0x7f6d7c06eff0 2023-11-27T18:12:35.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.906+0000 7f6d70ff9640 1 -- 172.21.15.91:0/2687155730 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6d580057e0 con 0x7f6d7c06eff0 2023-11-27T18:12:35.937 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.938+0000 7f6d72ffd640 1 -- 172.21.15.91:0/2687155730 <== mon.2 v2:172.21.15.94:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7f6d78015070 con 0x7f6d7c06eff0 2023-11-27T18:12:35.938 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:12:35.938 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2023-11-27T18:12:35.938 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 1 2023-11-27T18:12:35.940 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.938+0000 7f6d70ff9640 1 -- 172.21.15.91:0/2687155730 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f6d600667b0 msgr2=0x7f6d60068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:35.940 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.938+0000 7f6d70ff9640 1 --2- 172.21.15.91:0/2687155730 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f6d600667b0 0x7f6d60068c70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c0b2000 tx=0x7f6d6c008040 comp rx=0 tx=0).stop 2023-11-27T18:12:35.941 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.938+0000 7f6d70ff9640 1 -- 172.21.15.91:0/2687155730 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6d7c06eff0 msgr2=0x7f6d7c0c3e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:35.941 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.938+0000 7f6d70ff9640 1 --2- 172.21.15.91:0/2687155730 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6d7c06eff0 0x7f6d7c0c3e40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6d7800b440 tx=0x7f6d7800b900 comp rx=0 tx=0).stop 2023-11-27T18:12:35.941 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.938+0000 7f6d70ff9640 1 -- 172.21.15.91:0/2687155730 shutdown_connections 2023-11-27T18:12:35.941 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.938+0000 7f6d70ff9640 1 --2- 172.21.15.91:0/2687155730 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f6d600667b0 0x7f6d60068c70 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:35.941 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.938+0000 7f6d70ff9640 1 --2- 172.21.15.91:0/2687155730 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6d7c1506d0 0x7f6d7c1ef2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:35.941 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.938+0000 7f6d70ff9640 1 --2- 172.21.15.91:0/2687155730 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d7c0c2ca0 0x7f6d7c144da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:35.941 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.938+0000 7f6d70ff9640 1 --2- 172.21.15.91:0/2687155730 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6d7c06eff0 0x7f6d7c0c3e40 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:35.941 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.938+0000 7f6d70ff9640 1 -- 172.21.15.91:0/2687155730 >> 172.21.15.91:0/2687155730 conn(0x7f6d7c0cbec0 msgr2=0x7f6d7c146bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:12:35.941 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.938+0000 7f6d70ff9640 1 -- 172.21.15.91:0/2687155730 shutdown_connections 2023-11-27T18:12:35.941 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:35.938+0000 7f6d70ff9640 1 -- 172.21.15.91:0/2687155730 wait complete. 2023-11-27T18:12:37.960 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T18:12:38.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.070+0000 7f63f8c5b640 1 Processor -- start 2023-11-27T18:12:38.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.070+0000 7f63f8c5b640 1 -- start start 2023-11-27T18:12:38.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.074+0000 7f63f8c5b640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f63f4070cf0 0x7f63f40c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:38.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.074+0000 7f63f8c5b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f63f40710d0 0x7f63f40c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:38.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.074+0000 7f63f8c5b640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63f40cd860 con 0x7f63f40ccc20 2023-11-27T18:12:38.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.074+0000 7f63f8c5b640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63f406b6a0 con 0x7f63f40710d0 2023-11-27T18:12:38.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.074+0000 7f63f8c5b640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63f40cd650 con 0x7f63f4070cf0 2023-11-27T18:12:38.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.074+0000 7f63ebfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f63f40710d0 0x7f63f40c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:38.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.074+0000 7f63f259c640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f63f4070cf0 0x7f63f40c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:38.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.074+0000 7f63ebfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f63f40710d0 0x7f63f40c87d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:60272/0 (socket says 172.21.15.91:60272) 2023-11-27T18:12:38.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.074+0000 7f63ebfff640 1 -- 172.21.15.91:0/461241788 learned_addr learned my addr 172.21.15.91:0/461241788 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:12:38.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.078+0000 7f63ebfff640 1 -- 172.21.15.91:0/461241788 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f63f4070cf0 msgr2=0x7f63f40c7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:12:38.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.078+0000 7f63ebfff640 1 --2- 172.21.15.91:0/461241788 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f63f4070cf0 0x7f63f40c7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:38.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.078+0000 7f63ebfff640 1 -- 172.21.15.91:0/461241788 >> v1:172.21.15.91:6789/0 conn(0x7f63f40ccc20 legacy=0x7f63f4153390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:12:38.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.078+0000 7f63ebfff640 1 -- 172.21.15.91:0/461241788 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f40cdb40 con 0x7f63f40710d0 2023-11-27T18:12:38.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.082+0000 7f63ebfff640 1 --2- 172.21.15.91:0/461241788 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f63f40710d0 0x7f63f40c87d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f63dc009870 tx=0x7f63dc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7178ac838d2ae526 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:12:38.086 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.086+0000 7f63f1d9b640 1 -- 172.21.15.91:0/461241788 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63dc0aa5f0 con 0x7f63f40710d0 2023-11-27T18:12:38.086 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.086+0000 7f63f1d9b640 1 -- 172.21.15.91:0/461241788 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63dc0aa750 con 0x7f63f40710d0 2023-11-27T18:12:38.086 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.086+0000 7f63f1d9b640 1 -- 172.21.15.91:0/461241788 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63dc0aaae0 con 0x7f63f40710d0 2023-11-27T18:12:38.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.086+0000 7f63f8c5b640 1 -- 172.21.15.91:0/461241788 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f63f40710d0 msgr2=0x7f63f40c87d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:38.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.086+0000 7f63f8c5b640 1 --2- 172.21.15.91:0/461241788 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f63f40710d0 0x7f63f40c87d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f63dc009870 tx=0x7f63dc01c4d0 comp rx=0 tx=0).stop 2023-11-27T18:12:38.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.086+0000 7f63f8c5b640 1 -- 172.21.15.91:0/461241788 shutdown_connections 2023-11-27T18:12:38.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.086+0000 7f63f8c5b640 1 --2- 172.21.15.91:0/461241788 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f63f40710d0 0x7f63f40c87d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:38.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.086+0000 7f63f8c5b640 1 --2- 172.21.15.91:0/461241788 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f63f4070cf0 0x7f63f40c7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:38.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.086+0000 7f63f8c5b640 1 -- 172.21.15.91:0/461241788 >> 172.21.15.91:0/461241788 conn(0x7f63f40669c0 msgr2=0x7f63f406ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:12:38.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.086+0000 7f63f8c5b640 1 -- 172.21.15.91:0/461241788 shutdown_connections 2023-11-27T18:12:38.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.086+0000 7f63f8c5b640 1 -- 172.21.15.91:0/461241788 wait complete. 2023-11-27T18:12:38.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.086+0000 7f63f8c5b640 1 Processor -- start 2023-11-27T18:12:38.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.086+0000 7f63f8c5b640 1 -- start start 2023-11-27T18:12:38.089 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.090+0000 7f63f8c5b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f63f4070cf0 0x7f63f41f6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:38.089 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.090+0000 7f63f8c5b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63f40710d0 0x7f63f4152850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:38.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.090+0000 7f63f8c5b640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f63f40ccc20 0x7f63f4152d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:38.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.090+0000 7f63f8c5b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f4148ae0 con 0x7f63f4070cf0 2023-11-27T18:12:38.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.090+0000 7f63f8c5b640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f41f5a30 con 0x7f63f40710d0 2023-11-27T18:12:38.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.090+0000 7f63f8c5b640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63f41f6980 con 0x7f63f40ccc20 2023-11-27T18:12:38.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.090+0000 7f63f259c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f63f4070cf0 0x7f63f41f6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:38.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.090+0000 7f63f2d9d640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f63f40ccc20 0x7f63f4152d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:38.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.090+0000 7f63f259c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f63f4070cf0 0x7f63f41f6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:60274/0 (socket says 172.21.15.91:60274) 2023-11-27T18:12:38.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.090+0000 7f63f259c640 1 -- 172.21.15.91:0/639781074 learned_addr learned my addr 172.21.15.91:0/639781074 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:12:38.096 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.094+0000 7f63f259c640 1 -- 172.21.15.91:0/639781074 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f63f40ccc20 msgr2=0x7f63f4152d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:38.096 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.094+0000 7f63f259c640 1 --2- 172.21.15.91:0/639781074 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f63f40ccc20 0x7f63f4152d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:38.096 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.094+0000 7f63f259c640 1 -- 172.21.15.91:0/639781074 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63f40710d0 msgr2=0x7f63f4152850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:38.096 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.094+0000 7f63f259c640 1 --2- 172.21.15.91:0/639781074 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63f40710d0 0x7f63f4152850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:38.096 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.094+0000 7f63f259c640 1 -- 172.21.15.91:0/639781074 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63dc0094d0 con 0x7f63f4070cf0 2023-11-27T18:12:38.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.098+0000 7f63f259c640 1 --2- 172.21.15.91:0/639781074 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f63f4070cf0 0x7f63f41f6440 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f63e400e930 tx=0x7f63e400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:12:38.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.102+0000 7f63eaffd640 1 -- 172.21.15.91:0/639781074 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e4009690 con 0x7f63f4070cf0 2023-11-27T18:12:38.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.102+0000 7f63eaffd640 1 -- 172.21.15.91:0/639781074 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e400ca00 con 0x7f63f4070cf0 2023-11-27T18:12:38.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.102+0000 7f63eaffd640 1 -- 172.21.15.91:0/639781074 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e400cd70 con 0x7f63f4070cf0 2023-11-27T18:12:38.104 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.102+0000 7f63f8c5b640 1 -- 172.21.15.91:0/639781074 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63f41f5fb0 con 0x7f63f4070cf0 2023-11-27T18:12:38.104 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.102+0000 7f63f8c5b640 1 -- 172.21.15.91:0/639781074 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63f414cd00 con 0x7f63f4070cf0 2023-11-27T18:12:38.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.102+0000 7f63f8c5b640 1 -- 172.21.15.91:0/639781074 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63f40c5080 con 0x7f63f4070cf0 2023-11-27T18:12:38.370 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.370+0000 7f63eaffd640 1 -- 172.21.15.91:0/639781074 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 6) v1 ==== 85935+0+0 (secure 0 0 0) 0x7f63e4013470 con 0x7f63f4070cf0 2023-11-27T18:12:38.370 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.370+0000 7f63eaffd640 1 --2- 172.21.15.91:0/639781074 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f63d40667e0 0x7f63d4068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:38.370 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.370+0000 7f63ebfff640 1 --2- 172.21.15.91:0/639781074 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f63d40667e0 0x7f63d4068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:38.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.370+0000 7f63ebfff640 1 --2- 172.21.15.91:0/639781074 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f63d40667e0 0x7f63d4068ca0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f63dc0ae000 tx=0x7f63dc008040 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:12:38.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.394+0000 7f63eaffd640 1 -- 172.21.15.91:0/639781074 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f63e4055a30 con 0x7f63f4070cf0 2023-11-27T18:12:38.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.394+0000 7f63eaffd640 1 -- 172.21.15.91:0/639781074 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f63e4051d70 con 0x7f63f4070cf0 2023-11-27T18:12:38.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.626+0000 7f63f8c5b640 1 -- 172.21.15.91:0/639781074 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f63f404e930 con 0x7f63f4070cf0 2023-11-27T18:12:38.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.638+0000 7f63eaffd640 1 -- 172.21.15.91:0/639781074 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7f63e4021020 con 0x7f63f4070cf0 2023-11-27T18:12:38.640 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:12:38.641 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2023-11-27T18:12:38.641 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 1 2023-11-27T18:12:38.642 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.638+0000 7f63f8c5b640 1 -- 172.21.15.91:0/639781074 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f63d40667e0 msgr2=0x7f63d4068ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:38.642 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.638+0000 7f63f8c5b640 1 --2- 172.21.15.91:0/639781074 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f63d40667e0 0x7f63d4068ca0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f63dc0ae000 tx=0x7f63dc008040 comp rx=0 tx=0).stop 2023-11-27T18:12:38.642 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.638+0000 7f63f8c5b640 1 -- 172.21.15.91:0/639781074 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f63f4070cf0 msgr2=0x7f63f41f6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:38.642 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.638+0000 7f63f8c5b640 1 --2- 172.21.15.91:0/639781074 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f63f4070cf0 0x7f63f41f6440 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f63e400e930 tx=0x7f63e400edf0 comp rx=0 tx=0).stop 2023-11-27T18:12:38.642 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.638+0000 7f63f8c5b640 1 -- 172.21.15.91:0/639781074 shutdown_connections 2023-11-27T18:12:38.642 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.638+0000 7f63f8c5b640 1 --2- 172.21.15.91:0/639781074 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f63d40667e0 0x7f63d4068ca0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:38.642 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.638+0000 7f63f8c5b640 1 --2- 172.21.15.91:0/639781074 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f63f40ccc20 0x7f63f4152d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:38.642 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.638+0000 7f63f8c5b640 1 --2- 172.21.15.91:0/639781074 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63f40710d0 0x7f63f4152850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:38.642 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.638+0000 7f63f8c5b640 1 --2- 172.21.15.91:0/639781074 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f63f4070cf0 0x7f63f41f6440 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:38.642 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.638+0000 7f63f8c5b640 1 -- 172.21.15.91:0/639781074 >> 172.21.15.91:0/639781074 conn(0x7f63f40669c0 msgr2=0x7f63f40caad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:12:38.642 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.638+0000 7f63f8c5b640 1 -- 172.21.15.91:0/639781074 shutdown_connections 2023-11-27T18:12:38.642 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:38.638+0000 7f63f8c5b640 1 -- 172.21.15.91:0/639781074 wait complete. 2023-11-27T18:12:40.656 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T18:12:40.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.810+0000 7f71eb628640 1 Processor -- start 2023-11-27T18:12:40.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.810+0000 7f71eb628640 1 -- start start 2023-11-27T18:12:40.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.810+0000 7f71eb628640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f71e4071690 0x7f71e4071b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:40.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.810+0000 7f71eb628640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f71e4155b10 0x7f71e4155f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:40.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.810+0000 7f71eb628640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71e40c4810 con 0x7f71e414fd60 2023-11-27T18:12:40.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.810+0000 7f71eb628640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71e40c5420 con 0x7f71e4155b10 2023-11-27T18:12:40.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.810+0000 7f71eb628640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71e406ac30 con 0x7f71e4071690 2023-11-27T18:12:40.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.814+0000 7f71e9bc5640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f71e4155b10 0x7f71e4155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:40.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.814+0000 7f71e93c4640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f71e414fd60 0x7f71e406a520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:42488/0 (socket says 172.21.15.91:42488) 2023-11-27T18:12:40.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.814+0000 7f71e93c4640 1 -- 172.21.15.91:0/1238697883 learned_addr learned my addr 172.21.15.91:0/1238697883 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:12:40.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.814+0000 7f71e8bc3640 1 --2- 172.21.15.91:0/1238697883 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f71e4071690 0x7f71e4071b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:40.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.818+0000 7f71e9bc5640 1 -- 172.21.15.91:0/1238697883 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f71e4071690 msgr2=0x7f71e4071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:12:40.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.818+0000 7f71e9bc5640 1 --2- 172.21.15.91:0/1238697883 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f71e4071690 0x7f71e4071b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:40.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.818+0000 7f71e9bc5640 1 -- 172.21.15.91:0/1238697883 >> v1:172.21.15.91:6789/0 conn(0x7f71e414fd60 legacy=0x7f71e406a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:40.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.818+0000 7f71e9bc5640 1 -- 172.21.15.91:0/1238697883 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e4156910 con 0x7f71e4155b10 2023-11-27T18:12:40.823 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.822+0000 7f71e9bc5640 1 --2- 172.21.15.91:0/1238697883 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71e4155b10 0x7f71e4155f40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f71dc009d90 tx=0x7f71dc01c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efd5acad2b243927 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:12:40.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.830+0000 7f71dbfff640 1 -- 172.21.15.91:0/1238697883 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71dc0a5850 con 0x7f71e4155b10 2023-11-27T18:12:40.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.830+0000 7f71dbfff640 1 -- 172.21.15.91:0/1238697883 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71dc0a59b0 con 0x7f71e4155b10 2023-11-27T18:12:40.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.830+0000 7f71dbfff640 1 -- 172.21.15.91:0/1238697883 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71dc0a5d40 con 0x7f71e4155b10 2023-11-27T18:12:40.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.830+0000 7f71eb628640 1 -- 172.21.15.91:0/1238697883 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71e4155b10 msgr2=0x7f71e4155f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:40.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.830+0000 7f71eb628640 1 --2- 172.21.15.91:0/1238697883 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71e4155b10 0x7f71e4155f40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f71dc009d90 tx=0x7f71dc01c920 comp rx=0 tx=0).stop 2023-11-27T18:12:40.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.830+0000 7f71eb628640 1 -- 172.21.15.91:0/1238697883 shutdown_connections 2023-11-27T18:12:40.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.830+0000 7f71eb628640 1 --2- 172.21.15.91:0/1238697883 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71e4155b10 0x7f71e4155f40 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:40.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.830+0000 7f71eb628640 1 --2- 172.21.15.91:0/1238697883 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f71e4071690 0x7f71e4071b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:40.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.830+0000 7f71eb628640 1 -- 172.21.15.91:0/1238697883 >> 172.21.15.91:0/1238697883 conn(0x7f71e40c7fa0 msgr2=0x7f71e40c83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:12:40.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.830+0000 7f71eb628640 1 -- 172.21.15.91:0/1238697883 shutdown_connections 2023-11-27T18:12:40.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.830+0000 7f71eb628640 1 -- 172.21.15.91:0/1238697883 wait complete. 2023-11-27T18:12:40.833 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.834+0000 7f71eb628640 1 Processor -- start 2023-11-27T18:12:40.833 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.834+0000 7f71eb628640 1 -- start start 2023-11-27T18:12:40.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.834+0000 7f71eb628640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f71e4071690 0x7f71e414e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:40.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.834+0000 7f71eb628640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71e414fd60 0x7f71e41f3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:40.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.834+0000 7f71eb628640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f71e4155b10 0x7f71e41419f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:40.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.834+0000 7f71eb628640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e41f4900 con 0x7f71e4071690 2023-11-27T18:12:40.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.834+0000 7f71eb628640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e414dc60 con 0x7f71e414fd60 2023-11-27T18:12:40.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.834+0000 7f71eb628640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71e414e1c0 con 0x7f71e4155b10 2023-11-27T18:12:40.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.834+0000 7f71e8bc3640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71e414fd60 0x7f71e41f3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:40.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.834+0000 7f71e93c4640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f71e4071690 0x7f71e414e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:40.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.834+0000 7f71e8bc3640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71e414fd60 0x7f71e41f3be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.91:57754/0 (socket says 172.21.15.91:57754) 2023-11-27T18:12:40.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.834+0000 7f71e8bc3640 1 -- 172.21.15.91:0/3644888170 learned_addr learned my addr 172.21.15.91:0/3644888170 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:12:40.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.834+0000 7f71e9bc5640 1 --2- 172.21.15.91:0/3644888170 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f71e4155b10 0x7f71e41419f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:40.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.842+0000 7f71e8bc3640 1 -- 172.21.15.91:0/3644888170 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f71e4155b10 msgr2=0x7f71e41419f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:40.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.842+0000 7f71e8bc3640 1 --2- 172.21.15.91:0/3644888170 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f71e4155b10 0x7f71e41419f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:40.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.842+0000 7f71e8bc3640 1 -- 172.21.15.91:0/3644888170 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f71e4071690 msgr2=0x7f71e414e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:40.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.842+0000 7f71e8bc3640 1 --2- 172.21.15.91:0/3644888170 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f71e4071690 0x7f71e414e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:40.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.842+0000 7f71e8bc3640 1 -- 172.21.15.91:0/3644888170 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71dc009a70 con 0x7f71e414fd60 2023-11-27T18:12:40.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.846+0000 7f71e8bc3640 1 --2- 172.21.15.91:0/3644888170 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71e414fd60 0x7f71e41f3be0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f71d400e930 tx=0x7f71d400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:12:40.857 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.858+0000 7f71d9ffb640 1 -- 172.21.15.91:0/3644888170 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d4009690 con 0x7f71e414fd60 2023-11-27T18:12:40.857 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.858+0000 7f71d9ffb640 1 -- 172.21.15.91:0/3644888170 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d400ca00 con 0x7f71e414fd60 2023-11-27T18:12:40.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.858+0000 7f71d9ffb640 1 -- 172.21.15.91:0/3644888170 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d400cd70 con 0x7f71e414fd60 2023-11-27T18:12:40.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.858+0000 7f71eb628640 1 -- 172.21.15.91:0/3644888170 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71e41537a0 con 0x7f71e414fd60 2023-11-27T18:12:40.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.858+0000 7f71eb628640 1 -- 172.21.15.91:0/3644888170 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71e41f4620 con 0x7f71e414fd60 2023-11-27T18:12:40.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.858+0000 7f71eb628640 1 -- 172.21.15.91:0/3644888170 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71e414e370 con 0x7f71e414fd60 2023-11-27T18:12:40.891 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.890+0000 7f71d9ffb640 1 -- 172.21.15.91:0/3644888170 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 85935+0+0 (secure 0 0 0) 0x7f71d4013650 con 0x7f71e414fd60 2023-11-27T18:12:40.891 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.890+0000 7f71d9ffb640 1 --2- 172.21.15.91:0/3644888170 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f71c8066790 0x7f71c8068c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:40.891 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.890+0000 7f71e93c4640 1 --2- 172.21.15.91:0/3644888170 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f71c8066790 0x7f71c8068c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:40.891 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.890+0000 7f71e93c4640 1 --2- 172.21.15.91:0/3644888170 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f71c8066790 0x7f71c8068c50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f71e0000f70 tx=0x7f71e0009040 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:12:40.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:40.894+0000 7f71d9ffb640 1 -- 172.21.15.91:0/3644888170 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f71d4059780 con 0x7f71e414fd60 2023-11-27T18:12:41.179 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:41.178+0000 7f71d9ffb640 1 -- 172.21.15.91:0/3644888170 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f71d4055ac0 con 0x7f71e414fd60 2023-11-27T18:12:41.478 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:41.478+0000 7f71eb628640 1 -- 172.21.15.91:0/3644888170 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f71e414e330 con 0x7f71e414fd60 2023-11-27T18:12:41.503 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:41.502+0000 7f71d9ffb640 1 -- 172.21.15.91:0/3644888170 <== mon.1 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7f71d4020030 con 0x7f71e414fd60 2023-11-27T18:12:41.504 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:12:41.504 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2023-11-27T18:12:41.504 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 1 2023-11-27T18:12:41.506 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:41.506+0000 7f71eb628640 1 -- 172.21.15.91:0/3644888170 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f71c8066790 msgr2=0x7f71c8068c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:41.506 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:41.506+0000 7f71eb628640 1 --2- 172.21.15.91:0/3644888170 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f71c8066790 0x7f71c8068c50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f71e0000f70 tx=0x7f71e0009040 comp rx=0 tx=0).stop 2023-11-27T18:12:41.506 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:41.506+0000 7f71eb628640 1 -- 172.21.15.91:0/3644888170 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71e414fd60 msgr2=0x7f71e41f3be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:41.506 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:41.506+0000 7f71eb628640 1 --2- 172.21.15.91:0/3644888170 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71e414fd60 0x7f71e41f3be0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f71d400e930 tx=0x7f71d400edf0 comp rx=0 tx=0).stop 2023-11-27T18:12:41.506 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:41.506+0000 7f71eb628640 1 -- 172.21.15.91:0/3644888170 shutdown_connections 2023-11-27T18:12:41.506 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:41.506+0000 7f71eb628640 1 --2- 172.21.15.91:0/3644888170 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f71c8066790 0x7f71c8068c50 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:41.506 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:41.506+0000 7f71eb628640 1 --2- 172.21.15.91:0/3644888170 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f71e4155b10 0x7f71e41419f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:41.506 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:41.506+0000 7f71eb628640 1 --2- 172.21.15.91:0/3644888170 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71e414fd60 0x7f71e41f3be0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:41.506 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:41.506+0000 7f71eb628640 1 --2- 172.21.15.91:0/3644888170 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f71e4071690 0x7f71e414e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:41.507 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:41.506+0000 7f71eb628640 1 -- 172.21.15.91:0/3644888170 >> 172.21.15.91:0/3644888170 conn(0x7f71e40c7fa0 msgr2=0x7f71e4153980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:12:41.507 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:41.506+0000 7f71eb628640 1 -- 172.21.15.91:0/3644888170 shutdown_connections 2023-11-27T18:12:41.507 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:41.506+0000 7f71eb628640 1 -- 172.21.15.91:0/3644888170 wait complete. 2023-11-27T18:12:41.996 INFO:tasks.ceph.mds.f.smithi094.stdout:starting mds.f at 2023-11-27T18:12:42.046 INFO:tasks.ceph.mds.b.smithi094.stdout:starting mds.b at 2023-11-27T18:12:42.121 INFO:tasks.ceph.mds.a.smithi091.stdout:starting mds.a at 2023-11-27T18:12:42.163 INFO:tasks.ceph.mds.e.smithi091.stdout:starting mds.e at 2023-11-27T18:12:42.245 INFO:tasks.ceph.mds.d.smithi094.stdout:starting mds.d at 2023-11-27T18:12:42.306 INFO:tasks.ceph.mds.c.smithi091.stdout:starting mds.c at 2023-11-27T18:12:43.522 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T18:12:43.644 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:43.642+0000 7fc14b26d640 1 Processor -- start 2023-11-27T18:12:43.644 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:43.642+0000 7fc14b26d640 1 -- start start 2023-11-27T18:12:43.645 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:43.646+0000 7fc14b26d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fc14406dfd0 0x7fc14406b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:43.645 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:43.646+0000 7fc14b26d640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc14415a160 0x7fc144153770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:43.645 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:43.646+0000 7fc14b26d640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc14415cb40 con 0x7fc144153300 2023-11-27T18:12:43.645 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:43.646+0000 7fc14b26d640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc14406f400 con 0x7fc14406dfd0 2023-11-27T18:12:43.645 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:43.646+0000 7fc14b26d640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc144153cb0 con 0x7fc14415a160 2023-11-27T18:12:43.646 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:43.646+0000 7fc149009640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fc14406dfd0 0x7fc14406b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:43.646 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:43.646+0000 7fc148808640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fc144153300 0x7fc144159a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:42530/0 (socket says 172.21.15.91:42530) 2023-11-27T18:12:43.646 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:43.646+0000 7fc148808640 1 -- 172.21.15.91:0/927999089 learned_addr learned my addr 172.21.15.91:0/927999089 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:12:43.646 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:43.646+0000 7fc14980a640 1 --2- 172.21.15.91:0/927999089 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc14415a160 0x7fc144153770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:43.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:43.650+0000 7fc149009640 1 -- 172.21.15.91:0/927999089 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc14415a160 msgr2=0x7fc144153770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:12:43.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:43.650+0000 7fc149009640 1 --2- 172.21.15.91:0/927999089 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc14415a160 0x7fc144153770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:43.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:43.650+0000 7fc149009640 1 -- 172.21.15.91:0/927999089 >> v1:172.21.15.91:6789/0 conn(0x7fc144153300 legacy=0x7fc144159a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:43.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:43.650+0000 7fc149009640 1 -- 172.21.15.91:0/927999089 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc144159550 con 0x7fc14406dfd0 2023-11-27T18:12:43.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:43.654+0000 7fc149009640 1 --2- 172.21.15.91:0/927999089 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc14406dfd0 0x7fc14406b080 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc1400097c0 tx=0x7fc14001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dd0e4a4e363dd1d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:12:45.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:45.754+0000 7fc13bfff640 1 -- 172.21.15.91:0/927999089 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1400a8970 con 0x7fc14406dfd0 2023-11-27T18:12:45.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:45.754+0000 7fc13bfff640 1 -- 172.21.15.91:0/927999089 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1400a8ad0 con 0x7fc14406dfd0 2023-11-27T18:12:45.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:45.754+0000 7fc13bfff640 1 -- 172.21.15.91:0/927999089 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1400a8e60 con 0x7fc14406dfd0 2023-11-27T18:12:45.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:45.758+0000 7fc14b26d640 1 -- 172.21.15.91:0/927999089 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc14406dfd0 msgr2=0x7fc14406b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:45.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:45.758+0000 7fc14b26d640 1 --2- 172.21.15.91:0/927999089 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc14406dfd0 0x7fc14406b080 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc1400097c0 tx=0x7fc14001ec70 comp rx=0 tx=0).stop 2023-11-27T18:12:45.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:45.758+0000 7fc14b26d640 1 -- 172.21.15.91:0/927999089 shutdown_connections 2023-11-27T18:12:45.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:45.758+0000 7fc14b26d640 1 --2- 172.21.15.91:0/927999089 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc14415a160 0x7fc144153770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:45.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:45.758+0000 7fc14b26d640 1 --2- 172.21.15.91:0/927999089 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc14406dfd0 0x7fc14406b080 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:45.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:45.758+0000 7fc14b26d640 1 -- 172.21.15.91:0/927999089 >> 172.21.15.91:0/927999089 conn(0x7fc1440cbec0 msgr2=0x7fc1440cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:12:45.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:45.758+0000 7fc14b26d640 1 -- 172.21.15.91:0/927999089 shutdown_connections 2023-11-27T18:12:45.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:45.758+0000 7fc14b26d640 1 -- 172.21.15.91:0/927999089 wait complete. 2023-11-27T18:12:45.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:45.758+0000 7fc14b26d640 1 Processor -- start 2023-11-27T18:12:45.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:45.758+0000 7fc14b26d640 1 -- start start 2023-11-27T18:12:45.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:45.758+0000 7fc14b26d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc14406dfd0 0x7fc1441f39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:45.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:45.758+0000 7fc14b26d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc144153300 0x7fc1441e2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:45.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:45.758+0000 7fc14b26d640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc14415a160 0x7fc14414c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:45.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:45.758+0000 7fc14b26d640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc14415c870 con 0x7fc14406dfd0 2023-11-27T18:12:45.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:45.758+0000 7fc14b26d640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc144153f60 con 0x7fc144153300 2023-11-27T18:12:45.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:45.758+0000 7fc14b26d640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1441f3ee0 con 0x7fc14415a160 2023-11-27T18:12:45.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:45.762+0000 7fc14980a640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc14415a160 0x7fc14414c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:45.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:45.762+0000 7fc148808640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc144153300 0x7fc1441e2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:45.763 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:45.762+0000 7fc14980a640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc14415a160 0x7fc14414c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.91:48286/0 (socket says 172.21.15.91:48286) 2023-11-27T18:12:45.763 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:45.762+0000 7fc14980a640 1 -- 172.21.15.91:0/229588310 learned_addr learned my addr 172.21.15.91:0/229588310 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:12:45.772 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:45.770+0000 7fc149009640 1 --2- 172.21.15.91:0/229588310 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc14406dfd0 0x7fc1441f39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:45.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:45.774+0000 7fc148808640 1 -- 172.21.15.91:0/229588310 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc14415a160 msgr2=0x7fc14414c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:45.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:45.774+0000 7fc148808640 1 --2- 172.21.15.91:0/229588310 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc14415a160 0x7fc14414c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:45.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:45.774+0000 7fc148808640 1 -- 172.21.15.91:0/229588310 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc14406dfd0 msgr2=0x7fc1441f39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:45.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:45.774+0000 7fc148808640 1 --2- 172.21.15.91:0/229588310 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc14406dfd0 0x7fc1441f39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:45.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:45.774+0000 7fc148808640 1 -- 172.21.15.91:0/229588310 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc140009420 con 0x7fc144153300 2023-11-27T18:12:45.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:45.778+0000 7fc148808640 1 --2- 172.21.15.91:0/229588310 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc144153300 0x7fc1441e2c00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc13400c340 tx=0x7fc13400c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:12:45.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:45.786+0000 7fc139ffb640 1 -- 172.21.15.91:0/229588310 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc134005cf0 con 0x7fc144153300 2023-11-27T18:12:45.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:45.790+0000 7fc139ffb640 1 -- 172.21.15.91:0/229588310 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc134005e50 con 0x7fc144153300 2023-11-27T18:12:45.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:45.790+0000 7fc139ffb640 1 -- 172.21.15.91:0/229588310 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1340072d0 con 0x7fc144153300 2023-11-27T18:12:45.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:45.790+0000 7fc14b26d640 1 -- 172.21.15.91:0/229588310 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc14415c5b0 con 0x7fc144153300 2023-11-27T18:12:45.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:45.790+0000 7fc14b26d640 1 -- 172.21.15.91:0/229588310 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1440c3380 con 0x7fc144153300 2023-11-27T18:12:45.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:45.790+0000 7fc14b26d640 1 -- 172.21.15.91:0/229588310 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc144067810 con 0x7fc144153300 2023-11-27T18:12:46.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:46.118+0000 7fc139ffb640 1 -- 172.21.15.91:0/229588310 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 85935+0+0 (secure 0 0 0) 0x7fc134007430 con 0x7fc144153300 2023-11-27T18:12:46.120 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:46.118+0000 7fc139ffb640 1 --2- 172.21.15.91:0/229588310 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fc1280667b0 0x7fc128068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:46.120 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:46.118+0000 7fc149009640 1 --2- 172.21.15.91:0/229588310 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fc1280667b0 0x7fc128068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:46.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:46.118+0000 7fc149009640 1 --2- 172.21.15.91:0/229588310 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fc1280667b0 0x7fc128068c70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc1400b2000 tx=0x7fc140008040 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:12:46.133 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:46.130+0000 7fc139ffb640 1 -- 172.21.15.91:0/229588310 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc134054a10 con 0x7fc144153300 2023-11-27T18:12:46.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:46.162+0000 7fc139ffb640 1 -- 172.21.15.91:0/229588310 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fc134050d50 con 0x7fc144153300 2023-11-27T18:12:46.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:46.370+0000 7fc14b26d640 1 -- 172.21.15.91:0/229588310 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc144158ff0 con 0x7fc144153300 2023-11-27T18:12:52.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:52.074+0000 7fc139ffb640 1 -- 172.21.15.91:0/229588310 <== mon.1 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7fc134021020 con 0x7fc144153300 2023-11-27T18:12:52.077 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:12:52.077 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2023-11-27T18:12:52.077 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 1 2023-11-27T18:12:52.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:52.078+0000 7fc14b26d640 1 -- 172.21.15.91:0/229588310 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fc1280667b0 msgr2=0x7fc128068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:52.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:52.078+0000 7fc14b26d640 1 --2- 172.21.15.91:0/229588310 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fc1280667b0 0x7fc128068c70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc1400b2000 tx=0x7fc140008040 comp rx=0 tx=0).stop 2023-11-27T18:12:52.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:52.078+0000 7fc14b26d640 1 -- 172.21.15.91:0/229588310 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc144153300 msgr2=0x7fc1441e2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:52.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:52.078+0000 7fc14b26d640 1 --2- 172.21.15.91:0/229588310 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc144153300 0x7fc1441e2c00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc13400c340 tx=0x7fc13400c800 comp rx=0 tx=0).stop 2023-11-27T18:12:52.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:52.078+0000 7fc14b26d640 1 -- 172.21.15.91:0/229588310 shutdown_connections 2023-11-27T18:12:52.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:52.078+0000 7fc14b26d640 1 --2- 172.21.15.91:0/229588310 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fc1280667b0 0x7fc128068c70 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:52.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:52.078+0000 7fc14b26d640 1 --2- 172.21.15.91:0/229588310 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc14415a160 0x7fc14414c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:52.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:52.078+0000 7fc14b26d640 1 --2- 172.21.15.91:0/229588310 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc144153300 0x7fc1441e2c00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:52.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:52.078+0000 7fc14b26d640 1 --2- 172.21.15.91:0/229588310 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc14406dfd0 0x7fc1441f39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:52.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:52.078+0000 7fc14b26d640 1 -- 172.21.15.91:0/229588310 >> 172.21.15.91:0/229588310 conn(0x7fc1440cbec0 msgr2=0x7fc14406e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:12:52.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:52.078+0000 7fc14b26d640 1 -- 172.21.15.91:0/229588310 shutdown_connections 2023-11-27T18:12:52.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:52.078+0000 7fc14b26d640 1 -- 172.21.15.91:0/229588310 wait complete. 2023-11-27T18:12:54.105 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T18:12:54.236 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.234+0000 7f1a9545b640 1 Processor -- start 2023-11-27T18:12:54.236 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.234+0000 7f1a9545b640 1 -- start start 2023-11-27T18:12:54.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.238+0000 7f1a9545b640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1a90151820 0x7f1a90070e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:54.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.238+0000 7f1a9545b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1a900c85c0 0x7f1a9006cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:54.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.238+0000 7f1a9545b640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a90072b70 con 0x7f1a900c5f10 2023-11-27T18:12:54.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.238+0000 7f1a9545b640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a900c2d20 con 0x7f1a900c85c0 2023-11-27T18:12:54.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.238+0000 7f1a9545b640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a90071350 con 0x7f1a90151820 2023-11-27T18:12:54.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.238+0000 7f1a8e7fc640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1a900c85c0 0x7f1a9006cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:54.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.238+0000 7f1a8effd640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1a90151820 0x7f1a90070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:54.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.238+0000 7f1a8effd640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1a90151820 0x7f1a90070e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.91:37236/0 (socket says 172.21.15.91:37236) 2023-11-27T18:12:54.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.238+0000 7f1a8effd640 1 -- 172.21.15.91:0/1705226085 learned_addr learned my addr 172.21.15.91:0/1705226085 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:12:54.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.246+0000 7f1a8effd640 1 -- 172.21.15.91:0/1705226085 >> v2:172.21.15.94:3300/0 conn(0x7f1a900c85c0 msgr2=0x7f1a9006cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:12:54.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.246+0000 7f1a8effd640 1 --2- 172.21.15.91:0/1705226085 >> v2:172.21.15.94:3300/0 conn(0x7f1a900c85c0 0x7f1a9006cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:54.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.246+0000 7f1a8effd640 1 -- 172.21.15.91:0/1705226085 >> v1:172.21.15.94:6789/0 conn(0x7f1a900c5f10 legacy=0x7f1a9006d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:54.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.246+0000 7f1a8effd640 1 -- 172.21.15.91:0/1705226085 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a900c6490 con 0x7f1a90151820 2023-11-27T18:12:54.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.250+0000 7f1a8effd640 1 --2- 172.21.15.91:0/1705226085 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1a90151820 0x7f1a90070e10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1a80009870 tx=0x7f1a8001ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5fb9087d5b12dc4 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:12:54.265 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.266+0000 7f1a8dffb640 1 -- 172.21.15.91:0/1705226085 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a800a8a30 con 0x7f1a90151820 2023-11-27T18:12:54.265 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.266+0000 7f1a8dffb640 1 -- 172.21.15.91:0/1705226085 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a800a8b90 con 0x7f1a90151820 2023-11-27T18:12:54.266 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.266+0000 7f1a8dffb640 1 -- 172.21.15.91:0/1705226085 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a800b0440 con 0x7f1a90151820 2023-11-27T18:12:54.266 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.266+0000 7f1a9545b640 1 -- 172.21.15.91:0/1705226085 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1a90151820 msgr2=0x7f1a90070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:54.266 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.266+0000 7f1a9545b640 1 --2- 172.21.15.91:0/1705226085 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1a90151820 0x7f1a90070e10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1a80009870 tx=0x7f1a8001ed30 comp rx=0 tx=0).stop 2023-11-27T18:12:54.266 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.266+0000 7f1a9545b640 1 -- 172.21.15.91:0/1705226085 shutdown_connections 2023-11-27T18:12:54.266 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.266+0000 7f1a9545b640 1 --2- 172.21.15.91:0/1705226085 >> v2:172.21.15.94:3300/0 conn(0x7f1a900c85c0 0x7f1a9006cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:54.266 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.266+0000 7f1a9545b640 1 --2- 172.21.15.91:0/1705226085 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1a90151820 0x7f1a90070e10 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:54.266 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.266+0000 7f1a9545b640 1 -- 172.21.15.91:0/1705226085 >> 172.21.15.91:0/1705226085 conn(0x7f1a900c79b0 msgr2=0x7f1a900c7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:12:54.266 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.266+0000 7f1a9545b640 1 -- 172.21.15.91:0/1705226085 shutdown_connections 2023-11-27T18:12:54.266 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.266+0000 7f1a9545b640 1 -- 172.21.15.91:0/1705226085 wait complete. 2023-11-27T18:12:54.267 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.266+0000 7f1a9545b640 1 Processor -- start 2023-11-27T18:12:54.267 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.266+0000 7f1a9545b640 1 -- start start 2023-11-27T18:12:54.267 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.266+0000 7f1a9545b640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1a900c5f10 0x7f1a901551a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:54.267 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.266+0000 7f1a9545b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a900c85c0 0x7f1a901efc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:54.268 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.266+0000 7f1a9545b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1a90151820 0x7f1a901e2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:54.268 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.266+0000 7f1a9545b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a901445f0 con 0x7f1a90151820 2023-11-27T18:12:54.268 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.266+0000 7f1a9545b640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a90157b50 con 0x7f1a900c85c0 2023-11-27T18:12:54.268 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.266+0000 7f1a9545b640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a901f0140 con 0x7f1a900c5f10 2023-11-27T18:12:54.268 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.266+0000 7f1a8f7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1a90151820 0x7f1a901e2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:54.269 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.266+0000 7f1a8f7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1a90151820 0x7f1a901e2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:38812/0 (socket says 172.21.15.91:38812) 2023-11-27T18:12:54.269 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.266+0000 7f1a8f7fe640 1 -- 172.21.15.91:0/3104161848 learned_addr learned my addr 172.21.15.91:0/3104161848 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:12:54.269 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.270+0000 7f1a8e7fc640 1 --2- 172.21.15.91:0/3104161848 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a900c85c0 0x7f1a901efc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:54.270 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.270+0000 7f1a8effd640 1 --2- 172.21.15.91:0/3104161848 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1a900c5f10 0x7f1a901551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:54.272 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.270+0000 7f1a8f7fe640 1 -- 172.21.15.91:0/3104161848 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1a900c5f10 msgr2=0x7f1a901551a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:54.272 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.270+0000 7f1a8f7fe640 1 --2- 172.21.15.91:0/3104161848 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1a900c5f10 0x7f1a901551a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:54.273 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.270+0000 7f1a8f7fe640 1 -- 172.21.15.91:0/3104161848 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a900c85c0 msgr2=0x7f1a901efc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:54.273 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.270+0000 7f1a8f7fe640 1 --2- 172.21.15.91:0/3104161848 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a900c85c0 0x7f1a901efc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:54.273 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.270+0000 7f1a8f7fe640 1 -- 172.21.15.91:0/3104161848 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a800094d0 con 0x7f1a90151820 2023-11-27T18:12:54.277 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.278+0000 7f1a8f7fe640 1 --2- 172.21.15.91:0/3104161848 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1a90151820 0x7f1a901e2d20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1a8800c770 tx=0x7f1a8800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:12:54.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.282+0000 7f1a777fe640 1 -- 172.21.15.91:0/3104161848 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a88003b80 con 0x7f1a90151820 2023-11-27T18:12:54.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.282+0000 7f1a777fe640 1 -- 172.21.15.91:0/3104161848 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a88003ce0 con 0x7f1a90151820 2023-11-27T18:12:54.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.282+0000 7f1a777fe640 1 -- 172.21.15.91:0/3104161848 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8800aa90 con 0x7f1a90151820 2023-11-27T18:12:54.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.282+0000 7f1a9545b640 1 -- 172.21.15.91:0/3104161848 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a90156ca0 con 0x7f1a90151820 2023-11-27T18:12:54.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.282+0000 7f1a9545b640 1 -- 172.21.15.91:0/3104161848 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a90156f40 con 0x7f1a90151820 2023-11-27T18:12:54.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.282+0000 7f1a9545b640 1 -- 172.21.15.91:0/3104161848 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a90157d00 con 0x7f1a90151820 2023-11-27T18:12:54.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.578+0000 7f1a777fe640 1 -- 172.21.15.91:0/3104161848 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 6) v1 ==== 85935+0+0 (secure 0 0 0) 0x7f1a8800abf0 con 0x7f1a90151820 2023-11-27T18:12:54.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.582+0000 7f1a777fe640 1 --2- 172.21.15.91:0/3104161848 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f1a7c0667b0 0x7f1a7c068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:54.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.582+0000 7f1a8effd640 1 --2- 172.21.15.91:0/3104161848 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f1a7c0667b0 0x7f1a7c068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:54.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.582+0000 7f1a8effd640 1 --2- 172.21.15.91:0/3104161848 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f1a7c0667b0 0x7f1a7c068c70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1a800b2000 tx=0x7f1a800aa070 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:12:54.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.594+0000 7f1a777fe640 1 -- 172.21.15.91:0/3104161848 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1a88055e30 con 0x7f1a90151820 2023-11-27T18:12:54.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.594+0000 7f1a777fe640 1 -- 172.21.15.91:0/3104161848 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f1a88051a70 con 0x7f1a90151820 2023-11-27T18:12:54.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.786+0000 7f1a9545b640 1 -- 172.21.15.91:0/3104161848 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1a90157d00 con 0x7f1a90151820 2023-11-27T18:12:54.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.798+0000 7f1a777fe640 1 -- 172.21.15.91:0/3104161848 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7f1a90157d00 con 0x7f1a90151820 2023-11-27T18:12:54.800 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:12:54.800 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2023-11-27T18:12:54.801 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 1 2023-11-27T18:12:54.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.802+0000 7f1a9545b640 1 -- 172.21.15.91:0/3104161848 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f1a7c0667b0 msgr2=0x7f1a7c068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:54.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.802+0000 7f1a9545b640 1 --2- 172.21.15.91:0/3104161848 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f1a7c0667b0 0x7f1a7c068c70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1a800b2000 tx=0x7f1a800aa070 comp rx=0 tx=0).stop 2023-11-27T18:12:54.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.802+0000 7f1a9545b640 1 -- 172.21.15.91:0/3104161848 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1a90151820 msgr2=0x7f1a901e2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:54.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.802+0000 7f1a9545b640 1 --2- 172.21.15.91:0/3104161848 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1a90151820 0x7f1a901e2d20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1a8800c770 tx=0x7f1a8800cc30 comp rx=0 tx=0).stop 2023-11-27T18:12:54.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.802+0000 7f1a9545b640 1 -- 172.21.15.91:0/3104161848 shutdown_connections 2023-11-27T18:12:54.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.802+0000 7f1a9545b640 1 --2- 172.21.15.91:0/3104161848 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f1a7c0667b0 0x7f1a7c068c70 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:54.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.802+0000 7f1a9545b640 1 --2- 172.21.15.91:0/3104161848 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1a90151820 0x7f1a901e2d20 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:54.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.802+0000 7f1a9545b640 1 --2- 172.21.15.91:0/3104161848 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a900c85c0 0x7f1a901efc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:54.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.802+0000 7f1a9545b640 1 --2- 172.21.15.91:0/3104161848 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1a900c5f10 0x7f1a901551a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:54.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.802+0000 7f1a9545b640 1 -- 172.21.15.91:0/3104161848 >> 172.21.15.91:0/3104161848 conn(0x7f1a900c79b0 msgr2=0x7f1a90071fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:12:54.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.802+0000 7f1a9545b640 1 -- 172.21.15.91:0/3104161848 shutdown_connections 2023-11-27T18:12:54.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:54.802+0000 7f1a9545b640 1 -- 172.21.15.91:0/3104161848 wait complete. 2023-11-27T18:12:56.820 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T18:12:56.950 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:56.949+0000 7f0bf7b23640 1 Processor -- start 2023-11-27T18:12:56.950 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:56.949+0000 7f0bf7b23640 1 -- start start 2023-11-27T18:12:56.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:56.949+0000 7f0bf7b23640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f0bf01514c0 0x7f0bf00c4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:56.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:56.949+0000 7f0bf7b23640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f0bf00c68b0 0x7f0bf00c50f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:56.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:56.949+0000 7f0bf7b23640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0bf0066360 0x7f0bf01578e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:56.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:56.949+0000 7f0bf7b23640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bf00c7b70 con 0x7f0bf00c68b0 2023-11-27T18:12:56.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:56.949+0000 7f0bf7b23640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bf01518a0 con 0x7f0bf01514c0 2023-11-27T18:12:56.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:56.949+0000 7f0bf7b23640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf006b750 con 0x7f0bf0066360 2023-11-27T18:12:56.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:56.949+0000 7f0bf60c0640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0bf0066360 0x7f0bf01578e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:56.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:56.953+0000 7f0bf60c0640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0bf0066360 0x7f0bf01578e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.91:34956/0 (socket says 172.21.15.91:34956) 2023-11-27T18:12:56.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:56.953+0000 7f0bf60c0640 1 -- 172.21.15.91:0/3418050595 learned_addr learned my addr 172.21.15.91:0/3418050595 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:12:56.959 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:56.957+0000 7f0bf60c0640 1 -- 172.21.15.91:0/3418050595 >> v2:172.21.15.94:3300/0 conn(0x7f0bf01514c0 msgr2=0x7f0bf00c4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:12:56.959 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:56.957+0000 7f0bf60c0640 1 --2- 172.21.15.91:0/3418050595 >> v2:172.21.15.94:3300/0 conn(0x7f0bf01514c0 0x7f0bf00c4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:56.959 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:56.957+0000 7f0bf60c0640 1 -- 172.21.15.91:0/3418050595 >> v2:172.21.15.91:3300/0 conn(0x7f0bf00c68b0 msgr2=0x7f0bf00c50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:12:56.959 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:56.957+0000 7f0bf60c0640 1 --2- 172.21.15.91:0/3418050595 >> v2:172.21.15.91:3300/0 conn(0x7f0bf00c68b0 0x7f0bf00c50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:56.959 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:56.957+0000 7f0bf60c0640 1 -- 172.21.15.91:0/3418050595 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf01573e0 con 0x7f0bf0066360 2023-11-27T18:12:56.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:56.961+0000 7f0bf60c0640 1 --2- 172.21.15.91:0/3418050595 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0bf0066360 0x7f0bf01578e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0bf00c8be0 tx=0x7f0be801f1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bcf5ec0476df55d1 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:12:56.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:56.973+0000 7f0bf48bd640 1 -- 172.21.15.91:0/3418050595 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be80af400 con 0x7f0bf0066360 2023-11-27T18:12:56.975 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:56.973+0000 7f0bf48bd640 1 -- 172.21.15.91:0/3418050595 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be80ab050 con 0x7f0bf0066360 2023-11-27T18:12:56.975 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:56.973+0000 7f0bf48bd640 1 -- 172.21.15.91:0/3418050595 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be80af780 con 0x7f0bf0066360 2023-11-27T18:12:56.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:56.973+0000 7f0bf7b23640 1 -- 172.21.15.91:0/3418050595 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0bf0066360 msgr2=0x7f0bf01578e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:56.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:56.973+0000 7f0bf7b23640 1 --2- 172.21.15.91:0/3418050595 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0bf0066360 0x7f0bf01578e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0bf00c8be0 tx=0x7f0be801f1c0 comp rx=0 tx=0).stop 2023-11-27T18:12:56.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:56.973+0000 7f0bf7b23640 1 -- 172.21.15.91:0/3418050595 shutdown_connections 2023-11-27T18:12:56.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:56.973+0000 7f0bf7b23640 1 --2- 172.21.15.91:0/3418050595 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0bf0066360 0x7f0bf01578e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:56.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:56.973+0000 7f0bf7b23640 1 --2- 172.21.15.91:0/3418050595 >> v2:172.21.15.91:3300/0 conn(0x7f0bf00c68b0 0x7f0bf00c50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:56.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:56.973+0000 7f0bf7b23640 1 --2- 172.21.15.91:0/3418050595 >> v2:172.21.15.94:3300/0 conn(0x7f0bf01514c0 0x7f0bf00c4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:56.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:56.973+0000 7f0bf7b23640 1 -- 172.21.15.91:0/3418050595 >> 172.21.15.91:0/3418050595 conn(0x7f0bf00c7fa0 msgr2=0x7f0bf00c83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:12:56.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:56.973+0000 7f0bf7b23640 1 -- 172.21.15.91:0/3418050595 shutdown_connections 2023-11-27T18:12:56.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:56.973+0000 7f0bf7b23640 1 -- 172.21.15.91:0/3418050595 wait complete. 2023-11-27T18:12:56.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:56.977+0000 7f0bf7b23640 1 Processor -- start 2023-11-27T18:12:56.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:56.977+0000 7f0bf7b23640 1 -- start start 2023-11-27T18:12:56.978 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:56.977+0000 7f0bf7b23640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0bf0066360 0x7f0bf01e0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:56.978 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:56.977+0000 7f0bf7b23640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0bf00c68b0 0x7f0bf0146920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:56.978 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:56.977+0000 7f0bf7b23640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0bf01514c0 0x7f0bf00ca270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:56.978 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:56.977+0000 7f0bf7b23640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf01e1560 con 0x7f0bf0066360 2023-11-27T18:12:56.978 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:56.977+0000 7f0bf7b23640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf00c42b0 con 0x7f0bf01514c0 2023-11-27T18:12:56.978 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:56.977+0000 7f0bf7b23640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf00c29a0 con 0x7f0bf00c68b0 2023-11-27T18:12:56.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:56.981+0000 7f0bf60c0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0bf01514c0 0x7f0bf00ca270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:56.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:56.981+0000 7f0bf50be640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0bf00c68b0 0x7f0bf0146920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:56.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:56.981+0000 7f0bf60c0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0bf01514c0 0x7f0bf00ca270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.91:53580/0 (socket says 172.21.15.91:53580) 2023-11-27T18:12:56.983 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:56.981+0000 7f0bf60c0640 1 -- 172.21.15.91:0/3822134767 learned_addr learned my addr 172.21.15.91:0/3822134767 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:12:56.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:56.997+0000 7f0bf50be640 1 -- 172.21.15.91:0/3822134767 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0bf01514c0 msgr2=0x7f0bf00ca270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:56.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:56.997+0000 7f0bf50be640 1 --2- 172.21.15.91:0/3822134767 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0bf01514c0 0x7f0bf00ca270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:56.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:56.997+0000 7f0bf50be640 1 -- 172.21.15.91:0/3822134767 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0bf0066360 msgr2=0x7f0bf01e0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:12:56.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:56.997+0000 7f0bf50be640 1 --2- 172.21.15.91:0/3822134767 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0bf0066360 0x7f0bf01e0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:12:56.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:56.997+0000 7f0bf50be640 1 -- 172.21.15.91:0/3822134767 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be8009b30 con 0x7f0bf00c68b0 2023-11-27T18:12:57.005 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:57.005+0000 7f0bf50be640 1 --2- 172.21.15.91:0/3822134767 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0bf00c68b0 0x7f0bf0146920 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0bec00b410 tx=0x7f0bec00b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:12:57.016 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:57.013+0000 7f0be67fc640 1 -- 172.21.15.91:0/3822134767 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bec011830 con 0x7f0bf00c68b0 2023-11-27T18:12:57.016 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:57.013+0000 7f0be67fc640 1 -- 172.21.15.91:0/3822134767 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bec011990 con 0x7f0bf00c68b0 2023-11-27T18:12:57.016 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:57.013+0000 7f0be67fc640 1 -- 172.21.15.91:0/3822134767 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bec011d40 con 0x7f0bf00c68b0 2023-11-27T18:12:57.016 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:57.013+0000 7f0bf7b23640 1 -- 172.21.15.91:0/3822134767 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bf00c2c60 con 0x7f0bf00c68b0 2023-11-27T18:12:57.016 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:57.013+0000 7f0bf7b23640 1 -- 172.21.15.91:0/3822134767 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bf00c3e00 con 0x7f0bf00c68b0 2023-11-27T18:12:57.016 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:57.017+0000 7f0bf7b23640 1 -- 172.21.15.91:0/3822134767 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bf0067810 con 0x7f0bf00c68b0 2023-11-27T18:12:57.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:57.341+0000 7f0be67fc640 1 -- 172.21.15.91:0/3822134767 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 6) v1 ==== 85935+0+0 (secure 0 0 0) 0x7f0bec01a400 con 0x7f0bf00c68b0 2023-11-27T18:12:57.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:57.341+0000 7f0be67fc640 1 --2- 172.21.15.91:0/3822134767 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f0bd40667b0 0x7f0bd4068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:12:57.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:57.341+0000 7f0bf58bf640 1 --2- 172.21.15.91:0/3822134767 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f0bd40667b0 0x7f0bd4068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:12:57.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:57.341+0000 7f0bf58bf640 1 --2- 172.21.15.91:0/3822134767 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f0bd40667b0 0x7f0bd4068c70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0be0009730 tx=0x7f0be0006ca0 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:12:57.349 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:57.349+0000 7f0be67fc640 1 -- 172.21.15.91:0/3822134767 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0bec055ce0 con 0x7f0bf00c68b0 2023-11-27T18:12:57.463 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:57.465+0000 7f0be67fc640 1 -- 172.21.15.91:0/3822134767 <== mon.2 v2:172.21.15.94:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f0bec051920 con 0x7f0bf00c68b0 2023-11-27T18:12:57.696 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:12:57.693+0000 7f0bf7b23640 1 -- 172.21.15.91:0/3822134767 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0bf004e930 con 0x7f0bf00c68b0 2023-11-27T18:13:03.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:03.529+0000 7f0be67fc640 1 -- 172.21.15.91:0/3822134767 <== mon.2 v2:172.21.15.94:3301/0 7 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f0bec051cf0 con 0x7f0bf00c68b0 2023-11-27T18:13:03.621 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:03.621+0000 7f0be67fc640 1 -- 172.21.15.91:0/3822134767 <== mon.2 v2:172.21.15.94:3301/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7f0bec07eea0 con 0x7f0bf00c68b0 2023-11-27T18:13:03.621 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:13:03.622 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3605337236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3605337236},{"type":"v1","addr":"172.21.15.94:6833","nonce":3605337236}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-11-27T18:13:03.622 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 2 2023-11-27T18:13:03.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:03.625+0000 7f0bf7b23640 1 -- 172.21.15.91:0/3822134767 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f0bd40667b0 msgr2=0x7f0bd4068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:03.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:03.625+0000 7f0bf7b23640 1 --2- 172.21.15.91:0/3822134767 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f0bd40667b0 0x7f0bd4068c70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0be0009730 tx=0x7f0be0006ca0 comp rx=0 tx=0).stop 2023-11-27T18:13:03.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:03.625+0000 7f0bf7b23640 1 -- 172.21.15.91:0/3822134767 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0bf00c68b0 msgr2=0x7f0bf0146920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:03.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:03.625+0000 7f0bf7b23640 1 --2- 172.21.15.91:0/3822134767 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0bf00c68b0 0x7f0bf0146920 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0bec00b410 tx=0x7f0bec00b810 comp rx=0 tx=0).stop 2023-11-27T18:13:03.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:03.625+0000 7f0bf7b23640 1 -- 172.21.15.91:0/3822134767 shutdown_connections 2023-11-27T18:13:03.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:03.625+0000 7f0bf7b23640 1 --2- 172.21.15.91:0/3822134767 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f0bd40667b0 0x7f0bd4068c70 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:03.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:03.625+0000 7f0bf7b23640 1 --2- 172.21.15.91:0/3822134767 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0bf00c68b0 0x7f0bf0146920 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:03.625 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:03.625+0000 7f0bf7b23640 1 --2- 172.21.15.91:0/3822134767 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0bf01514c0 0x7f0bf00ca270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:03.625 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:03.625+0000 7f0bf7b23640 1 --2- 172.21.15.91:0/3822134767 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0bf0066360 0x7f0bf01e0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:03.625 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:03.625+0000 7f0bf7b23640 1 -- 172.21.15.91:0/3822134767 >> 172.21.15.91:0/3822134767 conn(0x7f0bf00c7fa0 msgr2=0x7f0bf0156770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:03.625 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:03.625+0000 7f0bf7b23640 1 -- 172.21.15.91:0/3822134767 shutdown_connections 2023-11-27T18:13:03.625 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:03.625+0000 7f0bf7b23640 1 -- 172.21.15.91:0/3822134767 wait complete. 2023-11-27T18:13:04.255 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:13:04.257 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:13:05.645 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T18:13:05.776 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:05.777+0000 7f86b3329640 1 Processor -- start 2023-11-27T18:13:05.776 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:05.777+0000 7f86b3329640 1 -- start start 2023-11-27T18:13:05.777 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:05.781+0000 7f86b3329640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f86ac151560 0x7f86ac06f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:05.777 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:05.781+0000 7f86b3329640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f86ac158160 0x7f86ac15a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:05.777 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:05.781+0000 7f86b3329640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86ac0c59f0 con 0x7f86ac0c5d90 2023-11-27T18:13:05.778 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:05.781+0000 7f86b3329640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86ac0c3700 con 0x7f86ac158160 2023-11-27T18:13:05.778 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:05.781+0000 7f86b3329640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86ac151940 con 0x7f86ac151560 2023-11-27T18:13:05.779 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:05.781+0000 7f86b08c4640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f86ac158160 0x7f86ac15a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:05.779 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:05.781+0000 7f86b18c6640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f86ac0c5d90 0x7f86ac0c7640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:50308/0 (socket says 172.21.15.91:50308) 2023-11-27T18:13:05.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:05.781+0000 7f86b18c6640 1 -- 172.21.15.91:0/2396415624 learned_addr learned my addr 172.21.15.91:0/2396415624 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:13:05.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:05.781+0000 7f86b10c5640 1 --2- 172.21.15.91:0/2396415624 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f86ac151560 0x7f86ac06f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:05.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:05.785+0000 7f86b08c4640 1 -- 172.21.15.91:0/2396415624 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f86ac151560 msgr2=0x7f86ac06f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:05.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:05.785+0000 7f86b08c4640 1 --2- 172.21.15.91:0/2396415624 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f86ac151560 0x7f86ac06f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:05.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:05.785+0000 7f86b08c4640 1 -- 172.21.15.91:0/2396415624 >> v1:172.21.15.91:6789/0 conn(0x7f86ac0c5d90 legacy=0x7f86ac0c7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:05.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:05.785+0000 7f86b08c4640 1 -- 172.21.15.91:0/2396415624 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ac157cd0 con 0x7f86ac158160 2023-11-27T18:13:05.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:05.789+0000 7f86b08c4640 1 --2- 172.21.15.91:0/2396415624 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86ac158160 0x7f86ac15a9f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f869c0097c0 tx=0x7f869c01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef716278bc2de813 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:05.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:05.797+0000 7f86a3fff640 1 -- 172.21.15.91:0/2396415624 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869c0a8970 con 0x7f86ac158160 2023-11-27T18:13:05.794 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:05.797+0000 7f86a3fff640 1 -- 172.21.15.91:0/2396415624 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f869c0a8ad0 con 0x7f86ac158160 2023-11-27T18:13:05.794 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:05.797+0000 7f86a3fff640 1 -- 172.21.15.91:0/2396415624 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869c0a8e60 con 0x7f86ac158160 2023-11-27T18:13:05.794 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:05.797+0000 7f86b3329640 1 -- 172.21.15.91:0/2396415624 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86ac158160 msgr2=0x7f86ac15a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:05.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:05.797+0000 7f86b3329640 1 --2- 172.21.15.91:0/2396415624 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86ac158160 0x7f86ac15a9f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f869c0097c0 tx=0x7f869c01ec70 comp rx=0 tx=0).stop 2023-11-27T18:13:05.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:05.797+0000 7f86b3329640 1 -- 172.21.15.91:0/2396415624 shutdown_connections 2023-11-27T18:13:05.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:05.797+0000 7f86b3329640 1 --2- 172.21.15.91:0/2396415624 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86ac158160 0x7f86ac15a9f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:05.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:05.797+0000 7f86b3329640 1 --2- 172.21.15.91:0/2396415624 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f86ac151560 0x7f86ac06f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:05.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:05.797+0000 7f86b3329640 1 -- 172.21.15.91:0/2396415624 >> 172.21.15.91:0/2396415624 conn(0x7f86ac0cbec0 msgr2=0x7f86ac0cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:05.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:05.797+0000 7f86b3329640 1 -- 172.21.15.91:0/2396415624 shutdown_connections 2023-11-27T18:13:05.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:05.797+0000 7f86b3329640 1 -- 172.21.15.91:0/2396415624 wait complete. 2023-11-27T18:13:05.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:05.797+0000 7f86b3329640 1 Processor -- start 2023-11-27T18:13:05.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:05.797+0000 7f86b3329640 1 -- start start 2023-11-27T18:13:05.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:05.797+0000 7f86b3329640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f86ac0c5d90 0x7f86ac14e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:05.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:05.797+0000 7f86b3329640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86ac151560 0x7f86ac1f22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:05.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:05.797+0000 7f86b3329640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f86ac158160 0x7f86ac155040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:05.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:05.797+0000 7f86b3329640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ac14eec0 con 0x7f86ac151560 2023-11-27T18:13:05.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:05.797+0000 7f86b3329640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ac1eed40 con 0x7f86ac0c5d90 2023-11-27T18:13:05.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:05.797+0000 7f86b3329640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86ac0caed0 con 0x7f86ac158160 2023-11-27T18:13:05.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:05.801+0000 7f86b08c4640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86ac151560 0x7f86ac1f22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:05.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:05.801+0000 7f86b08c4640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86ac151560 0x7f86ac1f22b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:45202/0 (socket says 172.21.15.91:45202) 2023-11-27T18:13:05.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:05.801+0000 7f86b08c4640 1 -- 172.21.15.91:0/899614488 learned_addr learned my addr 172.21.15.91:0/899614488 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:05.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:05.801+0000 7f86b10c5640 1 --2- 172.21.15.91:0/899614488 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f86ac0c5d90 0x7f86ac14e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:05.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:05.801+0000 7f86b18c6640 1 --2- 172.21.15.91:0/899614488 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f86ac158160 0x7f86ac155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:05.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:05.805+0000 7f86b08c4640 1 -- 172.21.15.91:0/899614488 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f86ac158160 msgr2=0x7f86ac155040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:05.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:05.805+0000 7f86b08c4640 1 --2- 172.21.15.91:0/899614488 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f86ac158160 0x7f86ac155040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:05.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:05.805+0000 7f86b08c4640 1 -- 172.21.15.91:0/899614488 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f86ac0c5d90 msgr2=0x7f86ac14e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:05.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:05.805+0000 7f86b08c4640 1 --2- 172.21.15.91:0/899614488 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f86ac0c5d90 0x7f86ac14e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:05.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:05.805+0000 7f86b08c4640 1 -- 172.21.15.91:0/899614488 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f869c009420 con 0x7f86ac151560 2023-11-27T18:13:05.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:05.805+0000 7f86b08c4640 1 --2- 172.21.15.91:0/899614488 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86ac151560 0x7f86ac1f22b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f869c01b880 tx=0x7f869c01ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:05.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:05.809+0000 7f86a1ffb640 1 -- 172.21.15.91:0/899614488 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869c0b0e60 con 0x7f86ac151560 2023-11-27T18:13:05.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:05.809+0000 7f86a1ffb640 1 -- 172.21.15.91:0/899614488 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f869c0b9400 con 0x7f86ac151560 2023-11-27T18:13:05.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:05.809+0000 7f86b3329640 1 -- 172.21.15.91:0/899614488 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86ac0cb1b0 con 0x7f86ac151560 2023-11-27T18:13:05.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:05.809+0000 7f86a1ffb640 1 -- 172.21.15.91:0/899614488 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869c0b97b0 con 0x7f86ac151560 2023-11-27T18:13:05.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:05.809+0000 7f86b3329640 1 -- 172.21.15.91:0/899614488 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86ac1ef2e0 con 0x7f86ac151560 2023-11-27T18:13:05.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:05.813+0000 7f86b3329640 1 -- 172.21.15.91:0/899614488 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86ac067810 con 0x7f86ac151560 2023-11-27T18:13:06.093 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.097+0000 7f86a1ffb640 1 -- 172.21.15.91:0/899614488 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f869c0b7040 con 0x7f86ac151560 2023-11-27T18:13:06.094 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.097+0000 7f86a1ffb640 1 --2- 172.21.15.91:0/899614488 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f8690066840 0x7f8690068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:06.094 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.097+0000 7f86b10c5640 1 --2- 172.21.15.91:0/899614488 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f8690066840 0x7f8690068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:06.095 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.097+0000 7f86b10c5640 1 --2- 172.21.15.91:0/899614488 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f8690066840 0x7f8690068d00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f86a8007a60 tx=0x7f86a8008040 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:06.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.129+0000 7f86a1ffb640 1 -- 172.21.15.91:0/899614488 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f869c0f35a0 con 0x7f86ac151560 2023-11-27T18:13:06.130 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.129+0000 7f86a1ffb640 1 -- 172.21.15.91:0/899614488 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f869c0ef8e0 con 0x7f86ac151560 2023-11-27T18:13:06.324 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.325+0000 7f86b3329640 1 -- 172.21.15.91:0/899614488 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f86ac159450 con 0x7f86ac151560 2023-11-27T18:13:06.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.345+0000 7f86a1ffb640 1 -- 172.21.15.91:0/899614488 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+5274 (secure 0 0 0) 0x7f869c0b5030 con 0x7f86ac151560 2023-11-27T18:13:06.344 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:13:06.344 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1156758494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1156758494},{"type":"v1","addr":"172.21.15.91:6835","nonce":1156758494}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4227,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/2636117364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2636117364},{"type":"v1","addr":"172.21.15.91:6837","nonce":2636117364}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6839/1813662020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6838","nonce":1813662020},{"type":"v1","addr":"172.21.15.91:6839","nonce":1813662020}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4243,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3605337236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3605337236},{"type":"v1","addr":"172.21.15.94:6833","nonce":3605337236}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4246,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/1691562292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1691562292},{"type":"v1","addr":"172.21.15.94:6835","nonce":1691562292}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4255,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6837/3938864244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":3938864244},{"type":"v1","addr":"172.21.15.94:6837","nonce":3938864244}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-11-27T18:13:06.344 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 3 2023-11-27T18:13:06.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.349+0000 7f86b3329640 1 -- 172.21.15.91:0/899614488 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f8690066840 msgr2=0x7f8690068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:06.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.349+0000 7f86b3329640 1 --2- 172.21.15.91:0/899614488 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f8690066840 0x7f8690068d00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f86a8007a60 tx=0x7f86a8008040 comp rx=0 tx=0).stop 2023-11-27T18:13:06.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.349+0000 7f86b3329640 1 -- 172.21.15.91:0/899614488 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86ac151560 msgr2=0x7f86ac1f22b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:06.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.349+0000 7f86b3329640 1 --2- 172.21.15.91:0/899614488 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86ac151560 0x7f86ac1f22b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f869c01b880 tx=0x7f869c01ba10 comp rx=0 tx=0).stop 2023-11-27T18:13:06.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.349+0000 7f86b3329640 1 -- 172.21.15.91:0/899614488 shutdown_connections 2023-11-27T18:13:06.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.349+0000 7f86b3329640 1 --2- 172.21.15.91:0/899614488 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f8690066840 0x7f8690068d00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:06.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.349+0000 7f86b3329640 1 --2- 172.21.15.91:0/899614488 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f86ac158160 0x7f86ac155040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:06.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.349+0000 7f86b3329640 1 --2- 172.21.15.91:0/899614488 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86ac151560 0x7f86ac1f22b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:06.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.349+0000 7f86b3329640 1 --2- 172.21.15.91:0/899614488 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f86ac0c5d90 0x7f86ac14e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:06.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.349+0000 7f86b3329640 1 -- 172.21.15.91:0/899614488 >> 172.21.15.91:0/899614488 conn(0x7f86ac0cbec0 msgr2=0x7f86ac0cc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:06.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.349+0000 7f86b3329640 1 -- 172.21.15.91:0/899614488 shutdown_connections 2023-11-27T18:13:06.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.349+0000 7f86b3329640 1 -- 172.21.15.91:0/899614488 wait complete. 2023-11-27T18:13:06.364 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T18:13:06.480 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.481+0000 7f47173b0640 1 Processor -- start 2023-11-27T18:13:06.480 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.481+0000 7f47173b0640 1 -- start start 2023-11-27T18:13:06.481 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.485+0000 7f47173b0640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f4710156e90 0x7f4710157700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:06.481 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.485+0000 7f47173b0640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f47100c6950 0x7f47100cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:06.481 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.485+0000 7f47173b0640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47100c1ce0 con 0x7f47101505a0 2023-11-27T18:13:06.481 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.485+0000 7f47173b0640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4710156a70 con 0x7f4710156e90 2023-11-27T18:13:06.481 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.485+0000 7f47173b0640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4710150980 con 0x7f47100c6950 2023-11-27T18:13:06.482 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.485+0000 7f471494b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f4710156e90 0x7f4710157700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:06.482 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.485+0000 7f471494b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f4710156e90 0x7f4710157700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:56850/0 (socket says 172.21.15.91:56850) 2023-11-27T18:13:06.482 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.485+0000 7f471494b640 1 -- 172.21.15.91:0/1579039282 learned_addr learned my addr 172.21.15.91:0/1579039282 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:06.485 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.489+0000 7f471494b640 1 -- 172.21.15.91:0/1579039282 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f47100c6950 msgr2=0x7f47100cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:06.485 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.489+0000 7f471494b640 1 --2- 172.21.15.91:0/1579039282 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f47100c6950 0x7f47100cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:06.485 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.489+0000 7f471494b640 1 -- 172.21.15.91:0/1579039282 >> v1:172.21.15.94:6789/0 conn(0x7f47101505a0 legacy=0x7f47100c0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:06.485 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.489+0000 7f471494b640 1 -- 172.21.15.91:0/1579039282 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47100c1720 con 0x7f4710156e90 2023-11-27T18:13:06.489 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.493+0000 7f471494b640 1 --2- 172.21.15.91:0/1579039282 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4710156e90 0x7f4710157700 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f470c0098a0 tx=0x7f470c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54fec8def275226 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:06.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.497+0000 7f4707fff640 1 -- 172.21.15.91:0/1579039282 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470c0aa610 con 0x7f4710156e90 2023-11-27T18:13:06.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.497+0000 7f4707fff640 1 -- 172.21.15.91:0/1579039282 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f470c0a6040 con 0x7f4710156e90 2023-11-27T18:13:06.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.497+0000 7f4707fff640 1 -- 172.21.15.91:0/1579039282 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470c0aa990 con 0x7f4710156e90 2023-11-27T18:13:06.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.497+0000 7f47173b0640 1 -- 172.21.15.91:0/1579039282 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4710156e90 msgr2=0x7f4710157700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:06.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.497+0000 7f47173b0640 1 --2- 172.21.15.91:0/1579039282 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4710156e90 0x7f4710157700 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f470c0098a0 tx=0x7f470c01c490 comp rx=0 tx=0).stop 2023-11-27T18:13:06.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.497+0000 7f47173b0640 1 -- 172.21.15.91:0/1579039282 shutdown_connections 2023-11-27T18:13:06.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.497+0000 7f47173b0640 1 --2- 172.21.15.91:0/1579039282 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f47100c6950 0x7f47100cbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:06.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.497+0000 7f47173b0640 1 --2- 172.21.15.91:0/1579039282 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4710156e90 0x7f4710157700 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:06.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.497+0000 7f47173b0640 1 -- 172.21.15.91:0/1579039282 >> 172.21.15.91:0/1579039282 conn(0x7f471006f9c0 msgr2=0x7f471006fdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:06.496 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.497+0000 7f47173b0640 1 -- 172.21.15.91:0/1579039282 shutdown_connections 2023-11-27T18:13:06.496 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.497+0000 7f47173b0640 1 -- 172.21.15.91:0/1579039282 wait complete. 2023-11-27T18:13:06.496 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.497+0000 7f47173b0640 1 Processor -- start 2023-11-27T18:13:06.496 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.497+0000 7f47173b0640 1 -- start start 2023-11-27T18:13:06.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.497+0000 7f47173b0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f47100c6950 0x7f47101494d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:06.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.497+0000 7f47173b0640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f47101505a0 0x7f471014b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:06.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.497+0000 7f47173b0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4710156e90 0x7f471014bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:06.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.501+0000 7f47173b0640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f471006bed0 con 0x7f47100c6950 2023-11-27T18:13:06.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.501+0000 7f47173b0640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4710149a10 con 0x7f4710156e90 2023-11-27T18:13:06.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.501+0000 7f47173b0640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f471006c120 con 0x7f47101505a0 2023-11-27T18:13:06.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.501+0000 7f471514c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f47100c6950 0x7f47101494d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:06.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.501+0000 7f471514c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f47100c6950 0x7f47101494d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:56852/0 (socket says 172.21.15.91:56852) 2023-11-27T18:13:06.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.501+0000 7f471514c640 1 -- 172.21.15.91:0/4081490250 learned_addr learned my addr 172.21.15.91:0/4081490250 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:06.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.501+0000 7f471594d640 1 --2- 172.21.15.91:0/4081490250 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4710156e90 0x7f471014bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:06.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.505+0000 7f471514c640 1 -- 172.21.15.91:0/4081490250 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f47101505a0 msgr2=0x7f471014b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:06.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.505+0000 7f471514c640 1 --2- 172.21.15.91:0/4081490250 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f47101505a0 0x7f471014b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:06.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.505+0000 7f471514c640 1 -- 172.21.15.91:0/4081490250 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4710156e90 msgr2=0x7f471014bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:06.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.505+0000 7f471514c640 1 --2- 172.21.15.91:0/4081490250 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4710156e90 0x7f471014bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:06.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.505+0000 7f471514c640 1 -- 172.21.15.91:0/4081490250 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f470c0094d0 con 0x7f47100c6950 2023-11-27T18:13:06.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.521+0000 7f471514c640 1 --2- 172.21.15.91:0/4081490250 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f47100c6950 0x7f47101494d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f470000c3c0 tx=0x7f470000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:06.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.525+0000 7f4705ffb640 1 -- 172.21.15.91:0/4081490250 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47000052d0 con 0x7f47100c6950 2023-11-27T18:13:06.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.525+0000 7f4705ffb640 1 -- 172.21.15.91:0/4081490250 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4700005430 con 0x7f47100c6950 2023-11-27T18:13:06.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.525+0000 7f4705ffb640 1 -- 172.21.15.91:0/4081490250 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4700003840 con 0x7f47100c6950 2023-11-27T18:13:06.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.525+0000 7f47173b0640 1 -- 172.21.15.91:0/4081490250 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f471006c400 con 0x7f47100c6950 2023-11-27T18:13:06.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.525+0000 7f47173b0640 1 -- 172.21.15.91:0/4081490250 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4710151aa0 con 0x7f47100c6950 2023-11-27T18:13:06.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.529+0000 7f47173b0640 1 -- 172.21.15.91:0/4081490250 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47100680a0 con 0x7f47100c6950 2023-11-27T18:13:06.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.549+0000 7f4705ffb640 1 -- 172.21.15.91:0/4081490250 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f47000039a0 con 0x7f47100c6950 2023-11-27T18:13:06.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.549+0000 7f4705ffb640 1 --2- 172.21.15.91:0/4081490250 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f46f4066840 0x7f46f4068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:06.547 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.549+0000 7f471494b640 1 --2- 172.21.15.91:0/4081490250 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f46f4066840 0x7f46f4068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:06.547 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.549+0000 7f471494b640 1 --2- 172.21.15.91:0/4081490250 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f46f4066840 0x7f46f4068d00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f470c0ae000 tx=0x7f470c004740 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:06.835 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.837+0000 7f4705ffb640 1 -- 172.21.15.91:0/4081490250 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4700054a70 con 0x7f47100c6950 2023-11-27T18:13:06.835 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:06.837+0000 7f4705ffb640 1 -- 172.21.15.91:0/4081490250 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f4700050db0 con 0x7f47100c6950 2023-11-27T18:13:06.999 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.001+0000 7f47173b0640 1 -- 172.21.15.91:0/4081490250 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f471004e930 con 0x7f47100c6950 2023-11-27T18:13:07.126 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.129+0000 7f4705ffb640 1 -- 172.21.15.91:0/4081490250 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+12779 (secure 0 0 0) 0x7f4700017090 con 0x7f47100c6950 2023-11-27T18:13:07.126 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:13:07.126 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":20,"fsid":"08c8ebbf-7936-4c41-a995-d5600de2d072","created":"2023-11-27T18:12:06.484593+0000","modified":"2023-11-27T18:12:38.924195+0000","last_up_change":"2023-11-27T18:12:33.154694+0000","last_in_change":"2023-11-27T18:12:23.622113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T18:12:35.450305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ad53c08-dd19-4ae6-87c5-fa15bea3b4ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6811","nonce":472303992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6813","nonce":472303992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6817","nonce":472303992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6815","nonce":472303992}]},"public_addr":"172.21.15.91:6811/472303992","cluster_addr":"172.21.15.91:6813/472303992","heartbeat_back_addr":"172.21.15.91:6817/472303992","heartbeat_front_addr":"172.21.15.91:6815/472303992","state":["exists","up"]},{"osd":1,"uuid":"f8b5f147-ed29-4329-a787-a12cc34a2569","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6827","nonce":12316911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6829","nonce":12316911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6833","nonce":12316911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6831","nonce":12316911}]},"public_addr":"172.21.15.91:6827/12316911","cluster_addr":"172.21.15.91:6829/12316911","heartbeat_back_addr":"172.21.15.91:6833/12316911","heartbeat_front_addr":"172.21.15.91:6831/12316911","state":["exists","up"]},{"osd":2,"uuid":"c3029f9a-1c48-4f5d-983a-172a614d8795","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6803","nonce":3776125919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6805","nonce":3776125919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6809","nonce":3776125919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6807","nonce":3776125919}]},"public_addr":"172.21.15.91:6803/3776125919","cluster_addr":"172.21.15.91:6805/3776125919","heartbeat_back_addr":"172.21.15.91:6809/3776125919","heartbeat_front_addr":"172.21.15.91:6807/3776125919","state":["exists","up"]},{"osd":3,"uuid":"ab4b6fb2-0126-491b-9224-54a6badc5da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6819","nonce":1297704794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6821","nonce":1297704794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6825","nonce":1297704794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6823","nonce":1297704794}]},"public_addr":"172.21.15.91:6819/1297704794","cluster_addr":"172.21.15.91:6821/1297704794","heartbeat_back_addr":"172.21.15.91:6825/1297704794","heartbeat_front_addr":"172.21.15.91:6823/1297704794","state":["exists","up"]},{"osd":4,"uuid":"695071a8-2de8-4cba-bf20-050021a03bb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6809","nonce":2501531833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6811","nonce":2501531833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6815","nonce":2501531833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6813","nonce":2501531833}]},"public_addr":"172.21.15.94:6809/2501531833","cluster_addr":"172.21.15.94:6811/2501531833","heartbeat_back_addr":"172.21.15.94:6815/2501531833","heartbeat_front_addr":"172.21.15.94:6813/2501531833","state":["exists","up"]},{"osd":5,"uuid":"ca01da14-a700-4845-8db2-f5e3370677e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6817","nonce":2448969592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6819","nonce":2448969592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6823","nonce":2448969592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6821","nonce":2448969592}]},"public_addr":"172.21.15.94:6817/2448969592","cluster_addr":"172.21.15.94:6819/2448969592","heartbeat_back_addr":"172.21.15.94:6823/2448969592","heartbeat_front_addr":"172.21.15.94:6821/2448969592","state":["exists","up"]},{"osd":6,"uuid":"4784bc77-6c33-4e47-abba-d37484982f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6825","nonce":3389553935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6827","nonce":3389553935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6831","nonce":3389553935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6829","nonce":3389553935}]},"public_addr":"172.21.15.94:6825/3389553935","cluster_addr":"172.21.15.94:6827/3389553935","heartbeat_back_addr":"172.21.15.94:6831/3389553935","heartbeat_front_addr":"172.21.15.94:6829/3389553935","state":["exists","up"]},{"osd":7,"uuid":"b954cf3f-4a4f-4a75-9f90-014f72c16d15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6801","nonce":1606498064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6803","nonce":1606498064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6807","nonce":1606498064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6805","nonce":1606498064}]},"public_addr":"172.21.15.94:6801/1606498064","cluster_addr":"172.21.15.94:6803/1606498064","heartbeat_back_addr":"172.21.15.94:6807/1606498064","heartbeat_front_addr":"172.21.15.94:6805/1606498064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.534968+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.506182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.339267+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.532432+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:28.935756+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.471559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.485014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.352978+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T18:13:07.128 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.129+0000 7f47173b0640 1 -- 172.21.15.91:0/4081490250 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f46f4066840 msgr2=0x7f46f4068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:07.128 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.129+0000 7f47173b0640 1 --2- 172.21.15.91:0/4081490250 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f46f4066840 0x7f46f4068d00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f470c0ae000 tx=0x7f470c004740 comp rx=0 tx=0).stop 2023-11-27T18:13:07.128 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.129+0000 7f47173b0640 1 -- 172.21.15.91:0/4081490250 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f47100c6950 msgr2=0x7f47101494d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:07.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.129+0000 7f47173b0640 1 --2- 172.21.15.91:0/4081490250 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f47100c6950 0x7f47101494d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f470000c3c0 tx=0x7f470000c880 comp rx=0 tx=0).stop 2023-11-27T18:13:07.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.129+0000 7f47173b0640 1 -- 172.21.15.91:0/4081490250 shutdown_connections 2023-11-27T18:13:07.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.129+0000 7f47173b0640 1 --2- 172.21.15.91:0/4081490250 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f46f4066840 0x7f46f4068d00 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:07.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.129+0000 7f47173b0640 1 --2- 172.21.15.91:0/4081490250 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f47101505a0 0x7f471014b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:07.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.129+0000 7f47173b0640 1 --2- 172.21.15.91:0/4081490250 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4710156e90 0x7f471014bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:07.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.129+0000 7f47173b0640 1 --2- 172.21.15.91:0/4081490250 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f47100c6950 0x7f47101494d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:07.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.129+0000 7f47173b0640 1 -- 172.21.15.91:0/4081490250 >> 172.21.15.91:0/4081490250 conn(0x7f471006f9c0 msgr2=0x7f47100c0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:07.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.129+0000 7f47173b0640 1 -- 172.21.15.91:0/4081490250 shutdown_connections 2023-11-27T18:13:07.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.129+0000 7f47173b0640 1 -- 172.21.15.91:0/4081490250 wait complete. 2023-11-27T18:13:07.150 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T18:12:35.450305+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T18:13:07.151 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T18:13:07.277 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.281+0000 7f46f3e5e640 1 Processor -- start 2023-11-27T18:13:07.278 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.281+0000 7f46f3e5e640 1 -- start start 2023-11-27T18:13:07.278 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.281+0000 7f46f3e5e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f46ec0c40e0 0x7f46ec0c44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:07.278 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.281+0000 7f46f3e5e640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f46ec072820 0x7f46ec06ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:07.278 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.281+0000 7f46f3e5e640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f46ec06b140 0x7f46ec1576e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:07.278 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.281+0000 7f46f3e5e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46ec0c7090 con 0x7f46ec0c40e0 2023-11-27T18:13:07.279 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.281+0000 7f46f3e5e640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46ec0c4a00 con 0x7f46ec06b140 2023-11-27T18:13:07.279 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.281+0000 7f46f3e5e640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46ec15aa00 con 0x7f46ec072820 2023-11-27T18:13:07.279 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.281+0000 7f46f1bfa640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f46ec0c40e0 0x7f46ec0c44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:07.279 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.281+0000 7f46f1bfa640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f46ec0c40e0 0x7f46ec0c44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:56860/0 (socket says 172.21.15.91:56860) 2023-11-27T18:13:07.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.281+0000 7f46f1bfa640 1 -- 172.21.15.91:0/3353548294 learned_addr learned my addr 172.21.15.91:0/3353548294 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:07.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.281+0000 7f46f13f9640 1 --2- 172.21.15.91:0/3353548294 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f46ec072820 0x7f46ec06ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:07.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.281+0000 7f46f23fb640 1 --2- 172.21.15.91:0/3353548294 >> v2:172.21.15.94:3300/0 conn(0x7f46ec06b140 0x7f46ec1576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:07.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.285+0000 7f46f1bfa640 1 -- 172.21.15.91:0/3353548294 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f46ec072820 msgr2=0x7f46ec06ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:07.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.285+0000 7f46f1bfa640 1 --2- 172.21.15.91:0/3353548294 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f46ec072820 0x7f46ec06ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:07.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.285+0000 7f46f1bfa640 1 -- 172.21.15.91:0/3353548294 >> v2:172.21.15.94:3300/0 conn(0x7f46ec06b140 msgr2=0x7f46ec1576e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:07.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.285+0000 7f46f1bfa640 1 --2- 172.21.15.91:0/3353548294 >> v2:172.21.15.94:3300/0 conn(0x7f46ec06b140 0x7f46ec1576e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:07.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.285+0000 7f46f1bfa640 1 -- 172.21.15.91:0/3353548294 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ec15acc0 con 0x7f46ec0c40e0 2023-11-27T18:13:07.285 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.289+0000 7f46f1bfa640 1 --2- 172.21.15.91:0/3353548294 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f46ec0c40e0 0x7f46ec0c44c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f46ec070c70 tx=0x7f46e801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1654ff8af35657bd server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:07.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.293+0000 7f46f0bf8640 1 -- 172.21.15.91:0/3353548294 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e80aa620 con 0x7f46ec0c40e0 2023-11-27T18:13:07.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.293+0000 7f46f0bf8640 1 -- 172.21.15.91:0/3353548294 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e80aa780 con 0x7f46ec0c40e0 2023-11-27T18:13:07.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.293+0000 7f46f0bf8640 1 -- 172.21.15.91:0/3353548294 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e80aab10 con 0x7f46ec0c40e0 2023-11-27T18:13:07.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.293+0000 7f46f3e5e640 1 -- 172.21.15.91:0/3353548294 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f46ec0c40e0 msgr2=0x7f46ec0c44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:07.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.293+0000 7f46f3e5e640 1 --2- 172.21.15.91:0/3353548294 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f46ec0c40e0 0x7f46ec0c44c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f46ec070c70 tx=0x7f46e801c500 comp rx=0 tx=0).stop 2023-11-27T18:13:07.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.293+0000 7f46f3e5e640 1 -- 172.21.15.91:0/3353548294 shutdown_connections 2023-11-27T18:13:07.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.293+0000 7f46f3e5e640 1 --2- 172.21.15.91:0/3353548294 >> v2:172.21.15.94:3300/0 conn(0x7f46ec06b140 0x7f46ec1576e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:07.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.293+0000 7f46f3e5e640 1 --2- 172.21.15.91:0/3353548294 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f46ec072820 0x7f46ec06ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:07.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.293+0000 7f46f3e5e640 1 --2- 172.21.15.91:0/3353548294 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f46ec0c40e0 0x7f46ec0c44c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:07.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.293+0000 7f46f3e5e640 1 -- 172.21.15.91:0/3353548294 >> 172.21.15.91:0/3353548294 conn(0x7f46ec0ca9d0 msgr2=0x7f46ec0cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:07.292 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.293+0000 7f46f3e5e640 1 -- 172.21.15.91:0/3353548294 shutdown_connections 2023-11-27T18:13:07.292 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.293+0000 7f46f3e5e640 1 -- 172.21.15.91:0/3353548294 wait complete. 2023-11-27T18:13:07.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.293+0000 7f46f3e5e640 1 Processor -- start 2023-11-27T18:13:07.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.293+0000 7f46f3e5e640 1 -- start start 2023-11-27T18:13:07.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.293+0000 7f46f3e5e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f46ec06b140 0x7f46ec0c0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:07.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.293+0000 7f46f3e5e640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f46ec072820 0x7f46ec1569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:07.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.293+0000 7f46f3e5e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f46ec0c40e0 0x7f46ec0c36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:07.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.293+0000 7f46f3e5e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ec160b70 con 0x7f46ec0c40e0 2023-11-27T18:13:07.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.293+0000 7f46f3e5e640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ec160e50 con 0x7f46ec06b140 2023-11-27T18:13:07.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.293+0000 7f46f3e5e640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46ec161130 con 0x7f46ec072820 2023-11-27T18:13:07.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.297+0000 7f46f23fb640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f46ec0c40e0 0x7f46ec0c36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:07.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.297+0000 7f46f23fb640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f46ec0c40e0 0x7f46ec0c36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:56868/0 (socket says 172.21.15.91:56868) 2023-11-27T18:13:07.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.297+0000 7f46f23fb640 1 -- 172.21.15.91:0/348005580 learned_addr learned my addr 172.21.15.91:0/348005580 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:07.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.297+0000 7f46f13f9640 1 --2- 172.21.15.91:0/348005580 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f46ec072820 0x7f46ec1569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:07.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.297+0000 7f46f1bfa640 1 --2- 172.21.15.91:0/348005580 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f46ec06b140 0x7f46ec0c0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:07.297 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.301+0000 7f46f23fb640 1 -- 172.21.15.91:0/348005580 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f46ec072820 msgr2=0x7f46ec1569f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:07.297 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.301+0000 7f46f23fb640 1 --2- 172.21.15.91:0/348005580 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f46ec072820 0x7f46ec1569f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:07.297 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.301+0000 7f46f23fb640 1 -- 172.21.15.91:0/348005580 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f46ec06b140 msgr2=0x7f46ec0c0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:07.297 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.301+0000 7f46f23fb640 1 --2- 172.21.15.91:0/348005580 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f46ec06b140 0x7f46ec0c0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:07.297 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.301+0000 7f46f23fb640 1 -- 172.21.15.91:0/348005580 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e80094d0 con 0x7f46ec0c40e0 2023-11-27T18:13:07.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.301+0000 7f46f23fb640 1 --2- 172.21.15.91:0/348005580 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f46ec0c40e0 0x7f46ec0c36f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f46e4007e40 tx=0x7f46e400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:07.303 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.305+0000 7f46e27fc640 1 -- 172.21.15.91:0/348005580 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e4014620 con 0x7f46ec0c40e0 2023-11-27T18:13:07.303 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.305+0000 7f46e27fc640 1 -- 172.21.15.91:0/348005580 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e400ee90 con 0x7f46ec0c40e0 2023-11-27T18:13:07.303 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.305+0000 7f46f3e5e640 1 -- 172.21.15.91:0/348005580 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46ec161410 con 0x7f46ec0c40e0 2023-11-27T18:13:07.303 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.305+0000 7f46e27fc640 1 -- 172.21.15.91:0/348005580 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e40149e0 con 0x7f46ec0c40e0 2023-11-27T18:13:07.304 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.305+0000 7f46f3e5e640 1 -- 172.21.15.91:0/348005580 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46ec14c4b0 con 0x7f46ec0c40e0 2023-11-27T18:13:07.304 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.305+0000 7f46f3e5e640 1 -- 172.21.15.91:0/348005580 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46ec0c8a70 con 0x7f46ec0c40e0 2023-11-27T18:13:07.568 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.569+0000 7f46e27fc640 1 -- 172.21.15.91:0/348005580 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f46e4014b40 con 0x7f46ec0c40e0 2023-11-27T18:13:07.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.573+0000 7f46e27fc640 1 --2- 172.21.15.91:0/348005580 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f46d0066840 0x7f46d0068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:07.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.573+0000 7f46f1bfa640 1 --2- 172.21.15.91:0/348005580 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f46d0066840 0x7f46d0068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:07.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.573+0000 7f46f1bfa640 1 --2- 172.21.15.91:0/348005580 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f46d0066840 0x7f46d0068d00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f46e80ae000 tx=0x7f46e80b5040 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:07.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.609+0000 7f46e27fc640 1 -- 172.21.15.91:0/348005580 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f46e40569f0 con 0x7f46ec0c40e0 2023-11-27T18:13:07.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.609+0000 7f46e27fc640 1 -- 172.21.15.91:0/348005580 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f46e4052630 con 0x7f46ec0c40e0 2023-11-27T18:13:07.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.773+0000 7f46f3e5e640 1 -- 172.21.15.91:0/348005580 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f46ec0c8a70 con 0x7f46ec0c40e0 2023-11-27T18:13:07.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.813+0000 7f46e27fc640 1 -- 172.21.15.91:0/348005580 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f46ec0c8a70 con 0x7f46ec0c40e0 2023-11-27T18:13:07.809 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 1 2023-11-27T18:13:07.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.813+0000 7f46f3e5e640 1 -- 172.21.15.91:0/348005580 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f46d0066840 msgr2=0x7f46d0068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:07.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.813+0000 7f46f3e5e640 1 --2- 172.21.15.91:0/348005580 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f46d0066840 0x7f46d0068d00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f46e80ae000 tx=0x7f46e80b5040 comp rx=0 tx=0).stop 2023-11-27T18:13:07.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.813+0000 7f46f3e5e640 1 -- 172.21.15.91:0/348005580 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f46ec0c40e0 msgr2=0x7f46ec0c36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:07.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.813+0000 7f46f3e5e640 1 --2- 172.21.15.91:0/348005580 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f46ec0c40e0 0x7f46ec0c36f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f46e4007e40 tx=0x7f46e400e4b0 comp rx=0 tx=0).stop 2023-11-27T18:13:07.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.813+0000 7f46f3e5e640 1 -- 172.21.15.91:0/348005580 shutdown_connections 2023-11-27T18:13:07.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.813+0000 7f46f3e5e640 1 --2- 172.21.15.91:0/348005580 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f46d0066840 0x7f46d0068d00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:07.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.813+0000 7f46f3e5e640 1 --2- 172.21.15.91:0/348005580 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f46ec072820 0x7f46ec1569f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:07.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.813+0000 7f46f3e5e640 1 --2- 172.21.15.91:0/348005580 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f46ec0c40e0 0x7f46ec0c36f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:07.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.813+0000 7f46f3e5e640 1 --2- 172.21.15.91:0/348005580 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f46ec06b140 0x7f46ec0c0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:07.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.813+0000 7f46f3e5e640 1 -- 172.21.15.91:0/348005580 >> 172.21.15.91:0/348005580 conn(0x7f46ec0ca9d0 msgr2=0x7f46ec0c7430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:07.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.813+0000 7f46f3e5e640 1 -- 172.21.15.91:0/348005580 shutdown_connections 2023-11-27T18:13:07.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.813+0000 7f46f3e5e640 1 -- 172.21.15.91:0/348005580 wait complete. 2023-11-27T18:13:07.830 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-27T18:13:07.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.957+0000 7f01a09ed640 1 Processor -- start 2023-11-27T18:13:07.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.957+0000 7f01a09ed640 1 -- start start 2023-11-27T18:13:07.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.957+0000 7f01a09ed640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f019c1516f0 0x7f019c0c1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:07.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.957+0000 7f01a09ed640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f019c0c8ff0 0x7f019c157f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:07.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.957+0000 7f01a09ed640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f019c0c3470 0x7f019c0cccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:07.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.957+0000 7f01a09ed640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f019c0c85a0 con 0x7f019c0c3470 2023-11-27T18:13:07.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.957+0000 7f01a09ed640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f019c1584b0 con 0x7f019c1516f0 2023-11-27T18:13:07.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.957+0000 7f01a09ed640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f019c0c2fe0 con 0x7f019c0c8ff0 2023-11-27T18:13:07.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.957+0000 7f019ad9d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f019c0c3470 0x7f019c0cccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:07.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.957+0000 7f019ad9d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f019c0c3470 0x7f019c0cccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:56882/0 (socket says 172.21.15.91:56882) 2023-11-27T18:13:07.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.957+0000 7f019ad9d640 1 -- 172.21.15.91:0/3976150107 learned_addr learned my addr 172.21.15.91:0/3976150107 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:07.956 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.957+0000 7f019a59c640 1 --2- 172.21.15.91:0/3976150107 >> v2:172.21.15.94:3300/0 conn(0x7f019c1516f0 0x7f019c0c1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:07.956 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.957+0000 7f0199d9b640 1 --2- 172.21.15.91:0/3976150107 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f019c0c8ff0 0x7f019c157f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:07.958 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.961+0000 7f019ad9d640 1 -- 172.21.15.91:0/3976150107 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f019c0c8ff0 msgr2=0x7f019c157f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:07.959 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.961+0000 7f019ad9d640 1 --2- 172.21.15.91:0/3976150107 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f019c0c8ff0 0x7f019c157f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:07.959 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.961+0000 7f019ad9d640 1 -- 172.21.15.91:0/3976150107 >> v2:172.21.15.94:3300/0 conn(0x7f019c1516f0 msgr2=0x7f019c0c1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:07.959 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.961+0000 7f019ad9d640 1 --2- 172.21.15.91:0/3976150107 >> v2:172.21.15.94:3300/0 conn(0x7f019c1516f0 0x7f019c0c1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:07.959 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.961+0000 7f019ad9d640 1 -- 172.21.15.91:0/3976150107 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f019c0c7f00 con 0x7f019c0c3470 2023-11-27T18:13:07.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.965+0000 7f019ad9d640 1 --2- 172.21.15.91:0/3976150107 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f019c0c3470 0x7f019c0cccc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f019c0c7850 tx=0x7f019401f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3e89552e5a716aa server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:07.970 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.969+0000 7f019959a640 1 -- 172.21.15.91:0/3976150107 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01940af400 con 0x7f019c0c3470 2023-11-27T18:13:07.970 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.969+0000 7f019959a640 1 -- 172.21.15.91:0/3976150107 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01940ab050 con 0x7f019c0c3470 2023-11-27T18:13:07.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.969+0000 7f019959a640 1 -- 172.21.15.91:0/3976150107 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01940af780 con 0x7f019c0c3470 2023-11-27T18:13:07.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.969+0000 7f01a09ed640 1 -- 172.21.15.91:0/3976150107 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f019c0c3470 msgr2=0x7f019c0cccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:07.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.969+0000 7f01a09ed640 1 --2- 172.21.15.91:0/3976150107 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f019c0c3470 0x7f019c0cccc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f019c0c7850 tx=0x7f019401f1c0 comp rx=0 tx=0).stop 2023-11-27T18:13:07.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.969+0000 7f01a09ed640 1 -- 172.21.15.91:0/3976150107 shutdown_connections 2023-11-27T18:13:07.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.969+0000 7f01a09ed640 1 --2- 172.21.15.91:0/3976150107 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f019c0c3470 0x7f019c0cccc0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:07.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.969+0000 7f01a09ed640 1 --2- 172.21.15.91:0/3976150107 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f019c0c8ff0 0x7f019c157f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:07.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.969+0000 7f01a09ed640 1 --2- 172.21.15.91:0/3976150107 >> v2:172.21.15.94:3300/0 conn(0x7f019c1516f0 0x7f019c0c1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:07.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.969+0000 7f01a09ed640 1 -- 172.21.15.91:0/3976150107 >> 172.21.15.91:0/3976150107 conn(0x7f019c06a520 msgr2=0x7f019c06a930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:07.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.969+0000 7f01a09ed640 1 -- 172.21.15.91:0/3976150107 shutdown_connections 2023-11-27T18:13:07.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.969+0000 7f01a09ed640 1 -- 172.21.15.91:0/3976150107 wait complete. 2023-11-27T18:13:07.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.973+0000 7f01a09ed640 1 Processor -- start 2023-11-27T18:13:07.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.973+0000 7f01a09ed640 1 -- start start 2023-11-27T18:13:07.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.973+0000 7f01a09ed640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f019c0c3470 0x7f019c152e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:07.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.973+0000 7f01a09ed640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f019c0c8ff0 0x7f019c140c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:07.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.973+0000 7f01a09ed640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f019c1516f0 0x7f019c1411d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:07.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.973+0000 7f01a09ed640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019c0c5100 con 0x7f019c1516f0 2023-11-27T18:13:07.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.973+0000 7f01a09ed640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019c142020 con 0x7f019c0c8ff0 2023-11-27T18:13:07.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.973+0000 7f01a09ed640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f019c0c6fb0 con 0x7f019c0c3470 2023-11-27T18:13:07.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.973+0000 7f019ad9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f019c1516f0 0x7f019c1411d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:07.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.973+0000 7f019ad9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f019c1516f0 0x7f019c1411d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:56896/0 (socket says 172.21.15.91:56896) 2023-11-27T18:13:07.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.973+0000 7f019ad9d640 1 -- 172.21.15.91:0/776253088 learned_addr learned my addr 172.21.15.91:0/776253088 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:07.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.973+0000 7f019a59c640 1 --2- 172.21.15.91:0/776253088 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f019c0c3470 0x7f019c152e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:07.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.973+0000 7f0199d9b640 1 --2- 172.21.15.91:0/776253088 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f019c0c8ff0 0x7f019c140c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:07.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.977+0000 7f019ad9d640 1 -- 172.21.15.91:0/776253088 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f019c0c3470 msgr2=0x7f019c152e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:07.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.977+0000 7f019ad9d640 1 --2- 172.21.15.91:0/776253088 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f019c0c3470 0x7f019c152e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:07.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.977+0000 7f019ad9d640 1 -- 172.21.15.91:0/776253088 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f019c0c8ff0 msgr2=0x7f019c140c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:07.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.977+0000 7f019ad9d640 1 --2- 172.21.15.91:0/776253088 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f019c0c8ff0 0x7f019c140c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:07.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.977+0000 7f019ad9d640 1 -- 172.21.15.91:0/776253088 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0194009b30 con 0x7f019c1516f0 2023-11-27T18:13:07.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.981+0000 7f019ad9d640 1 --2- 172.21.15.91:0/776253088 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f019c1516f0 0x7f019c1411d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f019401cdf0 tx=0x7f019401bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:07.980 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.981+0000 7f018affd640 1 -- 172.21.15.91:0/776253088 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01940afd40 con 0x7f019c1516f0 2023-11-27T18:13:07.980 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.981+0000 7f01a09ed640 1 -- 172.21.15.91:0/776253088 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f019c0c7440 con 0x7f019c1516f0 2023-11-27T18:13:07.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.981+0000 7f01a09ed640 1 -- 172.21.15.91:0/776253088 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f019c0c6680 con 0x7f019c1516f0 2023-11-27T18:13:07.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.985+0000 7f01a09ed640 1 -- 172.21.15.91:0/776253088 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f019c0c3c90 con 0x7f019c1516f0 2023-11-27T18:13:07.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.985+0000 7f018affd640 1 -- 172.21.15.91:0/776253088 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01940c4410 con 0x7f019c1516f0 2023-11-27T18:13:07.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:07.985+0000 7f018affd640 1 -- 172.21.15.91:0/776253088 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01940afea0 con 0x7f019c1516f0 2023-11-27T18:13:08.263 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:08.265+0000 7f018affd640 1 -- 172.21.15.91:0/776253088 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f01940b6070 con 0x7f019c1516f0 2023-11-27T18:13:08.264 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:08.265+0000 7f018affd640 1 --2- 172.21.15.91:0/776253088 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f017c0667f0 0x7f017c068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:08.264 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:08.269+0000 7f019a59c640 1 --2- 172.21.15.91:0/776253088 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f017c0667f0 0x7f017c068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:08.265 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:08.269+0000 7f019a59c640 1 --2- 172.21.15.91:0/776253088 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f017c0667f0 0x7f017c068cb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f01900079e0 tx=0x7f0190008040 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:08.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:08.321+0000 7f018affd640 1 -- 172.21.15.91:0/776253088 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f01940f3920 con 0x7f019c1516f0 2023-11-27T18:13:08.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:08.321+0000 7f018affd640 1 -- 172.21.15.91:0/776253088 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f01940efc60 con 0x7f019c1516f0 2023-11-27T18:13:08.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:08.521+0000 7f01a09ed640 1 -- 172.21.15.91:0/776253088 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f019c04e930 con 0x7f019c1516f0 2023-11-27T18:13:08.781 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:08.785+0000 7f018affd640 1 -- 172.21.15.91:0/776253088 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v20) v1 ==== 84+0+65 (secure 0 0 0) 0x7f01940b4090 con 0x7f019c1516f0 2023-11-27T18:13:08.781 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:13:08.781 INFO:teuthology.orchestra.run.smithi091.stdout:[ 2023-11-27T18:13:08.781 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T18:13:08.781 INFO:teuthology.orchestra.run.smithi091.stdout: "poolnum": 1, 2023-11-27T18:13:08.781 INFO:teuthology.orchestra.run.smithi091.stdout: "poolname": ".mgr" 2023-11-27T18:13:08.781 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T18:13:08.782 INFO:teuthology.orchestra.run.smithi091.stdout:] 2023-11-27T18:13:08.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:08.785+0000 7f01a09ed640 1 -- 172.21.15.91:0/776253088 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f017c0667f0 msgr2=0x7f017c068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:08.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:08.785+0000 7f01a09ed640 1 --2- 172.21.15.91:0/776253088 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f017c0667f0 0x7f017c068cb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f01900079e0 tx=0x7f0190008040 comp rx=0 tx=0).stop 2023-11-27T18:13:08.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:08.785+0000 7f01a09ed640 1 -- 172.21.15.91:0/776253088 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f019c1516f0 msgr2=0x7f019c1411d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:08.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:08.785+0000 7f01a09ed640 1 --2- 172.21.15.91:0/776253088 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f019c1516f0 0x7f019c1411d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f019401cdf0 tx=0x7f019401bf60 comp rx=0 tx=0).stop 2023-11-27T18:13:08.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:08.785+0000 7f01a09ed640 1 -- 172.21.15.91:0/776253088 shutdown_connections 2023-11-27T18:13:08.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:08.785+0000 7f01a09ed640 1 --2- 172.21.15.91:0/776253088 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f017c0667f0 0x7f017c068cb0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:08.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:08.785+0000 7f01a09ed640 1 --2- 172.21.15.91:0/776253088 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f019c1516f0 0x7f019c1411d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:08.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:08.785+0000 7f01a09ed640 1 --2- 172.21.15.91:0/776253088 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f019c0c8ff0 0x7f019c140c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:08.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:08.785+0000 7f01a09ed640 1 --2- 172.21.15.91:0/776253088 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f019c0c3470 0x7f019c152e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:08.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:08.785+0000 7f01a09ed640 1 -- 172.21.15.91:0/776253088 >> 172.21.15.91:0/776253088 conn(0x7f019c06a520 msgr2=0x7f019c0c9440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:08.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:08.785+0000 7f01a09ed640 1 -- 172.21.15.91:0/776253088 shutdown_connections 2023-11-27T18:13:08.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:08.785+0000 7f01a09ed640 1 -- 172.21.15.91:0/776253088 wait complete. 2023-11-27T18:13:08.806 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-27T18:13:08.807 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-27T18:13:08.936 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:08.937+0000 7fd04f45f640 1 Processor -- start 2023-11-27T18:13:08.936 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:08.937+0000 7fd04f45f640 1 -- start start 2023-11-27T18:13:08.937 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:08.941+0000 7fd04f45f640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd048071000 0x7fd048159650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:08.937 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:08.941+0000 7fd04f45f640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd04806b630 con 0x7fd0480c86b0 2023-11-27T18:13:08.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:08.941+0000 7fd04f45f640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd04806bbf0 con 0x7fd048070c20 2023-11-27T18:13:08.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:08.941+0000 7fd04f45f640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0480ca410 con 0x7fd048071000 2023-11-27T18:13:08.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:08.941+0000 7fd04d1fb640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fd048070c20 0x7fd04815d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.91:52060/0 (socket says 172.21.15.91:52060) 2023-11-27T18:13:08.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:08.941+0000 7fd04d1fb640 1 -- 172.21.15.91:0/3977544635 learned_addr learned my addr 172.21.15.91:0/3977544635 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:13:08.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:08.977+0000 7fd04d9fc640 1 --2- 172.21.15.91:0/3977544635 >> v2:172.21.15.91:3300/0 conn(0x7fd048071000 0x7fd048159650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:08.987 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:08.989+0000 7fd04d9fc640 1 -- 172.21.15.91:0/3977544635 >> v1:172.21.15.94:6789/0 conn(0x7fd048070c20 legacy=0x7fd04815d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:08.987 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:08.989+0000 7fd04d9fc640 1 -- 172.21.15.91:0/3977544635 >> v1:172.21.15.91:6789/0 conn(0x7fd0480c86b0 legacy=0x7fd04806c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:08.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:08.989+0000 7fd04d9fc640 1 -- 172.21.15.91:0/3977544635 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd048159e90 con 0x7fd048071000 2023-11-27T18:13:08.994 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:08.997+0000 7fd04d9fc640 1 --2- 172.21.15.91:0/3977544635 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd048071000 0x7fd048159650 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd040009d90 tx=0x7fd04001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51d7fdf92f69c1 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:09.003 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:09.005+0000 7fd03ffff640 1 -- 172.21.15.91:0/3977544635 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0400a5870 con 0x7fd048071000 2023-11-27T18:13:09.004 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:09.005+0000 7fd03ffff640 1 -- 172.21.15.91:0/3977544635 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0400a59d0 con 0x7fd048071000 2023-11-27T18:13:09.004 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:09.005+0000 7fd03ffff640 1 -- 172.21.15.91:0/3977544635 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0400a5d60 con 0x7fd048071000 2023-11-27T18:13:09.005 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:09.005+0000 7fd04f45f640 1 -- 172.21.15.91:0/3977544635 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd048071000 msgr2=0x7fd048159650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:09.005 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:09.005+0000 7fd04f45f640 1 --2- 172.21.15.91:0/3977544635 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd048071000 0x7fd048159650 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd040009d90 tx=0x7fd04001c8c0 comp rx=0 tx=0).stop 2023-11-27T18:13:09.005 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:09.005+0000 7fd04f45f640 1 -- 172.21.15.91:0/3977544635 shutdown_connections 2023-11-27T18:13:09.005 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:09.005+0000 7fd04f45f640 1 --2- 172.21.15.91:0/3977544635 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd048071000 0x7fd048159650 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:09.005 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:09.005+0000 7fd04f45f640 1 -- 172.21.15.91:0/3977544635 >> 172.21.15.91:0/3977544635 conn(0x7fd048070060 msgr2=0x7fd04806ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:09.005 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:09.009+0000 7fd04f45f640 1 -- 172.21.15.91:0/3977544635 shutdown_connections 2023-11-27T18:13:09.005 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:09.009+0000 7fd04f45f640 1 -- 172.21.15.91:0/3977544635 wait complete. 2023-11-27T18:13:09.006 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:09.009+0000 7fd04f45f640 1 Processor -- start 2023-11-27T18:13:09.007 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:09.009+0000 7fd04f45f640 1 -- start start 2023-11-27T18:13:09.007 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:09.009+0000 7fd04f45f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd048070c20 0x7fd0480ccf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:09.008 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:09.009+0000 7fd04f45f640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd048071000 0x7fd0481f55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:09.008 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:09.009+0000 7fd04f45f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd0480c86b0 0x7fd048141170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:09.008 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:09.009+0000 7fd04f45f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0480cb7c0 con 0x7fd048070c20 2023-11-27T18:13:09.008 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:09.009+0000 7fd04f45f640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0480cb330 con 0x7fd0480c86b0 2023-11-27T18:13:09.008 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:09.009+0000 7fd04f45f640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0480cc8f0 con 0x7fd048071000 2023-11-27T18:13:09.008 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:09.009+0000 7fd04d1fb640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd048070c20 0x7fd0480ccf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:09.008 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:09.009+0000 7fd04d1fb640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd048070c20 0x7fd0480ccf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:56924/0 (socket says 172.21.15.91:56924) 2023-11-27T18:13:09.009 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:09.009+0000 7fd04d1fb640 1 -- 172.21.15.91:0/1923772400 learned_addr learned my addr 172.21.15.91:0/1923772400 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:09.012 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:09.017+0000 7fd04d1fb640 1 -- 172.21.15.91:0/1923772400 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd048071000 msgr2=0x7fd0481f55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:09.013 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:09.017+0000 7fd04d1fb640 1 --2- 172.21.15.91:0/1923772400 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd048071000 0x7fd0481f55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:09.013 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:09.017+0000 7fd04d1fb640 1 -- 172.21.15.91:0/1923772400 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd0480c86b0 msgr2=0x7fd048141170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:09.013 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:09.017+0000 7fd04d1fb640 1 --2- 172.21.15.91:0/1923772400 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd0480c86b0 0x7fd048141170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:09.013 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:09.017+0000 7fd04d1fb640 1 -- 172.21.15.91:0/1923772400 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd040009a70 con 0x7fd048070c20 2023-11-27T18:13:09.015 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:09.017+0000 7fd04d1fb640 1 --2- 172.21.15.91:0/1923772400 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd048070c20 0x7fd0480ccf20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd03800c430 tx=0x7fd03800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:09.020 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:09.021+0000 7fd03dffb640 1 -- 172.21.15.91:0/1923772400 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd038005cf0 con 0x7fd048070c20 2023-11-27T18:13:09.020 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:09.021+0000 7fd03dffb640 1 -- 172.21.15.91:0/1923772400 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd038005e50 con 0x7fd048070c20 2023-11-27T18:13:09.020 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:09.021+0000 7fd03dffb640 1 -- 172.21.15.91:0/1923772400 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0380072d0 con 0x7fd048070c20 2023-11-27T18:13:09.020 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:09.021+0000 7fd04f45f640 1 -- 172.21.15.91:0/1923772400 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd048147530 con 0x7fd048070c20 2023-11-27T18:13:09.020 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:09.021+0000 7fd04f45f640 1 -- 172.21.15.91:0/1923772400 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0480cace0 con 0x7fd048070c20 2023-11-27T18:13:09.021 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:09.025+0000 7fd04f45f640 1 -- 172.21.15.91:0/1923772400 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd04804e8c0 con 0x7fd048070c20 2023-11-27T18:13:09.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:09.301+0000 7fd03dffb640 1 -- 172.21.15.91:0/1923772400 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fd038007430 con 0x7fd048070c20 2023-11-27T18:13:09.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:09.301+0000 7fd03dffb640 1 --2- 172.21.15.91:0/1923772400 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fd02c0667f0 0x7fd02c068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:09.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:09.301+0000 7fd04c9fa640 1 --2- 172.21.15.91:0/1923772400 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fd02c0667f0 0x7fd02c068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:09.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:09.301+0000 7fd04c9fa640 1 --2- 172.21.15.91:0/1923772400 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fd02c0667f0 0x7fd02c068cb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd044000f70 tx=0x7fd0440079c0 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:09.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:09.329+0000 7fd03dffb640 1 -- 172.21.15.91:0/1923772400 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd038054aa0 con 0x7fd048070c20 2023-11-27T18:13:09.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:09.329+0000 7fd03dffb640 1 -- 172.21.15.91:0/1923772400 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fd038050de0 con 0x7fd048070c20 2023-11-27T18:13:09.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:09.509+0000 7fd04f45f640 1 -- 172.21.15.91:0/1923772400 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd0480ca810 con 0x7fd048070c20 2023-11-27T18:13:10.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.717+0000 7fd03dffb640 1 -- 172.21.15.91:0/1923772400 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v21) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd0380170b0 con 0x7fd048070c20 2023-11-27T18:13:10.713 INFO:teuthology.orchestra.run.smithi091.stderr:pool 'cephfs_metadata' created 2023-11-27T18:13:10.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.721+0000 7fd04f45f640 1 -- 172.21.15.91:0/1923772400 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fd02c0667f0 msgr2=0x7fd02c068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:10.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.721+0000 7fd04f45f640 1 --2- 172.21.15.91:0/1923772400 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fd02c0667f0 0x7fd02c068cb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd044000f70 tx=0x7fd0440079c0 comp rx=0 tx=0).stop 2023-11-27T18:13:10.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.721+0000 7fd04f45f640 1 -- 172.21.15.91:0/1923772400 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd048070c20 msgr2=0x7fd0480ccf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:10.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.721+0000 7fd04f45f640 1 --2- 172.21.15.91:0/1923772400 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd048070c20 0x7fd0480ccf20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd03800c430 tx=0x7fd03800c8f0 comp rx=0 tx=0).stop 2023-11-27T18:13:10.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.721+0000 7fd04f45f640 1 -- 172.21.15.91:0/1923772400 shutdown_connections 2023-11-27T18:13:10.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.721+0000 7fd04f45f640 1 --2- 172.21.15.91:0/1923772400 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fd02c0667f0 0x7fd02c068cb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:10.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.721+0000 7fd04f45f640 1 --2- 172.21.15.91:0/1923772400 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd048071000 0x7fd0481f55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:10.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.721+0000 7fd04f45f640 1 --2- 172.21.15.91:0/1923772400 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd0480c86b0 0x7fd048141170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:10.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.721+0000 7fd04f45f640 1 --2- 172.21.15.91:0/1923772400 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd048070c20 0x7fd0480ccf20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:10.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.721+0000 7fd04f45f640 1 -- 172.21.15.91:0/1923772400 >> 172.21.15.91:0/1923772400 conn(0x7fd048070060 msgr2=0x7fd0480c25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:10.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.721+0000 7fd04f45f640 1 -- 172.21.15.91:0/1923772400 shutdown_connections 2023-11-27T18:13:10.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.721+0000 7fd04f45f640 1 -- 172.21.15.91:0/1923772400 wait complete. 2023-11-27T18:13:10.742 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-11-27T18:13:10.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.877+0000 7f1c6c7fd640 1 Processor -- start 2023-11-27T18:13:10.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.877+0000 7f1c6c7fd640 1 -- start start 2023-11-27T18:13:10.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.877+0000 7f1c6c7fd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1c64151680 0x7f1c64157dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:10.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.877+0000 7f1c6c7fd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f1c640c7c40 0x7f1c640c1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:10.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.877+0000 7f1c6c7fd640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c640c2330 con 0x7f1c6415b5c0 2023-11-27T18:13:10.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.877+0000 7f1c6c7fd640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c64151a60 con 0x7f1c640c7c40 2023-11-27T18:13:10.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.877+0000 7f1c6c7fd640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c640cd940 con 0x7f1c64151680 2023-11-27T18:13:10.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.885+0000 7f1c6ad9a640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f1c640c7c40 0x7f1c640c1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:10.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.889+0000 7f1c6ad9a640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f1c640c7c40 0x7f1c640c1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:56938/0 (socket says 172.21.15.91:56938) 2023-11-27T18:13:10.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.889+0000 7f1c6ad9a640 1 -- 172.21.15.91:0/3573000203 learned_addr learned my addr 172.21.15.91:0/3573000203 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:10.888 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.889+0000 7f1c6ad9a640 1 -- 172.21.15.91:0/3573000203 >> v2:172.21.15.94:3300/0 conn(0x7f1c64151680 msgr2=0x7f1c64157dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:10.888 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.889+0000 7f1c6ad9a640 1 --2- 172.21.15.91:0/3573000203 >> v2:172.21.15.94:3300/0 conn(0x7f1c64151680 0x7f1c64157dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:10.888 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.889+0000 7f1c6ad9a640 1 -- 172.21.15.91:0/3573000203 >> v1:172.21.15.94:6789/0 conn(0x7f1c6415b5c0 legacy=0x7f1c640ccd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:10.888 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.889+0000 7f1c6ad9a640 1 -- 172.21.15.91:0/3573000203 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c640c8e60 con 0x7f1c640c7c40 2023-11-27T18:13:10.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.893+0000 7f1c6ad9a640 1 --2- 172.21.15.91:0/3573000203 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1c640c7c40 0x7f1c640c1df0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1c640cddb0 tx=0x7f1c5401f180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47876bdc79585335 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:10.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.901+0000 7f1c69597640 1 -- 172.21.15.91:0/3573000203 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c540af400 con 0x7f1c640c7c40 2023-11-27T18:13:10.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.901+0000 7f1c69597640 1 -- 172.21.15.91:0/3573000203 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c540ab050 con 0x7f1c640c7c40 2023-11-27T18:13:10.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.901+0000 7f1c69597640 1 -- 172.21.15.91:0/3573000203 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c540af780 con 0x7f1c640c7c40 2023-11-27T18:13:10.901 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.905+0000 7f1c6c7fd640 1 -- 172.21.15.91:0/3573000203 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1c640c7c40 msgr2=0x7f1c640c1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:10.901 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.905+0000 7f1c6c7fd640 1 --2- 172.21.15.91:0/3573000203 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1c640c7c40 0x7f1c640c1df0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1c640cddb0 tx=0x7f1c5401f180 comp rx=0 tx=0).stop 2023-11-27T18:13:10.901 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.905+0000 7f1c6c7fd640 1 -- 172.21.15.91:0/3573000203 shutdown_connections 2023-11-27T18:13:10.901 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.905+0000 7f1c6c7fd640 1 --2- 172.21.15.91:0/3573000203 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1c640c7c40 0x7f1c640c1df0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:10.901 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.905+0000 7f1c6c7fd640 1 --2- 172.21.15.91:0/3573000203 >> v2:172.21.15.94:3300/0 conn(0x7f1c64151680 0x7f1c64157dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:10.901 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.905+0000 7f1c6c7fd640 1 -- 172.21.15.91:0/3573000203 >> 172.21.15.91:0/3573000203 conn(0x7f1c6406a520 msgr2=0x7f1c6406a930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:10.901 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.905+0000 7f1c6c7fd640 1 -- 172.21.15.91:0/3573000203 shutdown_connections 2023-11-27T18:13:10.901 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.905+0000 7f1c6c7fd640 1 -- 172.21.15.91:0/3573000203 wait complete. 2023-11-27T18:13:10.902 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.905+0000 7f1c6c7fd640 1 Processor -- start 2023-11-27T18:13:10.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.905+0000 7f1c6c7fd640 1 -- start start 2023-11-27T18:13:10.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.905+0000 7f1c6c7fd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1c640c7c40 0x7f1c64158f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:10.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.905+0000 7f1c6c7fd640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1c64151680 0x7f1c64159a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:10.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.905+0000 7f1c6c7fd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1c6415b5c0 0x7f1c641efc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:10.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.905+0000 7f1c6c7fd640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c641594d0 con 0x7f1c6415b5c0 2023-11-27T18:13:10.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.905+0000 7f1c6c7fd640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c641f29a0 con 0x7f1c640c7c40 2023-11-27T18:13:10.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.905+0000 7f1c6c7fd640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6414cc40 con 0x7f1c64151680 2023-11-27T18:13:10.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.909+0000 7f1c6ad9a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1c6415b5c0 0x7f1c641efc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:10.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.909+0000 7f1c6ad9a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1c6415b5c0 0x7f1c641efc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:56952/0 (socket says 172.21.15.91:56952) 2023-11-27T18:13:10.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.909+0000 7f1c6ad9a640 1 -- 172.21.15.91:0/3271627480 learned_addr learned my addr 172.21.15.91:0/3271627480 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:10.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.909+0000 7f1c69d98640 1 --2- 172.21.15.91:0/3271627480 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1c64151680 0x7f1c64159a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:10.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.913+0000 7f1c6ad9a640 1 -- 172.21.15.91:0/3271627480 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1c64151680 msgr2=0x7f1c64159a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:10.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.913+0000 7f1c6ad9a640 1 --2- 172.21.15.91:0/3271627480 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1c64151680 0x7f1c64159a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:10.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.913+0000 7f1c6ad9a640 1 -- 172.21.15.91:0/3271627480 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1c640c7c40 msgr2=0x7f1c64158f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:10.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.913+0000 7f1c6ad9a640 1 --2- 172.21.15.91:0/3271627480 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1c640c7c40 0x7f1c64158f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:10.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.913+0000 7f1c6ad9a640 1 -- 172.21.15.91:0/3271627480 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c54009b30 con 0x7f1c6415b5c0 2023-11-27T18:13:10.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.913+0000 7f1c6ad9a640 1 --2- 172.21.15.91:0/3271627480 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1c6415b5c0 0x7f1c641efc10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1c5401cdb0 tx=0x7f1c5401bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:10.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.917+0000 7f1c62ffd640 1 -- 172.21.15.91:0/3271627480 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c540afd60 con 0x7f1c6415b5c0 2023-11-27T18:13:10.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.917+0000 7f1c6c7fd640 1 -- 172.21.15.91:0/3271627480 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c641ef430 con 0x7f1c6415b5c0 2023-11-27T18:13:10.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.917+0000 7f1c6c7fd640 1 -- 172.21.15.91:0/3271627480 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c6414d1e0 con 0x7f1c6415b5c0 2023-11-27T18:13:10.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.917+0000 7f1c6c7fd640 1 -- 172.21.15.91:0/3271627480 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c6404e850 con 0x7f1c6415b5c0 2023-11-27T18:13:10.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.917+0000 7f1c62ffd640 1 -- 172.21.15.91:0/3271627480 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c540d0430 con 0x7f1c6415b5c0 2023-11-27T18:13:10.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:10.917+0000 7f1c62ffd640 1 -- 172.21.15.91:0/3271627480 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c540d05e0 con 0x7f1c6415b5c0 2023-11-27T18:13:11.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:11.201+0000 7f1c62ffd640 1 -- 172.21.15.91:0/3271627480 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f1c540b6050 con 0x7f1c6415b5c0 2023-11-27T18:13:11.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:11.201+0000 7f1c62ffd640 1 --2- 172.21.15.91:0/3271627480 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f1c50066820 0x7f1c50068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:11.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:11.201+0000 7f1c6a599640 1 --2- 172.21.15.91:0/3271627480 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f1c50066820 0x7f1c50068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:11.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:11.201+0000 7f1c6a599640 1 --2- 172.21.15.91:0/3271627480 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f1c50066820 0x7f1c50068ce0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c009730 tx=0x7f1c5c006ca0 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:11.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:11.233+0000 7f1c62ffd640 1 -- 172.21.15.91:0/3271627480 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f1c540f4040 con 0x7f1c6415b5c0 2023-11-27T18:13:11.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:11.233+0000 7f1c62ffd640 1 -- 172.21.15.91:0/3271627480 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f1c540efc80 con 0x7f1c6415b5c0 2023-11-27T18:13:11.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:11.409+0000 7f1c6c7fd640 1 -- 172.21.15.91:0/3271627480 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f1c641577e0 con 0x7f1c6415b5c0 2023-11-27T18:13:12.101 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.105+0000 7f1c62ffd640 1 -- 172.21.15.91:0/3271627480 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v22) v1 ==== 171+0+0 (secure 0 0 0) 0x7f1c540b4030 con 0x7f1c6415b5c0 2023-11-27T18:13:12.101 INFO:teuthology.orchestra.run.smithi091.stderr:pool 'cephfs_data' created 2023-11-27T18:13:12.105 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.109+0000 7f1c6c7fd640 1 -- 172.21.15.91:0/3271627480 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f1c50066820 msgr2=0x7f1c50068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:12.105 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.109+0000 7f1c6c7fd640 1 --2- 172.21.15.91:0/3271627480 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f1c50066820 0x7f1c50068ce0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c009730 tx=0x7f1c5c006ca0 comp rx=0 tx=0).stop 2023-11-27T18:13:12.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.109+0000 7f1c6c7fd640 1 -- 172.21.15.91:0/3271627480 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1c6415b5c0 msgr2=0x7f1c641efc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:12.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.109+0000 7f1c6c7fd640 1 --2- 172.21.15.91:0/3271627480 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1c6415b5c0 0x7f1c641efc10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1c5401cdb0 tx=0x7f1c5401bf20 comp rx=0 tx=0).stop 2023-11-27T18:13:12.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.109+0000 7f1c6c7fd640 1 -- 172.21.15.91:0/3271627480 shutdown_connections 2023-11-27T18:13:12.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.109+0000 7f1c6c7fd640 1 --2- 172.21.15.91:0/3271627480 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f1c50066820 0x7f1c50068ce0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:12.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.109+0000 7f1c6c7fd640 1 --2- 172.21.15.91:0/3271627480 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1c64151680 0x7f1c64159a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:12.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.109+0000 7f1c6c7fd640 1 --2- 172.21.15.91:0/3271627480 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1c6415b5c0 0x7f1c641efc10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:12.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.109+0000 7f1c6c7fd640 1 --2- 172.21.15.91:0/3271627480 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1c640c7c40 0x7f1c64158f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:12.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.109+0000 7f1c6c7fd640 1 -- 172.21.15.91:0/3271627480 >> 172.21.15.91:0/3271627480 conn(0x7f1c6406a520 msgr2=0x7f1c640c3690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:12.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.109+0000 7f1c6c7fd640 1 -- 172.21.15.91:0/3271627480 shutdown_connections 2023-11-27T18:13:12.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.109+0000 7f1c6c7fd640 1 -- 172.21.15.91:0/3271627480 wait complete. 2023-11-27T18:13:12.125 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-27T18:13:12.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.253+0000 7f3bf7634640 1 Processor -- start 2023-11-27T18:13:12.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.253+0000 7f3bf7634640 1 -- start start 2023-11-27T18:13:12.253 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.257+0000 7f3bf7634640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3bf00ccbe0 0x7f3bf00cd070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:12.253 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.257+0000 7f3bf7634640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bf00c9f80 con 0x7f3bf0151730 2023-11-27T18:13:12.253 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.257+0000 7f3bf7634640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bf00c9090 con 0x7f3bf00c7c50 2023-11-27T18:13:12.253 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.257+0000 7f3bf7634640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf00b13c0 con 0x7f3bf00ccbe0 2023-11-27T18:13:12.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.257+0000 7f3bf53d0640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f3bf0151730 0x7f3bf015b240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:42242/0 (socket says 172.21.15.91:42242) 2023-11-27T18:13:12.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.257+0000 7f3bf53d0640 1 -- 172.21.15.91:0/1477097293 learned_addr learned my addr 172.21.15.91:0/1477097293 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:13:12.257 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.261+0000 7f3be7fff640 1 -- 172.21.15.91:0/1477097293 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3349186817 0 0) 0x7f3bf00c9f80 con 0x7f3bf0151730 2023-11-27T18:13:12.258 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.261+0000 7f3be7fff640 1 -- 172.21.15.91:0/1477097293 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bdc003530 con 0x7f3bf0151730 2023-11-27T18:13:12.263 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.265+0000 7f3be7fff640 1 -- 172.21.15.91:0/1477097293 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 699425736 0 0) 0x7f3bdc003530 con 0x7f3bf0151730 2023-11-27T18:13:12.263 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.265+0000 7f3be7fff640 1 -- 172.21.15.91:0/1477097293 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3bf00ccbe0 msgr2=0x7f3bf00cd070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:12.263 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.265+0000 7f3be7fff640 1 --2- 172.21.15.91:0/1477097293 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3bf00ccbe0 0x7f3bf00cd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:12.263 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.265+0000 7f3be7fff640 1 -- 172.21.15.91:0/1477097293 >> v1:172.21.15.94:6789/0 conn(0x7f3bf00c7c50 legacy=0x7f3bf00b0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:12.263 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.265+0000 7f3be7fff640 1 -- 172.21.15.91:0/1477097293 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf00c9370 con 0x7f3bf0151730 2023-11-27T18:13:12.263 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.265+0000 7f3be7fff640 1 -- 172.21.15.91:0/1477097293 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3378743932 0 0) 0x7f3bec001680 con 0x7f3bf0151730 2023-11-27T18:13:12.263 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.265+0000 7f3be7fff640 1 -- 172.21.15.91:0/1477097293 >> v1:172.21.15.91:6789/0 conn(0x7f3bf0151730 legacy=0x7f3bf015b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:12.263 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.265+0000 7f3be7fff640 1 --2- 172.21.15.91:0/1477097293 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3bf00ccbe0 0x7f3bdc0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:12.264 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.265+0000 7f3be7fff640 1 --2- 172.21.15.91:0/1477097293 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3bdc0040f0 0x7f3bdc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:12.264 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.265+0000 7f3be7fff640 1 --2- 172.21.15.91:0/1477097293 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3bdc004e30 0x7f3bdc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:12.264 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.265+0000 7f3be7fff640 1 -- 172.21.15.91:0/1477097293 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf00b13c0 con 0x7f3bdc0040f0 2023-11-27T18:13:12.264 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.265+0000 7f3be7fff640 1 -- 172.21.15.91:0/1477097293 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bdc0055d0 con 0x7f3bdc004e30 2023-11-27T18:13:12.264 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.265+0000 7f3be7fff640 1 -- 172.21.15.91:0/1477097293 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bdc00bed0 con 0x7f3bf00ccbe0 2023-11-27T18:13:12.267 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.269+0000 7f3bf4bcf640 1 --2- 172.21.15.91:0/1477097293 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3bdc0040f0 0x7f3bdc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:12.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.277+0000 7f3bf4bcf640 1 -- 172.21.15.91:0/1477097293 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3bf00ccbe0 msgr2=0x7f3bdc0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:12.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.277+0000 7f3bf4bcf640 1 --2- 172.21.15.91:0/1477097293 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3bf00ccbe0 0x7f3bdc0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:12.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.277+0000 7f3bf4bcf640 1 -- 172.21.15.91:0/1477097293 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3bdc004e30 msgr2=0x7f3bdc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:12.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.277+0000 7f3bf4bcf640 1 --2- 172.21.15.91:0/1477097293 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3bdc004e30 0x7f3bdc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:12.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.277+0000 7f3bf4bcf640 1 -- 172.21.15.91:0/1477097293 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bdc003530 con 0x7f3bdc0040f0 2023-11-27T18:13:12.278 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.281+0000 7f3bf4bcf640 1 --2- 172.21.15.91:0/1477097293 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3bdc0040f0 0x7f3bdc0047d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3be0001650 tx=0x7f3be001c2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e3c5ff86290aa78 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:12.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.285+0000 7f3be7fff640 1 -- 172.21.15.91:0/1477097293 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be0005270 con 0x7f3bdc0040f0 2023-11-27T18:13:12.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.285+0000 7f3be7fff640 1 -- 172.21.15.91:0/1477097293 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be00a7070 con 0x7f3bdc0040f0 2023-11-27T18:13:12.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.285+0000 7f3be7fff640 1 -- 172.21.15.91:0/1477097293 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be0003620 con 0x7f3bdc0040f0 2023-11-27T18:13:12.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.285+0000 7f3bf7634640 1 -- 172.21.15.91:0/1477097293 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3bdc0040f0 msgr2=0x7f3bdc0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:12.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.285+0000 7f3bf7634640 1 --2- 172.21.15.91:0/1477097293 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3bdc0040f0 0x7f3bdc0047d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3be0001650 tx=0x7f3be001c2e0 comp rx=0 tx=0).stop 2023-11-27T18:13:12.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.285+0000 7f3bf5bd1640 1 -- 172.21.15.91:0/1477097293 reap_dead start 2023-11-27T18:13:12.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.285+0000 7f3bf7634640 1 -- 172.21.15.91:0/1477097293 shutdown_connections 2023-11-27T18:13:12.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.285+0000 7f3bf7634640 1 -- 172.21.15.91:0/1477097293 >> 172.21.15.91:0/1477097293 conn(0x7f3bf006a520 msgr2=0x7f3bf006a930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:12.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.285+0000 7f3bf7634640 1 -- 172.21.15.91:0/1477097293 shutdown_connections 2023-11-27T18:13:12.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.285+0000 7f3bf7634640 1 -- 172.21.15.91:0/1477097293 wait complete. 2023-11-27T18:13:12.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.289+0000 7f3bf7634640 1 Processor -- start 2023-11-27T18:13:12.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.289+0000 7f3bf7634640 1 -- start start 2023-11-27T18:13:12.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.289+0000 7f3bf7634640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3bdc0040f0 0x7f3bf00caee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:12.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.289+0000 7f3bf7634640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3bf00ac9b0 0x7f3bf01ef980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:12.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.289+0000 7f3bf7634640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3bf01efec0 0x7f3bf0149550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:12.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.289+0000 7f3bf7634640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf01ef560 con 0x7f3bdc0040f0 2023-11-27T18:13:12.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.289+0000 7f3bf7634640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf01f3760 con 0x7f3bf00ac9b0 2023-11-27T18:13:12.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.289+0000 7f3bf7634640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf00ae380 con 0x7f3bf01efec0 2023-11-27T18:13:12.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.289+0000 7f3bf53d0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3bdc0040f0 0x7f3bf00caee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:12.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.289+0000 7f3bf53d0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3bdc0040f0 0x7f3bf00caee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:56978/0 (socket says 172.21.15.91:56978) 2023-11-27T18:13:12.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.289+0000 7f3bf53d0640 1 -- 172.21.15.91:0/1458179747 learned_addr learned my addr 172.21.15.91:0/1458179747 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:12.297 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.301+0000 7f3bf53d0640 1 -- 172.21.15.91:0/1458179747 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3bf01efec0 msgr2=0x7f3bf0149550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:12.297 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.301+0000 7f3bf53d0640 1 --2- 172.21.15.91:0/1458179747 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3bf01efec0 0x7f3bf0149550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:12.297 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.301+0000 7f3bf53d0640 1 -- 172.21.15.91:0/1458179747 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3bf00ac9b0 msgr2=0x7f3bf01ef980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:12.297 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.301+0000 7f3bf53d0640 1 --2- 172.21.15.91:0/1458179747 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3bf00ac9b0 0x7f3bf01ef980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:12.297 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.301+0000 7f3bf53d0640 1 -- 172.21.15.91:0/1458179747 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf01f2be0 con 0x7f3bdc0040f0 2023-11-27T18:13:12.307 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.309+0000 7f3bf53d0640 1 --2- 172.21.15.91:0/1458179747 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3bdc0040f0 0x7f3bf00caee0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3bec00c730 tx=0x7f3bec00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:12.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.325+0000 7f3be5ffb640 1 -- 172.21.15.91:0/1458179747 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bec0072d0 con 0x7f3bdc0040f0 2023-11-27T18:13:12.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.325+0000 7f3be5ffb640 1 -- 172.21.15.91:0/1458179747 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bec007450 con 0x7f3bdc0040f0 2023-11-27T18:13:12.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.325+0000 7f3be5ffb640 1 -- 172.21.15.91:0/1458179747 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bec0047f0 con 0x7f3bdc0040f0 2023-11-27T18:13:12.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.325+0000 7f3bf7634640 1 -- 172.21.15.91:0/1458179747 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bf01f2ec0 con 0x7f3bdc0040f0 2023-11-27T18:13:12.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.325+0000 7f3bf7634640 1 -- 172.21.15.91:0/1458179747 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bf01f3480 con 0x7f3bdc0040f0 2023-11-27T18:13:12.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.325+0000 7f3bf7634640 1 -- 172.21.15.91:0/1458179747 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bf01ef250 con 0x7f3bdc0040f0 2023-11-27T18:13:12.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.345+0000 7f3be5ffb640 1 -- 172.21.15.91:0/1458179747 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f3bec004b60 con 0x7f3bdc0040f0 2023-11-27T18:13:12.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.345+0000 7f3be5ffb640 1 --2- 172.21.15.91:0/1458179747 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f3bd4066840 0x7f3bd4068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:12.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.345+0000 7f3bf4bcf640 1 --2- 172.21.15.91:0/1458179747 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f3bd4066840 0x7f3bd4068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:12.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.345+0000 7f3bf4bcf640 1 --2- 172.21.15.91:0/1458179747 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f3bd4066840 0x7f3bd4068d00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3be00aa000 tx=0x7f3be0000fc0 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:12.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.353+0000 7f3be5ffb640 1 -- 172.21.15.91:0/1458179747 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f3bec0556b0 con 0x7f3bdc0040f0 2023-11-27T18:13:12.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.725+0000 7f3be5ffb640 1 -- 172.21.15.91:0/1458179747 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f3bec0512f0 con 0x7f3bdc0040f0 2023-11-27T18:13:12.994 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:12.997+0000 7f3bf7634640 1 -- 172.21.15.91:0/1458179747 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3bf004e850 con 0x7f3bdc0040f0 2023-11-27T18:13:14.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.137+0000 7f3be5ffb640 1 -- 172.21.15.91:0/1458179747 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f3bec018070 con 0x7f3bdc0040f0 2023-11-27T18:13:14.134 INFO:teuthology.orchestra.run.smithi091.stderr:new fs with metadata pool 2 and data pool 3 2023-11-27T18:13:14.135 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.137+0000 7f3bf7634640 1 -- 172.21.15.91:0/1458179747 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f3bd4066840 msgr2=0x7f3bd4068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:14.135 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.137+0000 7f3bf7634640 1 --2- 172.21.15.91:0/1458179747 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f3bd4066840 0x7f3bd4068d00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3be00aa000 tx=0x7f3be0000fc0 comp rx=0 tx=0).stop 2023-11-27T18:13:14.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.137+0000 7f3bf7634640 1 -- 172.21.15.91:0/1458179747 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3bdc0040f0 msgr2=0x7f3bf00caee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:14.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.137+0000 7f3bf7634640 1 --2- 172.21.15.91:0/1458179747 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3bdc0040f0 0x7f3bf00caee0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3bec00c730 tx=0x7f3bec00cbf0 comp rx=0 tx=0).stop 2023-11-27T18:13:14.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.137+0000 7f3bf7634640 1 -- 172.21.15.91:0/1458179747 shutdown_connections 2023-11-27T18:13:14.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.137+0000 7f3bf7634640 1 --2- 172.21.15.91:0/1458179747 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f3bd4066840 0x7f3bd4068d00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:14.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.137+0000 7f3bf7634640 1 --2- 172.21.15.91:0/1458179747 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3bf01efec0 0x7f3bf0149550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:14.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.137+0000 7f3bf7634640 1 --2- 172.21.15.91:0/1458179747 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3bf00ac9b0 0x7f3bf01ef980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:14.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.137+0000 7f3bf7634640 1 --2- 172.21.15.91:0/1458179747 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3bdc0040f0 0x7f3bf00caee0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:14.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.137+0000 7f3bf7634640 1 -- 172.21.15.91:0/1458179747 >> 172.21.15.91:0/1458179747 conn(0x7f3bf006a520 msgr2=0x7f3bf014ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:14.137 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.137+0000 7f3bf7634640 1 -- 172.21.15.91:0/1458179747 shutdown_connections 2023-11-27T18:13:14.137 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.137+0000 7f3bf7634640 1 -- 172.21.15.91:0/1458179747 wait complete. 2023-11-27T18:13:14.161 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-11-27T18:13:14.162 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-11-27T18:13:14.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.293+0000 7fadc0dc3640 1 Processor -- start 2023-11-27T18:13:14.296 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.293+0000 7fadc0dc3640 1 -- start start 2023-11-27T18:13:14.296 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.293+0000 7fadc0dc3640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fadbc150280 0x7fadbc150660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:14.296 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.293+0000 7fadc0dc3640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadbc156cd0 con 0x7fadbc072710 2023-11-27T18:13:14.297 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.293+0000 7fadc0dc3640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadbc0c7aa0 con 0x7fadbc0c1b70 2023-11-27T18:13:14.297 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.293+0000 7fadc0dc3640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadbc0c0fd0 con 0x7fadbc150280 2023-11-27T18:13:14.298 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.297+0000 7fadbad9d640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fadbc072710 0x7fadbc0c6720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:42244/0 (socket says 172.21.15.91:42244) 2023-11-27T18:13:14.298 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.297+0000 7fadbad9d640 1 -- 172.21.15.91:0/3126900555 learned_addr learned my addr 172.21.15.91:0/3126900555 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:13:14.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.297+0000 7fadb959a640 1 -- 172.21.15.91:0/3126900555 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2894080359 0 0) 0x7fadbc156cd0 con 0x7fadbc072710 2023-11-27T18:13:14.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.297+0000 7fadb959a640 1 -- 172.21.15.91:0/3126900555 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fada4003530 con 0x7fadbc072710 2023-11-27T18:13:14.301 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.301+0000 7fadb959a640 1 -- 172.21.15.91:0/3126900555 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1988462084 0 0) 0x7fada4003530 con 0x7fadbc072710 2023-11-27T18:13:14.301 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.301+0000 7fadb959a640 1 -- 172.21.15.91:0/3126900555 >> v2:172.21.15.94:3300/0 conn(0x7fadbc150280 msgr2=0x7fadbc150660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:14.301 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.301+0000 7fadb959a640 1 --2- 172.21.15.91:0/3126900555 >> v2:172.21.15.94:3300/0 conn(0x7fadbc150280 0x7fadbc150660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:14.301 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.301+0000 7fadb959a640 1 -- 172.21.15.91:0/3126900555 >> v1:172.21.15.94:6789/0 conn(0x7fadbc0c1b70 legacy=0x7fadbc159820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:14.301 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.301+0000 7fadb959a640 1 -- 172.21.15.91:0/3126900555 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadbc157160 con 0x7fadbc072710 2023-11-27T18:13:14.301 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.301+0000 7fadb959a640 1 -- 172.21.15.91:0/3126900555 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3378743932 0 0) 0x7fadb4001a00 con 0x7fadbc072710 2023-11-27T18:13:14.302 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.301+0000 7fadb959a640 1 -- 172.21.15.91:0/3126900555 >> v1:172.21.15.91:6789/0 conn(0x7fadbc072710 legacy=0x7fadbc0c6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:14.302 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.301+0000 7fadb959a640 1 --2- 172.21.15.91:0/3126900555 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fada40039d0 0x7fada4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:14.302 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.301+0000 7fadb959a640 1 --2- 172.21.15.91:0/3126900555 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fada40047d0 0x7fada4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:14.302 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.301+0000 7fadb959a640 1 --2- 172.21.15.91:0/3126900555 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fada40052b0 0x7fada400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:14.302 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.301+0000 7fadb959a640 1 -- 172.21.15.91:0/3126900555 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada400c1c0 con 0x7fada40047d0 2023-11-27T18:13:14.302 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.301+0000 7fadb959a640 1 -- 172.21.15.91:0/3126900555 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada400c330 con 0x7fada40039d0 2023-11-27T18:13:14.302 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.301+0000 7fadb959a640 1 -- 172.21.15.91:0/3126900555 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fada400c4f0 con 0x7fada40052b0 2023-11-27T18:13:14.303 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.305+0000 7fadb9d9b640 1 --2- 172.21.15.91:0/3126900555 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fada40047d0 0x7fada4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:14.307 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.309+0000 7fadb9d9b640 1 -- 172.21.15.91:0/3126900555 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fada40052b0 msgr2=0x7fada400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:14.307 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.309+0000 7fadb9d9b640 1 --2- 172.21.15.91:0/3126900555 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fada40052b0 0x7fada400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:14.307 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.309+0000 7fadb9d9b640 1 -- 172.21.15.91:0/3126900555 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fada40039d0 msgr2=0x7fada4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:14.307 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.309+0000 7fadb9d9b640 1 --2- 172.21.15.91:0/3126900555 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fada40039d0 0x7fada4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:14.307 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.309+0000 7fadb9d9b640 1 -- 172.21.15.91:0/3126900555 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada4003530 con 0x7fada40047d0 2023-11-27T18:13:14.307 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.309+0000 7fadbad9d640 1 -- 172.21.15.91:0/3126900555 reap_dead start 2023-11-27T18:13:14.310 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.313+0000 7fadb9d9b640 1 --2- 172.21.15.91:0/3126900555 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fada40047d0 0x7fada4004c50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fadb0007fd0 tx=0x7fadb001c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af7de2172517e0d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:14.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.317+0000 7fadb959a640 1 -- 172.21.15.91:0/3126900555 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb0005270 con 0x7fada40047d0 2023-11-27T18:13:14.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.317+0000 7fadb959a640 1 -- 172.21.15.91:0/3126900555 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb00a7070 con 0x7fada40047d0 2023-11-27T18:13:14.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.317+0000 7fadb959a640 1 -- 172.21.15.91:0/3126900555 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb0003620 con 0x7fada40047d0 2023-11-27T18:13:14.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.317+0000 7fadc0dc3640 1 -- 172.21.15.91:0/3126900555 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fada40047d0 msgr2=0x7fada4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:14.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.317+0000 7fadc0dc3640 1 --2- 172.21.15.91:0/3126900555 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fada40047d0 0x7fada4004c50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fadb0007fd0 tx=0x7fadb001c260 comp rx=0 tx=0).stop 2023-11-27T18:13:14.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.317+0000 7fadc0dc3640 1 -- 172.21.15.91:0/3126900555 shutdown_connections 2023-11-27T18:13:14.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.317+0000 7fadc0dc3640 1 --2- 172.21.15.91:0/3126900555 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fada40047d0 0x7fada4004c50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:14.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.317+0000 7fadc0dc3640 1 -- 172.21.15.91:0/3126900555 >> 172.21.15.91:0/3126900555 conn(0x7fadbc06e7a0 msgr2=0x7fadbc06ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:14.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.317+0000 7fadc0dc3640 1 -- 172.21.15.91:0/3126900555 shutdown_connections 2023-11-27T18:13:14.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.317+0000 7fadc0dc3640 1 -- 172.21.15.91:0/3126900555 wait complete. 2023-11-27T18:13:14.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.321+0000 7fadc0dc3640 1 Processor -- start 2023-11-27T18:13:14.318 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.321+0000 7fadc0dc3640 1 -- start start 2023-11-27T18:13:14.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.321+0000 7fadc0dc3640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fada40047d0 0x7fadbc1eb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:14.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.321+0000 7fadc0dc3640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fadbc0cac00 0x7fadbc0710f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:14.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.321+0000 7fadc0dc3640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fadbc153560 0x7fadbc149210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:14.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.321+0000 7fadc0dc3640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadbc14bb90 con 0x7fadbc0cac00 2023-11-27T18:13:14.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.321+0000 7fadc0dc3640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadbc0cb9c0 con 0x7fadbc153560 2023-11-27T18:13:14.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.321+0000 7fadc0dc3640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadbc1eaf40 con 0x7fada40047d0 2023-11-27T18:13:14.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.321+0000 7fadb9d9b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fadbc0cac00 0x7fadbc0710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:14.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.321+0000 7fadb9d9b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fadbc0cac00 0x7fadbc0710f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:56984/0 (socket says 172.21.15.91:56984) 2023-11-27T18:13:14.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.321+0000 7fadb9d9b640 1 -- 172.21.15.91:0/2813594267 learned_addr learned my addr 172.21.15.91:0/2813594267 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:14.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.325+0000 7fadb9d9b640 1 -- 172.21.15.91:0/2813594267 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fada40047d0 msgr2=0x7fadbc1eb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:14.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.325+0000 7fadb9d9b640 1 --2- 172.21.15.91:0/2813594267 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fada40047d0 0x7fadbc1eb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:14.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.325+0000 7fadb9d9b640 1 -- 172.21.15.91:0/2813594267 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fadbc153560 msgr2=0x7fadbc149210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:14.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.325+0000 7fadb9d9b640 1 --2- 172.21.15.91:0/2813594267 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fadbc153560 0x7fadbc149210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:14.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.325+0000 7fadb9d9b640 1 -- 172.21.15.91:0/2813594267 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadbc0cb120 con 0x7fadbc0cac00 2023-11-27T18:13:14.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.329+0000 7fadb9d9b640 1 --2- 172.21.15.91:0/2813594267 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fadbc0cac00 0x7fadbc0710f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fadb0097c70 tx=0x7fada4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:14.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.333+0000 7fadaaffd640 1 -- 172.21.15.91:0/2813594267 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb00b1070 con 0x7fadbc0cac00 2023-11-27T18:13:14.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.333+0000 7fadaaffd640 1 -- 172.21.15.91:0/2813594267 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb0007030 con 0x7fadbc0cac00 2023-11-27T18:13:14.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.333+0000 7fadaaffd640 1 -- 172.21.15.91:0/2813594267 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb00073a0 con 0x7fadbc0cac00 2023-11-27T18:13:14.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.333+0000 7fadc0dc3640 1 -- 172.21.15.91:0/2813594267 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadbc0cb400 con 0x7fadbc0cac00 2023-11-27T18:13:14.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.333+0000 7fadc0dc3640 1 -- 172.21.15.91:0/2813594267 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadbc1eabd0 con 0x7fadbc0cac00 2023-11-27T18:13:14.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.333+0000 7fadc0dc3640 1 -- 172.21.15.91:0/2813594267 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadbc1eaa30 con 0x7fadbc0cac00 2023-11-27T18:13:14.352 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.353+0000 7fadaaffd640 1 -- 172.21.15.91:0/2813594267 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fadb00b5070 con 0x7fadbc0cac00 2023-11-27T18:13:14.353 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.353+0000 7fadaaffd640 1 --2- 172.21.15.91:0/2813594267 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fad9c066870 0x7fad9c068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:14.353 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.353+0000 7fadba59c640 1 --2- 172.21.15.91:0/2813594267 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fad9c066870 0x7fad9c068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:14.353 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.357+0000 7fadba59c640 1 --2- 172.21.15.91:0/2813594267 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fad9c066870 0x7fad9c068d30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fadbc050190 tx=0x7fadac006d10 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:14.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.361+0000 7fadaaffd640 1 -- 172.21.15.91:0/2813594267 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fadb00ef510 con 0x7fadbc0cac00 2023-11-27T18:13:14.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.689+0000 7fadaaffd640 1 -- 172.21.15.91:0/2813594267 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fadb00eebe0 con 0x7fadbc0cac00 2023-11-27T18:13:14.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:14.861+0000 7fadc0dc3640 1 -- 172.21.15.91:0/2813594267 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fadbc1eaa30 con 0x7fadbc0cac00 2023-11-27T18:13:15.857 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:15.861+0000 7fadaaffd640 1 -- 172.21.15.91:0/2813594267 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v24) v1 ==== 157+0+0 (secure 0 0 0) 0x7fadbc1eaa30 con 0x7fadbc0cac00 2023-11-27T18:13:15.860 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:15.861+0000 7fadc0dc3640 1 -- 172.21.15.91:0/2813594267 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fad9c066870 msgr2=0x7fad9c068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:15.860 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:15.861+0000 7fadc0dc3640 1 --2- 172.21.15.91:0/2813594267 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fad9c066870 0x7fad9c068d30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fadbc050190 tx=0x7fadac006d10 comp rx=0 tx=0).stop 2023-11-27T18:13:15.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:15.861+0000 7fadc0dc3640 1 -- 172.21.15.91:0/2813594267 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fadbc0cac00 msgr2=0x7fadbc0710f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:15.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:15.861+0000 7fadc0dc3640 1 --2- 172.21.15.91:0/2813594267 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fadbc0cac00 0x7fadbc0710f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fadb0097c70 tx=0x7fada4005800 comp rx=0 tx=0).stop 2023-11-27T18:13:15.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:15.861+0000 7fadc0dc3640 1 -- 172.21.15.91:0/2813594267 shutdown_connections 2023-11-27T18:13:15.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:15.861+0000 7fadc0dc3640 1 --2- 172.21.15.91:0/2813594267 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fad9c066870 0x7fad9c068d30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:15.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:15.861+0000 7fadc0dc3640 1 --2- 172.21.15.91:0/2813594267 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fadbc153560 0x7fadbc149210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:15.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:15.861+0000 7fadc0dc3640 1 --2- 172.21.15.91:0/2813594267 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fadbc0cac00 0x7fadbc0710f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:15.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:15.861+0000 7fadc0dc3640 1 --2- 172.21.15.91:0/2813594267 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fada40047d0 0x7fadbc1eb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:15.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:15.861+0000 7fadc0dc3640 1 -- 172.21.15.91:0/2813594267 >> 172.21.15.91:0/2813594267 conn(0x7fadbc06e7a0 msgr2=0x7fadbc154bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:15.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:15.861+0000 7fadc0dc3640 1 -- 172.21.15.91:0/2813594267 shutdown_connections 2023-11-27T18:13:15.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:15.861+0000 7fadc0dc3640 1 -- 172.21.15.91:0/2813594267 wait complete. 2023-11-27T18:13:15.879 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-11-27T18:13:16.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.029+0000 7f18a81fa640 1 Processor -- start 2023-11-27T18:13:16.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.029+0000 7f18a81fa640 1 -- start start 2023-11-27T18:13:16.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.029+0000 7f18a81fa640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f18a00c87d0 0x7f18a00c8d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:16.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.029+0000 7f18a81fa640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f18a015a900 0x7f18a00c9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:16.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.029+0000 7f18a81fa640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18a006f1b0 con 0x7f18a0151580 2023-11-27T18:13:16.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.029+0000 7f18a81fa640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18a015ad90 con 0x7f18a00c87d0 2023-11-27T18:13:16.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.029+0000 7f18a81fa640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a006fd50 con 0x7f18a015a900 2023-11-27T18:13:16.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.045+0000 7f18a5795640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f18a00c87d0 0x7f18a00c8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:16.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.045+0000 7f18a5795640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f18a00c87d0 0x7f18a00c8d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.91:40142/0 (socket says 172.21.15.91:40142) 2023-11-27T18:13:16.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.045+0000 7f18a5795640 1 -- 172.21.15.91:0/1302870514 learned_addr learned my addr 172.21.15.91:0/1302870514 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:16.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.117+0000 7f18a4f94640 1 -- 172.21.15.91:0/1302870514 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 457112298 0 0) 0x7f18a006f1b0 con 0x7f18a0151580 2023-11-27T18:13:16.114 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.117+0000 7f18a4f94640 1 -- 172.21.15.91:0/1302870514 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1888003530 con 0x7f18a0151580 2023-11-27T18:13:16.123 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.125+0000 7f18a4f94640 1 -- 172.21.15.91:0/1302870514 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3085982184 0 0) 0x7f1888003530 con 0x7f18a0151580 2023-11-27T18:13:16.123 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.125+0000 7f18a4f94640 1 -- 172.21.15.91:0/1302870514 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f18a015a900 msgr2=0x7f18a00c9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:16.123 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.125+0000 7f18a4f94640 1 --2- 172.21.15.91:0/1302870514 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f18a015a900 0x7f18a00c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:16.123 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.125+0000 7f18a4f94640 1 -- 172.21.15.91:0/1302870514 >> v2:172.21.15.94:3300/0 conn(0x7f18a00c87d0 msgr2=0x7f18a00c8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:16.123 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.125+0000 7f18a4f94640 1 --2- 172.21.15.91:0/1302870514 >> v2:172.21.15.94:3300/0 conn(0x7f18a00c87d0 0x7f18a00c8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:16.124 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.125+0000 7f18a4f94640 1 -- 172.21.15.91:0/1302870514 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a015af90 con 0x7f18a0151580 2023-11-27T18:13:16.124 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.125+0000 7f18a4f94640 1 -- 172.21.15.91:0/1302870514 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3378743932 0 0) 0x7f1898001680 con 0x7f18a0151580 2023-11-27T18:13:16.124 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.125+0000 7f18a4f94640 1 -- 172.21.15.91:0/1302870514 >> v1:172.21.15.91:6789/0 conn(0x7f18a0151580 legacy=0x7f18a006f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:16.124 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.125+0000 7f18a4f94640 1 --2- 172.21.15.91:0/1302870514 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f18a015a900 0x7f1888003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:16.124 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.125+0000 7f18a4f94640 1 --2- 172.21.15.91:0/1302870514 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1888003f50 0x7f18880047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:16.124 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.125+0000 7f18a4f94640 1 --2- 172.21.15.91:0/1302870514 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1888004d10 0x7f1888005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:16.124 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.125+0000 7f18a4f94640 1 -- 172.21.15.91:0/1302870514 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a015ad90 con 0x7f1888003f50 2023-11-27T18:13:16.124 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.125+0000 7f18a4f94640 1 -- 172.21.15.91:0/1302870514 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a006fd50 con 0x7f1888004d10 2023-11-27T18:13:16.124 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.125+0000 7f18a4f94640 1 -- 172.21.15.91:0/1302870514 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f188800bbb0 con 0x7f18a015a900 2023-11-27T18:13:16.128 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.133+0000 7f18a5795640 1 --2- 172.21.15.91:0/1302870514 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1888003f50 0x7f18880047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:16.135 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.137+0000 7f18a5f96640 1 --2- 172.21.15.91:0/1302870514 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f18a015a900 0x7f1888003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:16.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.137+0000 7f18a5795640 1 -- 172.21.15.91:0/1302870514 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f18a015a900 msgr2=0x7f1888003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:16.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.137+0000 7f18a5795640 1 --2- 172.21.15.91:0/1302870514 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f18a015a900 0x7f1888003980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:16.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.137+0000 7f18a5795640 1 -- 172.21.15.91:0/1302870514 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1888004d10 msgr2=0x7f1888005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:16.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.137+0000 7f18a5795640 1 --2- 172.21.15.91:0/1302870514 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1888004d10 0x7f1888005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:16.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.137+0000 7f18a5795640 1 -- 172.21.15.91:0/1302870514 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1888003530 con 0x7f1888003f50 2023-11-27T18:13:16.270 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.273+0000 7f18a5795640 1 --2- 172.21.15.91:0/1302870514 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1888003f50 0x7f18880047d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1894009b60 tx=0x7f189401cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e75881aaa9f37a39 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:16.324 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.325+0000 7f18a4f94640 1 -- 172.21.15.91:0/1302870514 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18940a5710 con 0x7f1888003f50 2023-11-27T18:13:16.324 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.325+0000 7f18a4f94640 1 -- 172.21.15.91:0/1302870514 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18940a5870 con 0x7f1888003f50 2023-11-27T18:13:16.324 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.325+0000 7f18a4f94640 1 -- 172.21.15.91:0/1302870514 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18940a5c00 con 0x7f1888003f50 2023-11-27T18:13:16.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.329+0000 7f18a81fa640 1 -- 172.21.15.91:0/1302870514 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1888003f50 msgr2=0x7f18880047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:16.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.329+0000 7f18a81fa640 1 --2- 172.21.15.91:0/1302870514 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1888003f50 0x7f18880047d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1894009b60 tx=0x7f189401cb10 comp rx=0 tx=0).stop 2023-11-27T18:13:16.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.329+0000 7f18a6797640 1 -- 172.21.15.91:0/1302870514 reap_dead start 2023-11-27T18:13:16.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.329+0000 7f18a81fa640 1 -- 172.21.15.91:0/1302870514 shutdown_connections 2023-11-27T18:13:16.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.329+0000 7f18a81fa640 1 -- 172.21.15.91:0/1302870514 >> 172.21.15.91:0/1302870514 conn(0x7f18a0070a80 msgr2=0x7f18a0070e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:16.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.329+0000 7f18a81fa640 1 -- 172.21.15.91:0/1302870514 shutdown_connections 2023-11-27T18:13:16.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.329+0000 7f18a81fa640 1 -- 172.21.15.91:0/1302870514 wait complete. 2023-11-27T18:13:16.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.329+0000 7f18a81fa640 1 Processor -- start 2023-11-27T18:13:16.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.329+0000 7f18a81fa640 1 -- start start 2023-11-27T18:13:16.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.333+0000 7f18a81fa640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1888003f50 0x7f18a014c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:16.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.333+0000 7f18a81fa640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f18a00af720 0x7f18a00adc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:16.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.333+0000 7f18a81fa640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f18a0149ce0 0x7f18a014e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:16.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.333+0000 7f18a81fa640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a014c860 con 0x7f18a00af720 2023-11-27T18:13:16.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.333+0000 7f18a81fa640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a00ae5c0 con 0x7f1888003f50 2023-11-27T18:13:16.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.333+0000 7f18a81fa640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a014b590 con 0x7f18a0149ce0 2023-11-27T18:13:16.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.333+0000 7f18a5f96640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1888003f50 0x7f18a014c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:16.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.333+0000 7f18a6797640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f18a0149ce0 0x7f18a014e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:16.332 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.333+0000 7f18a6797640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f18a0149ce0 0x7f18a014e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.91:35934/0 (socket says 172.21.15.91:35934) 2023-11-27T18:13:16.332 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.333+0000 7f18a6797640 1 -- 172.21.15.91:0/2143549258 learned_addr learned my addr 172.21.15.91:0/2143549258 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:16.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.349+0000 7f18a6797640 1 -- 172.21.15.91:0/2143549258 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1888003f50 msgr2=0x7f18a014c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:16.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.349+0000 7f18a6797640 1 --2- 172.21.15.91:0/2143549258 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1888003f50 0x7f18a014c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:16.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.349+0000 7f18a6797640 1 -- 172.21.15.91:0/2143549258 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f18a00af720 msgr2=0x7f18a00adc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:16.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.349+0000 7f18a6797640 1 --2- 172.21.15.91:0/2143549258 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f18a00af720 0x7f18a00adc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:16.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.349+0000 7f18a6797640 1 -- 172.21.15.91:0/2143549258 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a014b870 con 0x7f18a0149ce0 2023-11-27T18:13:16.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.361+0000 7f18a6797640 1 --2- 172.21.15.91:0/2143549258 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f18a0149ce0 0x7f18a014e650 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f18a006fe90 tx=0x7f189000cc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:16.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.373+0000 7f189e7fc640 1 -- 172.21.15.91:0/2143549258 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189000a9c0 con 0x7f18a0149ce0 2023-11-27T18:13:16.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.373+0000 7f189e7fc640 1 -- 172.21.15.91:0/2143549258 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f189000ab20 con 0x7f18a0149ce0 2023-11-27T18:13:16.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.373+0000 7f189e7fc640 1 -- 172.21.15.91:0/2143549258 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189000aed0 con 0x7f18a0149ce0 2023-11-27T18:13:16.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.373+0000 7f18a81fa640 1 -- 172.21.15.91:0/2143549258 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18a014a790 con 0x7f18a0149ce0 2023-11-27T18:13:16.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.373+0000 7f18a81fa640 1 -- 172.21.15.91:0/2143549258 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18a014ad50 con 0x7f18a0149ce0 2023-11-27T18:13:16.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.373+0000 7f18a81fa640 1 -- 172.21.15.91:0/2143549258 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18a014ba00 con 0x7f18a0149ce0 2023-11-27T18:13:16.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.429+0000 7f189e7fc640 1 -- 172.21.15.91:0/2143549258 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f1890005d50 con 0x7f18a0149ce0 2023-11-27T18:13:16.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.429+0000 7f189e7fc640 1 --2- 172.21.15.91:0/2143549258 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f188c066840 0x7f188c068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:16.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.429+0000 7f18a5f96640 1 --2- 172.21.15.91:0/2143549258 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f188c066840 0x7f188c068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:16.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.429+0000 7f18a5f96640 1 --2- 172.21.15.91:0/2143549258 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f188c066840 0x7f188c068d00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f18a01efb10 tx=0x7f1898009040 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:16.434 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.437+0000 7f189e7fc640 1 -- 172.21.15.91:0/2143549258 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f1890054b40 con 0x7f18a0149ce0 2023-11-27T18:13:16.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.793+0000 7f189e7fc640 1 -- 172.21.15.91:0/2143549258 <== mon.2 v2:172.21.15.94:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f1890054910 con 0x7f18a0149ce0 2023-11-27T18:13:16.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:16.969+0000 7f18a81fa640 1 -- 172.21.15.91:0/2143549258 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f18a004e850 con 0x7f18a0149ce0 2023-11-27T18:13:19.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:19.813+0000 7f189e7fc640 1 -- 172.21.15.91:0/2143549258 <== mon.2 v2:172.21.15.94:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v27) v1 ==== 228+0+0 (secure 0 0 0) 0x7f1890017100 con 0x7f18a0149ce0 2023-11-27T18:13:19.812 INFO:teuthology.orchestra.run.smithi091.stderr:pool 'cephfs_data_ec' created 2023-11-27T18:13:19.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:19.817+0000 7f18a81fa640 1 -- 172.21.15.91:0/2143549258 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f188c066840 msgr2=0x7f188c068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:19.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:19.817+0000 7f18a81fa640 1 --2- 172.21.15.91:0/2143549258 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f188c066840 0x7f188c068d00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f18a01efb10 tx=0x7f1898009040 comp rx=0 tx=0).stop 2023-11-27T18:13:19.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:19.817+0000 7f18a81fa640 1 -- 172.21.15.91:0/2143549258 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f18a0149ce0 msgr2=0x7f18a014e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:19.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:19.817+0000 7f18a81fa640 1 --2- 172.21.15.91:0/2143549258 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f18a0149ce0 0x7f18a014e650 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f18a006fe90 tx=0x7f189000cc00 comp rx=0 tx=0).stop 2023-11-27T18:13:19.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:19.821+0000 7f18a81fa640 1 -- 172.21.15.91:0/2143549258 shutdown_connections 2023-11-27T18:13:19.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:19.821+0000 7f18a81fa640 1 --2- 172.21.15.91:0/2143549258 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f188c066840 0x7f188c068d00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:19.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:19.821+0000 7f18a81fa640 1 --2- 172.21.15.91:0/2143549258 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f18a0149ce0 0x7f18a014e650 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:19.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:19.821+0000 7f18a81fa640 1 --2- 172.21.15.91:0/2143549258 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f18a00af720 0x7f18a00adc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:19.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:19.821+0000 7f18a81fa640 1 --2- 172.21.15.91:0/2143549258 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1888003f50 0x7f18a014c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:19.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:19.821+0000 7f18a81fa640 1 -- 172.21.15.91:0/2143549258 >> 172.21.15.91:0/2143549258 conn(0x7f18a0070a80 msgr2=0x7f18a006f640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:19.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:19.821+0000 7f18a81fa640 1 -- 172.21.15.91:0/2143549258 shutdown_connections 2023-11-27T18:13:19.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:19.821+0000 7f18a81fa640 1 -- 172.21.15.91:0/2143549258 wait complete. 2023-11-27T18:13:19.837 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-11-27T18:13:19.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:19.977+0000 7f4d22cf7640 1 Processor -- start 2023-11-27T18:13:19.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:19.977+0000 7f4d22cf7640 1 -- start start 2023-11-27T18:13:19.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:19.977+0000 7f4d22cf7640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4d1c06e210 0x7f4d1c161ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:19.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:19.977+0000 7f4d22cf7640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d1c157070 con 0x7f4d1c150570 2023-11-27T18:13:19.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:19.977+0000 7f4d22cf7640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d1c0c6a30 con 0x7f4d1c0c5e70 2023-11-27T18:13:19.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:19.977+0000 7f4d22cf7640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d1c156460 con 0x7f4d1c06e210 2023-11-27T18:13:19.975 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:19.977+0000 7f4d21294640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4d1c06e210 0x7f4d1c161ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:19.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:19.981+0000 7f4d21294640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4d1c06e210 0x7f4d1c161ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.91:40182/0 (socket says 172.21.15.91:40182) 2023-11-27T18:13:19.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:19.981+0000 7f4d21294640 1 -- 172.21.15.91:0/3762870875 learned_addr learned my addr 172.21.15.91:0/3762870875 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:19.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:19.985+0000 7f4d1b7fe640 1 -- 172.21.15.91:0/3762870875 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2582171417 0 0) 0x7f4d1c157070 con 0x7f4d1c150570 2023-11-27T18:13:19.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:19.985+0000 7f4d1b7fe640 1 -- 172.21.15.91:0/3762870875 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d04003530 con 0x7f4d1c150570 2023-11-27T18:13:19.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:19.985+0000 7f4d21294640 1 -- 172.21.15.91:0/3762870875 >> v1:172.21.15.94:6789/0 conn(0x7f4d1c0c5e70 legacy=0x7f4d1c06db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:19.983 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:19.985+0000 7f4d21294640 1 -- 172.21.15.91:0/3762870875 >> v1:172.21.15.91:6789/0 conn(0x7f4d1c150570 legacy=0x7f4d1c0c0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:19.983 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:19.985+0000 7f4d21294640 1 -- 172.21.15.91:0/3762870875 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d1c156740 con 0x7f4d1c06e210 2023-11-27T18:13:19.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:19.993+0000 7f4d21294640 1 --2- 172.21.15.91:0/3762870875 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4d1c06e210 0x7f4d1c161ac0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c00bb10 tx=0x7f4d0c0213c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55b93c54916c0c74 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:20.003 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:20.005+0000 7f4d1b7fe640 1 -- 172.21.15.91:0/3762870875 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c0b1600 con 0x7f4d1c06e210 2023-11-27T18:13:20.003 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:20.005+0000 7f4d1b7fe640 1 -- 172.21.15.91:0/3762870875 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d0c0ad050 con 0x7f4d1c06e210 2023-11-27T18:13:20.004 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:20.005+0000 7f4d1b7fe640 1 -- 172.21.15.91:0/3762870875 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c0b1980 con 0x7f4d1c06e210 2023-11-27T18:13:20.004 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:20.005+0000 7f4d22cf7640 1 -- 172.21.15.91:0/3762870875 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4d1c06e210 msgr2=0x7f4d1c161ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:20.004 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:20.005+0000 7f4d22cf7640 1 --2- 172.21.15.91:0/3762870875 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4d1c06e210 0x7f4d1c161ac0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c00bb10 tx=0x7f4d0c0213c0 comp rx=0 tx=0).stop 2023-11-27T18:13:20.004 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:20.005+0000 7f4d22cf7640 1 -- 172.21.15.91:0/3762870875 shutdown_connections 2023-11-27T18:13:20.005 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:20.005+0000 7f4d22cf7640 1 --2- 172.21.15.91:0/3762870875 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4d1c06e210 0x7f4d1c161ac0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:20.005 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:20.005+0000 7f4d22cf7640 1 -- 172.21.15.91:0/3762870875 >> 172.21.15.91:0/3762870875 conn(0x7f4d1c0cbcb0 msgr2=0x7f4d1c0cc0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:20.005 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:20.009+0000 7f4d22cf7640 1 -- 172.21.15.91:0/3762870875 shutdown_connections 2023-11-27T18:13:20.005 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:20.009+0000 7f4d22cf7640 1 -- 172.21.15.91:0/3762870875 wait complete. 2023-11-27T18:13:20.005 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:20.009+0000 7f4d22cf7640 1 Processor -- start 2023-11-27T18:13:20.005 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:20.009+0000 7f4d22cf7640 1 -- start start 2023-11-27T18:13:20.007 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:20.009+0000 7f4d22cf7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4d1c06e210 0x7f4d1c1557f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:20.007 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:20.009+0000 7f4d22cf7640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4d1c0c5e70 0x7f4d1c1f33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:20.007 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:20.009+0000 7f4d22cf7640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d1c150570 0x7f4d1c073b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:20.007 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:20.009+0000 7f4d22cf7640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c14c210 con 0x7f4d1c150570 2023-11-27T18:13:20.008 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:20.009+0000 7f4d22cf7640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c1f3910 con 0x7f4d1c06e210 2023-11-27T18:13:20.008 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:20.009+0000 7f4d22cf7640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c14bf30 con 0x7f4d1c0c5e70 2023-11-27T18:13:20.008 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:20.009+0000 7f4d21294640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d1c150570 0x7f4d1c073b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:20.009 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:20.009+0000 7f4d21294640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d1c150570 0x7f4d1c073b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:48952/0 (socket says 172.21.15.91:48952) 2023-11-27T18:13:20.009 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:20.009+0000 7f4d21294640 1 -- 172.21.15.91:0/3470045036 learned_addr learned my addr 172.21.15.91:0/3470045036 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:20.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:20.013+0000 7f4d20a93640 1 --2- 172.21.15.91:0/3470045036 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4d1c06e210 0x7f4d1c1557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:20.012 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:20.013+0000 7f4d21294640 1 -- 172.21.15.91:0/3470045036 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4d1c0c5e70 msgr2=0x7f4d1c1f33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:20.012 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:20.013+0000 7f4d21294640 1 --2- 172.21.15.91:0/3470045036 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4d1c0c5e70 0x7f4d1c1f33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:20.012 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:20.013+0000 7f4d21294640 1 -- 172.21.15.91:0/3470045036 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4d1c06e210 msgr2=0x7f4d1c1557f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:20.013 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:20.013+0000 7f4d21294640 1 --2- 172.21.15.91:0/3470045036 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4d1c06e210 0x7f4d1c1557f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:20.016 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:20.013+0000 7f4d21294640 1 -- 172.21.15.91:0/3470045036 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d0c00b770 con 0x7f4d1c150570 2023-11-27T18:13:20.016 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:20.017+0000 7f4d21294640 1 --2- 172.21.15.91:0/3470045036 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d1c150570 0x7f4d1c073b80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c01eff0 tx=0x7f4d0c01e160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:20.021 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:20.025+0000 7f4d197fa640 1 -- 172.21.15.91:0/3470045036 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c0b1e40 con 0x7f4d1c150570 2023-11-27T18:13:20.021 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:20.025+0000 7f4d197fa640 1 -- 172.21.15.91:0/3470045036 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d0c0ba440 con 0x7f4d1c150570 2023-11-27T18:13:20.021 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:20.025+0000 7f4d197fa640 1 -- 172.21.15.91:0/3470045036 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c0ba7b0 con 0x7f4d1c150570 2023-11-27T18:13:20.021 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:20.025+0000 7f4d22cf7640 1 -- 172.21.15.91:0/3470045036 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d1c150f70 con 0x7f4d1c150570 2023-11-27T18:13:20.021 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:20.025+0000 7f4d22cf7640 1 -- 172.21.15.91:0/3470045036 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d1c150bc0 con 0x7f4d1c150570 2023-11-27T18:13:20.022 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:20.025+0000 7f4d22cf7640 1 -- 172.21.15.91:0/3470045036 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d1c154170 con 0x7f4d1c150570 2023-11-27T18:13:20.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:20.321+0000 7f4d197fa640 1 -- 172.21.15.91:0/3470045036 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f4d0c0b8070 con 0x7f4d1c150570 2023-11-27T18:13:20.318 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:20.321+0000 7f4d197fa640 1 --2- 172.21.15.91:0/3470045036 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f4d08066870 0x7f4d08068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:20.318 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:20.321+0000 7f4d20a93640 1 --2- 172.21.15.91:0/3470045036 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f4d08066870 0x7f4d08068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:20.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:20.321+0000 7f4d20a93640 1 --2- 172.21.15.91:0/3470045036 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f4d08066870 0x7f4d08068d30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4d14007fd0 tx=0x7f4d14009040 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:20.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:20.357+0000 7f4d197fa640 1 -- 172.21.15.91:0/3470045036 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f4d0c0f3b40 con 0x7f4d1c150570 2023-11-27T18:13:20.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:20.357+0000 7f4d197fa640 1 -- 172.21.15.91:0/3470045036 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f4d0c0ef780 con 0x7f4d1c150570 2023-11-27T18:13:20.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:20.541+0000 7f4d22cf7640 1 -- 172.21.15.91:0/3470045036 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f4d1c154170 con 0x7f4d1c150570 2023-11-27T18:13:21.944 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:21.945+0000 7f4d197fa640 1 -- 172.21.15.91:0/3470045036 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v29) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4d1c154170 con 0x7f4d1c150570 2023-11-27T18:13:21.944 INFO:teuthology.orchestra.run.smithi091.stderr:set pool 4 allow_ec_overwrites to true 2023-11-27T18:13:21.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:21.949+0000 7f4d22cf7640 1 -- 172.21.15.91:0/3470045036 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f4d08066870 msgr2=0x7f4d08068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:21.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:21.949+0000 7f4d22cf7640 1 --2- 172.21.15.91:0/3470045036 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f4d08066870 0x7f4d08068d30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4d14007fd0 tx=0x7f4d14009040 comp rx=0 tx=0).stop 2023-11-27T18:13:21.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:21.949+0000 7f4d22cf7640 1 -- 172.21.15.91:0/3470045036 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d1c150570 msgr2=0x7f4d1c073b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:21.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:21.949+0000 7f4d22cf7640 1 --2- 172.21.15.91:0/3470045036 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d1c150570 0x7f4d1c073b80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c01eff0 tx=0x7f4d0c01e160 comp rx=0 tx=0).stop 2023-11-27T18:13:21.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:21.949+0000 7f4d22cf7640 1 -- 172.21.15.91:0/3470045036 shutdown_connections 2023-11-27T18:13:21.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:21.949+0000 7f4d22cf7640 1 --2- 172.21.15.91:0/3470045036 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f4d08066870 0x7f4d08068d30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:21.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:21.949+0000 7f4d22cf7640 1 --2- 172.21.15.91:0/3470045036 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4d1c0c5e70 0x7f4d1c1f33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:21.948 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:21.949+0000 7f4d22cf7640 1 --2- 172.21.15.91:0/3470045036 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d1c150570 0x7f4d1c073b80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:21.948 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:21.949+0000 7f4d22cf7640 1 --2- 172.21.15.91:0/3470045036 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4d1c06e210 0x7f4d1c1557f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:21.948 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:21.949+0000 7f4d22cf7640 1 -- 172.21.15.91:0/3470045036 >> 172.21.15.91:0/3470045036 conn(0x7f4d1c0cbcb0 msgr2=0x7f4d1c14dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:21.948 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:21.949+0000 7f4d22cf7640 1 -- 172.21.15.91:0/3470045036 shutdown_connections 2023-11-27T18:13:21.948 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:21.949+0000 7f4d22cf7640 1 -- 172.21.15.91:0/3470045036 wait complete. 2023-11-27T18:13:21.969 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-11-27T18:13:22.096 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.097+0000 7f857aeff640 1 Processor -- start 2023-11-27T18:13:22.096 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.097+0000 7f857aeff640 1 -- start start 2023-11-27T18:13:22.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.101+0000 7f857aeff640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8574072490 0x7f8574066360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:22.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.101+0000 7f857aeff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f8574072870 0x7f857406fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:22.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.101+0000 7f857aeff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8574156aa0 0x7f85740c30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:22.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.101+0000 7f857aeff640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f857406b9b0 con 0x7f8574072870 2023-11-27T18:13:22.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.101+0000 7f857aeff640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8574156610 con 0x7f8574156aa0 2023-11-27T18:13:22.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.101+0000 7f857aeff640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85740669c0 con 0x7f8574072490 2023-11-27T18:13:22.098 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.101+0000 7f857949c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8574156aa0 0x7f85740c30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:22.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.101+0000 7f8578c9b640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8574072490 0x7f8574066360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:22.100 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.101+0000 7f8578c9b640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8574072490 0x7f8574066360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.91:35952/0 (socket says 172.21.15.91:35952) 2023-11-27T18:13:22.100 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.101+0000 7f8578c9b640 1 -- 172.21.15.91:0/2429519514 learned_addr learned my addr 172.21.15.91:0/2429519514 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:22.105 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.109+0000 7f8578c9b640 1 -- 172.21.15.91:0/2429519514 >> v2:172.21.15.94:3300/0 conn(0x7f8574156aa0 msgr2=0x7f85740c30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:22.105 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.109+0000 7f8578c9b640 1 --2- 172.21.15.91:0/2429519514 >> v2:172.21.15.94:3300/0 conn(0x7f8574156aa0 0x7f85740c30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:22.105 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.109+0000 7f8578c9b640 1 -- 172.21.15.91:0/2429519514 >> v2:172.21.15.91:3300/0 conn(0x7f8574072870 msgr2=0x7f857406fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:22.105 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.109+0000 7f8578c9b640 1 --2- 172.21.15.91:0/2429519514 >> v2:172.21.15.91:3300/0 conn(0x7f8574072870 0x7f857406fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:22.105 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.109+0000 7f8578c9b640 1 -- 172.21.15.91:0/2429519514 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85740c4fd0 con 0x7f8574072490 2023-11-27T18:13:22.114 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.117+0000 7f8578c9b640 1 --2- 172.21.15.91:0/2429519514 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8574072490 0x7f8574066360 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8568009870 tx=0x7f856801ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=833fc9a894a3d661 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:22.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.229+0000 7f85737fe640 1 -- 172.21.15.91:0/2429519514 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85680a89b0 con 0x7f8574072490 2023-11-27T18:13:22.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.229+0000 7f85737fe640 1 -- 172.21.15.91:0/2429519514 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85680a8b10 con 0x7f8574072490 2023-11-27T18:13:22.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.229+0000 7f85737fe640 1 -- 172.21.15.91:0/2429519514 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85680a8ea0 con 0x7f8574072490 2023-11-27T18:13:22.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.229+0000 7f857aeff640 1 -- 172.21.15.91:0/2429519514 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8574072490 msgr2=0x7f8574066360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:22.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.229+0000 7f857aeff640 1 --2- 172.21.15.91:0/2429519514 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8574072490 0x7f8574066360 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8568009870 tx=0x7f856801ecf0 comp rx=0 tx=0).stop 2023-11-27T18:13:22.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.229+0000 7f857aeff640 1 -- 172.21.15.91:0/2429519514 shutdown_connections 2023-11-27T18:13:22.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.229+0000 7f857aeff640 1 --2- 172.21.15.91:0/2429519514 >> v2:172.21.15.94:3300/0 conn(0x7f8574156aa0 0x7f85740c30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:22.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.229+0000 7f857aeff640 1 --2- 172.21.15.91:0/2429519514 >> v2:172.21.15.91:3300/0 conn(0x7f8574072870 0x7f857406fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:22.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.229+0000 7f857aeff640 1 --2- 172.21.15.91:0/2429519514 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8574072490 0x7f8574066360 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:22.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.229+0000 7f857aeff640 1 -- 172.21.15.91:0/2429519514 >> 172.21.15.91:0/2429519514 conn(0x7f8574071740 msgr2=0x7f8574071b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:22.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.229+0000 7f857aeff640 1 -- 172.21.15.91:0/2429519514 shutdown_connections 2023-11-27T18:13:22.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.229+0000 7f857aeff640 1 -- 172.21.15.91:0/2429519514 wait complete. 2023-11-27T18:13:22.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.229+0000 7f857aeff640 1 Processor -- start 2023-11-27T18:13:22.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.229+0000 7f857aeff640 1 -- start start 2023-11-27T18:13:22.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.233+0000 7f857aeff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8574072490 0x7f8574154270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:22.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.233+0000 7f857aeff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8574072870 0x7f8574151b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:22.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.233+0000 7f857aeff640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8574156aa0 0x7f85741520c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:22.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.233+0000 7f857aeff640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85741ee4c0 con 0x7f8574072490 2023-11-27T18:13:22.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.233+0000 7f857aeff640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85741ee780 con 0x7f8574072870 2023-11-27T18:13:22.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.233+0000 7f857aeff640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85741eea60 con 0x7f8574156aa0 2023-11-27T18:13:22.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.233+0000 7f8578c9b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8574072490 0x7f8574154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:22.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.233+0000 7f8578c9b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8574072490 0x7f8574154270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:48984/0 (socket says 172.21.15.91:48984) 2023-11-27T18:13:22.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.233+0000 7f8578c9b640 1 -- 172.21.15.91:0/1334572196 learned_addr learned my addr 172.21.15.91:0/1334572196 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:22.234 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.237+0000 7f8578c9b640 1 -- 172.21.15.91:0/1334572196 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8574156aa0 msgr2=0x7f85741520c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:22.234 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.237+0000 7f8578c9b640 1 --2- 172.21.15.91:0/1334572196 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8574156aa0 0x7f85741520c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:22.234 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.237+0000 7f8578c9b640 1 -- 172.21.15.91:0/1334572196 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8574072870 msgr2=0x7f8574151b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:22.234 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.237+0000 7f8578c9b640 1 --2- 172.21.15.91:0/1334572196 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8574072870 0x7f8574151b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:22.235 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.237+0000 7f8578c9b640 1 -- 172.21.15.91:0/1334572196 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85680094d0 con 0x7f8574072490 2023-11-27T18:13:22.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.241+0000 7f8578c9b640 1 --2- 172.21.15.91:0/1334572196 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8574072490 0x7f8574154270 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f856801c920 tx=0x7f856801ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:22.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.249+0000 7f85717fa640 1 -- 172.21.15.91:0/1334572196 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85680b1cc0 con 0x7f8574072490 2023-11-27T18:13:22.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.249+0000 7f85717fa640 1 -- 172.21.15.91:0/1334572196 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85680b1e20 con 0x7f8574072490 2023-11-27T18:13:22.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.249+0000 7f85717fa640 1 -- 172.21.15.91:0/1334572196 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85680bb670 con 0x7f8574072490 2023-11-27T18:13:22.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.249+0000 7f857aeff640 1 -- 172.21.15.91:0/1334572196 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85741eed40 con 0x7f8574072490 2023-11-27T18:13:22.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.249+0000 7f857aeff640 1 -- 172.21.15.91:0/1334572196 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85741547b0 con 0x7f8574072490 2023-11-27T18:13:22.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.249+0000 7f857aeff640 1 -- 172.21.15.91:0/1334572196 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f857404e850 con 0x7f8574072490 2023-11-27T18:13:22.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.533+0000 7f85717fa640 1 -- 172.21.15.91:0/1334572196 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f85680b7070 con 0x7f8574072490 2023-11-27T18:13:22.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.533+0000 7f85717fa640 1 --2- 172.21.15.91:0/1334572196 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f8558066840 0x7f8558068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:22.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.537+0000 7f8573fff640 1 --2- 172.21.15.91:0/1334572196 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f8558066840 0x7f8558068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:22.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.537+0000 7f8573fff640 1 --2- 172.21.15.91:0/1334572196 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f8558066840 0x7f8558068d00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f85740c6690 tx=0x7f8560006ca0 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:22.576 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.581+0000 7f85717fa640 1 -- 172.21.15.91:0/1334572196 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f85680f4260 con 0x7f8574072490 2023-11-27T18:13:22.577 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.581+0000 7f85717fa640 1 -- 172.21.15.91:0/1334572196 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f85680efea0 con 0x7f8574072490 2023-11-27T18:13:22.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:22.789+0000 7f857aeff640 1 -- 172.21.15.91:0/1334572196 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f8574155df0 con 0x7f8574072490 2023-11-27T18:13:23.781 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.785+0000 7f85717fa640 1 -- 172.21.15.91:0/1334572196 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v6) v1 ==== 137+0+0 (secure 0 0 0) 0x7f85680b5070 con 0x7f8574072490 2023-11-27T18:13:23.781 INFO:teuthology.orchestra.run.smithi091.stderr:added data pool 4 to fsmap 2023-11-27T18:13:23.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.785+0000 7f857aeff640 1 -- 172.21.15.91:0/1334572196 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f8558066840 msgr2=0x7f8558068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:23.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.785+0000 7f857aeff640 1 --2- 172.21.15.91:0/1334572196 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f8558066840 0x7f8558068d00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f85740c6690 tx=0x7f8560006ca0 comp rx=0 tx=0).stop 2023-11-27T18:13:23.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.785+0000 7f857aeff640 1 -- 172.21.15.91:0/1334572196 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8574072490 msgr2=0x7f8574154270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:23.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.785+0000 7f857aeff640 1 --2- 172.21.15.91:0/1334572196 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8574072490 0x7f8574154270 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f856801c920 tx=0x7f856801ba90 comp rx=0 tx=0).stop 2023-11-27T18:13:23.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.785+0000 7f857aeff640 1 -- 172.21.15.91:0/1334572196 shutdown_connections 2023-11-27T18:13:23.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.785+0000 7f857aeff640 1 --2- 172.21.15.91:0/1334572196 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f8558066840 0x7f8558068d00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:23.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.785+0000 7f857aeff640 1 --2- 172.21.15.91:0/1334572196 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8574156aa0 0x7f85741520c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:23.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.785+0000 7f857aeff640 1 --2- 172.21.15.91:0/1334572196 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8574072870 0x7f8574151b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:23.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.785+0000 7f857aeff640 1 --2- 172.21.15.91:0/1334572196 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8574072490 0x7f8574154270 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:23.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.785+0000 7f857aeff640 1 -- 172.21.15.91:0/1334572196 >> 172.21.15.91:0/1334572196 conn(0x7f8574071740 msgr2=0x7f85740c4170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:23.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.785+0000 7f857aeff640 1 -- 172.21.15.91:0/1334572196 shutdown_connections 2023-11-27T18:13:23.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.785+0000 7f857aeff640 1 -- 172.21.15.91:0/1334572196 wait complete. 2023-11-27T18:13:23.805 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T18:13:23.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.933+0000 7f292e336640 1 Processor -- start 2023-11-27T18:13:23.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.933+0000 7f292e336640 1 -- start start 2023-11-27T18:13:23.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.933+0000 7f292e336640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f29280c5240 0x7f29280c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:23.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.933+0000 7f292e336640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f29280c5620 0x7f292814fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:23.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.933+0000 7f292e336640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29280c67c0 con 0x7f29280664f0 2023-11-27T18:13:23.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.933+0000 7f292e336640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29281565b0 con 0x7f29280c5240 2023-11-27T18:13:23.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.933+0000 7f292e336640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2928156890 con 0x7f29280c5620 2023-11-27T18:13:23.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.933+0000 7f291ffff640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f29280c5620 0x7f292814fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:23.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.937+0000 7f291ffff640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f29280c5620 0x7f292814fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.91:35968/0 (socket says 172.21.15.91:35968) 2023-11-27T18:13:23.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.937+0000 7f291ffff640 1 -- 172.21.15.91:0/3072006181 learned_addr learned my addr 172.21.15.91:0/3072006181 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:23.937 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.941+0000 7f291ffff640 1 -- 172.21.15.91:0/3072006181 >> v2:172.21.15.91:3300/0 conn(0x7f29280c5240 msgr2=0x7f29280c5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:23.937 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.941+0000 7f291ffff640 1 --2- 172.21.15.91:0/3072006181 >> v2:172.21.15.91:3300/0 conn(0x7f29280c5240 0x7f29280c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:23.937 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.941+0000 7f291ffff640 1 -- 172.21.15.91:0/3072006181 >> v1:172.21.15.94:6789/0 conn(0x7f29280664f0 legacy=0x7f29280c29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:23.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.941+0000 7f291ffff640 1 -- 172.21.15.91:0/3072006181 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2928156b70 con 0x7f29280c5620 2023-11-27T18:13:23.942 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.945+0000 7f291ffff640 1 --2- 172.21.15.91:0/3072006181 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f29280c5620 0x7f292814fe20 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2910009870 tx=0x7f291001c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ea24b486774165 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:23.950 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.953+0000 7f29277fe640 1 -- 172.21.15.91:0/3072006181 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29100aa610 con 0x7f29280c5620 2023-11-27T18:13:23.950 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.953+0000 7f29277fe640 1 -- 172.21.15.91:0/3072006181 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29100a6040 con 0x7f29280c5620 2023-11-27T18:13:23.950 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.953+0000 7f29277fe640 1 -- 172.21.15.91:0/3072006181 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29100aa990 con 0x7f29280c5620 2023-11-27T18:13:23.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.953+0000 7f292e336640 1 -- 172.21.15.91:0/3072006181 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f29280c5620 msgr2=0x7f292814fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:23.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.953+0000 7f292e336640 1 --2- 172.21.15.91:0/3072006181 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f29280c5620 0x7f292814fe20 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2910009870 tx=0x7f291001c4d0 comp rx=0 tx=0).stop 2023-11-27T18:13:23.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.953+0000 7f292e336640 1 -- 172.21.15.91:0/3072006181 shutdown_connections 2023-11-27T18:13:23.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.953+0000 7f292e336640 1 --2- 172.21.15.91:0/3072006181 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f29280c5620 0x7f292814fe20 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:23.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.953+0000 7f292e336640 1 --2- 172.21.15.91:0/3072006181 >> v2:172.21.15.91:3300/0 conn(0x7f29280c5240 0x7f29280c5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:23.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.953+0000 7f292e336640 1 -- 172.21.15.91:0/3072006181 >> 172.21.15.91:0/3072006181 conn(0x7f29280c7fa0 msgr2=0x7f29280c83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:23.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.953+0000 7f292e336640 1 -- 172.21.15.91:0/3072006181 shutdown_connections 2023-11-27T18:13:23.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.953+0000 7f292e336640 1 -- 172.21.15.91:0/3072006181 wait complete. 2023-11-27T18:13:23.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.953+0000 7f292e336640 1 Processor -- start 2023-11-27T18:13:23.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.953+0000 7f292e336640 1 -- start start 2023-11-27T18:13:23.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.957+0000 7f292e336640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f29280664f0 0x7f29281525d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:23.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.957+0000 7f292e336640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f29280c5240 0x7f2928153060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:23.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.957+0000 7f292e336640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29280c5620 0x7f29281ef490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:23.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.957+0000 7f292e336640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2928153710 con 0x7f29280c5240 2023-11-27T18:13:23.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.957+0000 7f292e336640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29281539f0 con 0x7f29280c5620 2023-11-27T18:13:23.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.957+0000 7f292e336640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2928151af0 con 0x7f29280664f0 2023-11-27T18:13:23.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.957+0000 7f2927fff640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f29280664f0 0x7f29281525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:23.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.957+0000 7f2927fff640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f29280664f0 0x7f29281525d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.91:35984/0 (socket says 172.21.15.91:35984) 2023-11-27T18:13:23.956 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.957+0000 7f2927fff640 1 -- 172.21.15.91:0/3486622981 learned_addr learned my addr 172.21.15.91:0/3486622981 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:23.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.969+0000 7f2927fff640 1 -- 172.21.15.91:0/3486622981 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29280c5620 msgr2=0x7f29281ef490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:23.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.969+0000 7f2927fff640 1 --2- 172.21.15.91:0/3486622981 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29280c5620 0x7f29281ef490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:23.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.969+0000 7f2927fff640 1 -- 172.21.15.91:0/3486622981 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f29280c5240 msgr2=0x7f2928153060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:23.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.969+0000 7f2927fff640 1 --2- 172.21.15.91:0/3486622981 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f29280c5240 0x7f2928153060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:23.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.969+0000 7f2927fff640 1 -- 172.21.15.91:0/3486622981 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29100094d0 con 0x7f29280664f0 2023-11-27T18:13:23.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.977+0000 7f2927fff640 1 --2- 172.21.15.91:0/3486622981 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f29280664f0 0x7f29281525d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f291800b550 tx=0x7f291800ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:23.983 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.985+0000 7f29257fa640 1 -- 172.21.15.91:0/3486622981 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2918010870 con 0x7f29280664f0 2023-11-27T18:13:23.983 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.985+0000 7f29257fa640 1 -- 172.21.15.91:0/3486622981 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29180109f0 con 0x7f29280664f0 2023-11-27T18:13:23.984 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.985+0000 7f29257fa640 1 -- 172.21.15.91:0/3486622981 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2918010da0 con 0x7f29280664f0 2023-11-27T18:13:23.984 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.985+0000 7f292e336640 1 -- 172.21.15.91:0/3486622981 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2928151dd0 con 0x7f29280664f0 2023-11-27T18:13:23.984 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.985+0000 7f292e336640 1 -- 172.21.15.91:0/3486622981 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f292814e9f0 con 0x7f29280664f0 2023-11-27T18:13:23.984 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:23.985+0000 7f292e336640 1 -- 172.21.15.91:0/3486622981 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2928067810 con 0x7f29280664f0 2023-11-27T18:13:24.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.321+0000 7f29257fa640 1 -- 172.21.15.91:0/3486622981 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f2918023480 con 0x7f29280664f0 2023-11-27T18:13:24.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.321+0000 7f29257fa640 1 --2- 172.21.15.91:0/3486622981 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f2908066840 0x7f2908068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:24.318 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.321+0000 7f291ffff640 1 --2- 172.21.15.91:0/3486622981 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f2908066840 0x7f2908068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:24.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.321+0000 7f291ffff640 1 --2- 172.21.15.91:0/3486622981 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f2908066840 0x7f2908068d00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f29100ae000 tx=0x7f2910008040 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:24.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.333+0000 7f29257fa640 1 -- 172.21.15.91:0/3486622981 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2918055c30 con 0x7f29280664f0 2023-11-27T18:13:24.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.365+0000 7f29257fa640 1 -- 172.21.15.91:0/3486622981 <== mon.2 v2:172.21.15.94:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f2918055300 con 0x7f29280664f0 2023-11-27T18:13:24.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.565+0000 7f292e336640 1 -- 172.21.15.91:0/3486622981 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f292804e930 con 0x7f29280664f0 2023-11-27T18:13:24.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.685+0000 7f29257fa640 1 -- 172.21.15.91:0/3486622981 <== mon.2 v2:172.21.15.94:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+6490 (secure 0 0 0) 0x7f291801e090 con 0x7f29280664f0 2023-11-27T18:13:24.683 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:13:24.683 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1156758494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1156758494},{"type":"v1","addr":"172.21.15.91:6835","nonce":1156758494}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4227,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/2636117364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2636117364},{"type":"v1","addr":"172.21.15.91:6837","nonce":2636117364}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6839/1813662020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6838","nonce":1813662020},{"type":"v1","addr":"172.21.15.91:6839","nonce":1813662020}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4243,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3605337236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3605337236},{"type":"v1","addr":"172.21.15.94:6833","nonce":3605337236}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4246,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/1691562292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1691562292},{"type":"v1","addr":"172.21.15.94:6835","nonce":1691562292}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T18:13:13.083833+0000","modified":"2023-11-27T18:13:22.804929+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":10,"addr":"172.21.15.94:6837/3938864244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":3938864244},{"type":"v1","addr":"172.21.15.94:6837","nonce":3938864244}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-11-27T18:13:24.683 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 6 2023-11-27T18:13:24.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.689+0000 7f292e336640 1 -- 172.21.15.91:0/3486622981 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f2908066840 msgr2=0x7f2908068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:24.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.689+0000 7f292e336640 1 --2- 172.21.15.91:0/3486622981 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f2908066840 0x7f2908068d00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f29100ae000 tx=0x7f2910008040 comp rx=0 tx=0).stop 2023-11-27T18:13:24.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.689+0000 7f292e336640 1 -- 172.21.15.91:0/3486622981 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f29280664f0 msgr2=0x7f29281525d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:24.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.689+0000 7f292e336640 1 --2- 172.21.15.91:0/3486622981 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f29280664f0 0x7f29281525d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f291800b550 tx=0x7f291800ba10 comp rx=0 tx=0).stop 2023-11-27T18:13:24.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.689+0000 7f292e336640 1 -- 172.21.15.91:0/3486622981 shutdown_connections 2023-11-27T18:13:24.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.689+0000 7f292e336640 1 --2- 172.21.15.91:0/3486622981 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f2908066840 0x7f2908068d00 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:24.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.689+0000 7f292e336640 1 --2- 172.21.15.91:0/3486622981 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29280c5620 0x7f29281ef490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:24.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.689+0000 7f292e336640 1 --2- 172.21.15.91:0/3486622981 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f29280c5240 0x7f2928153060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:24.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.689+0000 7f292e336640 1 --2- 172.21.15.91:0/3486622981 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f29280664f0 0x7f29281525d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:24.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.689+0000 7f292e336640 1 -- 172.21.15.91:0/3486622981 >> 172.21.15.91:0/3486622981 conn(0x7f29280c7fa0 msgr2=0x7f2928073720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:24.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.689+0000 7f292e336640 1 -- 172.21.15.91:0/3486622981 shutdown_connections 2023-11-27T18:13:24.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.689+0000 7f292e336640 1 -- 172.21.15.91:0/3486622981 wait complete. 2023-11-27T18:13:24.707 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T18:13:24.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.829+0000 7f995805a640 1 Processor -- start 2023-11-27T18:13:24.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.829+0000 7f995805a640 1 -- start start 2023-11-27T18:13:24.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.829+0000 7f995805a640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f9950151820 0x7f9950070e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:24.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.829+0000 7f995805a640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9950072b70 con 0x7f99500c5f10 2023-11-27T18:13:24.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.829+0000 7f995805a640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f995006d9b0 con 0x7f99500c85c0 2023-11-27T18:13:24.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.829+0000 7f995805a640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99500c2d20 con 0x7f9950151820 2023-11-27T18:13:24.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.829+0000 7f9955df6640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f9950151820 0x7f9950070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:24.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.829+0000 7f9955df6640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f9950151820 0x7f9950070e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:48998/0 (socket says 172.21.15.91:48998) 2023-11-27T18:13:24.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.829+0000 7f9955df6640 1 -- 172.21.15.91:0/2833684645 learned_addr learned my addr 172.21.15.91:0/2833684645 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:24.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.833+0000 7f9955df6640 1 -- 172.21.15.91:0/2833684645 >> v1:172.21.15.94:6789/0 conn(0x7f99500c85c0 legacy=0x7f995006cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:24.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.833+0000 7f9955df6640 1 -- 172.21.15.91:0/2833684645 >> v1:172.21.15.91:6789/0 conn(0x7f99500c5f10 legacy=0x7f995006d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:24.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.833+0000 7f9955df6640 1 -- 172.21.15.91:0/2833684645 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9950071350 con 0x7f9950151820 2023-11-27T18:13:24.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.837+0000 7f9955df6640 1 --2- 172.21.15.91:0/2833684645 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9950151820 0x7f9950070e10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9940009e50 tx=0x7f994001f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5234d5934c91920f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:24.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.841+0000 7f9954df4640 1 -- 172.21.15.91:0/2833684645 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99400af400 con 0x7f9950151820 2023-11-27T18:13:24.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.841+0000 7f9954df4640 1 -- 172.21.15.91:0/2833684645 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99400ab050 con 0x7f9950151820 2023-11-27T18:13:24.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.841+0000 7f9954df4640 1 -- 172.21.15.91:0/2833684645 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99400af780 con 0x7f9950151820 2023-11-27T18:13:24.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.845+0000 7f995805a640 1 -- 172.21.15.91:0/2833684645 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9950151820 msgr2=0x7f9950070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:24.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.845+0000 7f995805a640 1 --2- 172.21.15.91:0/2833684645 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9950151820 0x7f9950070e10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9940009e50 tx=0x7f994001f1f0 comp rx=0 tx=0).stop 2023-11-27T18:13:24.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.845+0000 7f995805a640 1 -- 172.21.15.91:0/2833684645 shutdown_connections 2023-11-27T18:13:24.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.845+0000 7f995805a640 1 --2- 172.21.15.91:0/2833684645 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9950151820 0x7f9950070e10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:24.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.845+0000 7f995805a640 1 -- 172.21.15.91:0/2833684645 >> 172.21.15.91:0/2833684645 conn(0x7f99500c79b0 msgr2=0x7f99500c7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:24.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.845+0000 7f995805a640 1 -- 172.21.15.91:0/2833684645 shutdown_connections 2023-11-27T18:13:24.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.845+0000 7f995805a640 1 -- 172.21.15.91:0/2833684645 wait complete. 2023-11-27T18:13:24.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.845+0000 7f995805a640 1 Processor -- start 2023-11-27T18:13:24.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.845+0000 7f995805a640 1 -- start start 2023-11-27T18:13:24.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.845+0000 7f995805a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99500c5f10 0x7f99501f08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:24.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.845+0000 7f995805a640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f99500c85c0 0x7f99501ee560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:24.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.845+0000 7f995805a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9950151820 0x7f99501eeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:24.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.845+0000 7f995805a640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f995014e5e0 con 0x7f9950151820 2023-11-27T18:13:24.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.845+0000 7f995805a640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f995014ee20 con 0x7f99500c5f10 2023-11-27T18:13:24.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.845+0000 7f995805a640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99501f1370 con 0x7f99500c85c0 2023-11-27T18:13:24.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.845+0000 7f99565f7640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9950151820 0x7f99501eeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:24.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.845+0000 7f99565f7640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9950151820 0x7f99501eeaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:49010/0 (socket says 172.21.15.91:49010) 2023-11-27T18:13:24.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.845+0000 7f99565f7640 1 -- 172.21.15.91:0/1874076366 learned_addr learned my addr 172.21.15.91:0/1874076366 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:24.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.845+0000 7f99555f5640 1 --2- 172.21.15.91:0/1874076366 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f99500c85c0 0x7f99501ee560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:24.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.849+0000 7f9955df6640 1 --2- 172.21.15.91:0/1874076366 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99500c5f10 0x7f99501f08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:24.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.849+0000 7f99565f7640 1 -- 172.21.15.91:0/1874076366 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f99500c85c0 msgr2=0x7f99501ee560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:24.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.849+0000 7f99565f7640 1 --2- 172.21.15.91:0/1874076366 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f99500c85c0 0x7f99501ee560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:24.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.849+0000 7f99565f7640 1 -- 172.21.15.91:0/1874076366 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99500c5f10 msgr2=0x7f99501f08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:24.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.849+0000 7f99565f7640 1 --2- 172.21.15.91:0/1874076366 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99500c5f10 0x7f99501f08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:24.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.849+0000 7f99565f7640 1 -- 172.21.15.91:0/1874076366 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9940009b30 con 0x7f9950151820 2023-11-27T18:13:24.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.853+0000 7f99565f7640 1 --2- 172.21.15.91:0/1874076366 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9950151820 0x7f99501eeaa0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f994800c400 tx=0x7f994800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:24.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.857+0000 7f994e7fc640 1 -- 172.21.15.91:0/1874076366 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99480052d0 con 0x7f9950151820 2023-11-27T18:13:24.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.857+0000 7f994e7fc640 1 -- 172.21.15.91:0/1874076366 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9948005430 con 0x7f9950151820 2023-11-27T18:13:24.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.857+0000 7f994e7fc640 1 -- 172.21.15.91:0/1874076366 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9948003800 con 0x7f9950151820 2023-11-27T18:13:24.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.857+0000 7f995805a640 1 -- 172.21.15.91:0/1874076366 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f995014e7d0 con 0x7f9950151820 2023-11-27T18:13:24.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.857+0000 7f995805a640 1 -- 172.21.15.91:0/1874076366 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99501500a0 con 0x7f9950151820 2023-11-27T18:13:24.855 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.857+0000 7f995805a640 1 -- 172.21.15.91:0/1874076366 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9950067150 con 0x7f9950151820 2023-11-27T18:13:24.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.877+0000 7f994e7fc640 1 -- 172.21.15.91:0/1874076366 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f9948003960 con 0x7f9950151820 2023-11-27T18:13:24.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.877+0000 7f994e7fc640 1 --2- 172.21.15.91:0/1874076366 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f993c0667f0 0x7f993c068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:24.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.877+0000 7f9955df6640 1 --2- 172.21.15.91:0/1874076366 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f993c0667f0 0x7f993c068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:24.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.877+0000 7f9955df6640 1 --2- 172.21.15.91:0/1874076366 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f993c0667f0 0x7f993c068cb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f99400b1000 tx=0x7f99400aa000 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:24.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:24.881+0000 7f994e7fc640 1 -- 172.21.15.91:0/1874076366 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9948054da0 con 0x7f9950151820 2023-11-27T18:13:25.147 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.149+0000 7f994e7fc640 1 -- 172.21.15.91:0/1874076366 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f99480510e0 con 0x7f9950151820 2023-11-27T18:13:25.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.321+0000 7f995805a640 1 -- 172.21.15.91:0/1874076366 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f995014ef60 con 0x7f9950151820 2023-11-27T18:13:25.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.393+0000 7f994e7fc640 1 -- 172.21.15.91:0/1874076366 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f9948017090 con 0x7f9950151820 2023-11-27T18:13:25.391 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:13:25.391 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":30,"fsid":"08c8ebbf-7936-4c41-a995-d5600de2d072","created":"2023-11-27T18:12:06.484593+0000","modified":"2023-11-27T18:13:22.801287+0000","last_up_change":"2023-11-27T18:12:33.154694+0000","last_in_change":"2023-11-27T18:12:23.622113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T18:12:35.450305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T18:13:09.589619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T18:13:11.439236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-27T18:13:18.514694+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ad53c08-dd19-4ae6-87c5-fa15bea3b4ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6811","nonce":472303992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6813","nonce":472303992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6817","nonce":472303992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6815","nonce":472303992}]},"public_addr":"172.21.15.91:6811/472303992","cluster_addr":"172.21.15.91:6813/472303992","heartbeat_back_addr":"172.21.15.91:6817/472303992","heartbeat_front_addr":"172.21.15.91:6815/472303992","state":["exists","up"]},{"osd":1,"uuid":"f8b5f147-ed29-4329-a787-a12cc34a2569","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6827","nonce":12316911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6829","nonce":12316911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6833","nonce":12316911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6831","nonce":12316911}]},"public_addr":"172.21.15.91:6827/12316911","cluster_addr":"172.21.15.91:6829/12316911","heartbeat_back_addr":"172.21.15.91:6833/12316911","heartbeat_front_addr":"172.21.15.91:6831/12316911","state":["exists","up"]},{"osd":2,"uuid":"c3029f9a-1c48-4f5d-983a-172a614d8795","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6803","nonce":3776125919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6805","nonce":3776125919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6809","nonce":3776125919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6807","nonce":3776125919}]},"public_addr":"172.21.15.91:6803/3776125919","cluster_addr":"172.21.15.91:6805/3776125919","heartbeat_back_addr":"172.21.15.91:6809/3776125919","heartbeat_front_addr":"172.21.15.91:6807/3776125919","state":["exists","up"]},{"osd":3,"uuid":"ab4b6fb2-0126-491b-9224-54a6badc5da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6819","nonce":1297704794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6821","nonce":1297704794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6825","nonce":1297704794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6823","nonce":1297704794}]},"public_addr":"172.21.15.91:6819/1297704794","cluster_addr":"172.21.15.91:6821/1297704794","heartbeat_back_addr":"172.21.15.91:6825/1297704794","heartbeat_front_addr":"172.21.15.91:6823/1297704794","state":["exists","up"]},{"osd":4,"uuid":"695071a8-2de8-4cba-bf20-050021a03bb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6809","nonce":2501531833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6811","nonce":2501531833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6815","nonce":2501531833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6813","nonce":2501531833}]},"public_addr":"172.21.15.94:6809/2501531833","cluster_addr":"172.21.15.94:6811/2501531833","heartbeat_back_addr":"172.21.15.94:6815/2501531833","heartbeat_front_addr":"172.21.15.94:6813/2501531833","state":["exists","up"]},{"osd":5,"uuid":"ca01da14-a700-4845-8db2-f5e3370677e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6817","nonce":2448969592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6819","nonce":2448969592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6823","nonce":2448969592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6821","nonce":2448969592}]},"public_addr":"172.21.15.94:6817/2448969592","cluster_addr":"172.21.15.94:6819/2448969592","heartbeat_back_addr":"172.21.15.94:6823/2448969592","heartbeat_front_addr":"172.21.15.94:6821/2448969592","state":["exists","up"]},{"osd":6,"uuid":"4784bc77-6c33-4e47-abba-d37484982f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6825","nonce":3389553935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6827","nonce":3389553935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6831","nonce":3389553935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6829","nonce":3389553935}]},"public_addr":"172.21.15.94:6825/3389553935","cluster_addr":"172.21.15.94:6827/3389553935","heartbeat_back_addr":"172.21.15.94:6831/3389553935","heartbeat_front_addr":"172.21.15.94:6829/3389553935","state":["exists","up"]},{"osd":7,"uuid":"b954cf3f-4a4f-4a75-9f90-014f72c16d15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6801","nonce":1606498064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6803","nonce":1606498064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6807","nonce":1606498064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6805","nonce":1606498064}]},"public_addr":"172.21.15.94:6801/1606498064","cluster_addr":"172.21.15.94:6803/1606498064","heartbeat_back_addr":"172.21.15.94:6807/1606498064","heartbeat_front_addr":"172.21.15.94:6805/1606498064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.534968+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.506182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.339267+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.532432+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:28.935756+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.471559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.485014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.352978+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T18:13:25.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.397+0000 7f995805a640 1 -- 172.21.15.91:0/1874076366 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f993c0667f0 msgr2=0x7f993c068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:25.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.397+0000 7f995805a640 1 --2- 172.21.15.91:0/1874076366 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f993c0667f0 0x7f993c068cb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f99400b1000 tx=0x7f99400aa000 comp rx=0 tx=0).stop 2023-11-27T18:13:25.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.397+0000 7f995805a640 1 -- 172.21.15.91:0/1874076366 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9950151820 msgr2=0x7f99501eeaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:25.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.397+0000 7f995805a640 1 --2- 172.21.15.91:0/1874076366 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9950151820 0x7f99501eeaa0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f994800c400 tx=0x7f994800c8c0 comp rx=0 tx=0).stop 2023-11-27T18:13:25.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.397+0000 7f995805a640 1 -- 172.21.15.91:0/1874076366 shutdown_connections 2023-11-27T18:13:25.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.397+0000 7f995805a640 1 --2- 172.21.15.91:0/1874076366 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f993c0667f0 0x7f993c068cb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:25.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.397+0000 7f995805a640 1 --2- 172.21.15.91:0/1874076366 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f99500c85c0 0x7f99501ee560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:25.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.397+0000 7f995805a640 1 --2- 172.21.15.91:0/1874076366 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9950151820 0x7f99501eeaa0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:25.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.397+0000 7f995805a640 1 --2- 172.21.15.91:0/1874076366 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99500c5f10 0x7f99501f08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:25.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.397+0000 7f995805a640 1 -- 172.21.15.91:0/1874076366 >> 172.21.15.91:0/1874076366 conn(0x7f99500c79b0 msgr2=0x7f99500c9b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:25.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.397+0000 7f995805a640 1 -- 172.21.15.91:0/1874076366 shutdown_connections 2023-11-27T18:13:25.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.397+0000 7f995805a640 1 -- 172.21.15.91:0/1874076366 wait complete. 2023-11-27T18:13:25.411 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T18:13:25.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.533+0000 7fa80673b640 1 Processor -- start 2023-11-27T18:13:25.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.533+0000 7fa80673b640 1 -- start start 2023-11-27T18:13:25.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.537+0000 7fa80673b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa8000710d0 0x7fa8000c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:25.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.537+0000 7fa80673b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa800153aa0 0x7fa8000c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:25.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.537+0000 7fa80673b640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8000cd860 con 0x7fa800070cf0 2023-11-27T18:13:25.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.537+0000 7fa80673b640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa80006b6a0 con 0x7fa8000710d0 2023-11-27T18:13:25.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.537+0000 7fa80673b640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8000cd650 con 0x7fa800153aa0 2023-11-27T18:13:25.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.537+0000 7fa804cd8640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa800153aa0 0x7fa8000c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:25.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.537+0000 7fa7fffff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fa800070cf0 0x7fa800153390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.91:41398/0 (socket says 172.21.15.91:41398) 2023-11-27T18:13:25.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.537+0000 7fa7fffff640 1 -- 172.21.15.91:0/1345313952 learned_addr learned my addr 172.21.15.91:0/1345313952 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:13:25.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.545+0000 7fa804cd8640 1 -- 172.21.15.91:0/1345313952 >> v2:172.21.15.91:3300/0 conn(0x7fa8000710d0 msgr2=0x7fa8000c7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:25.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.545+0000 7fa804cd8640 1 --2- 172.21.15.91:0/1345313952 >> v2:172.21.15.91:3300/0 conn(0x7fa8000710d0 0x7fa8000c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:25.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.545+0000 7fa804cd8640 1 -- 172.21.15.91:0/1345313952 >> v1:172.21.15.94:6789/0 conn(0x7fa800070cf0 legacy=0x7fa800153390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:25.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.545+0000 7fa804cd8640 1 -- 172.21.15.91:0/1345313952 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8000cdb40 con 0x7fa800153aa0 2023-11-27T18:13:25.554 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.557+0000 7fa804cd8640 1 --2- 172.21.15.91:0/1345313952 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa800153aa0 0x7fa8000c87d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa8000b2250 tx=0x7fa7f801c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbcf3293d0ca2f36 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:25.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.569+0000 7fa7feffd640 1 -- 172.21.15.91:0/1345313952 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f80ab5f0 con 0x7fa800153aa0 2023-11-27T18:13:25.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.569+0000 7fa7feffd640 1 -- 172.21.15.91:0/1345313952 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f80ab750 con 0x7fa800153aa0 2023-11-27T18:13:25.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.569+0000 7fa7feffd640 1 -- 172.21.15.91:0/1345313952 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f80abae0 con 0x7fa800153aa0 2023-11-27T18:13:25.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.569+0000 7fa80673b640 1 -- 172.21.15.91:0/1345313952 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa800153aa0 msgr2=0x7fa8000c87d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:25.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.569+0000 7fa80673b640 1 --2- 172.21.15.91:0/1345313952 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa800153aa0 0x7fa8000c87d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa8000b2250 tx=0x7fa7f801c3f0 comp rx=0 tx=0).stop 2023-11-27T18:13:25.566 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.569+0000 7fa80673b640 1 -- 172.21.15.91:0/1345313952 shutdown_connections 2023-11-27T18:13:25.566 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.569+0000 7fa80673b640 1 --2- 172.21.15.91:0/1345313952 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa800153aa0 0x7fa8000c87d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:25.566 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.569+0000 7fa80673b640 1 --2- 172.21.15.91:0/1345313952 >> v2:172.21.15.91:3300/0 conn(0x7fa8000710d0 0x7fa8000c7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:25.566 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.569+0000 7fa80673b640 1 -- 172.21.15.91:0/1345313952 >> 172.21.15.91:0/1345313952 conn(0x7fa8000669c0 msgr2=0x7fa80006ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:25.566 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.569+0000 7fa80673b640 1 -- 172.21.15.91:0/1345313952 shutdown_connections 2023-11-27T18:13:25.566 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.569+0000 7fa80673b640 1 -- 172.21.15.91:0/1345313952 wait complete. 2023-11-27T18:13:25.567 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.569+0000 7fa80673b640 1 Processor -- start 2023-11-27T18:13:25.567 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.569+0000 7fa80673b640 1 -- start start 2023-11-27T18:13:25.567 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.569+0000 7fa80673b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa800070cf0 0x7fa800153f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:25.567 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.569+0000 7fa80673b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8000710d0 0x7fa80014f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:25.568 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.569+0000 7fa80673b640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa800153aa0 0x7fa8001f2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:25.568 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.569+0000 7fa80673b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa800155f40 con 0x7fa800070cf0 2023-11-27T18:13:25.568 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.569+0000 7fa80673b640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa80014e7e0 con 0x7fa8000710d0 2023-11-27T18:13:25.568 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.569+0000 7fa80673b640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa80014dcf0 con 0x7fa800153aa0 2023-11-27T18:13:25.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.573+0000 7fa804cd8640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa800153aa0 0x7fa8001f2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:25.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.573+0000 7fa7ff7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8000710d0 0x7fa80014f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:25.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.573+0000 7fa7ff7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8000710d0 0x7fa80014f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.91:40250/0 (socket says 172.21.15.91:40250) 2023-11-27T18:13:25.571 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.573+0000 7fa7ff7fe640 1 -- 172.21.15.91:0/3957329012 learned_addr learned my addr 172.21.15.91:0/3957329012 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:25.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.581+0000 7fa7ff7fe640 1 -- 172.21.15.91:0/3957329012 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa800153aa0 msgr2=0x7fa8001f2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:25.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.581+0000 7fa7ff7fe640 1 --2- 172.21.15.91:0/3957329012 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa800153aa0 0x7fa8001f2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:25.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.581+0000 7fa7ff7fe640 1 -- 172.21.15.91:0/3957329012 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa800070cf0 msgr2=0x7fa800153f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:25.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.581+0000 7fa7ff7fe640 1 --2- 172.21.15.91:0/3957329012 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa800070cf0 0x7fa800153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:25.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.581+0000 7fa7ff7fe640 1 -- 172.21.15.91:0/3957329012 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f8009420 con 0x7fa8000710d0 2023-11-27T18:13:25.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.589+0000 7fa7ff7fe640 1 --2- 172.21.15.91:0/3957329012 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8000710d0 0x7fa80014f120 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa7e800ba80 tx=0x7fa7e800bf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:25.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.609+0000 7fa7fcff9640 1 -- 172.21.15.91:0/3957329012 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e800cc00 con 0x7fa8000710d0 2023-11-27T18:13:25.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.609+0000 7fa7fcff9640 1 -- 172.21.15.91:0/3957329012 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e800cd80 con 0x7fa8000710d0 2023-11-27T18:13:25.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.609+0000 7fa7fcff9640 1 -- 172.21.15.91:0/3957329012 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e8014680 con 0x7fa8000710d0 2023-11-27T18:13:25.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.609+0000 7fa80673b640 1 -- 172.21.15.91:0/3957329012 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa80014df40 con 0x7fa8000710d0 2023-11-27T18:13:25.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.609+0000 7fa80673b640 1 -- 172.21.15.91:0/3957329012 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa80014e500 con 0x7fa8000710d0 2023-11-27T18:13:25.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:25.609+0000 7fa80673b640 1 -- 172.21.15.91:0/3957329012 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8000b2180 con 0x7fa8000710d0 2023-11-27T18:13:26.021 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.025+0000 7fa7fcff9640 1 -- 172.21.15.91:0/3957329012 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fa7e801d3b0 con 0x7fa8000710d0 2023-11-27T18:13:26.021 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.025+0000 7fa7fcff9640 1 --2- 172.21.15.91:0/3957329012 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa7e0066840 0x7fa7e0068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:26.022 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.025+0000 7fa7fffff640 1 --2- 172.21.15.91:0/3957329012 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa7e0066840 0x7fa7e0068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:26.023 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.025+0000 7fa7fffff640 1 --2- 172.21.15.91:0/3957329012 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa7e0066840 0x7fa7e0068d00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0004fa0 tx=0x7fa7f0007ab0 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:26.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.033+0000 7fa7fcff9640 1 -- 172.21.15.91:0/3957329012 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa7e80554a0 con 0x7fa8000710d0 2023-11-27T18:13:26.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.061+0000 7fa7fcff9640 1 -- 172.21.15.91:0/3957329012 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fa7e80517e0 con 0x7fa8000710d0 2023-11-27T18:13:26.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.229+0000 7fa80673b640 1 -- 172.21.15.91:0/3957329012 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa80004e930 con 0x7fa8000710d0 2023-11-27T18:13:26.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.377+0000 7fa7fcff9640 1 -- 172.21.15.91:0/3957329012 <== mon.1 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+18279 (secure 0 0 0) 0x7fa7e8019020 con 0x7fa8000710d0 2023-11-27T18:13:26.373 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:13:26.373 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":30,"fsid":"08c8ebbf-7936-4c41-a995-d5600de2d072","created":"2023-11-27T18:12:06.484593+0000","modified":"2023-11-27T18:13:22.801287+0000","last_up_change":"2023-11-27T18:12:33.154694+0000","last_in_change":"2023-11-27T18:12:23.622113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T18:12:35.450305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T18:13:09.589619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T18:13:11.439236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-27T18:13:18.514694+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ad53c08-dd19-4ae6-87c5-fa15bea3b4ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6811","nonce":472303992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6813","nonce":472303992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6817","nonce":472303992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6815","nonce":472303992}]},"public_addr":"172.21.15.91:6811/472303992","cluster_addr":"172.21.15.91:6813/472303992","heartbeat_back_addr":"172.21.15.91:6817/472303992","heartbeat_front_addr":"172.21.15.91:6815/472303992","state":["exists","up"]},{"osd":1,"uuid":"f8b5f147-ed29-4329-a787-a12cc34a2569","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6827","nonce":12316911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6829","nonce":12316911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6833","nonce":12316911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6831","nonce":12316911}]},"public_addr":"172.21.15.91:6827/12316911","cluster_addr":"172.21.15.91:6829/12316911","heartbeat_back_addr":"172.21.15.91:6833/12316911","heartbeat_front_addr":"172.21.15.91:6831/12316911","state":["exists","up"]},{"osd":2,"uuid":"c3029f9a-1c48-4f5d-983a-172a614d8795","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6803","nonce":3776125919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6805","nonce":3776125919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6809","nonce":3776125919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6807","nonce":3776125919}]},"public_addr":"172.21.15.91:6803/3776125919","cluster_addr":"172.21.15.91:6805/3776125919","heartbeat_back_addr":"172.21.15.91:6809/3776125919","heartbeat_front_addr":"172.21.15.91:6807/3776125919","state":["exists","up"]},{"osd":3,"uuid":"ab4b6fb2-0126-491b-9224-54a6badc5da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6819","nonce":1297704794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6821","nonce":1297704794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6825","nonce":1297704794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6823","nonce":1297704794}]},"public_addr":"172.21.15.91:6819/1297704794","cluster_addr":"172.21.15.91:6821/1297704794","heartbeat_back_addr":"172.21.15.91:6825/1297704794","heartbeat_front_addr":"172.21.15.91:6823/1297704794","state":["exists","up"]},{"osd":4,"uuid":"695071a8-2de8-4cba-bf20-050021a03bb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6809","nonce":2501531833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6811","nonce":2501531833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6815","nonce":2501531833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6813","nonce":2501531833}]},"public_addr":"172.21.15.94:6809/2501531833","cluster_addr":"172.21.15.94:6811/2501531833","heartbeat_back_addr":"172.21.15.94:6815/2501531833","heartbeat_front_addr":"172.21.15.94:6813/2501531833","state":["exists","up"]},{"osd":5,"uuid":"ca01da14-a700-4845-8db2-f5e3370677e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6817","nonce":2448969592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6819","nonce":2448969592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6823","nonce":2448969592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6821","nonce":2448969592}]},"public_addr":"172.21.15.94:6817/2448969592","cluster_addr":"172.21.15.94:6819/2448969592","heartbeat_back_addr":"172.21.15.94:6823/2448969592","heartbeat_front_addr":"172.21.15.94:6821/2448969592","state":["exists","up"]},{"osd":6,"uuid":"4784bc77-6c33-4e47-abba-d37484982f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6825","nonce":3389553935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6827","nonce":3389553935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6831","nonce":3389553935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6829","nonce":3389553935}]},"public_addr":"172.21.15.94:6825/3389553935","cluster_addr":"172.21.15.94:6827/3389553935","heartbeat_back_addr":"172.21.15.94:6831/3389553935","heartbeat_front_addr":"172.21.15.94:6829/3389553935","state":["exists","up"]},{"osd":7,"uuid":"b954cf3f-4a4f-4a75-9f90-014f72c16d15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6801","nonce":1606498064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6803","nonce":1606498064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6807","nonce":1606498064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6805","nonce":1606498064}]},"public_addr":"172.21.15.94:6801/1606498064","cluster_addr":"172.21.15.94:6803/1606498064","heartbeat_back_addr":"172.21.15.94:6807/1606498064","heartbeat_front_addr":"172.21.15.94:6805/1606498064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.534968+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.506182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.339267+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.532432+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:28.935756+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.471559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.485014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.352978+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T18:13:26.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.381+0000 7fa80673b640 1 -- 172.21.15.91:0/3957329012 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa7e0066840 msgr2=0x7fa7e0068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:26.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.381+0000 7fa80673b640 1 --2- 172.21.15.91:0/3957329012 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa7e0066840 0x7fa7e0068d00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0004fa0 tx=0x7fa7f0007ab0 comp rx=0 tx=0).stop 2023-11-27T18:13:26.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.381+0000 7fa80673b640 1 -- 172.21.15.91:0/3957329012 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8000710d0 msgr2=0x7fa80014f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:26.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.381+0000 7fa80673b640 1 --2- 172.21.15.91:0/3957329012 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8000710d0 0x7fa80014f120 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa7e800ba80 tx=0x7fa7e800bf40 comp rx=0 tx=0).stop 2023-11-27T18:13:26.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.381+0000 7fa80673b640 1 -- 172.21.15.91:0/3957329012 shutdown_connections 2023-11-27T18:13:26.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.381+0000 7fa80673b640 1 --2- 172.21.15.91:0/3957329012 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa7e0066840 0x7fa7e0068d00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:26.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.381+0000 7fa80673b640 1 --2- 172.21.15.91:0/3957329012 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa800153aa0 0x7fa8001f2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:26.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.381+0000 7fa80673b640 1 --2- 172.21.15.91:0/3957329012 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8000710d0 0x7fa80014f120 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:26.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.381+0000 7fa80673b640 1 --2- 172.21.15.91:0/3957329012 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa800070cf0 0x7fa800153f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:26.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.381+0000 7fa80673b640 1 -- 172.21.15.91:0/3957329012 >> 172.21.15.91:0/3957329012 conn(0x7fa8000669c0 msgr2=0x7fa8000cb440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:26.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.381+0000 7fa80673b640 1 -- 172.21.15.91:0/3957329012 shutdown_connections 2023-11-27T18:13:26.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.381+0000 7fa80673b640 1 -- 172.21.15.91:0/3957329012 wait complete. 2023-11-27T18:13:26.416 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T18:13:26.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.545+0000 7f42f4bd9640 1 Processor -- start 2023-11-27T18:13:26.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.545+0000 7f42f4bd9640 1 -- start start 2023-11-27T18:13:26.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.549+0000 7f42f4bd9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f42f01514c0 0x7f42f00c4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:26.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.549+0000 7f42f4bd9640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42f01518a0 con 0x7f42f0157ff0 2023-11-27T18:13:26.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.549+0000 7f42f4bd9640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42f006b750 con 0x7f42f00c68b0 2023-11-27T18:13:26.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.549+0000 7f42f4bd9640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42f00c7b70 con 0x7f42f01514c0 2023-11-27T18:13:26.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.549+0000 7f42ee59c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f42f01514c0 0x7f42f00c4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:26.547 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.549+0000 7f42ee59c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f42f01514c0 0x7f42f00c4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44298/0 (socket says 172.21.15.91:44298) 2023-11-27T18:13:26.547 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.549+0000 7f42ee59c640 1 -- 172.21.15.91:0/4263341373 learned_addr learned my addr 172.21.15.91:0/4263341373 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:26.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.553+0000 7f42ee59c640 1 -- 172.21.15.91:0/4263341373 >> v1:172.21.15.94:6789/0 conn(0x7f42f00c68b0 legacy=0x7f42f01578e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:26.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.553+0000 7f42ee59c640 1 -- 172.21.15.91:0/4263341373 >> v1:172.21.15.91:6789/0 conn(0x7f42f0157ff0 legacy=0x7f42f0161d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:26.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.553+0000 7f42ee59c640 1 -- 172.21.15.91:0/4263341373 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f01573e0 con 0x7f42f01514c0 2023-11-27T18:13:26.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.557+0000 7f42ee59c640 1 --2- 172.21.15.91:0/4263341373 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f42f01514c0 0x7f42f00c4bb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f42e0009870 tx=0x7f42e001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aed5362a245be6aa server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:26.558 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.561+0000 7f42ed59a640 1 -- 172.21.15.91:0/4263341373 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e00a89f0 con 0x7f42f01514c0 2023-11-27T18:13:26.559 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.561+0000 7f42ed59a640 1 -- 172.21.15.91:0/4263341373 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e00a8b50 con 0x7f42f01514c0 2023-11-27T18:13:26.559 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.561+0000 7f42ed59a640 1 -- 172.21.15.91:0/4263341373 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e00b0440 con 0x7f42f01514c0 2023-11-27T18:13:26.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.561+0000 7f42f4bd9640 1 -- 172.21.15.91:0/4263341373 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f42f01514c0 msgr2=0x7f42f00c4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:26.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.561+0000 7f42f4bd9640 1 --2- 172.21.15.91:0/4263341373 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f42f01514c0 0x7f42f00c4bb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f42e0009870 tx=0x7f42e001ecf0 comp rx=0 tx=0).stop 2023-11-27T18:13:26.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.561+0000 7f42f4bd9640 1 -- 172.21.15.91:0/4263341373 shutdown_connections 2023-11-27T18:13:26.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.561+0000 7f42f4bd9640 1 --2- 172.21.15.91:0/4263341373 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f42f01514c0 0x7f42f00c4bb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:26.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.561+0000 7f42f4bd9640 1 -- 172.21.15.91:0/4263341373 >> 172.21.15.91:0/4263341373 conn(0x7f42f00c7fa0 msgr2=0x7f42f00c83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:26.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.561+0000 7f42f4bd9640 1 -- 172.21.15.91:0/4263341373 shutdown_connections 2023-11-27T18:13:26.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.561+0000 7f42f4bd9640 1 -- 172.21.15.91:0/4263341373 wait complete. 2023-11-27T18:13:26.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.565+0000 7f42f4bd9640 1 Processor -- start 2023-11-27T18:13:26.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.565+0000 7f42f4bd9640 1 -- start start 2023-11-27T18:13:26.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.565+0000 7f42f4bd9640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f42f00c68b0 0x7f42f0141380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:26.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.565+0000 7f42f4bd9640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f42f01514c0 0x7f42f013e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:26.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.565+0000 7f42f4bd9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f42f0157ff0 0x7f42f01ed0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:26.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.565+0000 7f42f4bd9640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f0140510 con 0x7f42f00c68b0 2023-11-27T18:13:26.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.565+0000 7f42f4bd9640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f01f15a0 con 0x7f42f0157ff0 2023-11-27T18:13:26.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.565+0000 7f42f4bd9640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42f0141be0 con 0x7f42f01514c0 2023-11-27T18:13:26.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.565+0000 7f42ee59c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f42f00c68b0 0x7f42f0141380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:26.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.565+0000 7f42ee59c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f42f00c68b0 0x7f42f0141380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44306/0 (socket says 172.21.15.91:44306) 2023-11-27T18:13:26.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.565+0000 7f42ee59c640 1 -- 172.21.15.91:0/1087194453 learned_addr learned my addr 172.21.15.91:0/1087194453 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:26.566 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.569+0000 7f42ee59c640 1 -- 172.21.15.91:0/1087194453 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f42f01514c0 msgr2=0x7f42f013e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:26.567 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.569+0000 7f42ee59c640 1 --2- 172.21.15.91:0/1087194453 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f42f01514c0 0x7f42f013e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:26.567 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.569+0000 7f42ee59c640 1 -- 172.21.15.91:0/1087194453 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f42f0157ff0 msgr2=0x7f42f01ed0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:26.567 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.569+0000 7f42ee59c640 1 --2- 172.21.15.91:0/1087194453 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f42f0157ff0 0x7f42f01ed0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:26.567 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.569+0000 7f42ee59c640 1 -- 172.21.15.91:0/1087194453 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e00094d0 con 0x7f42f00c68b0 2023-11-27T18:13:26.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.573+0000 7f42ee59c640 1 --2- 172.21.15.91:0/1087194453 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f42f00c68b0 0x7f42f0141380 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f42e001b900 tx=0x7f42e001ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:26.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.577+0000 7f42deffd640 1 -- 172.21.15.91:0/1087194453 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e00b1db0 con 0x7f42f00c68b0 2023-11-27T18:13:26.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.577+0000 7f42deffd640 1 -- 172.21.15.91:0/1087194453 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e00bb470 con 0x7f42f00c68b0 2023-11-27T18:13:26.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.577+0000 7f42deffd640 1 -- 172.21.15.91:0/1087194453 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e00bb820 con 0x7f42f00c68b0 2023-11-27T18:13:26.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.577+0000 7f42f4bd9640 1 -- 172.21.15.91:0/1087194453 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42f01f07e0 con 0x7f42f00c68b0 2023-11-27T18:13:26.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.577+0000 7f42f4bd9640 1 -- 172.21.15.91:0/1087194453 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42f01f0da0 con 0x7f42f00c68b0 2023-11-27T18:13:26.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.577+0000 7f42f4bd9640 1 -- 172.21.15.91:0/1087194453 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42f0067810 con 0x7f42f00c68b0 2023-11-27T18:13:26.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.597+0000 7f42deffd640 1 -- 172.21.15.91:0/1087194453 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f42e00b7070 con 0x7f42f00c68b0 2023-11-27T18:13:26.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.597+0000 7f42deffd640 1 --2- 172.21.15.91:0/1087194453 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f42d0066820 0x7f42d0068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:26.595 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.597+0000 7f42edd9b640 1 --2- 172.21.15.91:0/1087194453 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f42d0066820 0x7f42d0068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:26.595 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.597+0000 7f42edd9b640 1 --2- 172.21.15.91:0/1087194453 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f42d0066820 0x7f42d0068ce0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f42f006b110 tx=0x7f42e4006bb0 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:26.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.925+0000 7f42deffd640 1 -- 172.21.15.91:0/1087194453 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f42e00f4450 con 0x7f42f00c68b0 2023-11-27T18:13:26.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:26.925+0000 7f42deffd640 1 -- 172.21.15.91:0/1087194453 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f42e00f0090 con 0x7f42f00c68b0 2023-11-27T18:13:27.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.121+0000 7f42f4bd9640 1 -- 172.21.15.91:0/1087194453 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42f0067810 con 0x7f42f00c68b0 2023-11-27T18:13:27.307 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.309+0000 7f42deffd640 1 -- 172.21.15.91:0/1087194453 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+6490 (secure 0 0 0) 0x7f42e00b5020 con 0x7f42f00c68b0 2023-11-27T18:13:27.308 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:13:27.308 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1156758494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1156758494},{"type":"v1","addr":"172.21.15.91:6835","nonce":1156758494}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4227,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/2636117364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2636117364},{"type":"v1","addr":"172.21.15.91:6837","nonce":2636117364}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6839/1813662020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6838","nonce":1813662020},{"type":"v1","addr":"172.21.15.91:6839","nonce":1813662020}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4243,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3605337236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3605337236},{"type":"v1","addr":"172.21.15.94:6833","nonce":3605337236}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4246,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/1691562292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1691562292},{"type":"v1","addr":"172.21.15.94:6835","nonce":1691562292}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T18:13:13.083833+0000","modified":"2023-11-27T18:13:22.804929+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":10,"addr":"172.21.15.94:6837/3938864244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":3938864244},{"type":"v1","addr":"172.21.15.94:6837","nonce":3938864244}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-11-27T18:13:27.308 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 6 2023-11-27T18:13:27.310 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.313+0000 7f42f4bd9640 1 -- 172.21.15.91:0/1087194453 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f42d0066820 msgr2=0x7f42d0068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:27.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.313+0000 7f42f4bd9640 1 --2- 172.21.15.91:0/1087194453 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f42d0066820 0x7f42d0068ce0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f42f006b110 tx=0x7f42e4006bb0 comp rx=0 tx=0).stop 2023-11-27T18:13:27.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.313+0000 7f42f4bd9640 1 -- 172.21.15.91:0/1087194453 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f42f00c68b0 msgr2=0x7f42f0141380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:27.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.313+0000 7f42f4bd9640 1 --2- 172.21.15.91:0/1087194453 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f42f00c68b0 0x7f42f0141380 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f42e001b900 tx=0x7f42e001ba90 comp rx=0 tx=0).stop 2023-11-27T18:13:27.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.313+0000 7f42f4bd9640 1 -- 172.21.15.91:0/1087194453 shutdown_connections 2023-11-27T18:13:27.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.313+0000 7f42f4bd9640 1 --2- 172.21.15.91:0/1087194453 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f42d0066820 0x7f42d0068ce0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:27.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.313+0000 7f42f4bd9640 1 --2- 172.21.15.91:0/1087194453 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f42f01514c0 0x7f42f013e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:27.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.313+0000 7f42f4bd9640 1 --2- 172.21.15.91:0/1087194453 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f42f0157ff0 0x7f42f01ed0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:27.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.313+0000 7f42f4bd9640 1 --2- 172.21.15.91:0/1087194453 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f42f00c68b0 0x7f42f0141380 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:27.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.313+0000 7f42f4bd9640 1 -- 172.21.15.91:0/1087194453 >> 172.21.15.91:0/1087194453 conn(0x7f42f00c7fa0 msgr2=0x7f42f00c50f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:27.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.313+0000 7f42f4bd9640 1 -- 172.21.15.91:0/1087194453 shutdown_connections 2023-11-27T18:13:27.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.313+0000 7f42f4bd9640 1 -- 172.21.15.91:0/1087194453 wait complete. 2023-11-27T18:13:27.334 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T18:13:27.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.457+0000 7fb552c04640 1 Processor -- start 2023-11-27T18:13:27.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.457+0000 7fb552c04640 1 -- start start 2023-11-27T18:13:27.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.461+0000 7fb552c04640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb54c0c85c0 0x7fb54c06cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:27.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.461+0000 7fb552c04640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb54c0c5f10 0x7fb54c06d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:27.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.461+0000 7fb552c04640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb54c072b70 con 0x7fb54c151820 2023-11-27T18:13:27.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.461+0000 7fb552c04640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb54c0c2d20 con 0x7fb54c0c5f10 2023-11-27T18:13:27.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.461+0000 7fb552c04640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb54c0c6490 con 0x7fb54c0c85c0 2023-11-27T18:13:27.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.461+0000 7fb5511a1640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb54c0c5f10 0x7fb54c06d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:27.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.461+0000 7fb5511a1640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb54c0c5f10 0x7fb54c06d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44310/0 (socket says 172.21.15.91:44310) 2023-11-27T18:13:27.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.461+0000 7fb5511a1640 1 -- 172.21.15.91:0/447609071 learned_addr learned my addr 172.21.15.91:0/447609071 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:27.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.461+0000 7fb54bfff640 1 --2- 172.21.15.91:0/447609071 >> v2:172.21.15.94:3300/0 conn(0x7fb54c0c85c0 0x7fb54c06cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:27.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.465+0000 7fb5511a1640 1 -- 172.21.15.91:0/447609071 >> v2:172.21.15.94:3300/0 conn(0x7fb54c0c85c0 msgr2=0x7fb54c06cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:27.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.465+0000 7fb5511a1640 1 --2- 172.21.15.91:0/447609071 >> v2:172.21.15.94:3300/0 conn(0x7fb54c0c85c0 0x7fb54c06cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:27.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.465+0000 7fb5511a1640 1 -- 172.21.15.91:0/447609071 >> v1:172.21.15.91:6789/0 conn(0x7fb54c151820 legacy=0x7fb54c070e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:27.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.465+0000 7fb5511a1640 1 -- 172.21.15.91:0/447609071 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb54c158160 con 0x7fb54c0c5f10 2023-11-27T18:13:27.464 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.469+0000 7fb5511a1640 1 --2- 172.21.15.91:0/447609071 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb54c0c5f10 0x7fb54c06d0d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb54c06b3a0 tx=0x7fb54401f180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26a7d879904b6a92 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:27.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.473+0000 7fb54b7fe640 1 -- 172.21.15.91:0/447609071 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5440af400 con 0x7fb54c0c5f10 2023-11-27T18:13:27.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.473+0000 7fb54b7fe640 1 -- 172.21.15.91:0/447609071 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5440ab050 con 0x7fb54c0c5f10 2023-11-27T18:13:27.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.473+0000 7fb54b7fe640 1 -- 172.21.15.91:0/447609071 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5440af780 con 0x7fb54c0c5f10 2023-11-27T18:13:27.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.473+0000 7fb552c04640 1 -- 172.21.15.91:0/447609071 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb54c0c5f10 msgr2=0x7fb54c06d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:27.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.473+0000 7fb552c04640 1 --2- 172.21.15.91:0/447609071 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb54c0c5f10 0x7fb54c06d0d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb54c06b3a0 tx=0x7fb54401f180 comp rx=0 tx=0).stop 2023-11-27T18:13:27.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.473+0000 7fb552c04640 1 -- 172.21.15.91:0/447609071 shutdown_connections 2023-11-27T18:13:27.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.473+0000 7fb552c04640 1 --2- 172.21.15.91:0/447609071 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb54c0c5f10 0x7fb54c06d0d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:27.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.473+0000 7fb552c04640 1 --2- 172.21.15.91:0/447609071 >> v2:172.21.15.94:3300/0 conn(0x7fb54c0c85c0 0x7fb54c06cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:27.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.473+0000 7fb552c04640 1 -- 172.21.15.91:0/447609071 >> 172.21.15.91:0/447609071 conn(0x7fb54c0c79b0 msgr2=0x7fb54c0c7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:27.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.473+0000 7fb552c04640 1 -- 172.21.15.91:0/447609071 shutdown_connections 2023-11-27T18:13:27.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.473+0000 7fb552c04640 1 -- 172.21.15.91:0/447609071 wait complete. 2023-11-27T18:13:27.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.477+0000 7fb552c04640 1 Processor -- start 2023-11-27T18:13:27.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.477+0000 7fb552c04640 1 -- start start 2023-11-27T18:13:27.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.477+0000 7fb552c04640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb54c0c5f10 0x7fb54c14a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:27.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.477+0000 7fb552c04640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb54c0c85c0 0x7fb54c155350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:27.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.477+0000 7fb552c04640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb54c151820 0x7fb54c155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:27.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.477+0000 7fb552c04640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c1ecf00 con 0x7fb54c151820 2023-11-27T18:13:27.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.477+0000 7fb552c04640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c1ed110 con 0x7fb54c0c5f10 2023-11-27T18:13:27.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.477+0000 7fb552c04640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c1ed3f0 con 0x7fb54c0c85c0 2023-11-27T18:13:27.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.477+0000 7fb5511a1640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb54c151820 0x7fb54c155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:27.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.477+0000 7fb5511a1640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb54c151820 0x7fb54c155890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44320/0 (socket says 172.21.15.91:44320) 2023-11-27T18:13:27.476 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.477+0000 7fb5511a1640 1 -- 172.21.15.91:0/3719226928 learned_addr learned my addr 172.21.15.91:0/3719226928 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:27.476 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.477+0000 7fb5509a0640 1 --2- 172.21.15.91:0/3719226928 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb54c0c5f10 0x7fb54c14a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:27.476 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.477+0000 7fb54bfff640 1 --2- 172.21.15.91:0/3719226928 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb54c0c85c0 0x7fb54c155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:27.479 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.481+0000 7fb5511a1640 1 -- 172.21.15.91:0/3719226928 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb54c0c85c0 msgr2=0x7fb54c155350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:27.479 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.481+0000 7fb5511a1640 1 --2- 172.21.15.91:0/3719226928 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb54c0c85c0 0x7fb54c155350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:27.479 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.481+0000 7fb5511a1640 1 -- 172.21.15.91:0/3719226928 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb54c0c5f10 msgr2=0x7fb54c14a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:27.479 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.481+0000 7fb5511a1640 1 --2- 172.21.15.91:0/3719226928 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb54c0c5f10 0x7fb54c14a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:27.479 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.481+0000 7fb5511a1640 1 -- 172.21.15.91:0/3719226928 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb544009b30 con 0x7fb54c151820 2023-11-27T18:13:27.481 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.485+0000 7fb5511a1640 1 --2- 172.21.15.91:0/3719226928 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb54c151820 0x7fb54c155890 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb54401bd90 tx=0x7fb54401bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:27.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.489+0000 7fb5497fa640 1 -- 172.21.15.91:0/3719226928 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5440afcb0 con 0x7fb54c151820 2023-11-27T18:13:27.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.489+0000 7fb5497fa640 1 -- 172.21.15.91:0/3719226928 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5440afe30 con 0x7fb54c151820 2023-11-27T18:13:27.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.489+0000 7fb552c04640 1 -- 172.21.15.91:0/3719226928 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb54c1ed6d0 con 0x7fb54c151820 2023-11-27T18:13:27.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.489+0000 7fb5497fa640 1 -- 172.21.15.91:0/3719226928 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5440b9650 con 0x7fb54c151820 2023-11-27T18:13:27.487 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.489+0000 7fb552c04640 1 -- 172.21.15.91:0/3719226928 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb54c1edc90 con 0x7fb54c151820 2023-11-27T18:13:27.487 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.489+0000 7fb552c04640 1 -- 172.21.15.91:0/3719226928 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb54c067150 con 0x7fb54c151820 2023-11-27T18:13:27.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.769+0000 7fb5497fa640 1 -- 172.21.15.91:0/3719226928 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fb5440b6070 con 0x7fb54c151820 2023-11-27T18:13:27.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.769+0000 7fb5497fa640 1 --2- 172.21.15.91:0/3719226928 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fb538066820 0x7fb538068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:27.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.769+0000 7fb5509a0640 1 --2- 172.21.15.91:0/3719226928 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fb538066820 0x7fb538068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:27.769 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.773+0000 7fb5509a0640 1 --2- 172.21.15.91:0/3719226928 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fb538066820 0x7fb538068ce0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb53c0098e0 tx=0x7fb53c009060 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:27.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.805+0000 7fb5497fa640 1 -- 172.21.15.91:0/3719226928 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb5440f3b40 con 0x7fb54c151820 2023-11-27T18:13:27.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.805+0000 7fb5497fa640 1 -- 172.21.15.91:0/3719226928 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fb5440efe80 con 0x7fb54c151820 2023-11-27T18:13:27.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:27.977+0000 7fb552c04640 1 -- 172.21.15.91:0/3719226928 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb54c072950 con 0x7fb54c151820 2023-11-27T18:13:28.018 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.021+0000 7fb5497fa640 1 -- 172.21.15.91:0/3719226928 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+18279 (secure 0 0 0) 0x7fb5440b4070 con 0x7fb54c151820 2023-11-27T18:13:28.019 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:13:28.019 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":30,"fsid":"08c8ebbf-7936-4c41-a995-d5600de2d072","created":"2023-11-27T18:12:06.484593+0000","modified":"2023-11-27T18:13:22.801287+0000","last_up_change":"2023-11-27T18:12:33.154694+0000","last_in_change":"2023-11-27T18:12:23.622113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T18:12:35.450305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T18:13:09.589619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T18:13:11.439236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-27T18:13:18.514694+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ad53c08-dd19-4ae6-87c5-fa15bea3b4ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6811","nonce":472303992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6813","nonce":472303992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6817","nonce":472303992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6815","nonce":472303992}]},"public_addr":"172.21.15.91:6811/472303992","cluster_addr":"172.21.15.91:6813/472303992","heartbeat_back_addr":"172.21.15.91:6817/472303992","heartbeat_front_addr":"172.21.15.91:6815/472303992","state":["exists","up"]},{"osd":1,"uuid":"f8b5f147-ed29-4329-a787-a12cc34a2569","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6827","nonce":12316911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6829","nonce":12316911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6833","nonce":12316911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6831","nonce":12316911}]},"public_addr":"172.21.15.91:6827/12316911","cluster_addr":"172.21.15.91:6829/12316911","heartbeat_back_addr":"172.21.15.91:6833/12316911","heartbeat_front_addr":"172.21.15.91:6831/12316911","state":["exists","up"]},{"osd":2,"uuid":"c3029f9a-1c48-4f5d-983a-172a614d8795","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6803","nonce":3776125919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6805","nonce":3776125919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6809","nonce":3776125919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6807","nonce":3776125919}]},"public_addr":"172.21.15.91:6803/3776125919","cluster_addr":"172.21.15.91:6805/3776125919","heartbeat_back_addr":"172.21.15.91:6809/3776125919","heartbeat_front_addr":"172.21.15.91:6807/3776125919","state":["exists","up"]},{"osd":3,"uuid":"ab4b6fb2-0126-491b-9224-54a6badc5da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6819","nonce":1297704794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6821","nonce":1297704794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6825","nonce":1297704794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6823","nonce":1297704794}]},"public_addr":"172.21.15.91:6819/1297704794","cluster_addr":"172.21.15.91:6821/1297704794","heartbeat_back_addr":"172.21.15.91:6825/1297704794","heartbeat_front_addr":"172.21.15.91:6823/1297704794","state":["exists","up"]},{"osd":4,"uuid":"695071a8-2de8-4cba-bf20-050021a03bb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6809","nonce":2501531833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6811","nonce":2501531833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6815","nonce":2501531833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6813","nonce":2501531833}]},"public_addr":"172.21.15.94:6809/2501531833","cluster_addr":"172.21.15.94:6811/2501531833","heartbeat_back_addr":"172.21.15.94:6815/2501531833","heartbeat_front_addr":"172.21.15.94:6813/2501531833","state":["exists","up"]},{"osd":5,"uuid":"ca01da14-a700-4845-8db2-f5e3370677e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6817","nonce":2448969592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6819","nonce":2448969592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6823","nonce":2448969592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6821","nonce":2448969592}]},"public_addr":"172.21.15.94:6817/2448969592","cluster_addr":"172.21.15.94:6819/2448969592","heartbeat_back_addr":"172.21.15.94:6823/2448969592","heartbeat_front_addr":"172.21.15.94:6821/2448969592","state":["exists","up"]},{"osd":6,"uuid":"4784bc77-6c33-4e47-abba-d37484982f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6825","nonce":3389553935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6827","nonce":3389553935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6831","nonce":3389553935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6829","nonce":3389553935}]},"public_addr":"172.21.15.94:6825/3389553935","cluster_addr":"172.21.15.94:6827/3389553935","heartbeat_back_addr":"172.21.15.94:6831/3389553935","heartbeat_front_addr":"172.21.15.94:6829/3389553935","state":["exists","up"]},{"osd":7,"uuid":"b954cf3f-4a4f-4a75-9f90-014f72c16d15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6801","nonce":1606498064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6803","nonce":1606498064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6807","nonce":1606498064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6805","nonce":1606498064}]},"public_addr":"172.21.15.94:6801/1606498064","cluster_addr":"172.21.15.94:6803/1606498064","heartbeat_back_addr":"172.21.15.94:6807/1606498064","heartbeat_front_addr":"172.21.15.94:6805/1606498064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.534968+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.506182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.339267+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.532432+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:28.935756+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.471559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.485014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.352978+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T18:13:28.022 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.025+0000 7fb552c04640 1 -- 172.21.15.91:0/3719226928 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fb538066820 msgr2=0x7fb538068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:28.022 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.025+0000 7fb552c04640 1 --2- 172.21.15.91:0/3719226928 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fb538066820 0x7fb538068ce0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb53c0098e0 tx=0x7fb53c009060 comp rx=0 tx=0).stop 2023-11-27T18:13:28.022 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.025+0000 7fb552c04640 1 -- 172.21.15.91:0/3719226928 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb54c151820 msgr2=0x7fb54c155890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:28.022 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.025+0000 7fb552c04640 1 --2- 172.21.15.91:0/3719226928 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb54c151820 0x7fb54c155890 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb54401bd90 tx=0x7fb54401bf20 comp rx=0 tx=0).stop 2023-11-27T18:13:28.022 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.025+0000 7fb552c04640 1 -- 172.21.15.91:0/3719226928 shutdown_connections 2023-11-27T18:13:28.022 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.025+0000 7fb552c04640 1 --2- 172.21.15.91:0/3719226928 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fb538066820 0x7fb538068ce0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:28.022 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.025+0000 7fb552c04640 1 --2- 172.21.15.91:0/3719226928 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb54c0c85c0 0x7fb54c155350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:28.022 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.025+0000 7fb552c04640 1 --2- 172.21.15.91:0/3719226928 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb54c151820 0x7fb54c155890 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:28.022 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.025+0000 7fb552c04640 1 --2- 172.21.15.91:0/3719226928 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb54c0c5f10 0x7fb54c14a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:28.022 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.025+0000 7fb552c04640 1 -- 172.21.15.91:0/3719226928 >> 172.21.15.91:0/3719226928 conn(0x7fb54c0c79b0 msgr2=0x7fb54c14cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:28.023 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.025+0000 7fb552c04640 1 -- 172.21.15.91:0/3719226928 shutdown_connections 2023-11-27T18:13:28.023 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.025+0000 7fb552c04640 1 -- 172.21.15.91:0/3719226928 wait complete. 2023-11-27T18:13:28.644 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-27T18:13:13.083833+0000', 'modified': '2023-11-27T18:13:22.804929+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4255}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4255': {'gid': 4255, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.94:6837/3938864244', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.94:6836', 'nonce': 3938864244}, {'type': 'v1', 'addr': '172.21.15.94:6837', 'nonce': 3938864244}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-11-27T18:13:28.645 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-27T18:13:28.645 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-27T18:13:28.781 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.785+0000 7f847fd46640 1 Processor -- start 2023-11-27T18:13:28.781 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.785+0000 7f847fd46640 1 -- start start 2023-11-27T18:13:28.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.785+0000 7f847fd46640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f84780721f0 0x7f84780c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:28.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.785+0000 7f847fd46640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f84780c60d0 0x7f84781561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:28.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.785+0000 7f847fd46640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f847806b850 con 0x7f8478071e10 2023-11-27T18:13:28.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.785+0000 7f847fd46640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84780c6880 con 0x7f84780721f0 2023-11-27T18:13:28.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.785+0000 7f847fd46640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8478159860 con 0x7f84780c60d0 2023-11-27T18:13:28.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.785+0000 7f847e2e3640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f84780c60d0 0x7f84781561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:28.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.789+0000 7f847e2e3640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f84780c60d0 0x7f84781561d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.91:50452/0 (socket says 172.21.15.91:50452) 2023-11-27T18:13:28.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.789+0000 7f847e2e3640 1 -- 172.21.15.91:0/3770004103 learned_addr learned my addr 172.21.15.91:0/3770004103 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:28.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.793+0000 7f847e2e3640 1 -- 172.21.15.91:0/3770004103 >> v2:172.21.15.91:3300/0 conn(0x7f84780721f0 msgr2=0x7f84780c7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:28.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.793+0000 7f847e2e3640 1 --2- 172.21.15.91:0/3770004103 >> v2:172.21.15.91:3300/0 conn(0x7f84780721f0 0x7f84780c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:28.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.793+0000 7f847e2e3640 1 -- 172.21.15.91:0/3770004103 >> v1:172.21.15.91:6789/0 conn(0x7f8478071e10 legacy=0x7f8478150030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:28.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.793+0000 7f847e2e3640 1 -- 172.21.15.91:0/3770004103 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f847806baa0 con 0x7f84780c60d0 2023-11-27T18:13:28.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.801+0000 7f847e2e3640 1 --2- 172.21.15.91:0/3770004103 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84780c60d0 0x7f84781561d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f84780c6ac0 tx=0x7f847001c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c90b82db014d4304 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:28.807 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.809+0000 7f847cae0640 1 -- 172.21.15.91:0/3770004103 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84700a5740 con 0x7f84780c60d0 2023-11-27T18:13:28.807 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.809+0000 7f847cae0640 1 -- 172.21.15.91:0/3770004103 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84700a58a0 con 0x7f84780c60d0 2023-11-27T18:13:28.807 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.809+0000 7f847cae0640 1 -- 172.21.15.91:0/3770004103 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84700a5c30 con 0x7f84780c60d0 2023-11-27T18:13:28.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.813+0000 7f847fd46640 1 -- 172.21.15.91:0/3770004103 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84780c60d0 msgr2=0x7f84781561d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:28.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.813+0000 7f847fd46640 1 --2- 172.21.15.91:0/3770004103 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84780c60d0 0x7f84781561d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f84780c6ac0 tx=0x7f847001c990 comp rx=0 tx=0).stop 2023-11-27T18:13:28.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.813+0000 7f847fd46640 1 -- 172.21.15.91:0/3770004103 shutdown_connections 2023-11-27T18:13:28.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.813+0000 7f847fd46640 1 --2- 172.21.15.91:0/3770004103 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84780c60d0 0x7f84781561d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:28.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.813+0000 7f847fd46640 1 --2- 172.21.15.91:0/3770004103 >> v2:172.21.15.91:3300/0 conn(0x7f84780721f0 0x7f84780c7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:28.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.813+0000 7f847fd46640 1 -- 172.21.15.91:0/3770004103 >> 172.21.15.91:0/3770004103 conn(0x7f84780cbad0 msgr2=0x7f84780cbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:28.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.813+0000 7f847fd46640 1 -- 172.21.15.91:0/3770004103 shutdown_connections 2023-11-27T18:13:28.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.813+0000 7f847fd46640 1 -- 172.21.15.91:0/3770004103 wait complete. 2023-11-27T18:13:28.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.813+0000 7f847fd46640 1 Processor -- start 2023-11-27T18:13:28.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.813+0000 7f847fd46640 1 -- start start 2023-11-27T18:13:28.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.813+0000 7f847fd46640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8478071e10 0x7f84781f10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:28.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.813+0000 7f847fd46640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f84780721f0 0x7f84781f1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:28.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.813+0000 7f847fd46640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f84780c60d0 0x7f847813fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:28.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.813+0000 7f847fd46640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84781f0cc0 con 0x7f84780c60d0 2023-11-27T18:13:28.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.813+0000 7f847fd46640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8478142f70 con 0x7f8478071e10 2023-11-27T18:13:28.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.813+0000 7f847fd46640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84781403d0 con 0x7f84780721f0 2023-11-27T18:13:28.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.813+0000 7f847e2e3640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f84780c60d0 0x7f847813fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:28.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.813+0000 7f847e2e3640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f84780c60d0 0x7f847813fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44348/0 (socket says 172.21.15.91:44348) 2023-11-27T18:13:28.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.813+0000 7f847e2e3640 1 -- 172.21.15.91:0/2984038806 learned_addr learned my addr 172.21.15.91:0/2984038806 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:28.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.817+0000 7f847d2e1640 1 --2- 172.21.15.91:0/2984038806 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f84780721f0 0x7f84781f1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:28.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.817+0000 7f847dae2640 1 --2- 172.21.15.91:0/2984038806 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8478071e10 0x7f84781f10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:28.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.821+0000 7f847e2e3640 1 -- 172.21.15.91:0/2984038806 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f84780721f0 msgr2=0x7f84781f1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:28.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.821+0000 7f847e2e3640 1 --2- 172.21.15.91:0/2984038806 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f84780721f0 0x7f84781f1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:28.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.821+0000 7f847e2e3640 1 -- 172.21.15.91:0/2984038806 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8478071e10 msgr2=0x7f84781f10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:28.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.821+0000 7f847e2e3640 1 --2- 172.21.15.91:0/2984038806 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8478071e10 0x7f84781f10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:28.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.821+0000 7f847e2e3640 1 -- 172.21.15.91:0/2984038806 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8470009b30 con 0x7f84780c60d0 2023-11-27T18:13:28.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.825+0000 7f847e2e3640 1 --2- 172.21.15.91:0/2984038806 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f84780c60d0 0x7f847813fe90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f847001a5c0 tx=0x7f8470019730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:28.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.829+0000 7f846e7fc640 1 -- 172.21.15.91:0/2984038806 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84700b8670 con 0x7f84780c60d0 2023-11-27T18:13:28.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.829+0000 7f846e7fc640 1 -- 172.21.15.91:0/2984038806 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84700b87d0 con 0x7f84780c60d0 2023-11-27T18:13:28.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.829+0000 7f846e7fc640 1 -- 172.21.15.91:0/2984038806 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84700b8b60 con 0x7f84780c60d0 2023-11-27T18:13:28.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.829+0000 7f847fd46640 1 -- 172.21.15.91:0/2984038806 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8478147c90 con 0x7f84780c60d0 2023-11-27T18:13:28.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.829+0000 7f847fd46640 1 -- 172.21.15.91:0/2984038806 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84781f0600 con 0x7f84780c60d0 2023-11-27T18:13:28.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.833+0000 7f8482e76000 1 Processor -- start 2023-11-27T18:13:28.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.833+0000 7f8482e76000 1 -- start start 2023-11-27T18:13:28.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.833+0000 7f8482e76000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d09e0cd930 0x55d09e0cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:28.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.833+0000 7f8482e76000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d09e0d29f0 0x55d09e0d2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:28.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.833+0000 7f8482e76000 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55d09e0d3310 0x55d09e0d36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:28.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.833+0000 7f8482e76000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d09defc130 con 0x55d09e0cd930 2023-11-27T18:13:28.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.833+0000 7f8482e76000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d09dee99a0 con 0x55d09e0d29f0 2023-11-27T18:13:28.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.833+0000 7f8482e76000 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d09dee6ed0 con 0x55d09e0d3310 2023-11-27T18:13:28.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.833+0000 7f847d2e1640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55d09e0d3310 0x55d09e0d36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:28.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.833+0000 7f847dae2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d09e0d29f0 0x55d09e0d2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:28.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.837+0000 7f847d2e1640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55d09e0d3310 0x55d09e0d36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.91:48556/0 (socket says 172.21.15.91:48556) 2023-11-27T18:13:28.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.837+0000 7f847d2e1640 1 -- 172.21.15.91:0/840310146 learned_addr learned my addr 172.21.15.91:0/840310146 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:28.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.841+0000 7f847d2e1640 1 -- 172.21.15.91:0/840310146 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d09e0d29f0 msgr2=0x55d09e0d2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:28.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.841+0000 7f847d2e1640 1 --2- 172.21.15.91:0/840310146 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d09e0d29f0 0x55d09e0d2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:28.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.841+0000 7f847d2e1640 1 -- 172.21.15.91:0/840310146 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d09e0cd930 msgr2=0x55d09e0cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:28.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.841+0000 7f847d2e1640 1 --2- 172.21.15.91:0/840310146 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d09e0cd930 0x55d09e0cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:28.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.841+0000 7f847d2e1640 1 -- 172.21.15.91:0/840310146 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d09dbda890 con 0x55d09e0d3310 2023-11-27T18:13:28.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.845+0000 7f847d2e1640 1 --2- 172.21.15.91:0/840310146 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55d09e0d3310 0x55d09e0d36f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f847400a8d0 tx=0x7f847400ad90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e92ea5c64666b6f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:28.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.853+0000 7f846e7fc640 1 -- 172.21.15.91:0/2984038806 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f84700b8cc0 con 0x7f84780c60d0 2023-11-27T18:13:28.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.853+0000 7f846e7fc640 1 --2- 172.21.15.91:0/2984038806 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f845c066840 0x7f845c068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:28.852 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.853+0000 7f847dae2640 1 --2- 172.21.15.91:0/2984038806 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f845c066840 0x7f845c068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:28.852 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.853+0000 7f847dae2640 1 --2- 172.21.15.91:0/2984038806 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f845c066840 0x7f845c068d00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8468007fd0 tx=0x7f8468009040 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:28.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.857+0000 7f845b7fe640 1 -- 172.21.15.91:0/840310146 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f847400f9c0 con 0x55d09e0d3310 2023-11-27T18:13:28.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.857+0000 7f845b7fe640 1 -- 172.21.15.91:0/840310146 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f847400c030 con 0x55d09e0d3310 2023-11-27T18:13:28.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.857+0000 7f845b7fe640 1 -- 172.21.15.91:0/840310146 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f847400fd60 con 0x55d09e0d3310 2023-11-27T18:13:28.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.857+0000 7f8482e76000 1 -- 172.21.15.91:0/840310146 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55d09e0d3310 msgr2=0x55d09e0d36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:28.855 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.857+0000 7f8482e76000 1 --2- 172.21.15.91:0/840310146 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55d09e0d3310 0x55d09e0d36f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f847400a8d0 tx=0x7f847400ad90 comp rx=0 tx=0).stop 2023-11-27T18:13:28.855 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.857+0000 7f8482e76000 1 -- 172.21.15.91:0/840310146 shutdown_connections 2023-11-27T18:13:28.855 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.857+0000 7f8482e76000 1 --2- 172.21.15.91:0/840310146 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55d09e0d3310 0x55d09e0d36f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:28.855 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.857+0000 7f8482e76000 1 --2- 172.21.15.91:0/840310146 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d09e0d29f0 0x55d09e0d2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:28.855 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.857+0000 7f8482e76000 1 --2- 172.21.15.91:0/840310146 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d09e0cd930 0x55d09e0cdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:28.855 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.857+0000 7f8482e76000 1 -- 172.21.15.91:0/840310146 >> 172.21.15.91:0/840310146 conn(0x55d09e0ce7a0 msgr2=0x55d09e0d0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:28.855 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.857+0000 7f8482e76000 1 -- 172.21.15.91:0/840310146 shutdown_connections 2023-11-27T18:13:28.855 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.857+0000 7f8482e76000 1 -- 172.21.15.91:0/840310146 wait complete. 2023-11-27T18:13:28.856 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.857+0000 7f8482e76000 1 -- start start 2023-11-27T18:13:28.856 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.857+0000 7f8482e76000 1 Processor -- start 2023-11-27T18:13:28.856 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.857+0000 7f846e7fc640 1 -- 172.21.15.91:0/2984038806 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f84700f0cd0 con 0x7f84780c60d0 2023-11-27T18:13:28.856 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.857+0000 7f8482e76000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d09e0cd930 0x55d09e0ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:28.856 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.857+0000 7f8482e76000 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55d09e0d29f0 0x55d09e0cd250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:28.857 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.857+0000 7f8482e76000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d09e0d3310 0x55d09e0dc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:28.857 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.857+0000 7f8482e76000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d09dee27c0 con 0x55d09e0d3310 2023-11-27T18:13:28.857 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.857+0000 7f8482e76000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d09de9abf0 con 0x55d09e0cd930 2023-11-27T18:13:28.857 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.857+0000 7f8482e76000 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d09dea0a90 con 0x55d09e0d29f0 2023-11-27T18:13:28.857 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.857+0000 7f8482e76000 10 client.0 _ll_register_callbacks cb 0x55d09e07d3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-27T18:13:28.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.861+0000 7f847dae2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d09e0cd930 0x55d09e0ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:28.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.861+0000 7f847e2e3640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d09e0d3310 0x55d09e0dc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:28.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.861+0000 7f847e2e3640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d09e0d3310 0x55d09e0dc990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44358/0 (socket says 172.21.15.91:44358) 2023-11-27T18:13:28.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.861+0000 7f847e2e3640 1 -- 172.21.15.91:0/80404173 learned_addr learned my addr 172.21.15.91:0/80404173 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:28.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.861+0000 7f847d2e1640 1 --2- 172.21.15.91:0/80404173 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55d09e0d29f0 0x55d09e0cd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:28.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.865+0000 7f847e2e3640 1 -- 172.21.15.91:0/80404173 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55d09e0d29f0 msgr2=0x55d09e0cd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:28.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.865+0000 7f847e2e3640 1 --2- 172.21.15.91:0/80404173 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55d09e0d29f0 0x55d09e0cd250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:28.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.865+0000 7f847e2e3640 1 -- 172.21.15.91:0/80404173 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d09e0cd930 msgr2=0x55d09e0ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:28.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.865+0000 7f847e2e3640 1 --2- 172.21.15.91:0/80404173 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d09e0cd930 0x55d09e0ccd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:28.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.865+0000 7f847e2e3640 1 -- 172.21.15.91:0/80404173 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f847400e040 con 0x55d09e0d3310 2023-11-27T18:13:28.863 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.865+0000 7f847e2e3640 1 --2- 172.21.15.91:0/80404173 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d09e0d3310 0x55d09e0dc990 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f84700f02d0 tx=0x7f84700f06c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0e49abbfd45a092 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:28.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.865+0000 7f8458ff9640 10 client.0 ms_handle_connect on v2:172.21.15.91:3300/0 2023-11-27T18:13:28.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.869+0000 7f8458ff9640 1 -- 172.21.15.91:0/80404173 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84700efcc0 con 0x55d09e0d3310 2023-11-27T18:13:28.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.869+0000 7f8458ff9640 1 -- 172.21.15.91:0/80404173 <== mon.0 v2:172.21.15.91:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8470107dc0 con 0x55d09e0d3310 2023-11-27T18:13:28.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.869+0000 7f8482e76000 1 -- 172.21.15.91:0/80404173 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d09dea4470 con 0x55d09e0d3310 2023-11-27T18:13:28.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.873+0000 7f8458ff9640 1 -- 172.21.15.91:0/80404173 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f84700f8440 con 0x55d09e0d3310 2023-11-27T18:13:28.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.873+0000 7f8482e76000 10 client.4338 fetch_fsmap learned FSMap version 6 2023-11-27T18:13:28.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.873+0000 7f8482e76000 1 -- 172.21.15.91:0/80404173 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x55d09dea3190 con 0x55d09e0d3310 2023-11-27T18:13:28.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.877+0000 7f8458ff9640 1 -- 172.21.15.91:0/80404173 <== mon.0 v2:172.21.15.91:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d09dea4470 con 0x55d09e0d3310 2023-11-27T18:13:28.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.877+0000 7f8458ff9640 1 -- 172.21.15.91:0/80404173 <== mon.0 v2:172.21.15.91:3300/0 5 ==== fsmap(e 6) v1 ==== 4452+0+0 (secure 0 0 0) 0x7f8470005d20 con 0x55d09e0d3310 2023-11-27T18:13:28.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.877+0000 7f8482e76000 10 client.4338 fetch_fsmap finished waiting for FSMap version 6 2023-11-27T18:13:28.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.877+0000 7f8482e76000 10 client.4338 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-27T18:13:28.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.877+0000 7f8482e76000 20 client.4338 populate_metadata read hostname 'smithi091' 2023-11-27T18:13:28.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.877+0000 7f8482e76000 1 --2- 172.21.15.91:0/80404173 >> [v2:172.21.15.94:6836/3938864244,v1:172.21.15.94:6837/3938864244] conn(0x55d09e0dd6d0 0x55d09e0ddab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:28.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.877+0000 7f8482e76000 4 client.4338 mds_command: new command op to 4255 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-27T18:13:28.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.877+0000 7f8482e76000 1 -- 172.21.15.91:0/80404173 --> [v2:172.21.15.94:6836/3938864244,v1:172.21.15.94:6837/3938864244] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d09dea7b50 con 0x55d09e0dd6d0 2023-11-27T18:13:28.902 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:28.905+0000 7f847dae2640 1 --2- 172.21.15.91:0/80404173 >> [v2:172.21.15.94:6836/3938864244,v1:172.21.15.94:6837/3938864244] conn(0x55d09e0dd6d0 0x55d09e0ddab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:29.023 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.025+0000 7f847dae2640 1 --2- 172.21.15.91:0/80404173 >> [v2:172.21.15.94:6836/3938864244,v1:172.21.15.94:6837/3938864244] conn(0x55d09e0dd6d0 0x55d09e0ddab0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1542b64ec893774c server_cookie=dd0d5d9fbcc9637c in_seq=0 out_seq=0 2023-11-27T18:13:29.023 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.025+0000 7f8458ff9640 10 client.4338 ms_handle_connect on v2:172.21.15.94:6836/3938864244 2023-11-27T18:13:29.257 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.261+0000 7f8458ff9640 1 -- 172.21.15.91:0/80404173 <== mds.0 v2:172.21.15.94:6836/3938864244 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d09dea7b50 con 0x55d09e0dd6d0 2023-11-27T18:13:29.258 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.261+0000 7f8458ff9640 10 client.4338 handle_command_reply: tid=0 2023-11-27T18:13:29.258 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.261+0000 7f8482e76000 1 client.4338 shutdown 2023-11-27T18:13:29.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.261+0000 7f8482e76000 1 -- 172.21.15.91:0/80404173 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d09e0d3310 msgr2=0x55d09e0dc990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:29.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.261+0000 7f8482e76000 1 --2- 172.21.15.91:0/80404173 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d09e0d3310 0x55d09e0dc990 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f84700f02d0 tx=0x7f84700f06c0 comp rx=0 tx=0).stop 2023-11-27T18:13:29.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.261+0000 7f8482e76000 1 -- 172.21.15.91:0/80404173 shutdown_connections 2023-11-27T18:13:29.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.261+0000 7f8482e76000 1 --2- 172.21.15.91:0/80404173 >> [v2:172.21.15.94:6836/3938864244,v1:172.21.15.94:6837/3938864244] conn(0x55d09e0dd6d0 0x55d09e0ddab0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:29.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.261+0000 7f8482e76000 1 --2- 172.21.15.91:0/80404173 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55d09e0d29f0 0x55d09e0cd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:29.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.261+0000 7f8482e76000 1 --2- 172.21.15.91:0/80404173 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d09e0d3310 0x55d09e0dc990 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:29.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.261+0000 7f8482e76000 1 --2- 172.21.15.91:0/80404173 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d09e0cd930 0x55d09e0ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:29.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.261+0000 7f8458ff9640 0 client.4338 ms_handle_reset on v2:172.21.15.94:6836/3938864244 2023-11-27T18:13:29.261 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.261+0000 7f8482e76000 1 -- 172.21.15.91:0/80404173 >> 172.21.15.91:0/80404173 conn(0x55d09e0ce7a0 msgr2=0x55d09e097ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:29.261 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.261+0000 7f8482e76000 1 -- 172.21.15.91:0/80404173 shutdown_connections 2023-11-27T18:13:29.261 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.261+0000 7f8482e76000 1 -- 172.21.15.91:0/80404173 wait complete. 2023-11-27T18:13:29.261 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.261+0000 7f8482e76000 20 client.4338 trim_cache size 0 max 16384 2023-11-27T18:13:29.307 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.309+0000 7f8482e76000 1 Processor -- start 2023-11-27T18:13:29.308 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.309+0000 7f8482e76000 1 -- start start 2023-11-27T18:13:29.309 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.313+0000 7f8482e76000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d09e0cd930 0x55d09e0dbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:29.310 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.313+0000 7f8482e76000 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55d09e0d29f0 0x55d09e0dc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:29.310 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.313+0000 7f8482e76000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d09e0d3310 0x55d09e0d0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:29.310 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.313+0000 7f8482e76000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d09db9b940 con 0x55d09e0cd930 2023-11-27T18:13:29.310 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.313+0000 7f8482e76000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d09de9bd60 con 0x55d09e0d3310 2023-11-27T18:13:29.310 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.313+0000 7f8482e76000 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d09e0df800 con 0x55d09e0d29f0 2023-11-27T18:13:29.310 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.313+0000 7f847dae2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d09e0cd930 0x55d09e0dbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:29.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.313+0000 7f847dae2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d09e0cd930 0x55d09e0dbfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44372/0 (socket says 172.21.15.91:44372) 2023-11-27T18:13:29.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.313+0000 7f847dae2640 1 -- 172.21.15.91:0/2673707976 learned_addr learned my addr 172.21.15.91:0/2673707976 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:29.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.317+0000 7f847d2e1640 1 --2- 172.21.15.91:0/2673707976 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55d09e0d29f0 0x55d09e0dc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:29.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.317+0000 7f847dae2640 1 -- 172.21.15.91:0/2673707976 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55d09e0d29f0 msgr2=0x55d09e0dc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:29.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.317+0000 7f847dae2640 1 --2- 172.21.15.91:0/2673707976 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55d09e0d29f0 0x55d09e0dc500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:29.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.317+0000 7f847dae2640 1 -- 172.21.15.91:0/2673707976 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d09e0d3310 msgr2=0x55d09e0d0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:29.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.317+0000 7f847dae2640 1 --2- 172.21.15.91:0/2673707976 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d09e0d3310 0x55d09e0d0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:29.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.317+0000 7f847dae2640 1 -- 172.21.15.91:0/2673707976 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d09de89490 con 0x55d09e0cd930 2023-11-27T18:13:29.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.325+0000 7f847dae2640 1 --2- 172.21.15.91:0/2673707976 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d09e0cd930 0x55d09e0dbfc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f84680126e0 tx=0x7f8468015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27e2dc739e638019 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:29.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.329+0000 7f845bfff640 1 -- 172.21.15.91:0/2673707976 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8468016920 con 0x55d09e0cd930 2023-11-27T18:13:29.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.333+0000 7f845bfff640 1 -- 172.21.15.91:0/2673707976 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8468016a80 con 0x55d09e0cd930 2023-11-27T18:13:29.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.333+0000 7f845bfff640 1 -- 172.21.15.91:0/2673707976 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8468016c10 con 0x55d09e0cd930 2023-11-27T18:13:29.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.333+0000 7f8482e76000 1 -- 172.21.15.91:0/2673707976 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d09e0cd930 msgr2=0x55d09e0dbfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:29.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.333+0000 7f8482e76000 1 --2- 172.21.15.91:0/2673707976 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d09e0cd930 0x55d09e0dbfc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f84680126e0 tx=0x7f8468015000 comp rx=0 tx=0).stop 2023-11-27T18:13:29.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.333+0000 7f8482e76000 1 -- 172.21.15.91:0/2673707976 shutdown_connections 2023-11-27T18:13:29.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.333+0000 7f8482e76000 1 --2- 172.21.15.91:0/2673707976 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55d09e0d29f0 0x55d09e0dc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:29.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.333+0000 7f8482e76000 1 --2- 172.21.15.91:0/2673707976 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d09e0d3310 0x55d09e0d0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:29.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.333+0000 7f8482e76000 1 --2- 172.21.15.91:0/2673707976 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d09e0cd930 0x55d09e0dbfc0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:29.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.333+0000 7f8482e76000 1 -- 172.21.15.91:0/2673707976 >> 172.21.15.91:0/2673707976 conn(0x55d09e0ce7a0 msgr2=0x55d09e0decd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:29.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.333+0000 7f8482e76000 1 -- 172.21.15.91:0/2673707976 shutdown_connections 2023-11-27T18:13:29.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.333+0000 7f8482e76000 1 -- 172.21.15.91:0/2673707976 wait complete. 2023-11-27T18:13:29.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.333+0000 7f8482e76000 1 -- start start 2023-11-27T18:13:29.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.333+0000 7f8482e76000 1 Processor -- start 2023-11-27T18:13:29.332 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.337+0000 7f8482e76000 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55d09e0cd930 0x55d09e0de5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:29.333 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.337+0000 7f8482e76000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d09e0d29f0 0x55d09e0f9690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:29.333 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.337+0000 7f8482e76000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d09e0d3310 0x55d09e0f9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:29.333 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.337+0000 7f8482e76000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d09dede130 con 0x55d09e0d3310 2023-11-27T18:13:29.333 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.337+0000 7f8482e76000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d09dbdb1b0 con 0x55d09e0d29f0 2023-11-27T18:13:29.333 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.337+0000 7f8482e76000 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d09dea18f0 con 0x55d09e0cd930 2023-11-27T18:13:29.333 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.337+0000 7f8482e76000 10 client.0 _ll_register_callbacks cb 0x55d09e05dbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-27T18:13:29.333 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.337+0000 7f847d2e1640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d09e0d29f0 0x55d09e0f9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:29.334 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.337+0000 7f847dae2640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55d09e0cd930 0x55d09e0de5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:29.335 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.337+0000 7f847d2e1640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d09e0d29f0 0x55d09e0f9690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.91:50504/0 (socket says 172.21.15.91:50504) 2023-11-27T18:13:29.335 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.337+0000 7f847d2e1640 1 -- 172.21.15.91:0/2849346460 learned_addr learned my addr 172.21.15.91:0/2849346460 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:29.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.349+0000 7f847d2e1640 1 -- 172.21.15.91:0/2849346460 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55d09e0cd930 msgr2=0x55d09e0de5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:29.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.349+0000 7f847d2e1640 1 --2- 172.21.15.91:0/2849346460 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55d09e0cd930 0x55d09e0de5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:29.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.349+0000 7f847d2e1640 1 -- 172.21.15.91:0/2849346460 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d09e0d3310 msgr2=0x55d09e0f9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:29.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.349+0000 7f847d2e1640 1 --2- 172.21.15.91:0/2849346460 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d09e0d3310 0x55d09e0f9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:29.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.349+0000 7f847d2e1640 1 -- 172.21.15.91:0/2849346460 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d09dbdacc0 con 0x55d09e0d29f0 2023-11-27T18:13:29.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.357+0000 7f847d2e1640 1 --2- 172.21.15.91:0/2849346460 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d09e0d29f0 0x55d09e0f9690 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8474006e20 tx=0x7f8474006a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b2460beb606742d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:29.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.357+0000 7f8458ff9640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2023-11-27T18:13:29.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.477+0000 7f8458ff9640 1 -- 172.21.15.91:0/2849346460 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8474023070 con 0x55d09e0d29f0 2023-11-27T18:13:29.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.477+0000 7f8458ff9640 1 -- 172.21.15.91:0/2849346460 <== mon.1 v2:172.21.15.94:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8474027410 con 0x55d09e0d29f0 2023-11-27T18:13:29.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.477+0000 7f8482e76000 1 -- 172.21.15.91:0/2849346460 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d09dee1110 con 0x55d09e0d29f0 2023-11-27T18:13:29.480 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.485+0000 7f8458ff9640 1 -- 172.21.15.91:0/2849346460 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f847400a5a0 con 0x55d09e0d29f0 2023-11-27T18:13:29.480 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.485+0000 7f8482e76000 10 client.4342 fetch_fsmap learned FSMap version 6 2023-11-27T18:13:29.481 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.485+0000 7f8482e76000 1 -- 172.21.15.91:0/2849346460 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x55d09de0ba50 con 0x55d09e0d29f0 2023-11-27T18:13:29.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.517+0000 7f8458ff9640 1 -- 172.21.15.91:0/2849346460 <== mon.1 v2:172.21.15.94:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d09dee1110 con 0x55d09e0d29f0 2023-11-27T18:13:29.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.517+0000 7f8458ff9640 1 -- 172.21.15.91:0/2849346460 <== mon.1 v2:172.21.15.94:3300/0 5 ==== fsmap(e 6) v1 ==== 4452+0+0 (secure 0 0 0) 0x7f84740275d0 con 0x55d09e0d29f0 2023-11-27T18:13:29.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.517+0000 7f8482e76000 10 client.4342 fetch_fsmap finished waiting for FSMap version 6 2023-11-27T18:13:29.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.517+0000 7f8482e76000 10 client.4342 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-27T18:13:29.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.517+0000 7f8482e76000 20 client.4342 populate_metadata read hostname 'smithi091' 2023-11-27T18:13:29.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.517+0000 7f8482e76000 1 --2- 172.21.15.91:0/2849346460 >> [v2:172.21.15.94:6836/3938864244,v1:172.21.15.94:6837/3938864244] conn(0x55d09e138a80 0x55d09e138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:29.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.517+0000 7f8482e76000 4 client.4342 mds_command: new command op to 4255 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-27T18:13:29.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.517+0000 7f8482e76000 1 -- 172.21.15.91:0/2849346460 --> [v2:172.21.15.94:6836/3938864244,v1:172.21.15.94:6837/3938864244] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d09df109a0 con 0x55d09e138a80 2023-11-27T18:13:29.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.517+0000 7f847dae2640 1 --2- 172.21.15.91:0/2849346460 >> [v2:172.21.15.94:6836/3938864244,v1:172.21.15.94:6837/3938864244] conn(0x55d09e138a80 0x55d09e138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:29.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.525+0000 7f847dae2640 1 --2- 172.21.15.91:0/2849346460 >> [v2:172.21.15.94:6836/3938864244,v1:172.21.15.94:6837/3938864244] conn(0x55d09e138a80 0x55d09e138e60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a6e3307e7fa31da server_cookie=533976b3f65bc7ff in_seq=0 out_seq=0 2023-11-27T18:13:29.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.525+0000 7f8458ff9640 10 client.4342 ms_handle_connect on v2:172.21.15.94:6836/3938864244 2023-11-27T18:13:29.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.549+0000 7f8458ff9640 1 -- 172.21.15.91:0/2849346460 <== mds.0 v2:172.21.15.94:6836/3938864244 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55d09df109a0 con 0x55d09e138a80 2023-11-27T18:13:29.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.549+0000 7f8458ff9640 10 client.4342 handle_command_reply: tid=0 2023-11-27T18:13:29.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.549+0000 7f8482e76000 1 client.4342 shutdown 2023-11-27T18:13:29.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.549+0000 7f8482e76000 1 -- 172.21.15.91:0/2849346460 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d09e0d29f0 msgr2=0x55d09e0f9690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:29.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.549+0000 7f8482e76000 1 --2- 172.21.15.91:0/2849346460 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d09e0d29f0 0x55d09e0f9690 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8474006e20 tx=0x7f8474006a40 comp rx=0 tx=0).stop 2023-11-27T18:13:29.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.549+0000 7f8482e76000 1 -- 172.21.15.91:0/2849346460 shutdown_connections 2023-11-27T18:13:29.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.549+0000 7f8482e76000 1 --2- 172.21.15.91:0/2849346460 >> [v2:172.21.15.94:6836/3938864244,v1:172.21.15.94:6837/3938864244] conn(0x55d09e138a80 0x55d09e138e60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:29.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.549+0000 7f8482e76000 1 --2- 172.21.15.91:0/2849346460 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d09e0d3310 0x55d09e0f9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:29.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.549+0000 7f8482e76000 1 --2- 172.21.15.91:0/2849346460 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d09e0d29f0 0x55d09e0f9690 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:29.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.549+0000 7f8482e76000 1 --2- 172.21.15.91:0/2849346460 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55d09e0cd930 0x55d09e0de5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:29.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.549+0000 7f8458ff9640 0 client.4342 ms_handle_reset on v2:172.21.15.94:6836/3938864244 2023-11-27T18:13:29.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.549+0000 7f8482e76000 1 -- 172.21.15.91:0/2849346460 >> 172.21.15.91:0/2849346460 conn(0x55d09e0ce7a0 msgr2=0x55d09e0ddab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:29.547 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.549+0000 7f8482e76000 1 -- 172.21.15.91:0/2849346460 shutdown_connections 2023-11-27T18:13:29.547 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.549+0000 7f8482e76000 1 -- 172.21.15.91:0/2849346460 wait complete. 2023-11-27T18:13:29.547 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.549+0000 7f8482e76000 20 client.4342 trim_cache size 0 max 16384 2023-11-27T18:13:29.547 INFO:teuthology.orchestra.run.smithi091.stdout:{ 2023-11-27T18:13:29.547 INFO:teuthology.orchestra.run.smithi091.stdout: "cluster_fsid": "08c8ebbf-7936-4c41-a995-d5600de2d072", 2023-11-27T18:13:29.547 INFO:teuthology.orchestra.run.smithi091.stdout: "whoami": 0, 2023-11-27T18:13:29.548 INFO:teuthology.orchestra.run.smithi091.stdout: "id": 4255, 2023-11-27T18:13:29.548 INFO:teuthology.orchestra.run.smithi091.stdout: "want_state": "up:active", 2023-11-27T18:13:29.548 INFO:teuthology.orchestra.run.smithi091.stdout: "state": "up:active", 2023-11-27T18:13:29.548 INFO:teuthology.orchestra.run.smithi091.stdout: "fs_name": "cephfs", 2023-11-27T18:13:29.548 INFO:teuthology.orchestra.run.smithi091.stdout: "rank_uptime": 15.155013038, 2023-11-27T18:13:29.548 INFO:teuthology.orchestra.run.smithi091.stdout: "mdsmap_epoch": 6, 2023-11-27T18:13:29.548 INFO:teuthology.orchestra.run.smithi091.stdout: "osdmap_epoch": 30, 2023-11-27T18:13:29.548 INFO:teuthology.orchestra.run.smithi091.stdout: "osdmap_epoch_barrier": 30, 2023-11-27T18:13:29.548 INFO:teuthology.orchestra.run.smithi091.stdout: "uptime": 47.227296445999997 2023-11-27T18:13:29.548 INFO:teuthology.orchestra.run.smithi091.stdout:} 2023-11-27T18:13:29.549 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.549+0000 7f847fd46640 1 -- 172.21.15.91:0/2984038806 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f845c066840 msgr2=0x7f845c068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:29.549 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.549+0000 7f847fd46640 1 --2- 172.21.15.91:0/2984038806 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f845c066840 0x7f845c068d00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8468007fd0 tx=0x7f8468009040 comp rx=0 tx=0).stop 2023-11-27T18:13:29.549 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.549+0000 7f847fd46640 1 -- 172.21.15.91:0/2984038806 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f84780c60d0 msgr2=0x7f847813fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:29.549 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.549+0000 7f847fd46640 1 --2- 172.21.15.91:0/2984038806 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f84780c60d0 0x7f847813fe90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f847001a5c0 tx=0x7f8470019730 comp rx=0 tx=0).stop 2023-11-27T18:13:29.549 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.549+0000 7f847fd46640 1 -- 172.21.15.91:0/2984038806 shutdown_connections 2023-11-27T18:13:29.549 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.549+0000 7f847fd46640 1 --2- 172.21.15.91:0/2984038806 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f845c066840 0x7f845c068d00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:29.549 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.549+0000 7f847fd46640 1 --2- 172.21.15.91:0/2984038806 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f84780721f0 0x7f84781f1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:29.549 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.549+0000 7f847fd46640 1 --2- 172.21.15.91:0/2984038806 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f84780c60d0 0x7f847813fe90 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:29.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.549+0000 7f847fd46640 1 --2- 172.21.15.91:0/2984038806 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8478071e10 0x7f84781f10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:29.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.549+0000 7f847fd46640 1 -- 172.21.15.91:0/2984038806 >> 172.21.15.91:0/2984038806 conn(0x7f84780cbad0 msgr2=0x7f84780c9860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:29.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.549+0000 7f847fd46640 1 -- 172.21.15.91:0/2984038806 shutdown_connections 2023-11-27T18:13:29.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.549+0000 7f847fd46640 1 -- 172.21.15.91:0/2984038806 wait complete. 2023-11-27T18:13:29.572 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-27T18:13:29.573 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-11-27T18:13:29.573 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-27T18:13:29.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.701+0000 7f21074a8640 1 Processor -- start 2023-11-27T18:13:29.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.701+0000 7f21074a8640 1 -- start start 2023-11-27T18:13:29.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.705+0000 7f21074a8640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2100151820 0x7f2100070e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:29.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.705+0000 7f21074a8640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f21000c5f10 0x7f210006d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:29.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.705+0000 7f21074a8640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2100072b70 con 0x7f21000c85c0 2023-11-27T18:13:29.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.705+0000 7f21074a8640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21000c2d20 con 0x7f21000c5f10 2023-11-27T18:13:29.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.705+0000 7f21074a8640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2100071350 con 0x7f2100151820 2023-11-27T18:13:29.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.705+0000 7f2105a45640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f21000c5f10 0x7f210006d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:29.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.705+0000 7f2105a45640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f21000c5f10 0x7f210006d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44376/0 (socket says 172.21.15.91:44376) 2023-11-27T18:13:29.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.705+0000 7f2105a45640 1 -- 172.21.15.91:0/4089757287 learned_addr learned my addr 172.21.15.91:0/4089757287 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:29.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.705+0000 7f2105244640 1 --2- 172.21.15.91:0/4089757287 >> v2:172.21.15.94:3300/0 conn(0x7f2100151820 0x7f2100070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:29.704 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.709+0000 7f2105a45640 1 -- 172.21.15.91:0/4089757287 >> v2:172.21.15.94:3300/0 conn(0x7f2100151820 msgr2=0x7f2100070e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:29.704 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.709+0000 7f2105a45640 1 --2- 172.21.15.91:0/4089757287 >> v2:172.21.15.94:3300/0 conn(0x7f2100151820 0x7f2100070e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:29.704 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.709+0000 7f2105a45640 1 -- 172.21.15.91:0/4089757287 >> v1:172.21.15.94:6789/0 conn(0x7f21000c85c0 legacy=0x7f210006cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:29.705 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.709+0000 7f2105a45640 1 -- 172.21.15.91:0/4089757287 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21000c6490 con 0x7f21000c5f10 2023-11-27T18:13:29.705 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.709+0000 7f2105244640 1 --2- 172.21.15.91:0/4089757287 >> v2:172.21.15.94:3300/0 conn(0x7f2100151820 0x7f2100070e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T18:13:29.708 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.709+0000 7f2105a45640 1 --2- 172.21.15.91:0/4089757287 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f21000c5f10 0x7f210006d2a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2100067da0 tx=0x7f20f801f180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23bd639dbeb90bfc server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:29.711 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.713+0000 7f20f3fff640 1 -- 172.21.15.91:0/4089757287 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f80af400 con 0x7f21000c5f10 2023-11-27T18:13:29.712 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.713+0000 7f20f3fff640 1 -- 172.21.15.91:0/4089757287 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20f80ab050 con 0x7f21000c5f10 2023-11-27T18:13:29.712 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.713+0000 7f20f3fff640 1 -- 172.21.15.91:0/4089757287 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f80af780 con 0x7f21000c5f10 2023-11-27T18:13:29.712 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.717+0000 7f21074a8640 1 -- 172.21.15.91:0/4089757287 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f21000c5f10 msgr2=0x7f210006d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:29.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.717+0000 7f21074a8640 1 --2- 172.21.15.91:0/4089757287 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f21000c5f10 0x7f210006d2a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2100067da0 tx=0x7f20f801f180 comp rx=0 tx=0).stop 2023-11-27T18:13:29.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.717+0000 7f21074a8640 1 -- 172.21.15.91:0/4089757287 shutdown_connections 2023-11-27T18:13:29.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.717+0000 7f21074a8640 1 --2- 172.21.15.91:0/4089757287 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f21000c5f10 0x7f210006d2a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:29.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.717+0000 7f21074a8640 1 --2- 172.21.15.91:0/4089757287 >> v2:172.21.15.94:3300/0 conn(0x7f2100151820 0x7f2100070e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:29.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.717+0000 7f21074a8640 1 -- 172.21.15.91:0/4089757287 >> 172.21.15.91:0/4089757287 conn(0x7f21000c79b0 msgr2=0x7f21000c7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:29.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.717+0000 7f21074a8640 1 -- 172.21.15.91:0/4089757287 shutdown_connections 2023-11-27T18:13:29.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.717+0000 7f21074a8640 1 -- 172.21.15.91:0/4089757287 wait complete. 2023-11-27T18:13:29.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.717+0000 7f21074a8640 1 Processor -- start 2023-11-27T18:13:29.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.717+0000 7f21074a8640 1 -- start start 2023-11-27T18:13:29.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.717+0000 7f21074a8640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f21000c5f10 0x7f21001ef3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:29.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.717+0000 7f21074a8640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f21000c85c0 0x7f21001ef8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:29.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.717+0000 7f21074a8640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2100151820 0x7f210014a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:29.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.717+0000 7f21074a8640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21001dd790 con 0x7f21000c5f10 2023-11-27T18:13:29.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.717+0000 7f21074a8640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2100153950 con 0x7f21000c85c0 2023-11-27T18:13:29.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.717+0000 7f21074a8640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21000c9470 con 0x7f2100151820 2023-11-27T18:13:29.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.717+0000 7f2105244640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f21000c5f10 0x7f21001ef3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:29.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.717+0000 7f2105244640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f21000c5f10 0x7f21001ef3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44392/0 (socket says 172.21.15.91:44392) 2023-11-27T18:13:29.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.717+0000 7f2105244640 1 -- 172.21.15.91:0/973743868 learned_addr learned my addr 172.21.15.91:0/973743868 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:29.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.717+0000 7f2105a45640 1 --2- 172.21.15.91:0/973743868 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2100151820 0x7f210014a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:29.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.717+0000 7f2104a43640 1 --2- 172.21.15.91:0/973743868 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f21000c85c0 0x7f21001ef8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:29.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.721+0000 7f2105244640 1 -- 172.21.15.91:0/973743868 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2100151820 msgr2=0x7f210014a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:29.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.721+0000 7f2105244640 1 --2- 172.21.15.91:0/973743868 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2100151820 0x7f210014a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:29.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.721+0000 7f2105244640 1 -- 172.21.15.91:0/973743868 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f21000c85c0 msgr2=0x7f21001ef8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:29.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.721+0000 7f2105244640 1 --2- 172.21.15.91:0/973743868 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f21000c85c0 0x7f21001ef8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:29.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.721+0000 7f2105244640 1 -- 172.21.15.91:0/973743868 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f8009b30 con 0x7f21000c5f10 2023-11-27T18:13:29.721 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.725+0000 7f2105244640 1 --2- 172.21.15.91:0/973743868 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f21000c5f10 0x7f21001ef3b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f20f400c7f0 tx=0x7f20f400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:29.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.729+0000 7f20f1ffb640 1 -- 172.21.15.91:0/973743868 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f4007820 con 0x7f21000c5f10 2023-11-27T18:13:29.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.729+0000 7f20f1ffb640 1 -- 172.21.15.91:0/973743868 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20f4007980 con 0x7f21000c5f10 2023-11-27T18:13:29.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.729+0000 7f20f1ffb640 1 -- 172.21.15.91:0/973743868 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f4007d30 con 0x7f21000c5f10 2023-11-27T18:13:29.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.729+0000 7f21074a8640 1 -- 172.21.15.91:0/973743868 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2100153c10 con 0x7f21000c5f10 2023-11-27T18:13:29.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.729+0000 7f21074a8640 1 -- 172.21.15.91:0/973743868 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21001ee5f0 con 0x7f21000c5f10 2023-11-27T18:13:29.726 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:29.729+0000 7f21074a8640 1 -- 172.21.15.91:0/973743868 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2100067150 con 0x7f21000c5f10 2023-11-27T18:13:30.004 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:30.005+0000 7f20f1ffb640 1 -- 172.21.15.91:0/973743868 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f20f4024480 con 0x7f21000c5f10 2023-11-27T18:13:30.004 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:30.009+0000 7f20f1ffb640 1 --2- 172.21.15.91:0/973743868 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f20e4066840 0x7f20e4068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:30.005 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:30.009+0000 7f2104a43640 1 --2- 172.21.15.91:0/973743868 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f20e4066840 0x7f20e4068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:30.005 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:30.009+0000 7f2104a43640 1 --2- 172.21.15.91:0/973743868 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f20e4066840 0x7f20e4068d00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f21000c9120 tx=0x7f20fc007e40 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:30.040 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:30.041+0000 7f20f1ffb640 1 -- 172.21.15.91:0/973743868 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f20f40557b0 con 0x7f21000c5f10 2023-11-27T18:13:30.040 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:30.041+0000 7f20f1ffb640 1 -- 172.21.15.91:0/973743868 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f20f4051af0 con 0x7f21000c5f10 2023-11-27T18:13:30.235 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:30.237+0000 7f21074a8640 1 -- 172.21.15.91:0/973743868 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2100072950 con 0x7f21000c5f10 2023-11-27T18:13:30.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:30.253+0000 7f20f1ffb640 1 -- 172.21.15.91:0/973743868 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+88 (secure 0 0 0) 0x7f20f401f070 con 0x7f21000c5f10 2023-11-27T18:13:30.252 INFO:teuthology.orchestra.run.smithi091.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-27T18:13:30.255 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:30.257+0000 7f21074a8640 1 -- 172.21.15.91:0/973743868 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f20e4066840 msgr2=0x7f20e4068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:30.255 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:30.257+0000 7f21074a8640 1 --2- 172.21.15.91:0/973743868 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f20e4066840 0x7f20e4068d00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f21000c9120 tx=0x7f20fc007e40 comp rx=0 tx=0).stop 2023-11-27T18:13:30.255 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:30.257+0000 7f21074a8640 1 -- 172.21.15.91:0/973743868 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f21000c5f10 msgr2=0x7f21001ef3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:30.255 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:30.257+0000 7f21074a8640 1 --2- 172.21.15.91:0/973743868 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f21000c5f10 0x7f21001ef3b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f20f400c7f0 tx=0x7f20f400ccb0 comp rx=0 tx=0).stop 2023-11-27T18:13:30.255 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:30.257+0000 7f21074a8640 1 -- 172.21.15.91:0/973743868 shutdown_connections 2023-11-27T18:13:30.255 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:30.257+0000 7f21074a8640 1 --2- 172.21.15.91:0/973743868 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f20e4066840 0x7f20e4068d00 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:30.255 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:30.257+0000 7f21074a8640 1 --2- 172.21.15.91:0/973743868 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2100151820 0x7f210014a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:30.256 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:30.257+0000 7f21074a8640 1 --2- 172.21.15.91:0/973743868 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f21000c85c0 0x7f21001ef8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:30.256 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:30.257+0000 7f21074a8640 1 --2- 172.21.15.91:0/973743868 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f21000c5f10 0x7f21001ef3b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:30.256 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:30.257+0000 7f21074a8640 1 -- 172.21.15.91:0/973743868 >> 172.21.15.91:0/973743868 conn(0x7f21000c79b0 msgr2=0x7f2100071520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:30.256 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:30.257+0000 7f21074a8640 1 -- 172.21.15.91:0/973743868 shutdown_connections 2023-11-27T18:13:30.256 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:30.257+0000 7f21074a8640 1 -- 172.21.15.91:0/973743868 wait complete. 2023-11-27T18:13:30.273 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-27T18:13:30.273 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-27T18:13:30.273 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi091.front.sepia.ceph.com 2023-11-27T18:13:30.273 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-11-27T18:13:30.274 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-11-27T18:13:30.274 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-27T18:13:30.274 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-27T18:13:30.274 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-27T18:13:30.274 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-11-27T18:13:30.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T18:13:30.277 DEBUG:teuthology.orchestra.run.smithi091:> ip addr 2023-11-27T18:13:30.283 INFO:teuthology.orchestra.run.smithi091.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-27T18:13:30.283 INFO:teuthology.orchestra.run.smithi091.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-27T18:13:30.283 INFO:teuthology.orchestra.run.smithi091.stdout: inet 127.0.0.1/8 scope host lo 2023-11-27T18:13:30.283 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-27T18:13:30.283 INFO:teuthology.orchestra.run.smithi091.stdout: inet6 ::1/128 scope host 2023-11-27T18:13:30.283 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-27T18:13:30.283 INFO:teuthology.orchestra.run.smithi091.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-27T18:13:30.283 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 0c:c4:7a:d8:d9:c4 brd ff:ff:ff:ff:ff:ff 2023-11-27T18:13:30.284 INFO:teuthology.orchestra.run.smithi091.stdout: altname enp7s0f0 2023-11-27T18:13:30.284 INFO:teuthology.orchestra.run.smithi091.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-27T18:13:30.284 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 0c:c4:7a:d8:d9:c5 brd ff:ff:ff:ff:ff:ff 2023-11-27T18:13:30.284 INFO:teuthology.orchestra.run.smithi091.stdout: altname enp7s0f1 2023-11-27T18:13:30.284 INFO:teuthology.orchestra.run.smithi091.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-27T18:13:30.284 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 0c:c4:7a:8f:d3:d4 brd ff:ff:ff:ff:ff:ff 2023-11-27T18:13:30.284 INFO:teuthology.orchestra.run.smithi091.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-27T18:13:30.284 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 0c:c4:7a:8f:d3:d5 brd ff:ff:ff:ff:ff:ff 2023-11-27T18:13:30.284 INFO:teuthology.orchestra.run.smithi091.stdout: inet 172.21.15.91/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-27T18:13:30.284 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft 41836sec preferred_lft 41836sec 2023-11-27T18:13:30.284 INFO:teuthology.orchestra.run.smithi091.stdout: inet6 fe80::ec4:7aff:fe8f:d3d5/64 scope link 2023-11-27T18:13:30.285 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-27T18:13:30.285 INFO:teuthology.orchestra.run.smithi091.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-27T18:13:30.285 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 02:42:8f:16:d7:94 brd ff:ff:ff:ff:ff:ff 2023-11-27T18:13:30.285 INFO:teuthology.orchestra.run.smithi091.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-27T18:13:30.285 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-27T18:13:30.285 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-27T18:13:30.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T18:13:30.286 DEBUG:teuthology.orchestra.run.smithi091:> (cd / && exec bash -c ' 2023-11-27T18:13:30.286 DEBUG:teuthology.orchestra.run.smithi091:> set -e 2023-11-27T18:13:30.286 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip link add name ceph-brx type bridge 2023-11-27T18:13:30.286 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip addr flush dev ceph-brx 2023-11-27T18:13:30.286 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip link set ceph-brx up 2023-11-27T18:13:30.286 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-27T18:13:30.286 DEBUG:teuthology.orchestra.run.smithi091:> ') 2023-11-27T18:13:30.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T18:13:30.361 DEBUG:teuthology.orchestra.run.smithi091:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-27T18:13:30.416 INFO:teuthology.orchestra.run.smithi091.stdout:1 2023-11-27T18:13:30.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T18:13:30.418 DEBUG:teuthology.orchestra.run.smithi091:> route 2023-11-27T18:13:30.750 INFO:teuthology.orchestra.run.smithi091.stdout:Kernel IP routing table 2023-11-27T18:13:30.750 INFO:teuthology.orchestra.run.smithi091.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-27T18:13:30.750 INFO:teuthology.orchestra.run.smithi091.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-27T18:13:30.750 INFO:teuthology.orchestra.run.smithi091.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-27T18:13:30.751 INFO:teuthology.orchestra.run.smithi091.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-27T18:13:30.751 INFO:teuthology.orchestra.run.smithi091.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-27T18:13:30.751 INFO:teuthology.orchestra.run.smithi091.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-27T18:13:30.751 INFO:teuthology.orchestra.run.smithi091.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-27T18:13:30.751 INFO:teuthology.orchestra.run.smithi091.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-27T18:13:30.751 INFO:teuthology.orchestra.run.smithi091.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-27T18:13:30.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T18:13:30.751 DEBUG:teuthology.orchestra.run.smithi091:> (cd / && exec bash -c ' 2023-11-27T18:13:30.752 DEBUG:teuthology.orchestra.run.smithi091:> set -e 2023-11-27T18:13:30.752 DEBUG:teuthology.orchestra.run.smithi091:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-27T18:13:30.752 DEBUG:teuthology.orchestra.run.smithi091:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-27T18:13:30.752 DEBUG:teuthology.orchestra.run.smithi091:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-27T18:13:30.752 DEBUG:teuthology.orchestra.run.smithi091:> ') 2023-11-27T18:13:30.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T18:13:30.786 DEBUG:teuthology.orchestra.run.smithi091:> ip netns list 2023-11-27T18:13:30.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T18:13:30.834 DEBUG:teuthology.orchestra.run.smithi091:> ip netns list-id 2023-11-27T18:13:30.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T18:13:30.881 DEBUG:teuthology.orchestra.run.smithi091:> (cd / && exec bash -c ' 2023-11-27T18:13:30.881 DEBUG:teuthology.orchestra.run.smithi091:> set -e 2023-11-27T18:13:30.881 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-27T18:13:30.881 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-11-27T18:13:30.881 DEBUG:teuthology.orchestra.run.smithi091:> ') 2023-11-27T18:13:30.951 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-11-27T18:13:30.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T18:13:30.951 DEBUG:teuthology.orchestra.run.smithi091:> (cd / && exec bash -c ' 2023-11-27T18:13:30.951 DEBUG:teuthology.orchestra.run.smithi091:> set -e 2023-11-27T18:13:30.951 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-11-27T18:13:30.952 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-27T18:13:30.952 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-11-27T18:13:30.952 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-11-27T18:13:30.952 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-11-27T18:13:30.952 DEBUG:teuthology.orchestra.run.smithi091:> ') 2023-11-27T18:13:31.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T18:13:31.117 DEBUG:teuthology.orchestra.run.smithi091:> (cd / && exec bash -c ' 2023-11-27T18:13:31.117 DEBUG:teuthology.orchestra.run.smithi091:> set -e 2023-11-27T18:13:31.117 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip link set brx.0 up 2023-11-27T18:13:31.117 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip link set dev brx.0 master ceph-brx 2023-11-27T18:13:31.117 DEBUG:teuthology.orchestra.run.smithi091:> ') 2023-11-27T18:13:31.136 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-11-27T18:13:31.137 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T18:13:31.137 DEBUG:teuthology.orchestra.run.smithi091:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-11-27T18:13:31.188 INFO:teuthology.orchestra.run.smithi091.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-11-27T18:13:31.189 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T18:13:31.189 DEBUG:teuthology.orchestra.run.smithi091:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-11-27T18:13:31.241 DEBUG:teuthology.orchestra.run.smithi091:> sudo modprobe fuse 2023-11-27T18:13:31.299 DEBUG:teuthology.orchestra.run.smithi091:> cat /proc/self/mounts | awk '{print $2}' 2023-11-27T18:13:31.348 INFO:teuthology.orchestra.run.smithi091.stdout:/sys 2023-11-27T18:13:31.348 INFO:teuthology.orchestra.run.smithi091.stdout:/proc 2023-11-27T18:13:31.348 INFO:teuthology.orchestra.run.smithi091.stdout:/dev 2023-11-27T18:13:31.349 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/pts 2023-11-27T18:13:31.349 INFO:teuthology.orchestra.run.smithi091.stdout:/run 2023-11-27T18:13:31.349 INFO:teuthology.orchestra.run.smithi091.stdout:/ 2023-11-27T18:13:31.349 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/security 2023-11-27T18:13:31.349 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/shm 2023-11-27T18:13:31.349 INFO:teuthology.orchestra.run.smithi091.stdout:/run/lock 2023-11-27T18:13:31.349 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/cgroup 2023-11-27T18:13:31.349 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/pstore 2023-11-27T18:13:31.349 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/bpf 2023-11-27T18:13:31.349 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/sys/fs/binfmt_misc 2023-11-27T18:13:31.349 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/hugepages 2023-11-27T18:13:31.349 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/mqueue 2023-11-27T18:13:31.349 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/debug 2023-11-27T18:13:31.350 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/tracing 2023-11-27T18:13:31.350 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/fs/nfsd 2023-11-27T18:13:31.350 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/fuse/connections 2023-11-27T18:13:31.350 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/config 2023-11-27T18:13:31.350 INFO:teuthology.orchestra.run.smithi091.stdout:/run/credentials/systemd-sysusers.service 2023-11-27T18:13:31.350 INFO:teuthology.orchestra.run.smithi091.stdout:/run/rpc_pipefs 2023-11-27T18:13:31.350 INFO:teuthology.orchestra.run.smithi091.stdout:/run/user/1000 2023-11-27T18:13:31.350 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph 2023-11-27T18:13:31.350 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-0 2023-11-27T18:13:31.350 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-1 2023-11-27T18:13:31.350 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-2 2023-11-27T18:13:31.350 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-3 2023-11-27T18:13:31.350 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns 2023-11-27T18:13:31.351 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-27T18:13:31.351 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-27T18:13:31.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T18:13:31.352 DEBUG:teuthology.orchestra.run.smithi091:> ls /sys/fs/fuse/connections 2023-11-27T18:13:31.401 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-27T18:13:31.401 DEBUG:teuthology.orchestra.run.smithi091:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-11-27T18:13:31.446 DEBUG:teuthology.orchestra.run.smithi091:> sudo modprobe fuse 2023-11-27T18:13:31.459 DEBUG:teuthology.orchestra.run.smithi091:> cat /proc/self/mounts | awk '{print $2}' 2023-11-27T18:13:31.506 INFO:teuthology.orchestra.run.smithi091.stdout:/sys 2023-11-27T18:13:31.506 INFO:teuthology.orchestra.run.smithi091.stdout:/proc 2023-11-27T18:13:31.506 INFO:teuthology.orchestra.run.smithi091.stdout:/dev 2023-11-27T18:13:31.506 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/pts 2023-11-27T18:13:31.506 INFO:teuthology.orchestra.run.smithi091.stdout:/run 2023-11-27T18:13:31.506 INFO:teuthology.orchestra.run.smithi091.stdout:/ 2023-11-27T18:13:31.506 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/security 2023-11-27T18:13:31.507 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/shm 2023-11-27T18:13:31.507 INFO:teuthology.orchestra.run.smithi091.stdout:/run/lock 2023-11-27T18:13:31.507 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/cgroup 2023-11-27T18:13:31.507 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/pstore 2023-11-27T18:13:31.507 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/bpf 2023-11-27T18:13:31.507 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/sys/fs/binfmt_misc 2023-11-27T18:13:31.507 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/hugepages 2023-11-27T18:13:31.508 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/mqueue 2023-11-27T18:13:31.508 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/debug 2023-11-27T18:13:31.508 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/tracing 2023-11-27T18:13:31.508 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/fs/nfsd 2023-11-27T18:13:31.508 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/fuse/connections 2023-11-27T18:13:31.508 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/config 2023-11-27T18:13:31.508 INFO:teuthology.orchestra.run.smithi091.stdout:/run/credentials/systemd-sysusers.service 2023-11-27T18:13:31.508 INFO:teuthology.orchestra.run.smithi091.stdout:/run/rpc_pipefs 2023-11-27T18:13:31.509 INFO:teuthology.orchestra.run.smithi091.stdout:/run/user/1000 2023-11-27T18:13:31.509 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph 2023-11-27T18:13:31.509 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-0 2023-11-27T18:13:31.509 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-1 2023-11-27T18:13:31.509 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-2 2023-11-27T18:13:31.509 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-3 2023-11-27T18:13:31.509 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns 2023-11-27T18:13:31.509 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-27T18:13:31.509 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-27T18:13:31.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T18:13:31.510 DEBUG:teuthology.orchestra.run.smithi091:> ls /sys/fs/fuse/connections 2023-11-27T18:13:31.570 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi091.stderr:2023-11-27T18:13:31.573+0000 7fe9206dc580 -1 init, newargv = 0x556183e09e30 newargc=15 2023-11-27T18:13:31.570 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi091.stderr:ceph-fuse[43042]: starting ceph client 2023-11-27T18:13:31.989 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi091.stderr:ceph-fuse[43042]: starting fuse 2023-11-27T18:13:32.658 DEBUG:teuthology.orchestra.run.smithi091:> sudo modprobe fuse 2023-11-27T18:13:32.674 DEBUG:teuthology.orchestra.run.smithi091:> cat /proc/self/mounts | awk '{print $2}' 2023-11-27T18:13:32.722 INFO:teuthology.orchestra.run.smithi091.stdout:/sys 2023-11-27T18:13:32.722 INFO:teuthology.orchestra.run.smithi091.stdout:/proc 2023-11-27T18:13:32.722 INFO:teuthology.orchestra.run.smithi091.stdout:/dev 2023-11-27T18:13:32.722 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/pts 2023-11-27T18:13:32.722 INFO:teuthology.orchestra.run.smithi091.stdout:/run 2023-11-27T18:13:32.722 INFO:teuthology.orchestra.run.smithi091.stdout:/ 2023-11-27T18:13:32.722 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/security 2023-11-27T18:13:32.722 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/shm 2023-11-27T18:13:32.722 INFO:teuthology.orchestra.run.smithi091.stdout:/run/lock 2023-11-27T18:13:32.722 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/cgroup 2023-11-27T18:13:32.723 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/pstore 2023-11-27T18:13:32.723 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/bpf 2023-11-27T18:13:32.723 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/sys/fs/binfmt_misc 2023-11-27T18:13:32.723 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/hugepages 2023-11-27T18:13:32.723 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/mqueue 2023-11-27T18:13:32.723 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/debug 2023-11-27T18:13:32.723 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/tracing 2023-11-27T18:13:32.723 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/fs/nfsd 2023-11-27T18:13:32.723 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/fuse/connections 2023-11-27T18:13:32.723 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/config 2023-11-27T18:13:32.723 INFO:teuthology.orchestra.run.smithi091.stdout:/run/credentials/systemd-sysusers.service 2023-11-27T18:13:32.723 INFO:teuthology.orchestra.run.smithi091.stdout:/run/rpc_pipefs 2023-11-27T18:13:32.723 INFO:teuthology.orchestra.run.smithi091.stdout:/run/user/1000 2023-11-27T18:13:32.723 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph 2023-11-27T18:13:32.724 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-0 2023-11-27T18:13:32.724 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-1 2023-11-27T18:13:32.724 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-2 2023-11-27T18:13:32.724 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-3 2023-11-27T18:13:32.724 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns 2023-11-27T18:13:32.724 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-27T18:13:32.724 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-27T18:13:32.724 INFO:teuthology.orchestra.run.smithi091.stdout:/home/ubuntu/cephtest/mnt.admin 2023-11-27T18:13:32.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T18:13:32.725 DEBUG:teuthology.orchestra.run.smithi091:> ls /sys/fs/fuse/connections 2023-11-27T18:13:32.775 INFO:teuthology.orchestra.run.smithi091.stdout:45 2023-11-27T18:13:32.775 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-11-27T18:13:32.775 DEBUG:teuthology.orchestra.run.smithi091:> sudo stdin-killer -- python3 -c ' 2023-11-27T18:13:32.775 DEBUG:teuthology.orchestra.run.smithi091:> import glob 2023-11-27T18:13:32.775 DEBUG:teuthology.orchestra.run.smithi091:> import re 2023-11-27T18:13:32.775 DEBUG:teuthology.orchestra.run.smithi091:> import os 2023-11-27T18:13:32.775 DEBUG:teuthology.orchestra.run.smithi091:> import subprocess 2023-11-27T18:13:32.776 DEBUG:teuthology.orchestra.run.smithi091:> 2023-11-27T18:13:32.776 DEBUG:teuthology.orchestra.run.smithi091:> def _find_admin_socket(client_name): 2023-11-27T18:13:32.776 DEBUG:teuthology.orchestra.run.smithi091:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-11-27T18:13:32.776 DEBUG:teuthology.orchestra.run.smithi091:> files = glob.glob(asok_path) 2023-11-27T18:13:32.776 DEBUG:teuthology.orchestra.run.smithi091:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-11-27T18:13:32.776 DEBUG:teuthology.orchestra.run.smithi091:> 2023-11-27T18:13:32.776 DEBUG:teuthology.orchestra.run.smithi091:> # Given a non-glob path, it better be there 2023-11-27T18:13:32.776 DEBUG:teuthology.orchestra.run.smithi091:> if "*" not in asok_path: 2023-11-27T18:13:32.776 DEBUG:teuthology.orchestra.run.smithi091:> assert(len(files) == 1) 2023-11-27T18:13:32.776 DEBUG:teuthology.orchestra.run.smithi091:> return files[0] 2023-11-27T18:13:32.776 DEBUG:teuthology.orchestra.run.smithi091:> 2023-11-27T18:13:32.776 DEBUG:teuthology.orchestra.run.smithi091:> for f in files: 2023-11-27T18:13:32.776 DEBUG:teuthology.orchestra.run.smithi091:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-27T18:13:32.777 DEBUG:teuthology.orchestra.run.smithi091:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-27T18:13:32.777 DEBUG:teuthology.orchestra.run.smithi091:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-27T18:13:32.777 DEBUG:teuthology.orchestra.run.smithi091:> contents = proc_f.read() 2023-11-27T18:13:32.777 DEBUG:teuthology.orchestra.run.smithi091:> if mountpoint in contents: 2023-11-27T18:13:32.777 DEBUG:teuthology.orchestra.run.smithi091:> return f 2023-11-27T18:13:32.777 DEBUG:teuthology.orchestra.run.smithi091:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-27T18:13:32.777 DEBUG:teuthology.orchestra.run.smithi091:> 2023-11-27T18:13:32.777 DEBUG:teuthology.orchestra.run.smithi091:> print(_find_admin_socket("client.admin")) 2023-11-27T18:13:32.777 DEBUG:teuthology.orchestra.run.smithi091:> ' 2023-11-27T18:13:32.897 INFO:teuthology.orchestra.run.smithi091.stdout:/var/run/ceph/ceph-client.admin.43042.asok 2023-11-27T18:13:32.901 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-27T18:13:32.910 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.43042.asok 2023-11-27T18:13:32.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T18:13:32.910 DEBUG:teuthology.orchestra.run.smithi091:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.43042.asok status 2023-11-27T18:13:33.061 INFO:teuthology.orchestra.run.smithi091.stdout:{ 2023-11-27T18:13:33.061 INFO:teuthology.orchestra.run.smithi091.stdout: "metadata": { 2023-11-27T18:13:33.061 INFO:teuthology.orchestra.run.smithi091.stdout: "ceph_sha1": "369173db14b6995b2bd07c60ec5f63d01cf21631", 2023-11-27T18:13:33.061 INFO:teuthology.orchestra.run.smithi091.stdout: "ceph_version": "ceph version 18.0.0-7498-g369173db (369173db14b6995b2bd07c60ec5f63d01cf21631) squid (dev)", 2023-11-27T18:13:33.062 INFO:teuthology.orchestra.run.smithi091.stdout: "entity_id": "admin", 2023-11-27T18:13:33.062 INFO:teuthology.orchestra.run.smithi091.stdout: "hostname": "smithi091", 2023-11-27T18:13:33.062 INFO:teuthology.orchestra.run.smithi091.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-11-27T18:13:33.062 INFO:teuthology.orchestra.run.smithi091.stdout: "pid": "43042", 2023-11-27T18:13:33.062 INFO:teuthology.orchestra.run.smithi091.stdout: "root": "/" 2023-11-27T18:13:33.062 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T18:13:33.062 INFO:teuthology.orchestra.run.smithi091.stdout: "dentry_count": 0, 2023-11-27T18:13:33.062 INFO:teuthology.orchestra.run.smithi091.stdout: "dentry_pinned_count": 0, 2023-11-27T18:13:33.062 INFO:teuthology.orchestra.run.smithi091.stdout: "id": 4353, 2023-11-27T18:13:33.062 INFO:teuthology.orchestra.run.smithi091.stdout: "inst": { 2023-11-27T18:13:33.062 INFO:teuthology.orchestra.run.smithi091.stdout: "name": { 2023-11-27T18:13:33.062 INFO:teuthology.orchestra.run.smithi091.stdout: "type": "client", 2023-11-27T18:13:33.062 INFO:teuthology.orchestra.run.smithi091.stdout: "num": 4353 2023-11-27T18:13:33.063 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T18:13:33.063 INFO:teuthology.orchestra.run.smithi091.stdout: "addr": { 2023-11-27T18:13:33.063 INFO:teuthology.orchestra.run.smithi091.stdout: "type": "v1", 2023-11-27T18:13:33.063 INFO:teuthology.orchestra.run.smithi091.stdout: "addr": "192.168.0.1:0", 2023-11-27T18:13:33.063 INFO:teuthology.orchestra.run.smithi091.stdout: "nonce": 2298745264 2023-11-27T18:13:33.063 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T18:13:33.063 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T18:13:33.063 INFO:teuthology.orchestra.run.smithi091.stdout: "addr": { 2023-11-27T18:13:33.063 INFO:teuthology.orchestra.run.smithi091.stdout: "type": "v1", 2023-11-27T18:13:33.063 INFO:teuthology.orchestra.run.smithi091.stdout: "addr": "192.168.0.1:0", 2023-11-27T18:13:33.063 INFO:teuthology.orchestra.run.smithi091.stdout: "nonce": 2298745264 2023-11-27T18:13:33.063 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T18:13:33.063 INFO:teuthology.orchestra.run.smithi091.stdout: "inst_str": "client.4353 192.168.0.1:0/2298745264", 2023-11-27T18:13:33.064 INFO:teuthology.orchestra.run.smithi091.stdout: "addr_str": "192.168.0.1:0/2298745264", 2023-11-27T18:13:33.064 INFO:teuthology.orchestra.run.smithi091.stdout: "inode_count": 1, 2023-11-27T18:13:33.064 INFO:teuthology.orchestra.run.smithi091.stdout: "mds_epoch": 6, 2023-11-27T18:13:33.064 INFO:teuthology.orchestra.run.smithi091.stdout: "osd_epoch": 30, 2023-11-27T18:13:33.064 INFO:teuthology.orchestra.run.smithi091.stdout: "osd_epoch_barrier": 0, 2023-11-27T18:13:33.064 INFO:teuthology.orchestra.run.smithi091.stdout: "blocklisted": false, 2023-11-27T18:13:33.064 INFO:teuthology.orchestra.run.smithi091.stdout: "fs_name": "cephfs" 2023-11-27T18:13:33.064 INFO:teuthology.orchestra.run.smithi091.stdout:} 2023-11-27T18:13:33.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T18:13:33.075 DEBUG:teuthology.orchestra.run.smithi091:> stat --file-system '--printf=%T 2023-11-27T18:13:33.075 DEBUG:teuthology.orchestra.run.smithi091:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-11-27T18:13:33.114 INFO:teuthology.orchestra.run.smithi091.stdout:fuseblk 2023-11-27T18:13:33.114 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-11-27T18:13:33.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T18:13:33.115 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-11-27T18:13:33.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T18:13:33.302 DEBUG:teuthology.orchestra.run.smithi091:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-11-27T18:13:33.760 INFO:teuthology.orchestra.run.smithi091.stdout:# file: . 2023-11-27T18:13:33.760 INFO:teuthology.orchestra.run.smithi091.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-11-27T18:13:33.760 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:13:33.761 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T18:13:33.761 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T18:13:33.768 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T18:13:33.944 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.949+0000 7f4b375e8640 1 Processor -- start 2023-11-27T18:13:33.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.949+0000 7f4b375e8640 1 -- start start 2023-11-27T18:13:33.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.949+0000 7f4b375e8640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4b300c85c0 0x7f4b3006cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:33.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.949+0000 7f4b375e8640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f4b300c5f10 0x7f4b3006d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:33.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.949+0000 7f4b375e8640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b30072b70 con 0x7f4b30151820 2023-11-27T18:13:33.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.949+0000 7f4b375e8640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b300c2d20 con 0x7f4b300c5f10 2023-11-27T18:13:33.946 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.949+0000 7f4b375e8640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b300c6490 con 0x7f4b300c85c0 2023-11-27T18:13:33.946 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.949+0000 7f4b35b85640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f4b300c5f10 0x7f4b3006d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:33.946 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.949+0000 7f4b35384640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f4b30151820 0x7f4b30070e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:43998/0 (socket says 172.21.15.91:43998) 2023-11-27T18:13:33.946 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.949+0000 7f4b35384640 1 -- 172.21.15.91:0/4122356630 learned_addr learned my addr 172.21.15.91:0/4122356630 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:13:33.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.949+0000 7f4b34b83640 1 --2- 172.21.15.91:0/4122356630 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4b300c85c0 0x7f4b3006cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:33.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.953+0000 7f4b35b85640 1 -- 172.21.15.91:0/4122356630 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4b300c85c0 msgr2=0x7f4b3006cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:33.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.953+0000 7f4b35b85640 1 --2- 172.21.15.91:0/4122356630 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4b300c85c0 0x7f4b3006cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:33.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.953+0000 7f4b35b85640 1 -- 172.21.15.91:0/4122356630 >> v1:172.21.15.91:6789/0 conn(0x7f4b30151820 legacy=0x7f4b30070e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:33.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.953+0000 7f4b35b85640 1 -- 172.21.15.91:0/4122356630 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b30158160 con 0x7f4b300c5f10 2023-11-27T18:13:33.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.957+0000 7f4b35b85640 1 --2- 172.21.15.91:0/4122356630 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4b300c5f10 0x7f4b3006d0d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4b28009d90 tx=0x7f4b2801f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aed554b3b41ae31 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:33.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.961+0000 7f4b27fff640 1 -- 172.21.15.91:0/4122356630 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b280af600 con 0x7f4b300c5f10 2023-11-27T18:13:33.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.961+0000 7f4b27fff640 1 -- 172.21.15.91:0/4122356630 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b280ab050 con 0x7f4b300c5f10 2023-11-27T18:13:33.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.961+0000 7f4b27fff640 1 -- 172.21.15.91:0/4122356630 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b280af980 con 0x7f4b300c5f10 2023-11-27T18:13:33.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.965+0000 7f4b375e8640 1 -- 172.21.15.91:0/4122356630 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4b300c5f10 msgr2=0x7f4b3006d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:33.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.965+0000 7f4b375e8640 1 --2- 172.21.15.91:0/4122356630 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4b300c5f10 0x7f4b3006d0d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4b28009d90 tx=0x7f4b2801f130 comp rx=0 tx=0).stop 2023-11-27T18:13:33.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.965+0000 7f4b375e8640 1 -- 172.21.15.91:0/4122356630 shutdown_connections 2023-11-27T18:13:33.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.965+0000 7f4b375e8640 1 --2- 172.21.15.91:0/4122356630 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4b300c5f10 0x7f4b3006d0d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:33.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.965+0000 7f4b375e8640 1 --2- 172.21.15.91:0/4122356630 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4b300c85c0 0x7f4b3006cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:33.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.965+0000 7f4b375e8640 1 -- 172.21.15.91:0/4122356630 >> 172.21.15.91:0/4122356630 conn(0x7f4b300c79b0 msgr2=0x7f4b300c7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:33.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.965+0000 7f4b375e8640 1 -- 172.21.15.91:0/4122356630 shutdown_connections 2023-11-27T18:13:33.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.965+0000 7f4b375e8640 1 -- 172.21.15.91:0/4122356630 wait complete. 2023-11-27T18:13:33.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.965+0000 7f4b375e8640 1 Processor -- start 2023-11-27T18:13:33.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.965+0000 7f4b375e8640 1 -- start start 2023-11-27T18:13:33.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.965+0000 7f4b375e8640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4b300c5f10 0x7f4b300c12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:33.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.965+0000 7f4b375e8640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4b300c85c0 0x7f4b301491e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:33.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.965+0000 7f4b375e8640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4b30151820 0x7f4b30156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:33.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.965+0000 7f4b375e8640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b301f31c0 con 0x7f4b30151820 2023-11-27T18:13:33.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.965+0000 7f4b375e8640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b30156970 con 0x7f4b300c5f10 2023-11-27T18:13:33.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.965+0000 7f4b375e8640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b300c1ad0 con 0x7f4b300c85c0 2023-11-27T18:13:33.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.965+0000 7f4b35b85640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4b30151820 0x7f4b30156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:33.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.965+0000 7f4b35b85640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4b30151820 0x7f4b30156c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44400/0 (socket says 172.21.15.91:44400) 2023-11-27T18:13:33.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.965+0000 7f4b35b85640 1 -- 172.21.15.91:0/3321550577 learned_addr learned my addr 172.21.15.91:0/3321550577 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:33.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.969+0000 7f4b35384640 1 --2- 172.21.15.91:0/3321550577 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4b300c5f10 0x7f4b300c12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:33.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.969+0000 7f4b34b83640 1 --2- 172.21.15.91:0/3321550577 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4b300c85c0 0x7f4b301491e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:33.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.969+0000 7f4b35b85640 1 -- 172.21.15.91:0/3321550577 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4b300c85c0 msgr2=0x7f4b301491e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:33.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.969+0000 7f4b35b85640 1 --2- 172.21.15.91:0/3321550577 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4b300c85c0 0x7f4b301491e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:33.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.969+0000 7f4b35b85640 1 -- 172.21.15.91:0/3321550577 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4b300c5f10 msgr2=0x7f4b300c12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:33.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.969+0000 7f4b35b85640 1 --2- 172.21.15.91:0/3321550577 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4b300c5f10 0x7f4b300c12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:33.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.969+0000 7f4b35b85640 1 -- 172.21.15.91:0/3321550577 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b28009a70 con 0x7f4b30151820 2023-11-27T18:13:33.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.973+0000 7f4b35b85640 1 --2- 172.21.15.91:0/3321550577 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4b30151820 0x7f4b30156c30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4b2801d7e0 tx=0x7f4b2801bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:33.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.977+0000 7f4b25ffb640 1 -- 172.21.15.91:0/3321550577 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b280afca0 con 0x7f4b30151820 2023-11-27T18:13:33.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.977+0000 7f4b25ffb640 1 -- 172.21.15.91:0/3321550577 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b280afe00 con 0x7f4b30151820 2023-11-27T18:13:33.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.977+0000 7f4b25ffb640 1 -- 172.21.15.91:0/3321550577 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b280c4630 con 0x7f4b30151820 2023-11-27T18:13:33.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.977+0000 7f4b375e8640 1 -- 172.21.15.91:0/3321550577 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b300c1db0 con 0x7f4b30151820 2023-11-27T18:13:33.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.977+0000 7f4b375e8640 1 -- 172.21.15.91:0/3321550577 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b301f2b00 con 0x7f4b30151820 2023-11-27T18:13:33.975 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.977+0000 7f4b375e8640 1 -- 172.21.15.91:0/3321550577 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b301f3300 con 0x7f4b30151820 2023-11-27T18:13:33.995 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.997+0000 7f4b25ffb640 1 -- 172.21.15.91:0/3321550577 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f4b280b6070 con 0x7f4b30151820 2023-11-27T18:13:33.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.997+0000 7f4b25ffb640 1 --2- 172.21.15.91:0/3321550577 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f4b14066840 0x7f4b14068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:33.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.997+0000 7f4b35384640 1 --2- 172.21.15.91:0/3321550577 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f4b14066840 0x7f4b14068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:33.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:33.997+0000 7f4b35384640 1 --2- 172.21.15.91:0/3321550577 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f4b14066840 0x7f4b14068d00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c000f70 tx=0x7f4b2c007e90 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:34.269 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.273+0000 7f4b25ffb640 1 -- 172.21.15.91:0/3321550577 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4b280f44c0 con 0x7f4b30151820 2023-11-27T18:13:34.269 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.273+0000 7f4b25ffb640 1 -- 172.21.15.91:0/3321550577 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f4b280f3b90 con 0x7f4b30151820 2023-11-27T18:13:34.371 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:13:34.374 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:13:34.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.429+0000 7f4b375e8640 1 -- 172.21.15.91:0/3321550577 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b301f3300 con 0x7f4b30151820 2023-11-27T18:13:34.481 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.485+0000 7f4b25ffb640 1 -- 172.21.15.91:0/3321550577 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f4b301f3300 con 0x7f4b30151820 2023-11-27T18:13:34.542 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:13:34.542 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":30,"fsid":"08c8ebbf-7936-4c41-a995-d5600de2d072","created":"2023-11-27T18:12:06.484593+0000","modified":"2023-11-27T18:13:22.801287+0000","last_up_change":"2023-11-27T18:12:33.154694+0000","last_in_change":"2023-11-27T18:12:23.622113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T18:12:35.450305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T18:13:09.589619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T18:13:11.439236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-27T18:13:18.514694+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ad53c08-dd19-4ae6-87c5-fa15bea3b4ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6811","nonce":472303992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6813","nonce":472303992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6817","nonce":472303992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6815","nonce":472303992}]},"public_addr":"172.21.15.91:6811/472303992","cluster_addr":"172.21.15.91:6813/472303992","heartbeat_back_addr":"172.21.15.91:6817/472303992","heartbeat_front_addr":"172.21.15.91:6815/472303992","state":["exists","up"]},{"osd":1,"uuid":"f8b5f147-ed29-4329-a787-a12cc34a2569","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6827","nonce":12316911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6829","nonce":12316911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6833","nonce":12316911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6831","nonce":12316911}]},"public_addr":"172.21.15.91:6827/12316911","cluster_addr":"172.21.15.91:6829/12316911","heartbeat_back_addr":"172.21.15.91:6833/12316911","heartbeat_front_addr":"172.21.15.91:6831/12316911","state":["exists","up"]},{"osd":2,"uuid":"c3029f9a-1c48-4f5d-983a-172a614d8795","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6803","nonce":3776125919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6805","nonce":3776125919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6809","nonce":3776125919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6807","nonce":3776125919}]},"public_addr":"172.21.15.91:6803/3776125919","cluster_addr":"172.21.15.91:6805/3776125919","heartbeat_back_addr":"172.21.15.91:6809/3776125919","heartbeat_front_addr":"172.21.15.91:6807/3776125919","state":["exists","up"]},{"osd":3,"uuid":"ab4b6fb2-0126-491b-9224-54a6badc5da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6819","nonce":1297704794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6821","nonce":1297704794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6825","nonce":1297704794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6823","nonce":1297704794}]},"public_addr":"172.21.15.91:6819/1297704794","cluster_addr":"172.21.15.91:6821/1297704794","heartbeat_back_addr":"172.21.15.91:6825/1297704794","heartbeat_front_addr":"172.21.15.91:6823/1297704794","state":["exists","up"]},{"osd":4,"uuid":"695071a8-2de8-4cba-bf20-050021a03bb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6809","nonce":2501531833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6811","nonce":2501531833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6815","nonce":2501531833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6813","nonce":2501531833}]},"public_addr":"172.21.15.94:6809/2501531833","cluster_addr":"172.21.15.94:6811/2501531833","heartbeat_back_addr":"172.21.15.94:6815/2501531833","heartbeat_front_addr":"172.21.15.94:6813/2501531833","state":["exists","up"]},{"osd":5,"uuid":"ca01da14-a700-4845-8db2-f5e3370677e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6817","nonce":2448969592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6819","nonce":2448969592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6823","nonce":2448969592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6821","nonce":2448969592}]},"public_addr":"172.21.15.94:6817/2448969592","cluster_addr":"172.21.15.94:6819/2448969592","heartbeat_back_addr":"172.21.15.94:6823/2448969592","heartbeat_front_addr":"172.21.15.94:6821/2448969592","state":["exists","up"]},{"osd":6,"uuid":"4784bc77-6c33-4e47-abba-d37484982f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6825","nonce":3389553935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6827","nonce":3389553935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6831","nonce":3389553935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6829","nonce":3389553935}]},"public_addr":"172.21.15.94:6825/3389553935","cluster_addr":"172.21.15.94:6827/3389553935","heartbeat_back_addr":"172.21.15.94:6831/3389553935","heartbeat_front_addr":"172.21.15.94:6829/3389553935","state":["exists","up"]},{"osd":7,"uuid":"b954cf3f-4a4f-4a75-9f90-014f72c16d15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6801","nonce":1606498064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6803","nonce":1606498064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6807","nonce":1606498064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6805","nonce":1606498064}]},"public_addr":"172.21.15.94:6801/1606498064","cluster_addr":"172.21.15.94:6803/1606498064","heartbeat_back_addr":"172.21.15.94:6807/1606498064","heartbeat_front_addr":"172.21.15.94:6805/1606498064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.534968+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.506182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.339267+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.532432+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:28.935756+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.471559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.485014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.352978+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T18:13:34.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.489+0000 7f4b375e8640 1 -- 172.21.15.91:0/3321550577 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f4b14066840 msgr2=0x7f4b14068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:34.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.489+0000 7f4b375e8640 1 --2- 172.21.15.91:0/3321550577 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f4b14066840 0x7f4b14068d00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c000f70 tx=0x7f4b2c007e90 comp rx=0 tx=0).stop 2023-11-27T18:13:34.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.489+0000 7f4b375e8640 1 -- 172.21.15.91:0/3321550577 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4b30151820 msgr2=0x7f4b30156c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:34.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.489+0000 7f4b375e8640 1 --2- 172.21.15.91:0/3321550577 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4b30151820 0x7f4b30156c30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4b2801d7e0 tx=0x7f4b2801bed0 comp rx=0 tx=0).stop 2023-11-27T18:13:34.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.489+0000 7f4b375e8640 1 -- 172.21.15.91:0/3321550577 shutdown_connections 2023-11-27T18:13:34.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.489+0000 7f4b375e8640 1 --2- 172.21.15.91:0/3321550577 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f4b14066840 0x7f4b14068d00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:34.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.489+0000 7f4b375e8640 1 --2- 172.21.15.91:0/3321550577 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4b300c85c0 0x7f4b301491e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:34.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.489+0000 7f4b375e8640 1 --2- 172.21.15.91:0/3321550577 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4b30151820 0x7f4b30156c30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:34.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.489+0000 7f4b375e8640 1 --2- 172.21.15.91:0/3321550577 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4b300c5f10 0x7f4b300c12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:34.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.489+0000 7f4b375e8640 1 -- 172.21.15.91:0/3321550577 >> 172.21.15.91:0/3321550577 conn(0x7f4b300c79b0 msgr2=0x7f4b30072020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:34.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.489+0000 7f4b375e8640 1 -- 172.21.15.91:0/3321550577 shutdown_connections 2023-11-27T18:13:34.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.489+0000 7f4b375e8640 1 -- 172.21.15.91:0/3321550577 wait complete. 2023-11-27T18:13:34.545 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T18:12:35.450305+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T18:13:09.589619+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T18:13:11.439236+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-27T18:13:18.514694+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-27T18:13:34.546 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T18:13:34.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.721+0000 7f7f395dc640 1 Processor -- start 2023-11-27T18:13:34.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.721+0000 7f7f395dc640 1 -- start start 2023-11-27T18:13:34.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.721+0000 7f7f395dc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f7f340c8fc0 0x7f7f3415a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:34.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.721+0000 7f7f395dc640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7f340c7a90 0x7f7f340c84c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:34.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.721+0000 7f7f395dc640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f3415b840 con 0x7f7f34151770 2023-11-27T18:13:34.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.721+0000 7f7f395dc640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f34151b50 con 0x7f7f340c8fc0 2023-11-27T18:13:34.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.721+0000 7f7f395dc640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3415afa0 con 0x7f7f340c7a90 2023-11-27T18:13:34.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.721+0000 7f7f327fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f7f340c8fc0 0x7f7f3415a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:34.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.721+0000 7f7f32ffd640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f7f34151770 0x7f7f34070000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:44008/0 (socket says 172.21.15.91:44008) 2023-11-27T18:13:34.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.721+0000 7f7f32ffd640 1 -- 172.21.15.91:0/1385166060 learned_addr learned my addr 172.21.15.91:0/1385166060 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:13:34.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.721+0000 7f7f337fe640 1 --2- 172.21.15.91:0/1385166060 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7f340c7a90 0x7f7f340c84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:34.722 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.725+0000 7f7f327fc640 1 -- 172.21.15.91:0/1385166060 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7f340c7a90 msgr2=0x7f7f340c84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:34.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.725+0000 7f7f327fc640 1 --2- 172.21.15.91:0/1385166060 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7f340c7a90 0x7f7f340c84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:34.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.725+0000 7f7f327fc640 1 -- 172.21.15.91:0/1385166060 >> v1:172.21.15.91:6789/0 conn(0x7f7f34151770 legacy=0x7f7f34070000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:34.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.725+0000 7f7f327fc640 1 -- 172.21.15.91:0/1385166060 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f3415b280 con 0x7f7f340c8fc0 2023-11-27T18:13:34.726 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.729+0000 7f7f327fc640 1 --2- 172.21.15.91:0/1385166060 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7f340c8fc0 0x7f7f3415a8f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7f280097c0 tx=0x7f7f2801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=915d8782616353e0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:34.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.733+0000 7f7f31ffb640 1 -- 172.21.15.91:0/1385166060 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f280ab600 con 0x7f7f340c8fc0 2023-11-27T18:13:34.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.733+0000 7f7f31ffb640 1 -- 172.21.15.91:0/1385166060 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f280a7050 con 0x7f7f340c8fc0 2023-11-27T18:13:34.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.733+0000 7f7f31ffb640 1 -- 172.21.15.91:0/1385166060 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f280ab980 con 0x7f7f340c8fc0 2023-11-27T18:13:34.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.737+0000 7f7f395dc640 1 -- 172.21.15.91:0/1385166060 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7f340c8fc0 msgr2=0x7f7f3415a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:34.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.737+0000 7f7f395dc640 1 --2- 172.21.15.91:0/1385166060 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7f340c8fc0 0x7f7f3415a8f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7f280097c0 tx=0x7f7f2801c3c0 comp rx=0 tx=0).stop 2023-11-27T18:13:34.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.737+0000 7f7f395dc640 1 -- 172.21.15.91:0/1385166060 shutdown_connections 2023-11-27T18:13:34.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.737+0000 7f7f395dc640 1 --2- 172.21.15.91:0/1385166060 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7f340c7a90 0x7f7f340c84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:34.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.737+0000 7f7f395dc640 1 --2- 172.21.15.91:0/1385166060 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7f340c8fc0 0x7f7f3415a8f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:34.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.737+0000 7f7f395dc640 1 -- 172.21.15.91:0/1385166060 >> 172.21.15.91:0/1385166060 conn(0x7f7f34071ef0 msgr2=0x7f7f34072300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:34.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.737+0000 7f7f395dc640 1 -- 172.21.15.91:0/1385166060 shutdown_connections 2023-11-27T18:13:34.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.737+0000 7f7f395dc640 1 -- 172.21.15.91:0/1385166060 wait complete. 2023-11-27T18:13:34.734 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.737+0000 7f7f395dc640 1 Processor -- start 2023-11-27T18:13:34.734 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.737+0000 7f7f395dc640 1 -- start start 2023-11-27T18:13:34.735 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.737+0000 7f7f395dc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7f340c7a90 0x7f7f341f4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:34.735 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.737+0000 7f7f395dc640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7f340c8fc0 0x7f7f34144120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:34.735 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.737+0000 7f7f395dc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7f34151770 0x7f7f34153940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:34.735 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.737+0000 7f7f395dc640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f341534b0 con 0x7f7f34151770 2023-11-27T18:13:34.735 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.737+0000 7f7f395dc640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f340c5610 con 0x7f7f340c7a90 2023-11-27T18:13:34.735 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.737+0000 7f7f395dc640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f341531b0 con 0x7f7f340c8fc0 2023-11-27T18:13:34.735 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.737+0000 7f7f337fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7f34151770 0x7f7f34153940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:34.736 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.737+0000 7f7f337fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7f34151770 0x7f7f34153940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44426/0 (socket says 172.21.15.91:44426) 2023-11-27T18:13:34.736 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.737+0000 7f7f337fe640 1 -- 172.21.15.91:0/1130205182 learned_addr learned my addr 172.21.15.91:0/1130205182 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:34.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.741+0000 7f7f32ffd640 1 --2- 172.21.15.91:0/1130205182 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7f340c7a90 0x7f7f341f4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:34.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.741+0000 7f7f337fe640 1 -- 172.21.15.91:0/1130205182 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7f340c8fc0 msgr2=0x7f7f34144120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:34.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.741+0000 7f7f337fe640 1 --2- 172.21.15.91:0/1130205182 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7f340c8fc0 0x7f7f34144120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:34.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.741+0000 7f7f337fe640 1 -- 172.21.15.91:0/1130205182 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7f340c7a90 msgr2=0x7f7f341f4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:34.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.741+0000 7f7f337fe640 1 --2- 172.21.15.91:0/1130205182 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7f340c7a90 0x7f7f341f4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:34.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.741+0000 7f7f337fe640 1 -- 172.21.15.91:0/1130205182 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f28009420 con 0x7f7f34151770 2023-11-27T18:13:34.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.745+0000 7f7f337fe640 1 --2- 172.21.15.91:0/1130205182 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7f34151770 0x7f7f34153940 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c009d30 tx=0x7f7f2c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:34.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.745+0000 7f7f1b7fe640 1 -- 172.21.15.91:0/1130205182 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c009ba0 con 0x7f7f34151770 2023-11-27T18:13:34.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.745+0000 7f7f395dc640 1 -- 172.21.15.91:0/1130205182 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f341f47c0 con 0x7f7f34151770 2023-11-27T18:13:34.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.745+0000 7f7f395dc640 1 -- 172.21.15.91:0/1130205182 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f340c5860 con 0x7f7f34151770 2023-11-27T18:13:34.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.749+0000 7f7f395dc640 1 -- 172.21.15.91:0/1130205182 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f34153660 con 0x7f7f34151770 2023-11-27T18:13:34.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.749+0000 7f7f1b7fe640 1 -- 172.21.15.91:0/1130205182 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f2c00f040 con 0x7f7f34151770 2023-11-27T18:13:34.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:34.749+0000 7f7f1b7fe640 1 -- 172.21.15.91:0/1130205182 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c014680 con 0x7f7f34151770 2023-11-27T18:13:35.022 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.025+0000 7f7f1b7fe640 1 -- 172.21.15.91:0/1130205182 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f7f2c0147e0 con 0x7f7f34151770 2023-11-27T18:13:35.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.025+0000 7f7f1b7fe640 1 --2- 172.21.15.91:0/1130205182 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f7f200667f0 0x7f7f20068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:35.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.025+0000 7f7f32ffd640 1 --2- 172.21.15.91:0/1130205182 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f7f200667f0 0x7f7f20068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:35.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.025+0000 7f7f32ffd640 1 --2- 172.21.15.91:0/1130205182 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f7f200667f0 0x7f7f20068cb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7f24000f70 tx=0x7f7f24009040 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:35.059 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.061+0000 7f7f1b7fe640 1 -- 172.21.15.91:0/1130205182 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7f2c0568d0 con 0x7f7f34151770 2023-11-27T18:13:35.059 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.061+0000 7f7f1b7fe640 1 -- 172.21.15.91:0/1130205182 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f7f2c052510 con 0x7f7f34151770 2023-11-27T18:13:35.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.229+0000 7f7f395dc640 1 -- 172.21.15.91:0/1130205182 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7f34153660 con 0x7f7f34151770 2023-11-27T18:13:35.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.245+0000 7f7f1b7fe640 1 -- 172.21.15.91:0/1130205182 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7f34153660 con 0x7f7f34151770 2023-11-27T18:13:35.243 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 1 2023-11-27T18:13:35.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.249+0000 7f7f395dc640 1 -- 172.21.15.91:0/1130205182 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f7f200667f0 msgr2=0x7f7f20068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:35.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.249+0000 7f7f395dc640 1 --2- 172.21.15.91:0/1130205182 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f7f200667f0 0x7f7f20068cb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7f24000f70 tx=0x7f7f24009040 comp rx=0 tx=0).stop 2023-11-27T18:13:35.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.249+0000 7f7f395dc640 1 -- 172.21.15.91:0/1130205182 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7f34151770 msgr2=0x7f7f34153940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:35.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.249+0000 7f7f395dc640 1 --2- 172.21.15.91:0/1130205182 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7f34151770 0x7f7f34153940 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c009d30 tx=0x7f7f2c00c490 comp rx=0 tx=0).stop 2023-11-27T18:13:35.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.249+0000 7f7f395dc640 1 -- 172.21.15.91:0/1130205182 shutdown_connections 2023-11-27T18:13:35.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.249+0000 7f7f395dc640 1 --2- 172.21.15.91:0/1130205182 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f7f200667f0 0x7f7f20068cb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:35.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.249+0000 7f7f395dc640 1 --2- 172.21.15.91:0/1130205182 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7f340c8fc0 0x7f7f34144120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:35.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.249+0000 7f7f395dc640 1 --2- 172.21.15.91:0/1130205182 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7f34151770 0x7f7f34153940 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:35.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.249+0000 7f7f395dc640 1 --2- 172.21.15.91:0/1130205182 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7f340c7a90 0x7f7f341f4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:35.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.249+0000 7f7f395dc640 1 -- 172.21.15.91:0/1130205182 >> 172.21.15.91:0/1130205182 conn(0x7f7f34071ef0 msgr2=0x7f7f3414f830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:35.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.249+0000 7f7f395dc640 1 -- 172.21.15.91:0/1130205182 shutdown_connections 2023-11-27T18:13:35.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.249+0000 7f7f395dc640 1 -- 172.21.15.91:0/1130205182 wait complete. 2023-11-27T18:13:35.263 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T18:13:35.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.389+0000 7f63ef78b640 1 Processor -- start 2023-11-27T18:13:35.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.389+0000 7f63ef78b640 1 -- start start 2023-11-27T18:13:35.389 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.393+0000 7f63ef78b640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f63e80c40e0 0x7f63e80c44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:35.389 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.393+0000 7f63ef78b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f63e81576e0 0x7f63e8157b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:35.389 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.393+0000 7f63ef78b640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63e81580b0 con 0x7f63e8072820 2023-11-27T18:13:35.389 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.393+0000 7f63ef78b640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63e80c7090 con 0x7f63e81576e0 2023-11-27T18:13:35.389 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.393+0000 7f63ef78b640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e80c4a00 con 0x7f63e80c40e0 2023-11-27T18:13:35.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.393+0000 7f63edd28640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f63e81576e0 0x7f63e8157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:35.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.393+0000 7f63edd28640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f63e81576e0 0x7f63e8157b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.91:50548/0 (socket says 172.21.15.91:50548) 2023-11-27T18:13:35.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.393+0000 7f63edd28640 1 -- 172.21.15.91:0/164795539 learned_addr learned my addr 172.21.15.91:0/164795539 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:35.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.397+0000 7f63ed527640 1 --2- 172.21.15.91:0/164795539 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f63e80c40e0 0x7f63e80c44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:35.398 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.401+0000 7f63edd28640 1 -- 172.21.15.91:0/164795539 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f63e80c40e0 msgr2=0x7f63e80c44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:35.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.401+0000 7f63edd28640 1 --2- 172.21.15.91:0/164795539 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f63e80c40e0 0x7f63e80c44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:35.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.401+0000 7f63edd28640 1 -- 172.21.15.91:0/164795539 >> v1:172.21.15.94:6789/0 conn(0x7f63e8072820 legacy=0x7f63e806ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:35.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.401+0000 7f63edd28640 1 -- 172.21.15.91:0/164795539 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e815aa00 con 0x7f63e81576e0 2023-11-27T18:13:35.405 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.409+0000 7f63edd28640 1 --2- 172.21.15.91:0/164795539 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63e81576e0 0x7f63e8157b70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f63e0009870 tx=0x7f63e001c500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ad37ea3faf1eb2b server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:35.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.421+0000 7f63dffff640 1 -- 172.21.15.91:0/164795539 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e00aa620 con 0x7f63e81576e0 2023-11-27T18:13:35.419 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.421+0000 7f63dffff640 1 -- 172.21.15.91:0/164795539 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e00aa780 con 0x7f63e81576e0 2023-11-27T18:13:35.419 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.421+0000 7f63dffff640 1 -- 172.21.15.91:0/164795539 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e00aab10 con 0x7f63e81576e0 2023-11-27T18:13:35.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.421+0000 7f63ef78b640 1 -- 172.21.15.91:0/164795539 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63e81576e0 msgr2=0x7f63e8157b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:35.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.421+0000 7f63ef78b640 1 --2- 172.21.15.91:0/164795539 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63e81576e0 0x7f63e8157b70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f63e0009870 tx=0x7f63e001c500 comp rx=0 tx=0).stop 2023-11-27T18:13:35.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.421+0000 7f63ef78b640 1 -- 172.21.15.91:0/164795539 shutdown_connections 2023-11-27T18:13:35.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.421+0000 7f63ef78b640 1 --2- 172.21.15.91:0/164795539 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63e81576e0 0x7f63e8157b70 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:35.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.421+0000 7f63ef78b640 1 --2- 172.21.15.91:0/164795539 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f63e80c40e0 0x7f63e80c44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:35.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.421+0000 7f63ef78b640 1 -- 172.21.15.91:0/164795539 >> 172.21.15.91:0/164795539 conn(0x7f63e80ca9d0 msgr2=0x7f63e80cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:35.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.421+0000 7f63ef78b640 1 -- 172.21.15.91:0/164795539 shutdown_connections 2023-11-27T18:13:35.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.421+0000 7f63ef78b640 1 -- 172.21.15.91:0/164795539 wait complete. 2023-11-27T18:13:35.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.425+0000 7f63ef78b640 1 Processor -- start 2023-11-27T18:13:35.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.425+0000 7f63ef78b640 1 -- start start 2023-11-27T18:13:35.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.425+0000 7f63ef78b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63e8072820 0x7f63e81536f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:35.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.425+0000 7f63ef78b640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f63e80c40e0 0x7f63e80c2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:35.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.425+0000 7f63ef78b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f63e81576e0 0x7f63e81476d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:35.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.425+0000 7f63ef78b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e81f6250 con 0x7f63e81576e0 2023-11-27T18:13:35.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.425+0000 7f63ef78b640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e80bf930 con 0x7f63e8072820 2023-11-27T18:13:35.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.425+0000 7f63ef78b640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e80c1fb0 con 0x7f63e80c40e0 2023-11-27T18:13:35.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.425+0000 7f63edd28640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f63e81576e0 0x7f63e81476d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:35.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.425+0000 7f63edd28640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f63e81576e0 0x7f63e81476d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44440/0 (socket says 172.21.15.91:44440) 2023-11-27T18:13:35.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.425+0000 7f63edd28640 1 -- 172.21.15.91:0/1688665066 learned_addr learned my addr 172.21.15.91:0/1688665066 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:35.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.425+0000 7f63ecd26640 1 --2- 172.21.15.91:0/1688665066 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f63e80c40e0 0x7f63e80c2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:35.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.429+0000 7f63ed527640 1 --2- 172.21.15.91:0/1688665066 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63e8072820 0x7f63e81536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:35.427 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.429+0000 7f63edd28640 1 -- 172.21.15.91:0/1688665066 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f63e80c40e0 msgr2=0x7f63e80c2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:35.427 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.429+0000 7f63edd28640 1 --2- 172.21.15.91:0/1688665066 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f63e80c40e0 0x7f63e80c2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:35.427 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.429+0000 7f63edd28640 1 -- 172.21.15.91:0/1688665066 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63e8072820 msgr2=0x7f63e81536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:35.427 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.429+0000 7f63edd28640 1 --2- 172.21.15.91:0/1688665066 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63e8072820 0x7f63e81536f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:35.427 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.429+0000 7f63edd28640 1 -- 172.21.15.91:0/1688665066 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e00094d0 con 0x7f63e81576e0 2023-11-27T18:13:35.429 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.433+0000 7f63edd28640 1 --2- 172.21.15.91:0/1688665066 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f63e81576e0 0x7f63e81476d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f63e001abb0 tx=0x7f63e00192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:35.435 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.437+0000 7f63ddffb640 1 -- 172.21.15.91:0/1688665066 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e00aadc0 con 0x7f63e81576e0 2023-11-27T18:13:35.435 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.437+0000 7f63ddffb640 1 -- 172.21.15.91:0/1688665066 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e00b8070 con 0x7f63e81576e0 2023-11-27T18:13:35.435 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.437+0000 7f63ddffb640 1 -- 172.21.15.91:0/1688665066 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e00bf6c0 con 0x7f63e81576e0 2023-11-27T18:13:35.435 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.437+0000 7f63ef78b640 1 -- 172.21.15.91:0/1688665066 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63e81f5cd0 con 0x7f63e81576e0 2023-11-27T18:13:35.435 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.437+0000 7f63ef78b640 1 -- 172.21.15.91:0/1688665066 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63e81f5f70 con 0x7f63e81576e0 2023-11-27T18:13:35.436 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.437+0000 7f63ef78b640 1 -- 172.21.15.91:0/1688665066 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63e804e850 con 0x7f63e81576e0 2023-11-27T18:13:35.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.721+0000 7f63ddffb640 1 -- 172.21.15.91:0/1688665066 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f63e00bf820 con 0x7f63e81576e0 2023-11-27T18:13:35.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.721+0000 7f63ddffb640 1 --2- 172.21.15.91:0/1688665066 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f63cc066840 0x7f63cc068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:35.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.721+0000 7f63ed527640 1 --2- 172.21.15.91:0/1688665066 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f63cc066840 0x7f63cc068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:35.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.721+0000 7f63ed527640 1 --2- 172.21.15.91:0/1688665066 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f63cc066840 0x7f63cc068d00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f63e40113e0 tx=0x7f63e400b040 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:35.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.749+0000 7f63ddffb640 1 -- 172.21.15.91:0/1688665066 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f63e00ba070 con 0x7f63e81576e0 2023-11-27T18:13:35.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.753+0000 7f63ddffb640 1 -- 172.21.15.91:0/1688665066 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f63e00ec710 con 0x7f63e81576e0 2023-11-27T18:13:35.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.925+0000 7f63ef78b640 1 -- 172.21.15.91:0/1688665066 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f63e80bfa70 con 0x7f63e81576e0 2023-11-27T18:13:35.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.933+0000 7f63ddffb640 1 -- 172.21.15.91:0/1688665066 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f63e00efd30 con 0x7f63e81576e0 2023-11-27T18:13:35.931 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T18:13:35.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.937+0000 7f63ef78b640 1 -- 172.21.15.91:0/1688665066 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f63cc066840 msgr2=0x7f63cc068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:35.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.937+0000 7f63ef78b640 1 --2- 172.21.15.91:0/1688665066 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f63cc066840 0x7f63cc068d00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f63e40113e0 tx=0x7f63e400b040 comp rx=0 tx=0).stop 2023-11-27T18:13:35.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.937+0000 7f63ef78b640 1 -- 172.21.15.91:0/1688665066 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f63e81576e0 msgr2=0x7f63e81476d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:35.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.937+0000 7f63ef78b640 1 --2- 172.21.15.91:0/1688665066 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f63e81576e0 0x7f63e81476d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f63e001abb0 tx=0x7f63e00192a0 comp rx=0 tx=0).stop 2023-11-27T18:13:35.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.937+0000 7f63ef78b640 1 -- 172.21.15.91:0/1688665066 shutdown_connections 2023-11-27T18:13:35.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.937+0000 7f63ef78b640 1 --2- 172.21.15.91:0/1688665066 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f63cc066840 0x7f63cc068d00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:35.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.937+0000 7f63ef78b640 1 --2- 172.21.15.91:0/1688665066 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f63e80c40e0 0x7f63e80c2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:35.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.937+0000 7f63ef78b640 1 --2- 172.21.15.91:0/1688665066 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f63e81576e0 0x7f63e81476d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:35.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.937+0000 7f63ef78b640 1 --2- 172.21.15.91:0/1688665066 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63e8072820 0x7f63e81536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:35.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.937+0000 7f63ef78b640 1 -- 172.21.15.91:0/1688665066 >> 172.21.15.91:0/1688665066 conn(0x7f63e80ca9d0 msgr2=0x7f63e80cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:35.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.937+0000 7f63ef78b640 1 -- 172.21.15.91:0/1688665066 shutdown_connections 2023-11-27T18:13:35.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:35.937+0000 7f63ef78b640 1 -- 172.21.15.91:0/1688665066 wait complete. 2023-11-27T18:13:35.950 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T18:13:36.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.081+0000 7fed320d6640 1 Processor -- start 2023-11-27T18:13:36.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.081+0000 7fed320d6640 1 -- start start 2023-11-27T18:13:36.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.081+0000 7fed320d6640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fed2c153890 0x7fed2c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:36.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.081+0000 7fed320d6640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fed2c15a130 0x7fed2c06a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:36.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.081+0000 7fed320d6640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed2c15d830 con 0x7fed2c06aa60 2023-11-27T18:13:36.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.081+0000 7fed320d6640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed2c0c1cc0 con 0x7fed2c15a130 2023-11-27T18:13:36.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.081+0000 7fed320d6640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c06f3d0 con 0x7fed2c153890 2023-11-27T18:13:36.086 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.089+0000 7fed2b7fe640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fed2c153890 0x7fed2c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:36.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.089+0000 7fed2b7fe640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fed2c153890 0x7fed2c06edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.91:36090/0 (socket says 172.21.15.91:36090) 2023-11-27T18:13:36.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.089+0000 7fed2b7fe640 1 -- 172.21.15.91:0/2120560048 learned_addr learned my addr 172.21.15.91:0/2120560048 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:36.147 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.149+0000 7fed2affd640 1 --2- 172.21.15.91:0/2120560048 >> v2:172.21.15.91:3300/0 conn(0x7fed2c15a130 0x7fed2c06a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:36.157 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.161+0000 7fed2affd640 1 -- 172.21.15.91:0/2120560048 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fed2c153890 msgr2=0x7fed2c06edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:36.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.161+0000 7fed2affd640 1 --2- 172.21.15.91:0/2120560048 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fed2c153890 0x7fed2c06edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:36.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.161+0000 7fed2affd640 1 -- 172.21.15.91:0/2120560048 >> v1:172.21.15.91:6789/0 conn(0x7fed2c06aa60 legacy=0x7fed2c06d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:36.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.161+0000 7fed2affd640 1 -- 172.21.15.91:0/2120560048 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed2c15cc20 con 0x7fed2c15a130 2023-11-27T18:13:36.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.169+0000 7fed2affd640 1 --2- 172.21.15.91:0/2120560048 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fed2c15a130 0x7fed2c06a520 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fed200097c0 tx=0x7fed2001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c09a6fe733eae3d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:36.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.177+0000 7fed2a7fc640 1 -- 172.21.15.91:0/2120560048 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed200ab600 con 0x7fed2c15a130 2023-11-27T18:13:36.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.177+0000 7fed2a7fc640 1 -- 172.21.15.91:0/2120560048 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed200a7050 con 0x7fed2c15a130 2023-11-27T18:13:36.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.177+0000 7fed2a7fc640 1 -- 172.21.15.91:0/2120560048 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed200ab980 con 0x7fed2c15a130 2023-11-27T18:13:36.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.177+0000 7fed320d6640 1 -- 172.21.15.91:0/2120560048 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fed2c15a130 msgr2=0x7fed2c06a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:36.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.177+0000 7fed320d6640 1 --2- 172.21.15.91:0/2120560048 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fed2c15a130 0x7fed2c06a520 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fed200097c0 tx=0x7fed2001c480 comp rx=0 tx=0).stop 2023-11-27T18:13:36.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.177+0000 7fed320d6640 1 -- 172.21.15.91:0/2120560048 shutdown_connections 2023-11-27T18:13:36.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.177+0000 7fed320d6640 1 --2- 172.21.15.91:0/2120560048 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fed2c15a130 0x7fed2c06a520 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:36.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.177+0000 7fed320d6640 1 --2- 172.21.15.91:0/2120560048 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fed2c153890 0x7fed2c06edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:36.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.177+0000 7fed320d6640 1 -- 172.21.15.91:0/2120560048 >> 172.21.15.91:0/2120560048 conn(0x7fed2c0c8aa0 msgr2=0x7fed2c0c8e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:36.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.177+0000 7fed320d6640 1 -- 172.21.15.91:0/2120560048 shutdown_connections 2023-11-27T18:13:36.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.177+0000 7fed320d6640 1 -- 172.21.15.91:0/2120560048 wait complete. 2023-11-27T18:13:36.176 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.177+0000 7fed320d6640 1 Processor -- start 2023-11-27T18:13:36.176 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.177+0000 7fed320d6640 1 -- start start 2023-11-27T18:13:36.177 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.181+0000 7fed320d6640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed2c06aa60 0x7fed2c157f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:36.177 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.181+0000 7fed320d6640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fed2c153890 0x7fed2c14fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:36.177 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.181+0000 7fed320d6640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fed2c15a130 0x7fed2c15a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:36.177 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.181+0000 7fed320d6640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c15c3f0 con 0x7fed2c15a130 2023-11-27T18:13:36.177 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.181+0000 7fed320d6640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c1f1f30 con 0x7fed2c06aa60 2023-11-27T18:13:36.177 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.181+0000 7fed320d6640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c15c640 con 0x7fed2c153890 2023-11-27T18:13:36.180 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.181+0000 7fed2affd640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fed2c153890 0x7fed2c14fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:36.181 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.185+0000 7fed2b7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed2c06aa60 0x7fed2c157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:36.181 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.185+0000 7fed2affd640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fed2c153890 0x7fed2c14fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.91:36092/0 (socket says 172.21.15.91:36092) 2023-11-27T18:13:36.181 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.185+0000 7fed2affd640 1 -- 172.21.15.91:0/2080643857 learned_addr learned my addr 172.21.15.91:0/2080643857 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:36.183 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.185+0000 7fed2bfff640 1 --2- 172.21.15.91:0/2080643857 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fed2c15a130 0x7fed2c15a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:36.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.189+0000 7fed2bfff640 1 -- 172.21.15.91:0/2080643857 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fed2c153890 msgr2=0x7fed2c14fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:36.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.189+0000 7fed2bfff640 1 --2- 172.21.15.91:0/2080643857 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fed2c153890 0x7fed2c14fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:36.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.189+0000 7fed2bfff640 1 -- 172.21.15.91:0/2080643857 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed2c06aa60 msgr2=0x7fed2c157f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:36.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.189+0000 7fed2bfff640 1 --2- 172.21.15.91:0/2080643857 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed2c06aa60 0x7fed2c157f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:36.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.189+0000 7fed2bfff640 1 -- 172.21.15.91:0/2080643857 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed20009420 con 0x7fed2c15a130 2023-11-27T18:13:36.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.193+0000 7fed2bfff640 1 --2- 172.21.15.91:0/2080643857 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fed2c15a130 0x7fed2c15a810 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fed1c00c730 tx=0x7fed1c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:36.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.201+0000 7fed13fff640 1 -- 172.21.15.91:0/2080643857 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1c003b80 con 0x7fed2c15a130 2023-11-27T18:13:36.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.201+0000 7fed13fff640 1 -- 172.21.15.91:0/2080643857 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed1c003ce0 con 0x7fed2c15a130 2023-11-27T18:13:36.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.201+0000 7fed320d6640 1 -- 172.21.15.91:0/2080643857 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed2c15c920 con 0x7fed2c15a130 2023-11-27T18:13:36.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.201+0000 7fed13fff640 1 -- 172.21.15.91:0/2080643857 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1c00aa30 con 0x7fed2c15a130 2023-11-27T18:13:36.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.201+0000 7fed320d6640 1 -- 172.21.15.91:0/2080643857 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed2c1f1bc0 con 0x7fed2c15a130 2023-11-27T18:13:36.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.201+0000 7fed320d6640 1 -- 172.21.15.91:0/2080643857 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed2c04e850 con 0x7fed2c15a130 2023-11-27T18:13:36.484 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.485+0000 7fed13fff640 1 -- 172.21.15.91:0/2080643857 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fed1c00ab90 con 0x7fed2c15a130 2023-11-27T18:13:36.484 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.489+0000 7fed13fff640 1 --2- 172.21.15.91:0/2080643857 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fed18066840 0x7fed18068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:36.485 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.489+0000 7fed2b7fe640 1 --2- 172.21.15.91:0/2080643857 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fed18066840 0x7fed18068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:36.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.489+0000 7fed2b7fe640 1 --2- 172.21.15.91:0/2080643857 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fed18066840 0x7fed18068d00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fed24009b50 tx=0x7fed24009240 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:36.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.529+0000 7fed13fff640 1 -- 172.21.15.91:0/2080643857 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fed1c00ae40 con 0x7fed2c15a130 2023-11-27T18:13:36.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.553+0000 7fed13fff640 1 -- 172.21.15.91:0/2080643857 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fed1c051b50 con 0x7fed2c15a130 2023-11-27T18:13:36.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.741+0000 7fed320d6640 1 -- 172.21.15.91:0/2080643857 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fed2c1f2070 con 0x7fed2c15a130 2023-11-27T18:13:36.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.753+0000 7fed13fff640 1 -- 172.21.15.91:0/2080643857 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7fed1c055170 con 0x7fed2c15a130 2023-11-27T18:13:36.751 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-11-27T18:13:36.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.757+0000 7fed320d6640 1 -- 172.21.15.91:0/2080643857 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fed18066840 msgr2=0x7fed18068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:36.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.757+0000 7fed320d6640 1 --2- 172.21.15.91:0/2080643857 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fed18066840 0x7fed18068d00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fed24009b50 tx=0x7fed24009240 comp rx=0 tx=0).stop 2023-11-27T18:13:36.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.757+0000 7fed320d6640 1 -- 172.21.15.91:0/2080643857 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fed2c15a130 msgr2=0x7fed2c15a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:36.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.757+0000 7fed320d6640 1 --2- 172.21.15.91:0/2080643857 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fed2c15a130 0x7fed2c15a810 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fed1c00c730 tx=0x7fed1c00cbf0 comp rx=0 tx=0).stop 2023-11-27T18:13:36.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.757+0000 7fed320d6640 1 -- 172.21.15.91:0/2080643857 shutdown_connections 2023-11-27T18:13:36.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.757+0000 7fed320d6640 1 --2- 172.21.15.91:0/2080643857 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fed18066840 0x7fed18068d00 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:36.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.757+0000 7fed320d6640 1 --2- 172.21.15.91:0/2080643857 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fed2c153890 0x7fed2c14fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:36.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.757+0000 7fed320d6640 1 --2- 172.21.15.91:0/2080643857 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fed2c15a130 0x7fed2c15a810 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:36.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.757+0000 7fed320d6640 1 --2- 172.21.15.91:0/2080643857 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed2c06aa60 0x7fed2c157f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:36.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.757+0000 7fed320d6640 1 -- 172.21.15.91:0/2080643857 >> 172.21.15.91:0/2080643857 conn(0x7fed2c0c8aa0 msgr2=0x7fed2c0c2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:36.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.757+0000 7fed320d6640 1 -- 172.21.15.91:0/2080643857 shutdown_connections 2023-11-27T18:13:36.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.757+0000 7fed320d6640 1 -- 172.21.15.91:0/2080643857 wait complete. 2023-11-27T18:13:36.771 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-27T18:13:36.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.901+0000 7fafaa73c640 1 Processor -- start 2023-11-27T18:13:36.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.901+0000 7fafaa73c640 1 -- start start 2023-11-27T18:13:36.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.901+0000 7fafaa73c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fafa4150420 0x7fafa4072040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:36.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.901+0000 7fafaa73c640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafa406bdc0 con 0x7fafa406b630 2023-11-27T18:13:36.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.901+0000 7fafaa73c640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafa40c3530 con 0x7fafa4156a70 2023-11-27T18:13:36.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.901+0000 7fafaa73c640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafa40663d0 con 0x7fafa4150420 2023-11-27T18:13:36.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.901+0000 7fafa8cd9640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fafa4156a70 0x7fafa4160b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.91:36104/0 (socket says 172.21.15.91:36104) 2023-11-27T18:13:36.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.901+0000 7fafa8cd9640 1 -- 172.21.15.91:0/2811266600 learned_addr learned my addr 172.21.15.91:0/2811266600 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:13:36.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.909+0000 7fafa2ffd640 1 -- 172.21.15.91:0/2811266600 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4020948400 0 0) 0x7fafa40c3530 con 0x7fafa4156a70 2023-11-27T18:13:36.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.909+0000 7fafa2ffd640 1 -- 172.21.15.91:0/2811266600 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf8c003530 con 0x7fafa4156a70 2023-11-27T18:13:36.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.917+0000 7fafa2ffd640 1 -- 172.21.15.91:0/2811266600 <== mon.1 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4223339327 0 0) 0x7faf8c003530 con 0x7fafa4156a70 2023-11-27T18:13:36.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.917+0000 7fafa2ffd640 1 -- 172.21.15.91:0/2811266600 >> v2:172.21.15.91:3300/0 conn(0x7fafa4150420 msgr2=0x7fafa4072040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:36.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.917+0000 7fafa2ffd640 1 --2- 172.21.15.91:0/2811266600 >> v2:172.21.15.91:3300/0 conn(0x7fafa4150420 0x7fafa4072040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:36.917 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.917+0000 7fafa2ffd640 1 -- 172.21.15.91:0/2811266600 >> v1:172.21.15.91:6789/0 conn(0x7fafa406b630 legacy=0x7fafa4156360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:36.917 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.917+0000 7fafa2ffd640 1 -- 172.21.15.91:0/2811266600 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa406bb00 con 0x7fafa4156a70 2023-11-27T18:13:36.917 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.917+0000 7fafa2ffd640 1 -- 172.21.15.91:0/2811266600 <== mon.1 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3378743932 0 0) 0x7faf9c001a00 con 0x7fafa4156a70 2023-11-27T18:13:36.917 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.917+0000 7fafa2ffd640 1 -- 172.21.15.91:0/2811266600 >> v1:172.21.15.94:6789/0 conn(0x7fafa4156a70 legacy=0x7fafa4160b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:36.917 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.917+0000 7fafa2ffd640 1 --2- 172.21.15.91:0/2811266600 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faf8c0039d0 0x7faf8c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:36.917 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.917+0000 7fafa2ffd640 1 --2- 172.21.15.91:0/2811266600 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf8c0047d0 0x7faf8c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:36.917 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.917+0000 7fafa2ffd640 1 --2- 172.21.15.91:0/2811266600 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf8c0052b0 0x7faf8c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:36.917 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.917+0000 7fafa2ffd640 1 -- 172.21.15.91:0/2811266600 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa40663d0 con 0x7faf8c0047d0 2023-11-27T18:13:36.917 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.917+0000 7fafa2ffd640 1 -- 172.21.15.91:0/2811266600 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf8c00c1f0 con 0x7faf8c0052b0 2023-11-27T18:13:36.917 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.917+0000 7fafa2ffd640 1 -- 172.21.15.91:0/2811266600 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf8c00c3b0 con 0x7faf8c0039d0 2023-11-27T18:13:36.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.921+0000 7fafa3fff640 1 --2- 172.21.15.91:0/2811266600 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faf8c0039d0 0x7faf8c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:36.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.925+0000 7fafa8cd9640 1 --2- 172.21.15.91:0/2811266600 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf8c0052b0 0x7faf8c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:36.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.929+0000 7fafa3fff640 1 -- 172.21.15.91:0/2811266600 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf8c0052b0 msgr2=0x7faf8c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:36.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.929+0000 7fafa3fff640 1 --2- 172.21.15.91:0/2811266600 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf8c0052b0 0x7faf8c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:36.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.929+0000 7fafa3fff640 1 -- 172.21.15.91:0/2811266600 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf8c0047d0 msgr2=0x7faf8c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:36.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.929+0000 7fafa3fff640 1 --2- 172.21.15.91:0/2811266600 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf8c0047d0 0x7faf8c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:36.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.929+0000 7fafa3fff640 1 -- 172.21.15.91:0/2811266600 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf8c003530 con 0x7faf8c0039d0 2023-11-27T18:13:36.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.929+0000 7fafa8cd9640 1 -- 172.21.15.91:0/2811266600 reap_dead start 2023-11-27T18:13:36.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.933+0000 7fafa3fff640 1 --2- 172.21.15.91:0/2811266600 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faf8c0039d0 0x7faf8c003dd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7faf94009860 tx=0x7faf9401c300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad0213d912c48661 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:36.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.949+0000 7fafa2ffd640 1 -- 172.21.15.91:0/2811266600 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf940ab600 con 0x7faf8c0039d0 2023-11-27T18:13:36.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.949+0000 7fafa2ffd640 1 -- 172.21.15.91:0/2811266600 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf940a7050 con 0x7faf8c0039d0 2023-11-27T18:13:36.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.949+0000 7fafa2ffd640 1 -- 172.21.15.91:0/2811266600 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf940aba00 con 0x7faf8c0039d0 2023-11-27T18:13:36.948 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.949+0000 7fafaa73c640 1 -- 172.21.15.91:0/2811266600 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faf8c0039d0 msgr2=0x7faf8c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:36.948 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.949+0000 7fafaa73c640 1 --2- 172.21.15.91:0/2811266600 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faf8c0039d0 0x7faf8c003dd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7faf94009860 tx=0x7faf9401c300 comp rx=0 tx=0).stop 2023-11-27T18:13:36.948 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.949+0000 7fafaa73c640 1 -- 172.21.15.91:0/2811266600 shutdown_connections 2023-11-27T18:13:36.948 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.949+0000 7fafaa73c640 1 --2- 172.21.15.91:0/2811266600 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faf8c0039d0 0x7faf8c003dd0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:36.948 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.949+0000 7fafaa73c640 1 -- 172.21.15.91:0/2811266600 >> 172.21.15.91:0/2811266600 conn(0x7fafa4071520 msgr2=0x7fafa4071930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:36.948 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.949+0000 7fafaa73c640 1 -- 172.21.15.91:0/2811266600 shutdown_connections 2023-11-27T18:13:36.948 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.949+0000 7fafaa73c640 1 -- 172.21.15.91:0/2811266600 wait complete. 2023-11-27T18:13:36.949 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.953+0000 7fafaa73c640 1 Processor -- start 2023-11-27T18:13:36.949 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.953+0000 7fafaa73c640 1 -- start start 2023-11-27T18:13:36.950 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.953+0000 7fafaa73c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf8c0039d0 0x7fafa41586b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:36.950 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.953+0000 7fafaa73c640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fafa414cae0 0x7fafa40ca880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:36.950 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.953+0000 7fafaa73c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fafa41573c0 0x7fafa414a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:36.950 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.953+0000 7fafaa73c640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa4144af0 con 0x7faf8c0039d0 2023-11-27T18:13:36.950 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.953+0000 7fafaa73c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa4144810 con 0x7fafa41573c0 2023-11-27T18:13:36.950 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.953+0000 7fafaa73c640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa4142a10 con 0x7fafa414cae0 2023-11-27T18:13:36.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.953+0000 7fafa3fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf8c0039d0 0x7fafa41586b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:36.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.953+0000 7fafa3fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf8c0039d0 0x7fafa41586b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:59852/0 (socket says 172.21.15.91:59852) 2023-11-27T18:13:36.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.953+0000 7fafa3fff640 1 -- 172.21.15.91:0/2151503166 learned_addr learned my addr 172.21.15.91:0/2151503166 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:36.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.953+0000 7fafa8cd9640 1 --2- 172.21.15.91:0/2151503166 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fafa41573c0 0x7fafa414a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:36.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.957+0000 7fafa37fe640 1 --2- 172.21.15.91:0/2151503166 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fafa414cae0 0x7fafa40ca880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:36.957 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.957+0000 7fafa3fff640 1 -- 172.21.15.91:0/2151503166 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fafa414cae0 msgr2=0x7fafa40ca880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:36.957 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.957+0000 7fafa3fff640 1 --2- 172.21.15.91:0/2151503166 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fafa414cae0 0x7fafa40ca880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:36.957 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.957+0000 7fafa3fff640 1 -- 172.21.15.91:0/2151503166 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fafa41573c0 msgr2=0x7fafa414a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:36.957 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.957+0000 7fafa3fff640 1 --2- 172.21.15.91:0/2151503166 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fafa41573c0 0x7fafa414a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:36.958 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.957+0000 7fafa3fff640 1 -- 172.21.15.91:0/2151503166 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa4142cf0 con 0x7faf8c0039d0 2023-11-27T18:13:36.958 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.961+0000 7fafa3fff640 1 --2- 172.21.15.91:0/2151503166 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf8c0039d0 0x7fafa41586b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7faf9401cba0 tx=0x7faf8c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:36.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.965+0000 7fafa0ff9640 1 -- 172.21.15.91:0/2151503166 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf940abca0 con 0x7faf8c0039d0 2023-11-27T18:13:36.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.965+0000 7fafaa73c640 1 -- 172.21.15.91:0/2151503166 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafa4142fd0 con 0x7faf8c0039d0 2023-11-27T18:13:36.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.965+0000 7fafaa73c640 1 -- 172.21.15.91:0/2151503166 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafa41437d0 con 0x7faf8c0039d0 2023-11-27T18:13:36.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.965+0000 7fafa0ff9640 1 -- 172.21.15.91:0/2151503166 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf94000e90 con 0x7faf8c0039d0 2023-11-27T18:13:36.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.965+0000 7fafa0ff9640 1 -- 172.21.15.91:0/2151503166 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf940b4400 con 0x7faf8c0039d0 2023-11-27T18:13:36.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.965+0000 7fafaa73c640 1 -- 172.21.15.91:0/2151503166 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf84005260 con 0x7faf8c0039d0 2023-11-27T18:13:36.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.985+0000 7fafa0ff9640 1 -- 172.21.15.91:0/2151503166 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7faf940b2040 con 0x7faf8c0039d0 2023-11-27T18:13:36.983 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.985+0000 7fafa0ff9640 1 --2- 172.21.15.91:0/2151503166 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7faf90066820 0x7faf90068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:36.983 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.985+0000 7fafa37fe640 1 --2- 172.21.15.91:0/2151503166 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7faf90066820 0x7faf90068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:36.983 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.985+0000 7fafa37fe640 1 --2- 172.21.15.91:0/2151503166 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7faf90066820 0x7faf90068ce0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fafa414ba10 tx=0x7faf98009040 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:36.987 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:36.989+0000 7fafa0ff9640 1 -- 172.21.15.91:0/2151503166 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7faf940ee2e0 con 0x7faf8c0039d0 2023-11-27T18:13:37.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.253+0000 7fafa0ff9640 1 -- 172.21.15.91:0/2151503166 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7faf940ea620 con 0x7faf8c0039d0 2023-11-27T18:13:37.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.425+0000 7fafaa73c640 1 -- 172.21.15.91:0/2151503166 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7faf84005a90 con 0x7faf8c0039d0 2023-11-27T18:13:37.437 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.441+0000 7fafa0ff9640 1 -- 172.21.15.91:0/2151503166 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7faf940b00a0 con 0x7faf8c0039d0 2023-11-27T18:13:37.438 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T18:13:37.440 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.441+0000 7fafaa73c640 1 -- 172.21.15.91:0/2151503166 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7faf90066820 msgr2=0x7faf90068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:37.440 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.441+0000 7fafaa73c640 1 --2- 172.21.15.91:0/2151503166 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7faf90066820 0x7faf90068ce0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fafa414ba10 tx=0x7faf98009040 comp rx=0 tx=0).stop 2023-11-27T18:13:37.440 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.441+0000 7fafaa73c640 1 -- 172.21.15.91:0/2151503166 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf8c0039d0 msgr2=0x7fafa41586b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:37.440 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.441+0000 7fafaa73c640 1 --2- 172.21.15.91:0/2151503166 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf8c0039d0 0x7fafa41586b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7faf9401cba0 tx=0x7faf8c005800 comp rx=0 tx=0).stop 2023-11-27T18:13:37.440 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.445+0000 7fafaa73c640 1 -- 172.21.15.91:0/2151503166 shutdown_connections 2023-11-27T18:13:37.440 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.445+0000 7fafaa73c640 1 --2- 172.21.15.91:0/2151503166 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7faf90066820 0x7faf90068ce0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:37.440 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.445+0000 7fafaa73c640 1 --2- 172.21.15.91:0/2151503166 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fafa414cae0 0x7fafa40ca880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:37.441 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.445+0000 7fafaa73c640 1 --2- 172.21.15.91:0/2151503166 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fafa41573c0 0x7fafa414a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:37.441 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.445+0000 7fafaa73c640 1 --2- 172.21.15.91:0/2151503166 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf8c0039d0 0x7fafa41586b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:37.441 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.445+0000 7fafaa73c640 1 -- 172.21.15.91:0/2151503166 >> 172.21.15.91:0/2151503166 conn(0x7fafa4071520 msgr2=0x7fafa414d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:37.441 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.445+0000 7fafaa73c640 1 -- 172.21.15.91:0/2151503166 shutdown_connections 2023-11-27T18:13:37.441 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.445+0000 7fafaa73c640 1 -- 172.21.15.91:0/2151503166 wait complete. 2023-11-27T18:13:37.458 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-27T18:13:37.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.585+0000 7f640431f640 1 Processor -- start 2023-11-27T18:13:37.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.585+0000 7f640431f640 1 -- start start 2023-11-27T18:13:37.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.589+0000 7f640431f640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f63fc0728d0 0x7f63fc0c1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:37.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.589+0000 7f640431f640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63fc0c3770 con 0x7f63fc06e760 2023-11-27T18:13:37.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.589+0000 7f640431f640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63fc071b00 con 0x7f63fc0c52d0 2023-11-27T18:13:37.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.589+0000 7f640431f640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63fc0c5f30 con 0x7f63fc0728d0 2023-11-27T18:13:37.585 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.589+0000 7f64020bb640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f63fc06e760 0x7f63fc070ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:52108/0 (socket says 172.21.15.91:52108) 2023-11-27T18:13:37.585 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.589+0000 7f64020bb640 1 -- 172.21.15.91:0/2922554444 learned_addr learned my addr 172.21.15.91:0/2922554444 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:13:37.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.589+0000 7f64018ba640 1 --2- 172.21.15.91:0/2922554444 >> v2:172.21.15.94:3300/0 conn(0x7f63fc0728d0 0x7f63fc0c1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:37.588 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.589+0000 7f64010b9640 1 -- 172.21.15.91:0/2922554444 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 324964418 0 0) 0x7f63fc0c3770 con 0x7f63fc06e760 2023-11-27T18:13:37.588 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.589+0000 7f64010b9640 1 -- 172.21.15.91:0/2922554444 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63e8003530 con 0x7f63fc06e760 2023-11-27T18:13:37.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.597+0000 7f64010b9640 1 -- 172.21.15.91:0/2922554444 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 278862436 0 0) 0x7f63e8003530 con 0x7f63fc06e760 2023-11-27T18:13:37.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.597+0000 7f64010b9640 1 -- 172.21.15.91:0/2922554444 >> v2:172.21.15.94:3300/0 conn(0x7f63fc0728d0 msgr2=0x7f63fc0c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:37.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.597+0000 7f64010b9640 1 --2- 172.21.15.91:0/2922554444 >> v2:172.21.15.94:3300/0 conn(0x7f63fc0728d0 0x7f63fc0c1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:37.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.597+0000 7f64010b9640 1 -- 172.21.15.91:0/2922554444 >> v1:172.21.15.94:6789/0 conn(0x7f63fc0c52d0 legacy=0x7f63fc0713f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:37.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.597+0000 7f64010b9640 1 -- 172.21.15.91:0/2922554444 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63fc071eb0 con 0x7f63fc06e760 2023-11-27T18:13:37.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.597+0000 7f64010b9640 1 -- 172.21.15.91:0/2922554444 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3378743932 0 0) 0x7f63f8001680 con 0x7f63fc06e760 2023-11-27T18:13:37.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.597+0000 7f64010b9640 1 -- 172.21.15.91:0/2922554444 >> v1:172.21.15.91:6789/0 conn(0x7f63fc06e760 legacy=0x7f63fc070ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:37.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.597+0000 7f64010b9640 1 --2- 172.21.15.91:0/2922554444 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f63e80039d0 0x7f63e8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:37.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.597+0000 7f64010b9640 1 --2- 172.21.15.91:0/2922554444 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63e80047d0 0x7f63e8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:37.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.597+0000 7f64010b9640 1 --2- 172.21.15.91:0/2922554444 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f63e80051e0 0x7f63e800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:37.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.597+0000 7f64010b9640 1 -- 172.21.15.91:0/2922554444 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63fc0c5f30 con 0x7f63e80039d0 2023-11-27T18:13:37.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.597+0000 7f64010b9640 1 -- 172.21.15.91:0/2922554444 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e800c110 con 0x7f63e80047d0 2023-11-27T18:13:37.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.597+0000 7f64010b9640 1 -- 172.21.15.91:0/2922554444 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e800c2d0 con 0x7f63e80051e0 2023-11-27T18:13:37.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.597+0000 7f64028bc640 1 --2- 172.21.15.91:0/2922554444 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f63e80051e0 0x7f63e800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:37.596 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.597+0000 7f64020bb640 1 --2- 172.21.15.91:0/2922554444 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f63e80039d0 0x7f63e8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:37.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.601+0000 7f64020bb640 1 -- 172.21.15.91:0/2922554444 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f63e80051e0 msgr2=0x7f63e800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:37.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.601+0000 7f64020bb640 1 --2- 172.21.15.91:0/2922554444 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f63e80051e0 0x7f63e800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:37.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.601+0000 7f64020bb640 1 -- 172.21.15.91:0/2922554444 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63e80047d0 msgr2=0x7f63e8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:37.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.601+0000 7f64020bb640 1 --2- 172.21.15.91:0/2922554444 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63e80047d0 0x7f63e8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:37.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.601+0000 7f64020bb640 1 -- 172.21.15.91:0/2922554444 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e8003530 con 0x7f63e80039d0 2023-11-27T18:13:37.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.601+0000 7f64028bc640 1 -- 172.21.15.91:0/2922554444 reap_dead start 2023-11-27T18:13:37.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.609+0000 7f64020bb640 1 --2- 172.21.15.91:0/2922554444 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f63e80039d0 0x7f63e8003dd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f63f800c110 tx=0x7f63f801cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9888cec7995e442c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:37.611 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.613+0000 7f64010b9640 1 -- 172.21.15.91:0/2922554444 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f8005ae0 con 0x7f63e80039d0 2023-11-27T18:13:37.611 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.613+0000 7f64010b9640 1 -- 172.21.15.91:0/2922554444 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f8005c40 con 0x7f63e80039d0 2023-11-27T18:13:37.611 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.613+0000 7f64010b9640 1 -- 172.21.15.91:0/2922554444 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f80072b0 con 0x7f63e80039d0 2023-11-27T18:13:37.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.613+0000 7f640431f640 1 -- 172.21.15.91:0/2922554444 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f63e80039d0 msgr2=0x7f63e8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:37.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.613+0000 7f640431f640 1 --2- 172.21.15.91:0/2922554444 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f63e80039d0 0x7f63e8003dd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f63f800c110 tx=0x7f63f801cb40 comp rx=0 tx=0).stop 2023-11-27T18:13:37.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.613+0000 7f640431f640 1 -- 172.21.15.91:0/2922554444 shutdown_connections 2023-11-27T18:13:37.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.613+0000 7f640431f640 1 --2- 172.21.15.91:0/2922554444 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f63e80039d0 0x7f63e8003dd0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:37.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.613+0000 7f640431f640 1 -- 172.21.15.91:0/2922554444 >> 172.21.15.91:0/2922554444 conn(0x7f63fc0ca9d0 msgr2=0x7f63fc0cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:37.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.613+0000 7f640431f640 1 -- 172.21.15.91:0/2922554444 shutdown_connections 2023-11-27T18:13:37.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.617+0000 7f640431f640 1 -- 172.21.15.91:0/2922554444 wait complete. 2023-11-27T18:13:37.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.617+0000 7f640431f640 1 Processor -- start 2023-11-27T18:13:37.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.617+0000 7f640431f640 1 -- start start 2023-11-27T18:13:37.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.617+0000 7f640431f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f63e80039d0 0x7f63fc153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:37.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.617+0000 7f640431f640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f63fc156120 0x7f63fc154530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:37.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.617+0000 7f640431f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63fc152940 0x7f63fc152dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:37.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.617+0000 7f640431f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63fc1565f0 con 0x7f63e80039d0 2023-11-27T18:13:37.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.617+0000 7f640431f640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63fc143720 con 0x7f63fc152940 2023-11-27T18:13:37.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.617+0000 7f640431f640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63fc143160 con 0x7f63fc156120 2023-11-27T18:13:37.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.617+0000 7f64028bc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63fc152940 0x7f63fc152dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:37.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.617+0000 7f64018ba640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f63fc156120 0x7f63fc154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:37.617 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.621+0000 7f64018ba640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f63fc156120 0x7f63fc154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.91:36136/0 (socket says 172.21.15.91:36136) 2023-11-27T18:13:37.617 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.621+0000 7f64018ba640 1 -- 172.21.15.91:0/4099422 learned_addr learned my addr 172.21.15.91:0/4099422 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:37.620 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.625+0000 7f64020bb640 1 --2- 172.21.15.91:0/4099422 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f63e80039d0 0x7f63fc153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:37.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.629+0000 7f64020bb640 1 -- 172.21.15.91:0/4099422 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f63fc156120 msgr2=0x7f63fc154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:37.625 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.629+0000 7f64020bb640 1 --2- 172.21.15.91:0/4099422 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f63fc156120 0x7f63fc154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:37.625 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.629+0000 7f64020bb640 1 -- 172.21.15.91:0/4099422 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63fc152940 msgr2=0x7f63fc152dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:37.625 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.629+0000 7f64020bb640 1 --2- 172.21.15.91:0/4099422 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63fc152940 0x7f63fc152dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:37.625 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.629+0000 7f64020bb640 1 -- 172.21.15.91:0/4099422 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63fc143440 con 0x7f63e80039d0 2023-11-27T18:13:37.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.629+0000 7f64020bb640 1 --2- 172.21.15.91:0/4099422 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f63e80039d0 0x7f63fc153ff0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f63f8009000 tx=0x7f63e8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:37.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.633+0000 7f63f2ffd640 1 -- 172.21.15.91:0/4099422 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f80b4070 con 0x7f63e80039d0 2023-11-27T18:13:37.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.633+0000 7f63f2ffd640 1 -- 172.21.15.91:0/4099422 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f8001500 con 0x7f63e80039d0 2023-11-27T18:13:37.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.633+0000 7f63f2ffd640 1 -- 172.21.15.91:0/4099422 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f8007270 con 0x7f63e80039d0 2023-11-27T18:13:37.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.633+0000 7f640431f640 1 -- 172.21.15.91:0/4099422 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63fc1537f0 con 0x7f63e80039d0 2023-11-27T18:13:37.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.633+0000 7f640431f640 1 -- 172.21.15.91:0/4099422 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63fc155eb0 con 0x7f63e80039d0 2023-11-27T18:13:37.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.633+0000 7f640431f640 1 -- 172.21.15.91:0/4099422 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63fc04e850 con 0x7f63e80039d0 2023-11-27T18:13:37.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.653+0000 7f63f2ffd640 1 -- 172.21.15.91:0/4099422 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f63f80073d0 con 0x7f63e80039d0 2023-11-27T18:13:37.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.653+0000 7f63f2ffd640 1 --2- 172.21.15.91:0/4099422 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f63e0066840 0x7f63e0068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:37.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.657+0000 7f64018ba640 1 --2- 172.21.15.91:0/4099422 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f63e0066840 0x7f63e0068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:37.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.657+0000 7f64018ba640 1 --2- 172.21.15.91:0/4099422 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f63e0066840 0x7f63e0068d00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f63fc1422f0 tx=0x7f63ec00a710 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:37.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.925+0000 7f63f2ffd640 1 -- 172.21.15.91:0/4099422 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f63f80eec00 con 0x7f63e80039d0 2023-11-27T18:13:37.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:37.925+0000 7f63f2ffd640 1 -- 172.21.15.91:0/4099422 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f63f80eaf40 con 0x7f63e80039d0 2023-11-27T18:13:38.098 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.101+0000 7f640431f640 1 -- 172.21.15.91:0/4099422 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f63fc0be460 con 0x7f63e80039d0 2023-11-27T18:13:38.102 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.105+0000 7f63f2ffd640 1 -- 172.21.15.91:0/4099422 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v30) v1 ==== 80+0+0 (secure 0 0 0) 0x7f63f80be070 con 0x7f63e80039d0 2023-11-27T18:13:38.102 INFO:teuthology.orchestra.run.smithi091.stderr:listed 0 entries 2023-11-27T18:13:38.105 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.109+0000 7f640431f640 1 -- 172.21.15.91:0/4099422 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f63e0066840 msgr2=0x7f63e0068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:38.105 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.109+0000 7f640431f640 1 --2- 172.21.15.91:0/4099422 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f63e0066840 0x7f63e0068d00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f63fc1422f0 tx=0x7f63ec00a710 comp rx=0 tx=0).stop 2023-11-27T18:13:38.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.109+0000 7f640431f640 1 -- 172.21.15.91:0/4099422 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f63e80039d0 msgr2=0x7f63fc153ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:38.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.109+0000 7f640431f640 1 --2- 172.21.15.91:0/4099422 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f63e80039d0 0x7f63fc153ff0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f63f8009000 tx=0x7f63e8005800 comp rx=0 tx=0).stop 2023-11-27T18:13:38.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.109+0000 7f640431f640 1 -- 172.21.15.91:0/4099422 shutdown_connections 2023-11-27T18:13:38.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.109+0000 7f640431f640 1 --2- 172.21.15.91:0/4099422 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f63e0066840 0x7f63e0068d00 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:38.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.109+0000 7f640431f640 1 --2- 172.21.15.91:0/4099422 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f63fc156120 0x7f63fc154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:38.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.109+0000 7f640431f640 1 --2- 172.21.15.91:0/4099422 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63fc152940 0x7f63fc152dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:38.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.109+0000 7f640431f640 1 --2- 172.21.15.91:0/4099422 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f63e80039d0 0x7f63fc153ff0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:38.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.109+0000 7f640431f640 1 -- 172.21.15.91:0/4099422 >> 172.21.15.91:0/4099422 conn(0x7f63fc0ca9d0 msgr2=0x7f63fc0c69d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:38.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.109+0000 7f640431f640 1 -- 172.21.15.91:0/4099422 shutdown_connections 2023-11-27T18:13:38.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.109+0000 7f640431f640 1 -- 172.21.15.91:0/4099422 wait complete. 2023-11-27T18:13:38.122 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T18:13:38.122 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T18:13:38.128 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T18:13:38.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.285+0000 7f022cf34640 1 Processor -- start 2023-11-27T18:13:38.284 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.285+0000 7f022cf34640 1 -- start start 2023-11-27T18:13:38.285 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.289+0000 7f022cf34640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0228151560 0x7f022806f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:38.285 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.289+0000 7f022cf34640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f02280c5d90 0x7f02280c7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:38.285 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.289+0000 7f022cf34640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02280c59f0 con 0x7f0228158160 2023-11-27T18:13:38.285 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.289+0000 7f022cf34640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02280c3700 con 0x7f02280c5d90 2023-11-27T18:13:38.285 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.289+0000 7f022cf34640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0228151940 con 0x7f0228151560 2023-11-27T18:13:38.285 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.289+0000 7f0225d9b640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f0228158160 0x7f022815a9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:52124/0 (socket says 172.21.15.91:52124) 2023-11-27T18:13:38.286 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.289+0000 7f0225d9b640 1 -- 172.21.15.91:0/3918783616 learned_addr learned my addr 172.21.15.91:0/3918783616 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:13:38.286 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.289+0000 7f0226d9d640 1 --2- 172.21.15.91:0/3918783616 >> v2:172.21.15.94:3300/0 conn(0x7f02280c5d90 0x7f02280c7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:38.286 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.289+0000 7f022659c640 1 --2- 172.21.15.91:0/3918783616 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0228151560 0x7f022806f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:38.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.289+0000 7f022559a640 1 -- 172.21.15.91:0/3918783616 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 488044378 0 0) 0x7f02280c59f0 con 0x7f0228158160 2023-11-27T18:13:38.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.289+0000 7f022559a640 1 -- 172.21.15.91:0/3918783616 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0210003530 con 0x7f0228158160 2023-11-27T18:13:38.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.297+0000 7f0226d9d640 1 -- 172.21.15.91:0/3918783616 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0228151560 msgr2=0x7f022806f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:38.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.297+0000 7f0226d9d640 1 --2- 172.21.15.91:0/3918783616 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0228151560 0x7f022806f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:38.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.297+0000 7f0226d9d640 1 -- 172.21.15.91:0/3918783616 >> v1:172.21.15.91:6789/0 conn(0x7f0228158160 legacy=0x7f022815a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:38.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.297+0000 7f0226d9d640 1 -- 172.21.15.91:0/3918783616 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0228157cd0 con 0x7f02280c5d90 2023-11-27T18:13:38.298 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.301+0000 7f0226d9d640 1 --2- 172.21.15.91:0/3918783616 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02280c5d90 0x7f02280c7640 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f02180097f0 tx=0x7f021801ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31b165cc2461113 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:38.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.321+0000 7f022559a640 1 -- 172.21.15.91:0/3918783616 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02180a8970 con 0x7f02280c5d90 2023-11-27T18:13:38.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.321+0000 7f022559a640 1 -- 172.21.15.91:0/3918783616 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02180a8ad0 con 0x7f02280c5d90 2023-11-27T18:13:38.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.321+0000 7f022559a640 1 -- 172.21.15.91:0/3918783616 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02180a8e60 con 0x7f02280c5d90 2023-11-27T18:13:38.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.321+0000 7f022cf34640 1 -- 172.21.15.91:0/3918783616 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02280c5d90 msgr2=0x7f02280c7640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:38.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.321+0000 7f022cf34640 1 --2- 172.21.15.91:0/3918783616 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02280c5d90 0x7f02280c7640 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f02180097f0 tx=0x7f021801ec70 comp rx=0 tx=0).stop 2023-11-27T18:13:38.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.321+0000 7f022cf34640 1 -- 172.21.15.91:0/3918783616 shutdown_connections 2023-11-27T18:13:38.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.321+0000 7f022cf34640 1 --2- 172.21.15.91:0/3918783616 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02280c5d90 0x7f02280c7640 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:38.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.321+0000 7f022cf34640 1 --2- 172.21.15.91:0/3918783616 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0228151560 0x7f022806f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:38.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.321+0000 7f022cf34640 1 -- 172.21.15.91:0/3918783616 >> 172.21.15.91:0/3918783616 conn(0x7f02280cbec0 msgr2=0x7f02280cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:38.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.321+0000 7f022cf34640 1 -- 172.21.15.91:0/3918783616 shutdown_connections 2023-11-27T18:13:38.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.321+0000 7f022cf34640 1 -- 172.21.15.91:0/3918783616 wait complete. 2023-11-27T18:13:38.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.325+0000 7f022cf34640 1 Processor -- start 2023-11-27T18:13:38.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.325+0000 7f022cf34640 1 -- start start 2023-11-27T18:13:38.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.325+0000 7f022cf34640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02280c5d90 0x7f0228159f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:38.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.325+0000 7f022cf34640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0228151560 0x7f0228147b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:38.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.325+0000 7f022cf34640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0228158160 0x7f0228148040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:38.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.325+0000 7f022cf34640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02281e0670 con 0x7f02280c5d90 2023-11-27T18:13:38.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.325+0000 7f022cf34640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02281e1b20 con 0x7f0228151560 2023-11-27T18:13:38.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.325+0000 7f022cf34640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02281e1860 con 0x7f0228158160 2023-11-27T18:13:38.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.325+0000 7f0226d9d640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0228158160 0x7f0228148040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:38.324 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.329+0000 7f0226d9d640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0228158160 0x7f0228148040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.91:36166/0 (socket says 172.21.15.91:36166) 2023-11-27T18:13:38.324 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.329+0000 7f0226d9d640 1 -- 172.21.15.91:0/1006394224 learned_addr learned my addr 172.21.15.91:0/1006394224 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:38.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.329+0000 7f0225d9b640 1 --2- 172.21.15.91:0/1006394224 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0228151560 0x7f0228147b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:38.334 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.337+0000 7f022659c640 1 --2- 172.21.15.91:0/1006394224 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02280c5d90 0x7f0228159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:38.334 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.337+0000 7f0226d9d640 1 -- 172.21.15.91:0/1006394224 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0228151560 msgr2=0x7f0228147b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:38.335 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.337+0000 7f0226d9d640 1 --2- 172.21.15.91:0/1006394224 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0228151560 0x7f0228147b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:38.335 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.337+0000 7f0226d9d640 1 -- 172.21.15.91:0/1006394224 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02280c5d90 msgr2=0x7f0228159f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:38.335 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.337+0000 7f0226d9d640 1 --2- 172.21.15.91:0/1006394224 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02280c5d90 0x7f0228159f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:38.335 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.337+0000 7f0226d9d640 1 -- 172.21.15.91:0/1006394224 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0218009420 con 0x7f0228158160 2023-11-27T18:13:38.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.345+0000 7f0226d9d640 1 --2- 172.21.15.91:0/1006394224 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0228158160 0x7f0228148040 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f021801d320 tx=0x7f021801ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:38.482 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.485+0000 7f0216ffd640 1 -- 172.21.15.91:0/1006394224 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02180b0c40 con 0x7f0228158160 2023-11-27T18:13:38.482 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.485+0000 7f0216ffd640 1 -- 172.21.15.91:0/1006394224 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02180b0da0 con 0x7f0228158160 2023-11-27T18:13:38.482 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.485+0000 7f0216ffd640 1 -- 172.21.15.91:0/1006394224 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02180b9620 con 0x7f0228158160 2023-11-27T18:13:38.482 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.485+0000 7f022cf34640 1 -- 172.21.15.91:0/1006394224 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02281e03b0 con 0x7f0228158160 2023-11-27T18:13:38.482 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.485+0000 7f022cf34640 1 -- 172.21.15.91:0/1006394224 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02281e2030 con 0x7f0228158160 2023-11-27T18:13:38.482 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.485+0000 7f022cf34640 1 -- 172.21.15.91:0/1006394224 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0228067810 con 0x7f0228158160 2023-11-27T18:13:38.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.789+0000 7f0216ffd640 1 -- 172.21.15.91:0/1006394224 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f02180b7040 con 0x7f0228158160 2023-11-27T18:13:38.787 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.789+0000 7f0216ffd640 1 --2- 172.21.15.91:0/1006394224 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f0208066870 0x7f0208068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:38.787 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.789+0000 7f022659c640 1 --2- 172.21.15.91:0/1006394224 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f0208066870 0x7f0208068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:38.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.793+0000 7f022659c640 1 --2- 172.21.15.91:0/1006394224 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f0208066870 0x7f0208068d30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0220009fd0 tx=0x7f022000b040 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:38.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.797+0000 7f0216ffd640 1 -- 172.21.15.91:0/1006394224 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f02180f3980 con 0x7f0228158160 2023-11-27T18:13:38.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:38.829+0000 7f0216ffd640 1 -- 172.21.15.91:0/1006394224 <== mon.2 v2:172.21.15.94:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f02180ef5c0 con 0x7f0228158160 2023-11-27T18:13:38.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.001+0000 7f022cf34640 1 -- 172.21.15.91:0/1006394224 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f02280c58c0 con 0x7f0228158160 2023-11-27T18:13:39.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.205+0000 7f0216ffd640 1 -- 172.21.15.91:0/1006394224 <== mon.2 v2:172.21.15.94:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f02180b5030 con 0x7f0228158160 2023-11-27T18:13:39.205 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:13:39.205 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":30,"fsid":"08c8ebbf-7936-4c41-a995-d5600de2d072","created":"2023-11-27T18:12:06.484593+0000","modified":"2023-11-27T18:13:22.801287+0000","last_up_change":"2023-11-27T18:12:33.154694+0000","last_in_change":"2023-11-27T18:12:23.622113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T18:12:35.450305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T18:13:09.589619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T18:13:11.439236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-27T18:13:18.514694+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ad53c08-dd19-4ae6-87c5-fa15bea3b4ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6811","nonce":472303992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6813","nonce":472303992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6817","nonce":472303992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6815","nonce":472303992}]},"public_addr":"172.21.15.91:6811/472303992","cluster_addr":"172.21.15.91:6813/472303992","heartbeat_back_addr":"172.21.15.91:6817/472303992","heartbeat_front_addr":"172.21.15.91:6815/472303992","state":["exists","up"]},{"osd":1,"uuid":"f8b5f147-ed29-4329-a787-a12cc34a2569","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6827","nonce":12316911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6829","nonce":12316911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6833","nonce":12316911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6831","nonce":12316911}]},"public_addr":"172.21.15.91:6827/12316911","cluster_addr":"172.21.15.91:6829/12316911","heartbeat_back_addr":"172.21.15.91:6833/12316911","heartbeat_front_addr":"172.21.15.91:6831/12316911","state":["exists","up"]},{"osd":2,"uuid":"c3029f9a-1c48-4f5d-983a-172a614d8795","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6803","nonce":3776125919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6805","nonce":3776125919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6809","nonce":3776125919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6807","nonce":3776125919}]},"public_addr":"172.21.15.91:6803/3776125919","cluster_addr":"172.21.15.91:6805/3776125919","heartbeat_back_addr":"172.21.15.91:6809/3776125919","heartbeat_front_addr":"172.21.15.91:6807/3776125919","state":["exists","up"]},{"osd":3,"uuid":"ab4b6fb2-0126-491b-9224-54a6badc5da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6819","nonce":1297704794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6821","nonce":1297704794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6825","nonce":1297704794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6823","nonce":1297704794}]},"public_addr":"172.21.15.91:6819/1297704794","cluster_addr":"172.21.15.91:6821/1297704794","heartbeat_back_addr":"172.21.15.91:6825/1297704794","heartbeat_front_addr":"172.21.15.91:6823/1297704794","state":["exists","up"]},{"osd":4,"uuid":"695071a8-2de8-4cba-bf20-050021a03bb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6809","nonce":2501531833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6811","nonce":2501531833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6815","nonce":2501531833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6813","nonce":2501531833}]},"public_addr":"172.21.15.94:6809/2501531833","cluster_addr":"172.21.15.94:6811/2501531833","heartbeat_back_addr":"172.21.15.94:6815/2501531833","heartbeat_front_addr":"172.21.15.94:6813/2501531833","state":["exists","up"]},{"osd":5,"uuid":"ca01da14-a700-4845-8db2-f5e3370677e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6817","nonce":2448969592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6819","nonce":2448969592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6823","nonce":2448969592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6821","nonce":2448969592}]},"public_addr":"172.21.15.94:6817/2448969592","cluster_addr":"172.21.15.94:6819/2448969592","heartbeat_back_addr":"172.21.15.94:6823/2448969592","heartbeat_front_addr":"172.21.15.94:6821/2448969592","state":["exists","up"]},{"osd":6,"uuid":"4784bc77-6c33-4e47-abba-d37484982f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6825","nonce":3389553935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6827","nonce":3389553935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6831","nonce":3389553935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6829","nonce":3389553935}]},"public_addr":"172.21.15.94:6825/3389553935","cluster_addr":"172.21.15.94:6827/3389553935","heartbeat_back_addr":"172.21.15.94:6831/3389553935","heartbeat_front_addr":"172.21.15.94:6829/3389553935","state":["exists","up"]},{"osd":7,"uuid":"b954cf3f-4a4f-4a75-9f90-014f72c16d15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6801","nonce":1606498064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6803","nonce":1606498064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6807","nonce":1606498064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6805","nonce":1606498064}]},"public_addr":"172.21.15.94:6801/1606498064","cluster_addr":"172.21.15.94:6803/1606498064","heartbeat_back_addr":"172.21.15.94:6807/1606498064","heartbeat_front_addr":"172.21.15.94:6805/1606498064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.534968+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.506182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.339267+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.532432+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:28.935756+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.471559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.485014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.352978+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T18:13:39.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.209+0000 7f022cf34640 1 -- 172.21.15.91:0/1006394224 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f0208066870 msgr2=0x7f0208068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:39.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.209+0000 7f022cf34640 1 --2- 172.21.15.91:0/1006394224 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f0208066870 0x7f0208068d30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0220009fd0 tx=0x7f022000b040 comp rx=0 tx=0).stop 2023-11-27T18:13:39.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.209+0000 7f022cf34640 1 -- 172.21.15.91:0/1006394224 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0228158160 msgr2=0x7f0228148040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:39.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.209+0000 7f022cf34640 1 --2- 172.21.15.91:0/1006394224 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0228158160 0x7f0228148040 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f021801d320 tx=0x7f021801ba10 comp rx=0 tx=0).stop 2023-11-27T18:13:39.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.209+0000 7f022cf34640 1 -- 172.21.15.91:0/1006394224 shutdown_connections 2023-11-27T18:13:39.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.209+0000 7f022cf34640 1 --2- 172.21.15.91:0/1006394224 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f0208066870 0x7f0208068d30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:39.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.209+0000 7f022cf34640 1 --2- 172.21.15.91:0/1006394224 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0228158160 0x7f0228148040 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:39.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.209+0000 7f022cf34640 1 --2- 172.21.15.91:0/1006394224 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0228151560 0x7f0228147b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:39.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.209+0000 7f022cf34640 1 --2- 172.21.15.91:0/1006394224 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02280c5d90 0x7f0228159f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:39.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.209+0000 7f022cf34640 1 -- 172.21.15.91:0/1006394224 >> 172.21.15.91:0/1006394224 conn(0x7f02280cbec0 msgr2=0x7f0228150910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:39.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.209+0000 7f022cf34640 1 -- 172.21.15.91:0/1006394224 shutdown_connections 2023-11-27T18:13:39.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.209+0000 7f022cf34640 1 -- 172.21.15.91:0/1006394224 wait complete. 2023-11-27T18:13:39.231 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T18:12:35.450305+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T18:13:09.589619+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T18:13:11.439236+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-27T18:13:18.514694+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-27T18:13:39.231 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T18:13:39.362 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.365+0000 7fd2db0fe640 1 Processor -- start 2023-11-27T18:13:39.362 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.365+0000 7fd2db0fe640 1 -- start start 2023-11-27T18:13:39.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.365+0000 7fd2db0fe640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd2d413d3a0 0x7fd2d40c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:39.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.365+0000 7fd2db0fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd2d40717f0 0x7fd2d4071c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:39.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.365+0000 7fd2db0fe640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2d4072180 con 0x7fd2d4157d70 2023-11-27T18:13:39.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.365+0000 7fd2db0fe640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2d406afe0 con 0x7fd2d40717f0 2023-11-27T18:13:39.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.365+0000 7fd2db0fe640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d406b2c0 con 0x7fd2d413d3a0 2023-11-27T18:13:39.365 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.369+0000 7fd2d8e9a640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd2d413d3a0 0x7fd2d40c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:39.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.369+0000 7fd2d8e9a640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd2d413d3a0 0x7fd2d40c86b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.91:36180/0 (socket says 172.21.15.91:36180) 2023-11-27T18:13:39.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.369+0000 7fd2d8e9a640 1 -- 172.21.15.91:0/2344626562 learned_addr learned my addr 172.21.15.91:0/2344626562 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:39.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.373+0000 7fd2d8e9a640 1 -- 172.21.15.91:0/2344626562 >> v2:172.21.15.91:3300/0 conn(0x7fd2d40717f0 msgr2=0x7fd2d4071c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:39.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.373+0000 7fd2d8e9a640 1 --2- 172.21.15.91:0/2344626562 >> v2:172.21.15.91:3300/0 conn(0x7fd2d40717f0 0x7fd2d4071c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:39.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.373+0000 7fd2d8e9a640 1 -- 172.21.15.91:0/2344626562 >> v1:172.21.15.91:6789/0 conn(0x7fd2d4157d70 legacy=0x7fd2d40c4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:39.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.373+0000 7fd2d8e9a640 1 -- 172.21.15.91:0/2344626562 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d406b5a0 con 0x7fd2d413d3a0 2023-11-27T18:13:39.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.385+0000 7fd2d8e9a640 1 --2- 172.21.15.91:0/2344626562 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd2d413d3a0 0x7fd2d40c86b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd2c4009870 tx=0x7fd2c401ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b60424c6bc21669 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:39.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.513+0000 7fd2d37fe640 1 -- 172.21.15.91:0/2344626562 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c40a89b0 con 0x7fd2d413d3a0 2023-11-27T18:13:39.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.513+0000 7fd2d37fe640 1 -- 172.21.15.91:0/2344626562 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c40a8b10 con 0x7fd2d413d3a0 2023-11-27T18:13:39.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.513+0000 7fd2d37fe640 1 -- 172.21.15.91:0/2344626562 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c40a8ea0 con 0x7fd2d413d3a0 2023-11-27T18:13:39.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.517+0000 7fd2db0fe640 1 -- 172.21.15.91:0/2344626562 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd2d413d3a0 msgr2=0x7fd2d40c86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:39.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.517+0000 7fd2db0fe640 1 --2- 172.21.15.91:0/2344626562 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd2d413d3a0 0x7fd2d40c86b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd2c4009870 tx=0x7fd2c401ecf0 comp rx=0 tx=0).stop 2023-11-27T18:13:39.513 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.517+0000 7fd2db0fe640 1 -- 172.21.15.91:0/2344626562 shutdown_connections 2023-11-27T18:13:39.513 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.517+0000 7fd2db0fe640 1 --2- 172.21.15.91:0/2344626562 >> v2:172.21.15.91:3300/0 conn(0x7fd2d40717f0 0x7fd2d4071c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:39.513 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.517+0000 7fd2db0fe640 1 --2- 172.21.15.91:0/2344626562 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd2d413d3a0 0x7fd2d40c86b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:39.513 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.517+0000 7fd2db0fe640 1 -- 172.21.15.91:0/2344626562 >> 172.21.15.91:0/2344626562 conn(0x7fd2d40cbaa0 msgr2=0x7fd2d40c7fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:39.513 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.517+0000 7fd2db0fe640 1 -- 172.21.15.91:0/2344626562 shutdown_connections 2023-11-27T18:13:39.513 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.517+0000 7fd2db0fe640 1 -- 172.21.15.91:0/2344626562 wait complete. 2023-11-27T18:13:39.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.517+0000 7fd2db0fe640 1 Processor -- start 2023-11-27T18:13:39.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.517+0000 7fd2db0fe640 1 -- start start 2023-11-27T18:13:39.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.517+0000 7fd2db0fe640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd2d40717f0 0x7fd2d40c6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:39.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.517+0000 7fd2db0fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd2d413d3a0 0x7fd2d40c29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:39.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.517+0000 7fd2db0fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd2d4157d70 0x7fd2d40c2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:39.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.517+0000 7fd2db0fe640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d40c3f10 con 0x7fd2d4157d70 2023-11-27T18:13:39.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.517+0000 7fd2db0fe640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d40c23b0 con 0x7fd2d413d3a0 2023-11-27T18:13:39.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.517+0000 7fd2db0fe640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d40c25e0 con 0x7fd2d40717f0 2023-11-27T18:13:39.518 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.521+0000 7fd2d969b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd2d4157d70 0x7fd2d40c2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:39.518 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.521+0000 7fd2d3fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd2d413d3a0 0x7fd2d40c29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:39.518 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.521+0000 7fd2d969b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd2d4157d70 0x7fd2d40c2ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:59900/0 (socket says 172.21.15.91:59900) 2023-11-27T18:13:39.518 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.521+0000 7fd2d969b640 1 -- 172.21.15.91:0/2638330857 learned_addr learned my addr 172.21.15.91:0/2638330857 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:39.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.525+0000 7fd2d969b640 1 -- 172.21.15.91:0/2638330857 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd2d40717f0 msgr2=0x7fd2d40c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:39.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.525+0000 7fd2d969b640 1 --2- 172.21.15.91:0/2638330857 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd2d40717f0 0x7fd2d40c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:39.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.525+0000 7fd2d969b640 1 -- 172.21.15.91:0/2638330857 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd2d413d3a0 msgr2=0x7fd2d40c29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:39.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.525+0000 7fd2d969b640 1 --2- 172.21.15.91:0/2638330857 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd2d413d3a0 0x7fd2d40c29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:39.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.525+0000 7fd2d969b640 1 -- 172.21.15.91:0/2638330857 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c40094d0 con 0x7fd2d4157d70 2023-11-27T18:13:39.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.533+0000 7fd2d969b640 1 --2- 172.21.15.91:0/2638330857 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd2d4157d70 0x7fd2d40c2ee0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc00b9a0 tx=0x7fd2cc00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:39.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.541+0000 7fd2d17fa640 1 -- 172.21.15.91:0/2638330857 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2cc00cba0 con 0x7fd2d4157d70 2023-11-27T18:13:39.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.541+0000 7fd2d17fa640 1 -- 172.21.15.91:0/2638330857 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2cc00cd20 con 0x7fd2d4157d70 2023-11-27T18:13:39.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.541+0000 7fd2d17fa640 1 -- 172.21.15.91:0/2638330857 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2cc014680 con 0x7fd2d4157d70 2023-11-27T18:13:39.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.541+0000 7fd2db0fe640 1 -- 172.21.15.91:0/2638330857 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2d40c4740 con 0x7fd2d4157d70 2023-11-27T18:13:39.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.541+0000 7fd2db0fe640 1 -- 172.21.15.91:0/2638330857 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2d40c4460 con 0x7fd2d4157d70 2023-11-27T18:13:39.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.541+0000 7fd2db0fe640 1 -- 172.21.15.91:0/2638330857 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2d404e850 con 0x7fd2d4157d70 2023-11-27T18:13:39.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.833+0000 7fd2d17fa640 1 -- 172.21.15.91:0/2638330857 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fd2cc01d3b0 con 0x7fd2d4157d70 2023-11-27T18:13:39.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.833+0000 7fd2d17fa640 1 --2- 172.21.15.91:0/2638330857 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fd2c0066870 0x7fd2c0068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:39.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.833+0000 7fd2d8e9a640 1 --2- 172.21.15.91:0/2638330857 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fd2c0066870 0x7fd2c0068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:39.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.833+0000 7fd2d8e9a640 1 --2- 172.21.15.91:0/2638330857 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fd2c0066870 0x7fd2c0068d30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd2c40b2000 tx=0x7fd2c4004740 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:39.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.869+0000 7fd2d17fa640 1 -- 172.21.15.91:0/2638330857 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd2cc055440 con 0x7fd2d4157d70 2023-11-27T18:13:39.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:39.873+0000 7fd2d17fa640 1 -- 172.21.15.91:0/2638330857 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fd2cc051780 con 0x7fd2d4157d70 2023-11-27T18:13:40.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.061+0000 7fd2db0fe640 1 -- 172.21.15.91:0/2638330857 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd2d40737e0 con 0x7fd2d4157d70 2023-11-27T18:13:40.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.081+0000 7fd2d17fa640 1 -- 172.21.15.91:0/2638330857 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd2cc019070 con 0x7fd2d4157d70 2023-11-27T18:13:40.076 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 1 2023-11-27T18:13:40.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.081+0000 7fd2db0fe640 1 -- 172.21.15.91:0/2638330857 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fd2c0066870 msgr2=0x7fd2c0068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:40.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.081+0000 7fd2db0fe640 1 --2- 172.21.15.91:0/2638330857 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fd2c0066870 0x7fd2c0068d30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd2c40b2000 tx=0x7fd2c4004740 comp rx=0 tx=0).stop 2023-11-27T18:13:40.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.081+0000 7fd2db0fe640 1 -- 172.21.15.91:0/2638330857 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd2d4157d70 msgr2=0x7fd2d40c2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:40.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.081+0000 7fd2db0fe640 1 --2- 172.21.15.91:0/2638330857 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd2d4157d70 0x7fd2d40c2ee0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc00b9a0 tx=0x7fd2cc00be60 comp rx=0 tx=0).stop 2023-11-27T18:13:40.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.081+0000 7fd2db0fe640 1 -- 172.21.15.91:0/2638330857 shutdown_connections 2023-11-27T18:13:40.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.081+0000 7fd2db0fe640 1 --2- 172.21.15.91:0/2638330857 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fd2c0066870 0x7fd2c0068d30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:40.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.081+0000 7fd2db0fe640 1 --2- 172.21.15.91:0/2638330857 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd2d4157d70 0x7fd2d40c2ee0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:40.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.081+0000 7fd2db0fe640 1 --2- 172.21.15.91:0/2638330857 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd2d413d3a0 0x7fd2d40c29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:40.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.081+0000 7fd2db0fe640 1 --2- 172.21.15.91:0/2638330857 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd2d40717f0 0x7fd2d40c6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:40.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.081+0000 7fd2db0fe640 1 -- 172.21.15.91:0/2638330857 >> 172.21.15.91:0/2638330857 conn(0x7fd2d40cbaa0 msgr2=0x7fd2d40cabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:40.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.081+0000 7fd2db0fe640 1 -- 172.21.15.91:0/2638330857 shutdown_connections 2023-11-27T18:13:40.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.081+0000 7fd2db0fe640 1 -- 172.21.15.91:0/2638330857 wait complete. 2023-11-27T18:13:40.099 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T18:13:40.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.229+0000 7f0a81827640 1 Processor -- start 2023-11-27T18:13:40.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.229+0000 7f0a81827640 1 -- start start 2023-11-27T18:13:40.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.229+0000 7f0a81827640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f0a7c150420 0x7f0a7c072040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:40.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.229+0000 7f0a81827640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a7c06bdc0 con 0x7f0a7c156a70 2023-11-27T18:13:40.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.229+0000 7f0a81827640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a7c0c3530 con 0x7f0a7c06b630 2023-11-27T18:13:40.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.229+0000 7f0a81827640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a7c0663d0 con 0x7f0a7c150420 2023-11-27T18:13:40.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.229+0000 7f0a7affd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f0a7c150420 0x7f0a7c072040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:40.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.229+0000 7f0a7b7fe640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f0a7c156a70 0x7f0a7c160b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:52142/0 (socket says 172.21.15.91:52142) 2023-11-27T18:13:40.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.229+0000 7f0a7b7fe640 1 -- 172.21.15.91:0/4141815725 learned_addr learned my addr 172.21.15.91:0/4141815725 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:13:40.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.233+0000 7f0a7affd640 1 -- 172.21.15.91:0/4141815725 >> v1:172.21.15.94:6789/0 conn(0x7f0a7c06b630 legacy=0x7f0a7c156360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:40.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.233+0000 7f0a7affd640 1 -- 172.21.15.91:0/4141815725 >> v1:172.21.15.91:6789/0 conn(0x7f0a7c156a70 legacy=0x7f0a7c160b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:40.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.233+0000 7f0a7affd640 1 -- 172.21.15.91:0/4141815725 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a7c06bb00 con 0x7f0a7c150420 2023-11-27T18:13:40.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.241+0000 7f0a7affd640 1 --2- 172.21.15.91:0/4141815725 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0a7c150420 0x7f0a7c072040 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0a74009d90 tx=0x7f0a7401f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81e688ff84c0a925 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:40.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.245+0000 7f0a79ffb640 1 -- 172.21.15.91:0/4141815725 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a740af600 con 0x7f0a7c150420 2023-11-27T18:13:40.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.245+0000 7f0a79ffb640 1 -- 172.21.15.91:0/4141815725 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a740ab050 con 0x7f0a7c150420 2023-11-27T18:13:40.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.245+0000 7f0a79ffb640 1 -- 172.21.15.91:0/4141815725 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a740af980 con 0x7f0a7c150420 2023-11-27T18:13:40.243 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.245+0000 7f0a81827640 1 -- 172.21.15.91:0/4141815725 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0a7c150420 msgr2=0x7f0a7c072040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:40.243 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.245+0000 7f0a81827640 1 --2- 172.21.15.91:0/4141815725 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0a7c150420 0x7f0a7c072040 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0a74009d90 tx=0x7f0a7401f130 comp rx=0 tx=0).stop 2023-11-27T18:13:40.243 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.245+0000 7f0a81827640 1 -- 172.21.15.91:0/4141815725 shutdown_connections 2023-11-27T18:13:40.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.245+0000 7f0a81827640 1 --2- 172.21.15.91:0/4141815725 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0a7c150420 0x7f0a7c072040 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:40.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.245+0000 7f0a81827640 1 -- 172.21.15.91:0/4141815725 >> 172.21.15.91:0/4141815725 conn(0x7f0a7c071520 msgr2=0x7f0a7c071930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:40.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.245+0000 7f0a81827640 1 -- 172.21.15.91:0/4141815725 shutdown_connections 2023-11-27T18:13:40.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.245+0000 7f0a81827640 1 -- 172.21.15.91:0/4141815725 wait complete. 2023-11-27T18:13:40.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.249+0000 7f0a81827640 1 Processor -- start 2023-11-27T18:13:40.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.249+0000 7f0a81827640 1 -- start start 2023-11-27T18:13:40.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.249+0000 7f0a81827640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0a7c06b630 0x7f0a7c0ca840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:40.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.249+0000 7f0a81827640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0a7c150420 0x7f0a7c1ea9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:40.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.249+0000 7f0a81827640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0a7c156a70 0x7f0a7c1eaef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:40.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.249+0000 7f0a81827640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7c1eeb10 con 0x7f0a7c06b630 2023-11-27T18:13:40.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.249+0000 7f0a81827640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7c1edf20 con 0x7f0a7c150420 2023-11-27T18:13:40.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.249+0000 7f0a81827640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7c149d60 con 0x7f0a7c156a70 2023-11-27T18:13:40.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.249+0000 7f0a7affd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0a7c06b630 0x7f0a7c0ca840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:40.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.249+0000 7f0a7affd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0a7c06b630 0x7f0a7c0ca840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:59916/0 (socket says 172.21.15.91:59916) 2023-11-27T18:13:40.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.249+0000 7f0a7affd640 1 -- 172.21.15.91:0/630965639 learned_addr learned my addr 172.21.15.91:0/630965639 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:40.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.249+0000 7f0a7a7fc640 1 --2- 172.21.15.91:0/630965639 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0a7c150420 0x7f0a7c1ea9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:40.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.249+0000 7f0a7b7fe640 1 --2- 172.21.15.91:0/630965639 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0a7c156a70 0x7f0a7c1eaef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:40.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.253+0000 7f0a7affd640 1 -- 172.21.15.91:0/630965639 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0a7c156a70 msgr2=0x7f0a7c1eaef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:40.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.253+0000 7f0a7affd640 1 --2- 172.21.15.91:0/630965639 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0a7c156a70 0x7f0a7c1eaef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:40.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.253+0000 7f0a7affd640 1 -- 172.21.15.91:0/630965639 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0a7c150420 msgr2=0x7f0a7c1ea9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:40.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.253+0000 7f0a7affd640 1 --2- 172.21.15.91:0/630965639 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0a7c150420 0x7f0a7c1ea9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:40.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.253+0000 7f0a7affd640 1 -- 172.21.15.91:0/630965639 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a74009a70 con 0x7f0a7c06b630 2023-11-27T18:13:40.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.253+0000 7f0a7affd640 1 --2- 172.21.15.91:0/630965639 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0a7c06b630 0x7f0a7c0ca840 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0a7401bd40 tx=0x7f0a7401bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:40.257 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.261+0000 7f0a73fff640 1 -- 172.21.15.91:0/630965639 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a740ba420 con 0x7f0a7c06b630 2023-11-27T18:13:40.257 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.261+0000 7f0a73fff640 1 -- 172.21.15.91:0/630965639 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a740ba5a0 con 0x7f0a7c06b630 2023-11-27T18:13:40.257 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.261+0000 7f0a73fff640 1 -- 172.21.15.91:0/630965639 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a740ba950 con 0x7f0a7c06b630 2023-11-27T18:13:40.257 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.261+0000 7f0a81827640 1 -- 172.21.15.91:0/630965639 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a7c1ee170 con 0x7f0a7c06b630 2023-11-27T18:13:40.257 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.261+0000 7f0a81827640 1 -- 172.21.15.91:0/630965639 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a7c1ee730 con 0x7f0a7c06b630 2023-11-27T18:13:40.257 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.261+0000 7f0a81827640 1 -- 172.21.15.91:0/630965639 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a7c1eee30 con 0x7f0a7c06b630 2023-11-27T18:13:40.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.545+0000 7f0a73fff640 1 -- 172.21.15.91:0/630965639 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f0a740baab0 con 0x7f0a7c06b630 2023-11-27T18:13:40.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.545+0000 7f0a73fff640 1 --2- 172.21.15.91:0/630965639 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f0a5c066840 0x7f0a5c068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:40.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.545+0000 7f0a7a7fc640 1 --2- 172.21.15.91:0/630965639 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f0a5c066840 0x7f0a5c068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:40.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.545+0000 7f0a7a7fc640 1 --2- 172.21.15.91:0/630965639 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f0a5c066840 0x7f0a5c068d00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c0cb170 tx=0x7f0a64009040 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:40.575 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.577+0000 7f0a73fff640 1 -- 172.21.15.91:0/630965639 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0a740f3f20 con 0x7f0a7c06b630 2023-11-27T18:13:40.575 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.577+0000 7f0a73fff640 1 -- 172.21.15.91:0/630965639 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f0a740f0260 con 0x7f0a7c06b630 2023-11-27T18:13:40.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.741+0000 7f0a81827640 1 -- 172.21.15.91:0/630965639 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0a7c04e850 con 0x7f0a7c06b630 2023-11-27T18:13:40.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.753+0000 7f0a73fff640 1 -- 172.21.15.91:0/630965639 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0a740c8020 con 0x7f0a7c06b630 2023-11-27T18:13:40.750 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T18:13:40.752 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.757+0000 7f0a81827640 1 -- 172.21.15.91:0/630965639 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f0a5c066840 msgr2=0x7f0a5c068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:40.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.757+0000 7f0a81827640 1 --2- 172.21.15.91:0/630965639 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f0a5c066840 0x7f0a5c068d00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c0cb170 tx=0x7f0a64009040 comp rx=0 tx=0).stop 2023-11-27T18:13:40.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.757+0000 7f0a81827640 1 -- 172.21.15.91:0/630965639 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0a7c06b630 msgr2=0x7f0a7c0ca840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:40.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.757+0000 7f0a81827640 1 --2- 172.21.15.91:0/630965639 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0a7c06b630 0x7f0a7c0ca840 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0a7401bd40 tx=0x7f0a7401bed0 comp rx=0 tx=0).stop 2023-11-27T18:13:40.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.757+0000 7f0a81827640 1 -- 172.21.15.91:0/630965639 shutdown_connections 2023-11-27T18:13:40.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.757+0000 7f0a81827640 1 --2- 172.21.15.91:0/630965639 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f0a5c066840 0x7f0a5c068d00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:40.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.757+0000 7f0a81827640 1 --2- 172.21.15.91:0/630965639 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0a7c156a70 0x7f0a7c1eaef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:40.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.757+0000 7f0a81827640 1 --2- 172.21.15.91:0/630965639 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0a7c150420 0x7f0a7c1ea9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:40.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.757+0000 7f0a81827640 1 --2- 172.21.15.91:0/630965639 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0a7c06b630 0x7f0a7c0ca840 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:40.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.757+0000 7f0a81827640 1 -- 172.21.15.91:0/630965639 >> 172.21.15.91:0/630965639 conn(0x7f0a7c071520 msgr2=0x7f0a7c0c59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:40.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.757+0000 7f0a81827640 1 -- 172.21.15.91:0/630965639 shutdown_connections 2023-11-27T18:13:40.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.757+0000 7f0a81827640 1 -- 172.21.15.91:0/630965639 wait complete. 2023-11-27T18:13:40.768 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T18:13:40.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.901+0000 7f4133411640 1 Processor -- start 2023-11-27T18:13:40.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.901+0000 7f4133411640 1 -- start start 2023-11-27T18:13:40.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.901+0000 7f4133411640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f412c06b630 0x7f412c156360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:40.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.901+0000 7f4133411640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f412c06bdc0 con 0x7f412c1568a0 2023-11-27T18:13:40.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.901+0000 7f4133411640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f412c0c3530 con 0x7f412c150420 2023-11-27T18:13:40.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.901+0000 7f4133411640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f412c156d50 con 0x7f412c06b630 2023-11-27T18:13:40.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.901+0000 7f41319ae640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f412c1568a0 0x7f412c160b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:52148/0 (socket says 172.21.15.91:52148) 2023-11-27T18:13:40.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.901+0000 7f41319ae640 1 -- 172.21.15.91:0/1644966703 learned_addr learned my addr 172.21.15.91:0/1644966703 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:13:40.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.905+0000 7f4123fff640 1 -- 172.21.15.91:0/1644966703 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1097026251 0 0) 0x7f41240014a0 con 0x7f412c1568a0 2023-11-27T18:13:40.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.905+0000 7f4123fff640 1 -- 172.21.15.91:0/1644966703 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4118005740 con 0x7f412c1568a0 2023-11-27T18:13:40.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.905+0000 7f41309ac640 1 --2- 172.21.15.91:0/1644966703 >> v2:172.21.15.94:3300/0 conn(0x7f412c06b630 0x7f412c156360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:40.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.909+0000 7f4123fff640 1 -- 172.21.15.91:0/1644966703 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2882077642 0 0) 0x7f4118005740 con 0x7f412c1568a0 2023-11-27T18:13:40.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.909+0000 7f4123fff640 1 -- 172.21.15.91:0/1644966703 >> v2:172.21.15.94:3300/0 conn(0x7f412c06b630 msgr2=0x7f412c156360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:40.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.909+0000 7f4123fff640 1 --2- 172.21.15.91:0/1644966703 >> v2:172.21.15.94:3300/0 conn(0x7f412c06b630 0x7f412c156360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:40.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.909+0000 7f4123fff640 1 -- 172.21.15.91:0/1644966703 >> v1:172.21.15.94:6789/0 conn(0x7f412c150420 legacy=0x7f412c072040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:40.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.909+0000 7f4123fff640 1 -- 172.21.15.91:0/1644966703 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f412c0663d0 con 0x7f412c1568a0 2023-11-27T18:13:40.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.909+0000 7f4123fff640 1 -- 172.21.15.91:0/1644966703 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3378743932 0 0) 0x7f4124001b90 con 0x7f412c1568a0 2023-11-27T18:13:40.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.909+0000 7f4123fff640 1 -- 172.21.15.91:0/1644966703 >> v1:172.21.15.91:6789/0 conn(0x7f412c1568a0 legacy=0x7f412c160b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:40.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.909+0000 7f4123fff640 1 --2- 172.21.15.91:0/1644966703 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4118005be0 0x7f4118005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:40.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.909+0000 7f4123fff640 1 --2- 172.21.15.91:0/1644966703 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f41180069e0 0x7f4118006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:40.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.909+0000 7f4123fff640 1 --2- 172.21.15.91:0/1644966703 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f41180073a0 0x7f411800ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:40.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.909+0000 7f4123fff640 1 -- 172.21.15.91:0/1644966703 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f412c156d50 con 0x7f4118005be0 2023-11-27T18:13:40.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.909+0000 7f4123fff640 1 -- 172.21.15.91:0/1644966703 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4118010620 con 0x7f41180069e0 2023-11-27T18:13:40.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.909+0000 7f4123fff640 1 -- 172.21.15.91:0/1644966703 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41180107b0 con 0x7f41180073a0 2023-11-27T18:13:40.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.913+0000 7f41311ad640 1 --2- 172.21.15.91:0/1644966703 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4118005be0 0x7f4118005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:40.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.917+0000 7f41319ae640 1 --2- 172.21.15.91:0/1644966703 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f41180073a0 0x7f411800ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:40.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.917+0000 7f41311ad640 1 -- 172.21.15.91:0/1644966703 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f41180073a0 msgr2=0x7f411800ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:40.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.917+0000 7f41311ad640 1 --2- 172.21.15.91:0/1644966703 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f41180073a0 0x7f411800ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:40.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.917+0000 7f41311ad640 1 -- 172.21.15.91:0/1644966703 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f41180069e0 msgr2=0x7f4118006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:40.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.917+0000 7f41311ad640 1 --2- 172.21.15.91:0/1644966703 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f41180069e0 0x7f4118006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:40.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.917+0000 7f41311ad640 1 -- 172.21.15.91:0/1644966703 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4118005740 con 0x7f4118005be0 2023-11-27T18:13:40.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.917+0000 7f41319ae640 1 -- 172.21.15.91:0/1644966703 reap_dead start 2023-11-27T18:13:40.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.921+0000 7f41311ad640 1 --2- 172.21.15.91:0/1644966703 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4118005be0 0x7f4118005fe0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4128003de0 tx=0x7f412801c2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff5e515c14e9b252 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:40.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.929+0000 7f4123fff640 1 -- 172.21.15.91:0/1644966703 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41280ab600 con 0x7f4118005be0 2023-11-27T18:13:40.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.929+0000 7f4123fff640 1 -- 172.21.15.91:0/1644966703 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41280a7050 con 0x7f4118005be0 2023-11-27T18:13:40.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.929+0000 7f4123fff640 1 -- 172.21.15.91:0/1644966703 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41280aba00 con 0x7f4118005be0 2023-11-27T18:13:40.927 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.929+0000 7f4133411640 1 -- 172.21.15.91:0/1644966703 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4118005be0 msgr2=0x7f4118005fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:40.927 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.929+0000 7f4133411640 1 --2- 172.21.15.91:0/1644966703 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4118005be0 0x7f4118005fe0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4128003de0 tx=0x7f412801c2b0 comp rx=0 tx=0).stop 2023-11-27T18:13:40.927 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.929+0000 7f4133411640 1 -- 172.21.15.91:0/1644966703 shutdown_connections 2023-11-27T18:13:40.927 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.929+0000 7f4133411640 1 --2- 172.21.15.91:0/1644966703 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4118005be0 0x7f4118005fe0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:40.927 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.929+0000 7f4133411640 1 -- 172.21.15.91:0/1644966703 >> 172.21.15.91:0/1644966703 conn(0x7f412c071520 msgr2=0x7f412c071930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:40.927 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.929+0000 7f4133411640 1 -- 172.21.15.91:0/1644966703 shutdown_connections 2023-11-27T18:13:40.927 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.929+0000 7f4133411640 1 -- 172.21.15.91:0/1644966703 wait complete. 2023-11-27T18:13:40.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.933+0000 7f4133411640 1 Processor -- start 2023-11-27T18:13:40.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.933+0000 7f4133411640 1 -- start start 2023-11-27T18:13:40.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.933+0000 7f4133411640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4118005be0 0x7f412c14f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:40.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.933+0000 7f4133411640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f412c157b00 0x7f412c147e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:40.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.933+0000 7f4133411640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f412c1483c0 0x7f412c158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:40.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.933+0000 7f4133411640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f412c158940 con 0x7f4118005be0 2023-11-27T18:13:40.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.933+0000 7f4133411640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f412c153ce0 con 0x7f412c157b00 2023-11-27T18:13:40.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.933+0000 7f4133411640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f412c158390 con 0x7f412c1483c0 2023-11-27T18:13:40.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.933+0000 7f41319ae640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f412c1483c0 0x7f412c158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:40.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.933+0000 7f41309ac640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f412c157b00 0x7f412c147e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:40.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.933+0000 7f41311ad640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4118005be0 0x7f412c14f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:40.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.933+0000 7f41319ae640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f412c1483c0 0x7f412c158dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.91:36212/0 (socket says 172.21.15.91:36212) 2023-11-27T18:13:40.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.933+0000 7f41319ae640 1 -- 172.21.15.91:0/3134353362 learned_addr learned my addr 172.21.15.91:0/3134353362 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:40.941 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.945+0000 7f41319ae640 1 -- 172.21.15.91:0/3134353362 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f412c157b00 msgr2=0x7f412c147e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:40.941 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.945+0000 7f41319ae640 1 --2- 172.21.15.91:0/3134353362 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f412c157b00 0x7f412c147e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:40.942 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.945+0000 7f41319ae640 1 -- 172.21.15.91:0/3134353362 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4118005be0 msgr2=0x7f412c14f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:40.942 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.945+0000 7f41319ae640 1 --2- 172.21.15.91:0/3134353362 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4118005be0 0x7f412c14f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:40.942 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.945+0000 7f41319ae640 1 -- 172.21.15.91:0/3134353362 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f412c157400 con 0x7f412c1483c0 2023-11-27T18:13:40.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:40.949+0000 7f41319ae640 1 --2- 172.21.15.91:0/3134353362 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f412c1483c0 0x7f412c158dd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4124001600 tx=0x7f4124010d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:41.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:41.093+0000 7f4121ffb640 1 -- 172.21.15.91:0/3134353362 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412400eac0 con 0x7f412c1483c0 2023-11-27T18:13:41.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:41.093+0000 7f4121ffb640 1 -- 172.21.15.91:0/3134353362 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f412400ec20 con 0x7f412c1483c0 2023-11-27T18:13:41.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:41.093+0000 7f4133411640 1 -- 172.21.15.91:0/3134353362 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f412c1eb8d0 con 0x7f412c1483c0 2023-11-27T18:13:41.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:41.093+0000 7f4121ffb640 1 -- 172.21.15.91:0/3134353362 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4124015400 con 0x7f412c1483c0 2023-11-27T18:13:41.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:41.093+0000 7f4133411640 1 -- 172.21.15.91:0/3134353362 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f412c1ebbb0 con 0x7f412c1483c0 2023-11-27T18:13:41.093 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:41.097+0000 7f4133411640 1 -- 172.21.15.91:0/3134353362 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f412c157870 con 0x7f412c1483c0 2023-11-27T18:13:41.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:41.405+0000 7f4121ffb640 1 -- 172.21.15.91:0/3134353362 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f412401e3b0 con 0x7f412c1483c0 2023-11-27T18:13:41.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:41.409+0000 7f4121ffb640 1 --2- 172.21.15.91:0/3134353362 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f4110066870 0x7f4110068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:41.405 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:41.409+0000 7f41311ad640 1 --2- 172.21.15.91:0/3134353362 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f4110066870 0x7f4110068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:41.406 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:41.409+0000 7f41311ad640 1 --2- 172.21.15.91:0/3134353362 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f4110066870 0x7f4110068d30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f41280ad000 tx=0x7f4128003770 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:41.411 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:41.413+0000 7f4121ffb640 1 -- 172.21.15.91:0/3134353362 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4124001b80 con 0x7f412c1483c0 2023-11-27T18:13:41.445 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:41.449+0000 7f4121ffb640 1 -- 172.21.15.91:0/3134353362 <== mon.2 v2:172.21.15.94:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f4124057d40 con 0x7f412c1483c0 2023-11-27T18:13:41.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:41.613+0000 7f4133411640 1 -- 172.21.15.91:0/3134353362 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f412c158af0 con 0x7f412c1483c0 2023-11-27T18:13:41.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:41.913+0000 7f4121ffb640 1 -- 172.21.15.91:0/3134353362 <== mon.2 v2:172.21.15.94:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7f412c158af0 con 0x7f412c1483c0 2023-11-27T18:13:41.910 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-11-27T18:13:41.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:41.917+0000 7f4133411640 1 -- 172.21.15.91:0/3134353362 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f4110066870 msgr2=0x7f4110068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:41.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:41.917+0000 7f4133411640 1 --2- 172.21.15.91:0/3134353362 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f4110066870 0x7f4110068d30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f41280ad000 tx=0x7f4128003770 comp rx=0 tx=0).stop 2023-11-27T18:13:41.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:41.917+0000 7f4133411640 1 -- 172.21.15.91:0/3134353362 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f412c1483c0 msgr2=0x7f412c158dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:41.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:41.917+0000 7f4133411640 1 --2- 172.21.15.91:0/3134353362 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f412c1483c0 0x7f412c158dd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4124001600 tx=0x7f4124010d70 comp rx=0 tx=0).stop 2023-11-27T18:13:41.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:41.917+0000 7f4133411640 1 -- 172.21.15.91:0/3134353362 shutdown_connections 2023-11-27T18:13:41.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:41.917+0000 7f4133411640 1 --2- 172.21.15.91:0/3134353362 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f4110066870 0x7f4110068d30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:41.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:41.917+0000 7f4133411640 1 --2- 172.21.15.91:0/3134353362 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f412c1483c0 0x7f412c158dd0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:41.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:41.917+0000 7f4133411640 1 --2- 172.21.15.91:0/3134353362 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f412c157b00 0x7f412c147e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:41.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:41.917+0000 7f4133411640 1 --2- 172.21.15.91:0/3134353362 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4118005be0 0x7f412c14f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:41.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:41.917+0000 7f4133411640 1 -- 172.21.15.91:0/3134353362 >> 172.21.15.91:0/3134353362 conn(0x7f412c071520 msgr2=0x7f412c14c150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:41.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:41.917+0000 7f4133411640 1 -- 172.21.15.91:0/3134353362 shutdown_connections 2023-11-27T18:13:41.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:41.917+0000 7f4133411640 1 -- 172.21.15.91:0/3134353362 wait complete. 2023-11-27T18:13:41.936 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-27T18:13:42.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.073+0000 7f330dd97640 1 Processor -- start 2023-11-27T18:13:42.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.073+0000 7f330dd97640 1 -- start start 2023-11-27T18:13:42.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.073+0000 7f330dd97640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f33081514c0 0x7f330806e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:42.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.073+0000 7f330dd97640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33080c8820 con 0x7f33081571c0 2023-11-27T18:13:42.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.073+0000 7f330dd97640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33080c70f0 con 0x7f33080b1f20 2023-11-27T18:13:42.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.073+0000 7f330dd97640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33081518a0 con 0x7f33081514c0 2023-11-27T18:13:42.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.073+0000 7f33077fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f33081514c0 0x7f330806e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:42.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.073+0000 7f33077fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f33081514c0 0x7f330806e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:59940/0 (socket says 172.21.15.91:59940) 2023-11-27T18:13:42.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.073+0000 7f33077fe640 1 -- 172.21.15.91:0/583446960 learned_addr learned my addr 172.21.15.91:0/583446960 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:42.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.077+0000 7f33077fe640 1 -- 172.21.15.91:0/583446960 >> v1:172.21.15.94:6789/0 conn(0x7f33080b1f20 legacy=0x7f330815b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:42.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.077+0000 7f33077fe640 1 -- 172.21.15.91:0/583446960 >> v1:172.21.15.91:6789/0 conn(0x7f33081571c0 legacy=0x7f33080ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:42.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.077+0000 7f33077fe640 1 -- 172.21.15.91:0/583446960 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f330806f140 con 0x7f33081514c0 2023-11-27T18:13:42.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.085+0000 7f33077fe640 1 --2- 172.21.15.91:0/583446960 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f33081514c0 0x7f330806e260 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f32f8009870 tx=0x7f32f801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad98e58aebab3a70 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:42.083 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.085+0000 7f33067fc640 1 -- 172.21.15.91:0/583446960 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f80ab5f0 con 0x7f33081514c0 2023-11-27T18:13:42.084 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.085+0000 7f33067fc640 1 -- 172.21.15.91:0/583446960 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f80ab750 con 0x7f33081514c0 2023-11-27T18:13:42.084 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.085+0000 7f33067fc640 1 -- 172.21.15.91:0/583446960 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f80abae0 con 0x7f33081514c0 2023-11-27T18:13:42.084 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.089+0000 7f330dd97640 1 -- 172.21.15.91:0/583446960 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f33081514c0 msgr2=0x7f330806e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:42.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.089+0000 7f330dd97640 1 --2- 172.21.15.91:0/583446960 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f33081514c0 0x7f330806e260 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f32f8009870 tx=0x7f32f801c500 comp rx=0 tx=0).stop 2023-11-27T18:13:42.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.089+0000 7f330dd97640 1 -- 172.21.15.91:0/583446960 shutdown_connections 2023-11-27T18:13:42.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.089+0000 7f330dd97640 1 --2- 172.21.15.91:0/583446960 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f33081514c0 0x7f330806e260 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:42.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.089+0000 7f330dd97640 1 -- 172.21.15.91:0/583446960 >> 172.21.15.91:0/583446960 conn(0x7f3308070a80 msgr2=0x7f3308070e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:42.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.089+0000 7f330dd97640 1 -- 172.21.15.91:0/583446960 shutdown_connections 2023-11-27T18:13:42.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.089+0000 7f330dd97640 1 -- 172.21.15.91:0/583446960 wait complete. 2023-11-27T18:13:42.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.089+0000 7f330dd97640 1 Processor -- start 2023-11-27T18:13:42.086 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.089+0000 7f330dd97640 1 -- start start 2023-11-27T18:13:42.086 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.089+0000 7f330dd97640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f33080b1f20 0x7f33081598b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:42.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.089+0000 7f330dd97640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f33081514c0 0x7f33081f3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:42.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.089+0000 7f330dd97640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f33081571c0 0x7f33081f6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:42.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.089+0000 7f330dd97640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330806c740 con 0x7f33081514c0 2023-11-27T18:13:42.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.089+0000 7f330dd97640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330806d240 con 0x7f33080b1f20 2023-11-27T18:13:42.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.089+0000 7f330dd97640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33080c4410 con 0x7f33081571c0 2023-11-27T18:13:42.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.089+0000 7f3306ffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f33081514c0 0x7f33081f3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:42.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.089+0000 7f3306ffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f33081514c0 0x7f33081f3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:59954/0 (socket says 172.21.15.91:59954) 2023-11-27T18:13:42.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.089+0000 7f3306ffd640 1 -- 172.21.15.91:0/3090030001 learned_addr learned my addr 172.21.15.91:0/3090030001 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:42.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.093+0000 7f3306ffd640 1 -- 172.21.15.91:0/3090030001 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f33081571c0 msgr2=0x7f33081f6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:42.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.093+0000 7f3306ffd640 1 --2- 172.21.15.91:0/3090030001 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f33081571c0 0x7f33081f6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:42.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.093+0000 7f3306ffd640 1 -- 172.21.15.91:0/3090030001 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f33080b1f20 msgr2=0x7f33081598b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:42.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.093+0000 7f3306ffd640 1 --2- 172.21.15.91:0/3090030001 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f33080b1f20 0x7f33081598b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:42.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.093+0000 7f3306ffd640 1 -- 172.21.15.91:0/3090030001 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f80094d0 con 0x7f33081514c0 2023-11-27T18:13:42.093 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.097+0000 7f3306ffd640 1 --2- 172.21.15.91:0/3090030001 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f33081514c0 0x7f33081f3600 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f32fc00b410 tx=0x7f32fc00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:42.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.101+0000 7f32effff640 1 -- 172.21.15.91:0/3090030001 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32fc011830 con 0x7f33081514c0 2023-11-27T18:13:42.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.101+0000 7f32effff640 1 -- 172.21.15.91:0/3090030001 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32fc0119b0 con 0x7f33081514c0 2023-11-27T18:13:42.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.101+0000 7f32effff640 1 -- 172.21.15.91:0/3090030001 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32fc011d60 con 0x7f33081514c0 2023-11-27T18:13:42.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.101+0000 7f330dd97640 1 -- 172.21.15.91:0/3090030001 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33081f3170 con 0x7f33081514c0 2023-11-27T18:13:42.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.101+0000 7f330dd97640 1 -- 172.21.15.91:0/3090030001 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33080c5d10 con 0x7f33081514c0 2023-11-27T18:13:42.098 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.101+0000 7f330dd97640 1 -- 172.21.15.91:0/3090030001 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f330804e850 con 0x7f33081514c0 2023-11-27T18:13:42.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.121+0000 7f32effff640 1 -- 172.21.15.91:0/3090030001 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f32fc01a400 con 0x7f33081514c0 2023-11-27T18:13:42.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.121+0000 7f32effff640 1 --2- 172.21.15.91:0/3090030001 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f32f4066840 0x7f32f4068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:42.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.121+0000 7f33077fe640 1 --2- 172.21.15.91:0/3090030001 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f32f4066840 0x7f32f4068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:42.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.121+0000 7f33077fe640 1 --2- 172.21.15.91:0/3090030001 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f32f4066840 0x7f32f4068d00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f32f80af000 tx=0x7f32f8008040 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:42.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.365+0000 7f32effff640 1 -- 172.21.15.91:0/3090030001 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f32fc055ec0 con 0x7f33081514c0 2023-11-27T18:13:42.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.365+0000 7f32effff640 1 -- 172.21.15.91:0/3090030001 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f32fc051b00 con 0x7f33081514c0 2023-11-27T18:13:42.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.521+0000 7f330dd97640 1 -- 172.21.15.91:0/3090030001 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f33081f3300 con 0x7f33081514c0 2023-11-27T18:13:42.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.529+0000 7f32effff640 1 -- 172.21.15.91:0/3090030001 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f32fc055120 con 0x7f33081514c0 2023-11-27T18:13:42.528 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T18:13:42.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.533+0000 7f330dd97640 1 -- 172.21.15.91:0/3090030001 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f32f4066840 msgr2=0x7f32f4068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:42.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.533+0000 7f330dd97640 1 --2- 172.21.15.91:0/3090030001 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f32f4066840 0x7f32f4068d00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f32f80af000 tx=0x7f32f8008040 comp rx=0 tx=0).stop 2023-11-27T18:13:42.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.533+0000 7f330dd97640 1 -- 172.21.15.91:0/3090030001 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f33081514c0 msgr2=0x7f33081f3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:42.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.533+0000 7f330dd97640 1 --2- 172.21.15.91:0/3090030001 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f33081514c0 0x7f33081f3600 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f32fc00b410 tx=0x7f32fc00b8d0 comp rx=0 tx=0).stop 2023-11-27T18:13:42.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.533+0000 7f330dd97640 1 -- 172.21.15.91:0/3090030001 shutdown_connections 2023-11-27T18:13:42.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.533+0000 7f330dd97640 1 --2- 172.21.15.91:0/3090030001 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f32f4066840 0x7f32f4068d00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:42.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.533+0000 7f330dd97640 1 --2- 172.21.15.91:0/3090030001 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f33081571c0 0x7f33081f6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:42.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.533+0000 7f330dd97640 1 --2- 172.21.15.91:0/3090030001 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f33081514c0 0x7f33081f3600 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:42.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.533+0000 7f330dd97640 1 --2- 172.21.15.91:0/3090030001 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f33080b1f20 0x7f33081598b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:42.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.533+0000 7f330dd97640 1 -- 172.21.15.91:0/3090030001 >> 172.21.15.91:0/3090030001 conn(0x7f3308070a80 msgr2=0x7f33080c1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:42.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.533+0000 7f330dd97640 1 -- 172.21.15.91:0/3090030001 shutdown_connections 2023-11-27T18:13:42.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.533+0000 7f330dd97640 1 -- 172.21.15.91:0/3090030001 wait complete. 2023-11-27T18:13:42.546 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-27T18:13:42.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.669+0000 7faf2d9ac640 1 Processor -- start 2023-11-27T18:13:42.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.669+0000 7faf2d9ac640 1 -- start start 2023-11-27T18:13:42.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.669+0000 7faf2d9ac640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faf28072820 0x7faf280c44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:42.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.669+0000 7faf2d9ac640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faf281576e0 0x7faf28157b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:42.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.669+0000 7faf2d9ac640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf281580b0 con 0x7faf280c40e0 2023-11-27T18:13:42.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.669+0000 7faf2d9ac640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf280c7090 con 0x7faf28072820 2023-11-27T18:13:42.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.669+0000 7faf2d9ac640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf280c4a00 con 0x7faf281576e0 2023-11-27T18:13:42.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.669+0000 7faf267fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faf28072820 0x7faf280c44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:42.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.669+0000 7faf26ffd640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7faf280c40e0 0x7faf2806ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:52166/0 (socket says 172.21.15.91:52166) 2023-11-27T18:13:42.668 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.669+0000 7faf26ffd640 1 -- 172.21.15.91:0/1440280727 learned_addr learned my addr 172.21.15.91:0/1440280727 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:13:42.668 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.673+0000 7faf277fe640 1 --2- 172.21.15.91:0/1440280727 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faf281576e0 0x7faf28157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:42.670 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.673+0000 7faf267fc640 1 -- 172.21.15.91:0/1440280727 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faf281576e0 msgr2=0x7faf28157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:42.671 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.673+0000 7faf267fc640 1 --2- 172.21.15.91:0/1440280727 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faf281576e0 0x7faf28157b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:42.671 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.673+0000 7faf267fc640 1 -- 172.21.15.91:0/1440280727 >> v1:172.21.15.91:6789/0 conn(0x7faf280c40e0 legacy=0x7faf2806ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:42.671 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.673+0000 7faf267fc640 1 -- 172.21.15.91:0/1440280727 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf2815aa00 con 0x7faf28072820 2023-11-27T18:13:42.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.677+0000 7faf267fc640 1 --2- 172.21.15.91:0/1440280727 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf28072820 0x7faf280c44c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7faf100097c0 tx=0x7faf1001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9587d3a1bac91d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:42.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.681+0000 7faf25ffb640 1 -- 172.21.15.91:0/1440280727 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf100ab680 con 0x7faf28072820 2023-11-27T18:13:42.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.681+0000 7faf25ffb640 1 -- 172.21.15.91:0/1440280727 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf100ab7e0 con 0x7faf28072820 2023-11-27T18:13:42.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.681+0000 7faf25ffb640 1 -- 172.21.15.91:0/1440280727 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf100abb70 con 0x7faf28072820 2023-11-27T18:13:42.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.681+0000 7faf2d9ac640 1 -- 172.21.15.91:0/1440280727 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf28072820 msgr2=0x7faf280c44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:42.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.681+0000 7faf2d9ac640 1 --2- 172.21.15.91:0/1440280727 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf28072820 0x7faf280c44c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7faf100097c0 tx=0x7faf1001c480 comp rx=0 tx=0).stop 2023-11-27T18:13:42.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.681+0000 7faf2d9ac640 1 -- 172.21.15.91:0/1440280727 shutdown_connections 2023-11-27T18:13:42.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.681+0000 7faf2d9ac640 1 --2- 172.21.15.91:0/1440280727 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faf281576e0 0x7faf28157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:42.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.681+0000 7faf2d9ac640 1 --2- 172.21.15.91:0/1440280727 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf28072820 0x7faf280c44c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:42.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.681+0000 7faf2d9ac640 1 -- 172.21.15.91:0/1440280727 >> 172.21.15.91:0/1440280727 conn(0x7faf280ca9d0 msgr2=0x7faf280cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:42.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.681+0000 7faf2d9ac640 1 -- 172.21.15.91:0/1440280727 shutdown_connections 2023-11-27T18:13:42.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.681+0000 7faf2d9ac640 1 -- 172.21.15.91:0/1440280727 wait complete. 2023-11-27T18:13:42.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.685+0000 7faf2d9ac640 1 Processor -- start 2023-11-27T18:13:42.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.685+0000 7faf2d9ac640 1 -- start start 2023-11-27T18:13:42.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.685+0000 7faf2d9ac640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf28072820 0x7faf28152340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:42.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.685+0000 7faf2d9ac640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faf280c40e0 0x7faf281e9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:42.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.685+0000 7faf2d9ac640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf281576e0 0x7faf28152d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:42.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.685+0000 7faf2d9ac640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf28159f00 con 0x7faf28072820 2023-11-27T18:13:42.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.685+0000 7faf2d9ac640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2815a0a0 con 0x7faf281576e0 2023-11-27T18:13:42.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.685+0000 7faf2d9ac640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf28158ed0 con 0x7faf280c40e0 2023-11-27T18:13:42.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.685+0000 7faf26ffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf28072820 0x7faf28152340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:42.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.685+0000 7faf26ffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf28072820 0x7faf28152340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:59966/0 (socket says 172.21.15.91:59966) 2023-11-27T18:13:42.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.685+0000 7faf26ffd640 1 -- 172.21.15.91:0/2493960972 learned_addr learned my addr 172.21.15.91:0/2493960972 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:42.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.685+0000 7faf277fe640 1 --2- 172.21.15.91:0/2493960972 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf281576e0 0x7faf28152d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:42.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.685+0000 7faf267fc640 1 --2- 172.21.15.91:0/2493960972 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faf280c40e0 0x7faf281e9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:42.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.689+0000 7faf26ffd640 1 -- 172.21.15.91:0/2493960972 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faf280c40e0 msgr2=0x7faf281e9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:42.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.689+0000 7faf26ffd640 1 --2- 172.21.15.91:0/2493960972 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faf280c40e0 0x7faf281e9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:42.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.689+0000 7faf26ffd640 1 -- 172.21.15.91:0/2493960972 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf281576e0 msgr2=0x7faf28152d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:42.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.689+0000 7faf26ffd640 1 --2- 172.21.15.91:0/2493960972 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf281576e0 0x7faf28152d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:42.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.689+0000 7faf26ffd640 1 -- 172.21.15.91:0/2493960972 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf10009420 con 0x7faf28072820 2023-11-27T18:13:42.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.693+0000 7faf26ffd640 1 --2- 172.21.15.91:0/2493960972 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf28072820 0x7faf28152340 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7faf1800cb10 tx=0x7faf1800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:42.693 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.697+0000 7faf1ffff640 1 -- 172.21.15.91:0/2493960972 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1800ac70 con 0x7faf28072820 2023-11-27T18:13:42.693 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.697+0000 7faf1ffff640 1 -- 172.21.15.91:0/2493960972 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf1800add0 con 0x7faf28072820 2023-11-27T18:13:42.693 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.697+0000 7faf1ffff640 1 -- 172.21.15.91:0/2493960972 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf18012620 con 0x7faf28072820 2023-11-27T18:13:42.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.697+0000 7faf2d9ac640 1 -- 172.21.15.91:0/2493960972 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf2806ed60 con 0x7faf28072820 2023-11-27T18:13:42.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.697+0000 7faf2d9ac640 1 -- 172.21.15.91:0/2493960972 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf2815a590 con 0x7faf28072820 2023-11-27T18:13:42.695 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.697+0000 7faf2d9ac640 1 -- 172.21.15.91:0/2493960972 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf2804e850 con 0x7faf28072820 2023-11-27T18:13:42.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.949+0000 7faf1ffff640 1 -- 172.21.15.91:0/2493960972 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7faf18007070 con 0x7faf28072820 2023-11-27T18:13:42.948 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.953+0000 7faf1ffff640 1 --2- 172.21.15.91:0/2493960972 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7faf08066870 0x7faf08068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:42.949 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.953+0000 7faf267fc640 1 --2- 172.21.15.91:0/2493960972 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7faf08066870 0x7faf08068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:42.949 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.953+0000 7faf267fc640 1 --2- 172.21.15.91:0/2493960972 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7faf08066870 0x7faf08068d30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7faf100af000 tx=0x7faf100a7000 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:42.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.965+0000 7faf1ffff640 1 -- 172.21.15.91:0/2493960972 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7faf180554a0 con 0x7faf28072820 2023-11-27T18:13:42.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:42.965+0000 7faf1ffff640 1 -- 172.21.15.91:0/2493960972 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7faf180517e0 con 0x7faf28072820 2023-11-27T18:13:43.130 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:43.133+0000 7faf2d9ac640 1 -- 172.21.15.91:0/2493960972 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7faf281571e0 con 0x7faf28072820 2023-11-27T18:13:43.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:43.161+0000 7faf1ffff640 1 -- 172.21.15.91:0/2493960972 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v30) v1 ==== 80+0+0 (secure 0 0 0) 0x7faf18017080 con 0x7faf28072820 2023-11-27T18:13:43.160 INFO:teuthology.orchestra.run.smithi091.stderr:listed 0 entries 2023-11-27T18:13:43.162 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:43.165+0000 7faf2d9ac640 1 -- 172.21.15.91:0/2493960972 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7faf08066870 msgr2=0x7faf08068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:43.162 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:43.165+0000 7faf2d9ac640 1 --2- 172.21.15.91:0/2493960972 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7faf08066870 0x7faf08068d30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7faf100af000 tx=0x7faf100a7000 comp rx=0 tx=0).stop 2023-11-27T18:13:43.162 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:43.165+0000 7faf2d9ac640 1 -- 172.21.15.91:0/2493960972 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf28072820 msgr2=0x7faf28152340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:43.162 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:43.165+0000 7faf2d9ac640 1 --2- 172.21.15.91:0/2493960972 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf28072820 0x7faf28152340 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7faf1800cb10 tx=0x7faf1800a060 comp rx=0 tx=0).stop 2023-11-27T18:13:43.162 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:43.165+0000 7faf2d9ac640 1 -- 172.21.15.91:0/2493960972 shutdown_connections 2023-11-27T18:13:43.162 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:43.165+0000 7faf2d9ac640 1 --2- 172.21.15.91:0/2493960972 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7faf08066870 0x7faf08068d30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:43.162 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:43.165+0000 7faf2d9ac640 1 --2- 172.21.15.91:0/2493960972 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faf280c40e0 0x7faf281e9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:43.162 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:43.165+0000 7faf2d9ac640 1 --2- 172.21.15.91:0/2493960972 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf281576e0 0x7faf28152d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:43.162 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:43.165+0000 7faf2d9ac640 1 --2- 172.21.15.91:0/2493960972 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf28072820 0x7faf28152340 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:43.162 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:43.165+0000 7faf2d9ac640 1 -- 172.21.15.91:0/2493960972 >> 172.21.15.91:0/2493960972 conn(0x7faf280ca9d0 msgr2=0x7faf28071bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:43.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:43.165+0000 7faf2d9ac640 1 -- 172.21.15.91:0/2493960972 shutdown_connections 2023-11-27T18:13:43.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:43.165+0000 7faf2d9ac640 1 -- 172.21.15.91:0/2493960972 wait complete. 2023-11-27T18:13:43.179 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi091.front.sepia.ceph.com... 2023-11-27T18:13:43.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T18:13:43.179 DEBUG:teuthology.orchestra.run.smithi091:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-11-27T18:13:43.203 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi091.stderr:ceph-fuse[43042]: fuse finished with error 0 and tester_r 0 2023-11-27T18:13:43.204 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T18:13:49.306 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi091.front.sepia.ceph.com 2023-11-27T18:13:49.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T18:13:49.306 DEBUG:teuthology.orchestra.run.smithi091:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-11-27T18:13:49.483 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T18:13:49.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.617+0000 7fcdf5d13640 1 Processor -- start 2023-11-27T18:13:49.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.617+0000 7fcdf5d13640 1 -- start start 2023-11-27T18:13:49.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.617+0000 7fcdf5d13640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcdf00c8ff0 0x7fcdf00c1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:49.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.617+0000 7fcdf5d13640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fcdf0157f70 0x7fcdf00cccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:49.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.617+0000 7fcdf5d13640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdf00c2fe0 con 0x7fcdf01516f0 2023-11-27T18:13:49.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.617+0000 7fcdf5d13640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdf00c85a0 con 0x7fcdf0157f70 2023-11-27T18:13:49.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.617+0000 7fcdf5d13640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf0158420 con 0x7fcdf00c8ff0 2023-11-27T18:13:49.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.617+0000 7fcdeffff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fcdf0157f70 0x7fcdf00cccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:49.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.617+0000 7fcdef7fe640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fcdf01516f0 0x7fcdf00c3470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:37092/0 (socket says 172.21.15.91:37092) 2023-11-27T18:13:49.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.617+0000 7fcdef7fe640 1 -- 172.21.15.91:0/886022624 learned_addr learned my addr 172.21.15.91:0/886022624 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:13:49.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.617+0000 7fcde6ffd640 1 --2- 172.21.15.91:0/886022624 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcdf00c8ff0 0x7fcdf00c1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:49.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.621+0000 7fcdeffff640 1 -- 172.21.15.91:0/886022624 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcdf00c8ff0 msgr2=0x7fcdf00c1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:49.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.621+0000 7fcdeffff640 1 --2- 172.21.15.91:0/886022624 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcdf00c8ff0 0x7fcdf00c1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:49.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.621+0000 7fcdeffff640 1 -- 172.21.15.91:0/886022624 >> v1:172.21.15.91:6789/0 conn(0x7fcdf01516f0 legacy=0x7fcdf00c3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:49.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.621+0000 7fcdeffff640 1 -- 172.21.15.91:0/886022624 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf00c7f00 con 0x7fcdf0157f70 2023-11-27T18:13:49.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.625+0000 7fcdeffff640 1 --2- 172.21.15.91:0/886022624 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcdf0157f70 0x7fcdf00cccc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcde8009d90 tx=0x7fcde801f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3edc5574eb9e99c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:49.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.629+0000 7fcdeeffd640 1 -- 172.21.15.91:0/886022624 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde80af600 con 0x7fcdf0157f70 2023-11-27T18:13:49.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.629+0000 7fcdeeffd640 1 -- 172.21.15.91:0/886022624 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcde80ab050 con 0x7fcdf0157f70 2023-11-27T18:13:49.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.629+0000 7fcdeeffd640 1 -- 172.21.15.91:0/886022624 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde80af980 con 0x7fcdf0157f70 2023-11-27T18:13:49.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.629+0000 7fcdf5d13640 1 -- 172.21.15.91:0/886022624 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcdf0157f70 msgr2=0x7fcdf00cccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:49.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.629+0000 7fcdf5d13640 1 --2- 172.21.15.91:0/886022624 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcdf0157f70 0x7fcdf00cccc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcde8009d90 tx=0x7fcde801f130 comp rx=0 tx=0).stop 2023-11-27T18:13:49.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.629+0000 7fcdf5d13640 1 -- 172.21.15.91:0/886022624 shutdown_connections 2023-11-27T18:13:49.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.629+0000 7fcdf5d13640 1 --2- 172.21.15.91:0/886022624 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcdf0157f70 0x7fcdf00cccc0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:49.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.629+0000 7fcdf5d13640 1 --2- 172.21.15.91:0/886022624 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcdf00c8ff0 0x7fcdf00c1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:49.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.629+0000 7fcdf5d13640 1 -- 172.21.15.91:0/886022624 >> 172.21.15.91:0/886022624 conn(0x7fcdf006a520 msgr2=0x7fcdf006a930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:49.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.633+0000 7fcdf5d13640 1 -- 172.21.15.91:0/886022624 shutdown_connections 2023-11-27T18:13:49.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.633+0000 7fcdf5d13640 1 -- 172.21.15.91:0/886022624 wait complete. 2023-11-27T18:13:49.629 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.633+0000 7fcdf5d13640 1 Processor -- start 2023-11-27T18:13:49.629 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.633+0000 7fcdf5d13640 1 -- start start 2023-11-27T18:13:49.630 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.633+0000 7fcdf5d13640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcdf00c8ff0 0x7fcdf00cd270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:49.630 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.633+0000 7fcdf5d13640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcdf01516f0 0x7fcdf00b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:49.630 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.633+0000 7fcdf5d13640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcdf0157f70 0x7fcdf00cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:49.630 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.633+0000 7fcdf5d13640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf00cb7e0 con 0x7fcdf00c8ff0 2023-11-27T18:13:49.630 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.633+0000 7fcdf5d13640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf00cbe20 con 0x7fcdf0157f70 2023-11-27T18:13:49.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.633+0000 7fcdf5d13640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf00cb250 con 0x7fcdf01516f0 2023-11-27T18:13:49.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.633+0000 7fcdef7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcdf00c8ff0 0x7fcdf00cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:49.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.633+0000 7fcdef7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcdf00c8ff0 0x7fcdf00cd270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40284/0 (socket says 172.21.15.91:40284) 2023-11-27T18:13:49.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.633+0000 7fcdef7fe640 1 -- 172.21.15.91:0/3653158035 learned_addr learned my addr 172.21.15.91:0/3653158035 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:49.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.633+0000 7fcdeffff640 1 --2- 172.21.15.91:0/3653158035 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcdf0157f70 0x7fcdf00cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:49.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.637+0000 7fcde6ffd640 1 --2- 172.21.15.91:0/3653158035 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcdf01516f0 0x7fcdf00b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:49.635 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.637+0000 7fcdef7fe640 1 -- 172.21.15.91:0/3653158035 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcdf01516f0 msgr2=0x7fcdf00b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:49.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.637+0000 7fcdef7fe640 1 --2- 172.21.15.91:0/3653158035 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcdf01516f0 0x7fcdf00b25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:49.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.637+0000 7fcdef7fe640 1 -- 172.21.15.91:0/3653158035 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcdf0157f70 msgr2=0x7fcdf00cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:49.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.637+0000 7fcdef7fe640 1 --2- 172.21.15.91:0/3653158035 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcdf0157f70 0x7fcdf00cc2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:49.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.637+0000 7fcdef7fe640 1 -- 172.21.15.91:0/3653158035 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde8009a70 con 0x7fcdf00c8ff0 2023-11-27T18:13:49.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.641+0000 7fcdef7fe640 1 --2- 172.21.15.91:0/3653158035 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcdf00c8ff0 0x7fcdf00cd270 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcde000c450 tx=0x7fcde000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:49.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.645+0000 7fcdecff9640 1 -- 172.21.15.91:0/3653158035 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde0005cf0 con 0x7fcdf00c8ff0 2023-11-27T18:13:49.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.645+0000 7fcdecff9640 1 -- 172.21.15.91:0/3653158035 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcde0005e50 con 0x7fcdf00c8ff0 2023-11-27T18:13:49.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.645+0000 7fcdecff9640 1 -- 172.21.15.91:0/3653158035 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde0007290 con 0x7fcdf00c8ff0 2023-11-27T18:13:49.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.645+0000 7fcdf5d13640 1 -- 172.21.15.91:0/3653158035 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdf014d770 con 0x7fcdf00c8ff0 2023-11-27T18:13:49.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.645+0000 7fcdf5d13640 1 -- 172.21.15.91:0/3653158035 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdf00caf70 con 0x7fcdf00c8ff0 2023-11-27T18:13:49.642 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.645+0000 7fcdf5d13640 1 -- 172.21.15.91:0/3653158035 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdf0154eb0 con 0x7fcdf00c8ff0 2023-11-27T18:13:49.919 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.921+0000 7fcdecff9640 1 -- 172.21.15.91:0/3653158035 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fcde00073f0 con 0x7fcdf00c8ff0 2023-11-27T18:13:49.919 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.921+0000 7fcdecff9640 1 --2- 172.21.15.91:0/3653158035 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fcdd0066840 0x7fcdd0068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:49.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.921+0000 7fcde6ffd640 1 --2- 172.21.15.91:0/3653158035 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fcdd0066840 0x7fcdd0068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:49.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.925+0000 7fcde6ffd640 1 --2- 172.21.15.91:0/3653158035 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fcdd0066840 0x7fcdd0068d00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcdf00cdc30 tx=0x7fcdd8009190 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:49.946 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.949+0000 7fcdecff9640 1 -- 172.21.15.91:0/3653158035 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcde0054a80 con 0x7fcdf00c8ff0 2023-11-27T18:13:49.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:49.949+0000 7fcdecff9640 1 -- 172.21.15.91:0/3653158035 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fcde0050dc0 con 0x7fcdf00c8ff0 2023-11-27T18:13:50.105 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.109+0000 7fcdf5d13640 1 -- 172.21.15.91:0/3653158035 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcdf004e930 con 0x7fcdf00c8ff0 2023-11-27T18:13:50.149 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.153+0000 7fcdecff9640 1 -- 172.21.15.91:0/3653158035 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+18279 (secure 0 0 0) 0x7fcde0017030 con 0x7fcdf00c8ff0 2023-11-27T18:13:50.149 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:13:50.149 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":30,"fsid":"08c8ebbf-7936-4c41-a995-d5600de2d072","created":"2023-11-27T18:12:06.484593+0000","modified":"2023-11-27T18:13:22.801287+0000","last_up_change":"2023-11-27T18:12:33.154694+0000","last_in_change":"2023-11-27T18:12:23.622113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T18:12:35.450305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T18:13:09.589619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T18:13:11.439236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-27T18:13:18.514694+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ad53c08-dd19-4ae6-87c5-fa15bea3b4ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6811","nonce":472303992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6813","nonce":472303992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6817","nonce":472303992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6815","nonce":472303992}]},"public_addr":"172.21.15.91:6811/472303992","cluster_addr":"172.21.15.91:6813/472303992","heartbeat_back_addr":"172.21.15.91:6817/472303992","heartbeat_front_addr":"172.21.15.91:6815/472303992","state":["exists","up"]},{"osd":1,"uuid":"f8b5f147-ed29-4329-a787-a12cc34a2569","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6827","nonce":12316911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6829","nonce":12316911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6833","nonce":12316911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6831","nonce":12316911}]},"public_addr":"172.21.15.91:6827/12316911","cluster_addr":"172.21.15.91:6829/12316911","heartbeat_back_addr":"172.21.15.91:6833/12316911","heartbeat_front_addr":"172.21.15.91:6831/12316911","state":["exists","up"]},{"osd":2,"uuid":"c3029f9a-1c48-4f5d-983a-172a614d8795","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6803","nonce":3776125919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6805","nonce":3776125919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6809","nonce":3776125919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6807","nonce":3776125919}]},"public_addr":"172.21.15.91:6803/3776125919","cluster_addr":"172.21.15.91:6805/3776125919","heartbeat_back_addr":"172.21.15.91:6809/3776125919","heartbeat_front_addr":"172.21.15.91:6807/3776125919","state":["exists","up"]},{"osd":3,"uuid":"ab4b6fb2-0126-491b-9224-54a6badc5da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6819","nonce":1297704794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6821","nonce":1297704794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6825","nonce":1297704794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6823","nonce":1297704794}]},"public_addr":"172.21.15.91:6819/1297704794","cluster_addr":"172.21.15.91:6821/1297704794","heartbeat_back_addr":"172.21.15.91:6825/1297704794","heartbeat_front_addr":"172.21.15.91:6823/1297704794","state":["exists","up"]},{"osd":4,"uuid":"695071a8-2de8-4cba-bf20-050021a03bb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6809","nonce":2501531833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6811","nonce":2501531833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6815","nonce":2501531833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6813","nonce":2501531833}]},"public_addr":"172.21.15.94:6809/2501531833","cluster_addr":"172.21.15.94:6811/2501531833","heartbeat_back_addr":"172.21.15.94:6815/2501531833","heartbeat_front_addr":"172.21.15.94:6813/2501531833","state":["exists","up"]},{"osd":5,"uuid":"ca01da14-a700-4845-8db2-f5e3370677e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6817","nonce":2448969592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6819","nonce":2448969592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6823","nonce":2448969592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6821","nonce":2448969592}]},"public_addr":"172.21.15.94:6817/2448969592","cluster_addr":"172.21.15.94:6819/2448969592","heartbeat_back_addr":"172.21.15.94:6823/2448969592","heartbeat_front_addr":"172.21.15.94:6821/2448969592","state":["exists","up"]},{"osd":6,"uuid":"4784bc77-6c33-4e47-abba-d37484982f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6825","nonce":3389553935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6827","nonce":3389553935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6831","nonce":3389553935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6829","nonce":3389553935}]},"public_addr":"172.21.15.94:6825/3389553935","cluster_addr":"172.21.15.94:6827/3389553935","heartbeat_back_addr":"172.21.15.94:6831/3389553935","heartbeat_front_addr":"172.21.15.94:6829/3389553935","state":["exists","up"]},{"osd":7,"uuid":"b954cf3f-4a4f-4a75-9f90-014f72c16d15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6801","nonce":1606498064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6803","nonce":1606498064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6807","nonce":1606498064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6805","nonce":1606498064}]},"public_addr":"172.21.15.94:6801/1606498064","cluster_addr":"172.21.15.94:6803/1606498064","heartbeat_back_addr":"172.21.15.94:6807/1606498064","heartbeat_front_addr":"172.21.15.94:6805/1606498064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.534968+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.506182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.339267+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.532432+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:28.935756+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.471559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.485014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.352978+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T18:13:50.151 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.153+0000 7fcdf5d13640 1 -- 172.21.15.91:0/3653158035 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fcdd0066840 msgr2=0x7fcdd0068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:50.152 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.153+0000 7fcdf5d13640 1 --2- 172.21.15.91:0/3653158035 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fcdd0066840 0x7fcdd0068d00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcdf00cdc30 tx=0x7fcdd8009190 comp rx=0 tx=0).stop 2023-11-27T18:13:50.152 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.153+0000 7fcdf5d13640 1 -- 172.21.15.91:0/3653158035 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcdf00c8ff0 msgr2=0x7fcdf00cd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:50.152 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.153+0000 7fcdf5d13640 1 --2- 172.21.15.91:0/3653158035 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcdf00c8ff0 0x7fcdf00cd270 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcde000c450 tx=0x7fcde000c910 comp rx=0 tx=0).stop 2023-11-27T18:13:50.152 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.153+0000 7fcdf5d13640 1 -- 172.21.15.91:0/3653158035 shutdown_connections 2023-11-27T18:13:50.152 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.153+0000 7fcdf5d13640 1 --2- 172.21.15.91:0/3653158035 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fcdd0066840 0x7fcdd0068d00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:50.152 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.153+0000 7fcdf5d13640 1 --2- 172.21.15.91:0/3653158035 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcdf01516f0 0x7fcdf00b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:50.152 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.153+0000 7fcdf5d13640 1 --2- 172.21.15.91:0/3653158035 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcdf0157f70 0x7fcdf00cc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:50.152 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.153+0000 7fcdf5d13640 1 --2- 172.21.15.91:0/3653158035 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcdf00c8ff0 0x7fcdf00cd270 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:50.152 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.153+0000 7fcdf5d13640 1 -- 172.21.15.91:0/3653158035 >> 172.21.15.91:0/3653158035 conn(0x7fcdf006a520 msgr2=0x7fcdf014cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:50.152 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.153+0000 7fcdf5d13640 1 -- 172.21.15.91:0/3653158035 shutdown_connections 2023-11-27T18:13:50.152 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.153+0000 7fcdf5d13640 1 -- 172.21.15.91:0/3653158035 wait complete. 2023-11-27T18:13:50.169 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T18:13:50.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.297+0000 7f47d2d88640 1 Processor -- start 2023-11-27T18:13:50.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.297+0000 7f47d2d88640 1 -- start start 2023-11-27T18:13:50.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.297+0000 7f47d2d88640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f47cc14fd60 0x7f47cc06a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:50.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.297+0000 7f47d2d88640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f47cc0667f0 0x7f47cc155b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:50.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.297+0000 7f47d2d88640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47cc0c4810 con 0x7f47cc066360 2023-11-27T18:13:50.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.297+0000 7f47d2d88640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47cc0c5420 con 0x7f47cc14fd60 2023-11-27T18:13:50.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.297+0000 7f47d2d88640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47cc156910 con 0x7f47cc0667f0 2023-11-27T18:13:50.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.321+0000 7f47d1325640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f47cc0667f0 0x7f47cc155b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:50.352 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.357+0000 7f47d0b24640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f47cc14fd60 0x7f47cc06a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:50.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.361+0000 7f47d0b24640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f47cc14fd60 0x7f47cc06a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40296/0 (socket says 172.21.15.91:40296) 2023-11-27T18:13:50.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.361+0000 7f47d0b24640 1 -- 172.21.15.91:0/2618386850 learned_addr learned my addr 172.21.15.91:0/2618386850 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:50.362 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.365+0000 7f47d0b24640 1 -- 172.21.15.91:0/2618386850 >> v2:172.21.15.94:3300/0 conn(0x7f47cc0667f0 msgr2=0x7f47cc155b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:50.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.365+0000 7f47d0b24640 1 --2- 172.21.15.91:0/2618386850 >> v2:172.21.15.94:3300/0 conn(0x7f47cc0667f0 0x7f47cc155b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:50.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.365+0000 7f47d0b24640 1 -- 172.21.15.91:0/2618386850 >> v1:172.21.15.94:6789/0 conn(0x7f47cc066360 legacy=0x7f47cc071690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:50.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.365+0000 7f47d0b24640 1 -- 172.21.15.91:0/2618386850 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47cc0c4a80 con 0x7f47cc14fd60 2023-11-27T18:13:50.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.369+0000 7f47d0b24640 1 --2- 172.21.15.91:0/2618386850 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f47cc14fd60 0x7f47cc06a520 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f47cc0c4730 tx=0x7f47c401eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fb46bbb3d48db58 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:50.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.377+0000 7f47cb7fe640 1 -- 172.21.15.91:0/2618386850 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c40a7a40 con 0x7f47cc14fd60 2023-11-27T18:13:50.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.377+0000 7f47cb7fe640 1 -- 172.21.15.91:0/2618386850 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47c40a7ba0 con 0x7f47cc14fd60 2023-11-27T18:13:50.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.377+0000 7f47cb7fe640 1 -- 172.21.15.91:0/2618386850 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c40af3f0 con 0x7f47cc14fd60 2023-11-27T18:13:50.374 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.377+0000 7f47d2d88640 1 -- 172.21.15.91:0/2618386850 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f47cc14fd60 msgr2=0x7f47cc06a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:50.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.377+0000 7f47d2d88640 1 --2- 172.21.15.91:0/2618386850 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f47cc14fd60 0x7f47cc06a520 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f47cc0c4730 tx=0x7f47c401eb70 comp rx=0 tx=0).stop 2023-11-27T18:13:50.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.377+0000 7f47d2d88640 1 -- 172.21.15.91:0/2618386850 shutdown_connections 2023-11-27T18:13:50.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.377+0000 7f47d2d88640 1 --2- 172.21.15.91:0/2618386850 >> v2:172.21.15.94:3300/0 conn(0x7f47cc0667f0 0x7f47cc155b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:50.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.377+0000 7f47d2d88640 1 --2- 172.21.15.91:0/2618386850 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f47cc14fd60 0x7f47cc06a520 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:50.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.377+0000 7f47d2d88640 1 -- 172.21.15.91:0/2618386850 >> 172.21.15.91:0/2618386850 conn(0x7f47cc0c7fa0 msgr2=0x7f47cc0c83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:50.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.377+0000 7f47d2d88640 1 -- 172.21.15.91:0/2618386850 shutdown_connections 2023-11-27T18:13:50.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.377+0000 7f47d2d88640 1 -- 172.21.15.91:0/2618386850 wait complete. 2023-11-27T18:13:50.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.381+0000 7f47d2d88640 1 Processor -- start 2023-11-27T18:13:50.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.381+0000 7f47d2d88640 1 -- start start 2023-11-27T18:13:50.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.381+0000 7f47d2d88640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f47cc066360 0x7f47cc153040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:50.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.381+0000 7f47d2d88640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f47cc0667f0 0x7f47cc1f5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:50.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.381+0000 7f47d2d88640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f47cc14fd60 0x7f47cc146a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:50.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.381+0000 7f47d2d88640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc1525d0 con 0x7f47cc14fd60 2023-11-27T18:13:50.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.381+0000 7f47d2d88640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc1460f0 con 0x7f47cc066360 2023-11-27T18:13:50.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.381+0000 7f47d2d88640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc14bc40 con 0x7f47cc0667f0 2023-11-27T18:13:50.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.381+0000 7f47d1325640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f47cc14fd60 0x7f47cc146a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:50.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.381+0000 7f47d1325640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f47cc14fd60 0x7f47cc146a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40308/0 (socket says 172.21.15.91:40308) 2023-11-27T18:13:50.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.381+0000 7f47d1325640 1 -- 172.21.15.91:0/4014580926 learned_addr learned my addr 172.21.15.91:0/4014580926 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:50.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.385+0000 7f47d1325640 1 -- 172.21.15.91:0/4014580926 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f47cc0667f0 msgr2=0x7f47cc1f5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:50.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.385+0000 7f47d1325640 1 --2- 172.21.15.91:0/4014580926 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f47cc0667f0 0x7f47cc1f5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:50.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.385+0000 7f47d1325640 1 -- 172.21.15.91:0/4014580926 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f47cc066360 msgr2=0x7f47cc153040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:50.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.385+0000 7f47d1325640 1 --2- 172.21.15.91:0/4014580926 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f47cc066360 0x7f47cc153040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:50.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.385+0000 7f47d1325640 1 -- 172.21.15.91:0/4014580926 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c4009b30 con 0x7f47cc14fd60 2023-11-27T18:13:50.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.389+0000 7f47d1325640 1 --2- 172.21.15.91:0/4014580926 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f47cc14fd60 0x7f47cc146a70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f47bc00c7f0 tx=0x7f47bc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:50.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.393+0000 7f47c97fa640 1 -- 172.21.15.91:0/4014580926 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc004220 con 0x7f47cc14fd60 2023-11-27T18:13:50.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.393+0000 7f47c97fa640 1 -- 172.21.15.91:0/4014580926 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47bc004380 con 0x7f47cc14fd60 2023-11-27T18:13:50.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.393+0000 7f47c97fa640 1 -- 172.21.15.91:0/4014580926 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc003840 con 0x7f47cc14fd60 2023-11-27T18:13:50.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.393+0000 7f47d2d88640 1 -- 172.21.15.91:0/4014580926 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47cc14bf20 con 0x7f47cc14fd60 2023-11-27T18:13:50.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.393+0000 7f47d2d88640 1 -- 172.21.15.91:0/4014580926 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47cc152840 con 0x7f47cc14fd60 2023-11-27T18:13:50.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.393+0000 7f47d2d88640 1 -- 172.21.15.91:0/4014580926 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47cc067810 con 0x7f47cc14fd60 2023-11-27T18:13:50.673 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.677+0000 7f47c97fa640 1 -- 172.21.15.91:0/4014580926 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f47bc003bb0 con 0x7f47cc14fd60 2023-11-27T18:13:50.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.677+0000 7f47c97fa640 1 --2- 172.21.15.91:0/4014580926 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f47b8066870 0x7f47b8068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:50.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.677+0000 7f47d0b24640 1 --2- 172.21.15.91:0/4014580926 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f47b8066870 0x7f47b8068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:50.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.677+0000 7f47d0b24640 1 --2- 172.21.15.91:0/4014580926 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f47b8066870 0x7f47b8068d30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f47c40b0000 tx=0x7f47c4004ac0 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:50.705 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.709+0000 7f47c97fa640 1 -- 172.21.15.91:0/4014580926 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f47bc003e60 con 0x7f47cc14fd60 2023-11-27T18:13:50.705 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.709+0000 7f47c97fa640 1 -- 172.21.15.91:0/4014580926 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f47bc051810 con 0x7f47cc14fd60 2023-11-27T18:13:50.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.881+0000 7f47d2d88640 1 -- 172.21.15.91:0/4014580926 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47cc149200 con 0x7f47cc14fd60 2023-11-27T18:13:50.959 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.961+0000 7f47c97fa640 1 -- 172.21.15.91:0/4014580926 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f47bc01e070 con 0x7f47cc14fd60 2023-11-27T18:13:50.959 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:13:50.959 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":30,"fsid":"08c8ebbf-7936-4c41-a995-d5600de2d072","created":"2023-11-27T18:12:06.484593+0000","modified":"2023-11-27T18:13:22.801287+0000","last_up_change":"2023-11-27T18:12:33.154694+0000","last_in_change":"2023-11-27T18:12:23.622113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T18:12:35.450305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T18:13:09.589619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T18:13:11.439236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-27T18:13:18.514694+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ad53c08-dd19-4ae6-87c5-fa15bea3b4ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6811","nonce":472303992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6813","nonce":472303992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6817","nonce":472303992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6815","nonce":472303992}]},"public_addr":"172.21.15.91:6811/472303992","cluster_addr":"172.21.15.91:6813/472303992","heartbeat_back_addr":"172.21.15.91:6817/472303992","heartbeat_front_addr":"172.21.15.91:6815/472303992","state":["exists","up"]},{"osd":1,"uuid":"f8b5f147-ed29-4329-a787-a12cc34a2569","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6827","nonce":12316911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6829","nonce":12316911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6833","nonce":12316911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6831","nonce":12316911}]},"public_addr":"172.21.15.91:6827/12316911","cluster_addr":"172.21.15.91:6829/12316911","heartbeat_back_addr":"172.21.15.91:6833/12316911","heartbeat_front_addr":"172.21.15.91:6831/12316911","state":["exists","up"]},{"osd":2,"uuid":"c3029f9a-1c48-4f5d-983a-172a614d8795","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6803","nonce":3776125919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6805","nonce":3776125919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6809","nonce":3776125919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6807","nonce":3776125919}]},"public_addr":"172.21.15.91:6803/3776125919","cluster_addr":"172.21.15.91:6805/3776125919","heartbeat_back_addr":"172.21.15.91:6809/3776125919","heartbeat_front_addr":"172.21.15.91:6807/3776125919","state":["exists","up"]},{"osd":3,"uuid":"ab4b6fb2-0126-491b-9224-54a6badc5da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6819","nonce":1297704794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6821","nonce":1297704794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6825","nonce":1297704794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6823","nonce":1297704794}]},"public_addr":"172.21.15.91:6819/1297704794","cluster_addr":"172.21.15.91:6821/1297704794","heartbeat_back_addr":"172.21.15.91:6825/1297704794","heartbeat_front_addr":"172.21.15.91:6823/1297704794","state":["exists","up"]},{"osd":4,"uuid":"695071a8-2de8-4cba-bf20-050021a03bb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6809","nonce":2501531833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6811","nonce":2501531833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6815","nonce":2501531833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6813","nonce":2501531833}]},"public_addr":"172.21.15.94:6809/2501531833","cluster_addr":"172.21.15.94:6811/2501531833","heartbeat_back_addr":"172.21.15.94:6815/2501531833","heartbeat_front_addr":"172.21.15.94:6813/2501531833","state":["exists","up"]},{"osd":5,"uuid":"ca01da14-a700-4845-8db2-f5e3370677e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6817","nonce":2448969592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6819","nonce":2448969592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6823","nonce":2448969592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6821","nonce":2448969592}]},"public_addr":"172.21.15.94:6817/2448969592","cluster_addr":"172.21.15.94:6819/2448969592","heartbeat_back_addr":"172.21.15.94:6823/2448969592","heartbeat_front_addr":"172.21.15.94:6821/2448969592","state":["exists","up"]},{"osd":6,"uuid":"4784bc77-6c33-4e47-abba-d37484982f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6825","nonce":3389553935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6827","nonce":3389553935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6831","nonce":3389553935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6829","nonce":3389553935}]},"public_addr":"172.21.15.94:6825/3389553935","cluster_addr":"172.21.15.94:6827/3389553935","heartbeat_back_addr":"172.21.15.94:6831/3389553935","heartbeat_front_addr":"172.21.15.94:6829/3389553935","state":["exists","up"]},{"osd":7,"uuid":"b954cf3f-4a4f-4a75-9f90-014f72c16d15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6801","nonce":1606498064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6803","nonce":1606498064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6807","nonce":1606498064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6805","nonce":1606498064}]},"public_addr":"172.21.15.94:6801/1606498064","cluster_addr":"172.21.15.94:6803/1606498064","heartbeat_back_addr":"172.21.15.94:6807/1606498064","heartbeat_front_addr":"172.21.15.94:6805/1606498064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.534968+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.506182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.339267+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.532432+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:28.935756+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.471559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.485014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.352978+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T18:13:50.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.965+0000 7f47d2d88640 1 -- 172.21.15.91:0/4014580926 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f47b8066870 msgr2=0x7f47b8068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:50.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.965+0000 7f47d2d88640 1 --2- 172.21.15.91:0/4014580926 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f47b8066870 0x7f47b8068d30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f47c40b0000 tx=0x7f47c4004ac0 comp rx=0 tx=0).stop 2023-11-27T18:13:50.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.965+0000 7f47d2d88640 1 -- 172.21.15.91:0/4014580926 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f47cc14fd60 msgr2=0x7f47cc146a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:50.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.965+0000 7f47d2d88640 1 --2- 172.21.15.91:0/4014580926 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f47cc14fd60 0x7f47cc146a70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f47bc00c7f0 tx=0x7f47bc00ccb0 comp rx=0 tx=0).stop 2023-11-27T18:13:50.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.965+0000 7f47d2d88640 1 -- 172.21.15.91:0/4014580926 shutdown_connections 2023-11-27T18:13:50.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.965+0000 7f47d2d88640 1 --2- 172.21.15.91:0/4014580926 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f47b8066870 0x7f47b8068d30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:50.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.965+0000 7f47d2d88640 1 --2- 172.21.15.91:0/4014580926 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f47cc0667f0 0x7f47cc1f5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:50.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.965+0000 7f47d2d88640 1 --2- 172.21.15.91:0/4014580926 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f47cc14fd60 0x7f47cc146a70 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:50.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.965+0000 7f47d2d88640 1 --2- 172.21.15.91:0/4014580926 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f47cc066360 0x7f47cc153040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:50.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.965+0000 7f47d2d88640 1 -- 172.21.15.91:0/4014580926 >> 172.21.15.91:0/4014580926 conn(0x7f47cc0c7fa0 msgr2=0x7f47cc0c2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:50.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.965+0000 7f47d2d88640 1 -- 172.21.15.91:0/4014580926 shutdown_connections 2023-11-27T18:13:50.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:50.965+0000 7f47d2d88640 1 -- 172.21.15.91:0/4014580926 wait complete. 2023-11-27T18:13:50.989 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-27T18:13:51.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.113+0000 7fd4e8b1b640 1 Processor -- start 2023-11-27T18:13:51.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.113+0000 7fd4e8b1b640 1 -- start start 2023-11-27T18:13:51.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.117+0000 7fd4e8b1b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd4e40c54f0 0x7fd4e40c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:51.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.117+0000 7fd4e8b1b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd4e40c58d0 0x7fd4e40c8f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:51.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.117+0000 7fd4e8b1b640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4e41572d0 con 0x7fd4e415ab20 2023-11-27T18:13:51.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.117+0000 7fd4e8b1b640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4e41580d0 con 0x7fd4e40c58d0 2023-11-27T18:13:51.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.117+0000 7fd4e8b1b640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4e4157570 con 0x7fd4e40c54f0 2023-11-27T18:13:51.114 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.117+0000 7fd4e259c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd4e40c54f0 0x7fd4e40c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:51.115 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.117+0000 7fd4e259c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd4e40c54f0 0x7fd4e40c82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.91:59568/0 (socket says 172.21.15.91:59568) 2023-11-27T18:13:51.115 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.117+0000 7fd4e259c640 1 -- 172.21.15.91:0/1561703218 learned_addr learned my addr 172.21.15.91:0/1561703218 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:51.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.121+0000 7fd4e1d9b640 1 --2- 172.21.15.91:0/1561703218 >> v2:172.21.15.91:3300/0 conn(0x7fd4e40c58d0 0x7fd4e40c8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:51.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.125+0000 7fd4e259c640 1 -- 172.21.15.91:0/1561703218 >> v2:172.21.15.91:3300/0 conn(0x7fd4e40c58d0 msgr2=0x7fd4e40c8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:51.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.125+0000 7fd4e259c640 1 --2- 172.21.15.91:0/1561703218 >> v2:172.21.15.91:3300/0 conn(0x7fd4e40c58d0 0x7fd4e40c8f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:51.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.125+0000 7fd4e259c640 1 -- 172.21.15.91:0/1561703218 >> v1:172.21.15.91:6789/0 conn(0x7fd4e415ab20 legacy=0x7fd4e415af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:51.122 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.125+0000 7fd4e259c640 1 -- 172.21.15.91:0/1561703218 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e4157830 con 0x7fd4e40c54f0 2023-11-27T18:13:51.128 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.129+0000 7fd4e259c640 1 --2- 172.21.15.91:0/1561703218 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd4e40c54f0 0x7fd4e40c82a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd4e40c5de0 tx=0x7fd4d401c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81b777b0e14a3b1e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:51.138 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.141+0000 7fd4e159a640 1 -- 172.21.15.91:0/1561703218 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d40aa5f0 con 0x7fd4e40c54f0 2023-11-27T18:13:51.138 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.141+0000 7fd4e159a640 1 -- 172.21.15.91:0/1561703218 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4d40aa750 con 0x7fd4e40c54f0 2023-11-27T18:13:51.138 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.141+0000 7fd4e159a640 1 -- 172.21.15.91:0/1561703218 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d40aaae0 con 0x7fd4e40c54f0 2023-11-27T18:13:51.139 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.141+0000 7fd4e8b1b640 1 -- 172.21.15.91:0/1561703218 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd4e40c54f0 msgr2=0x7fd4e40c82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:51.139 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.141+0000 7fd4e8b1b640 1 --2- 172.21.15.91:0/1561703218 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd4e40c54f0 0x7fd4e40c82a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd4e40c5de0 tx=0x7fd4d401c490 comp rx=0 tx=0).stop 2023-11-27T18:13:51.139 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.141+0000 7fd4e8b1b640 1 -- 172.21.15.91:0/1561703218 shutdown_connections 2023-11-27T18:13:51.140 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.141+0000 7fd4e8b1b640 1 --2- 172.21.15.91:0/1561703218 >> v2:172.21.15.91:3300/0 conn(0x7fd4e40c58d0 0x7fd4e40c8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:51.140 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.141+0000 7fd4e8b1b640 1 --2- 172.21.15.91:0/1561703218 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd4e40c54f0 0x7fd4e40c82a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:51.140 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.141+0000 7fd4e8b1b640 1 -- 172.21.15.91:0/1561703218 >> 172.21.15.91:0/1561703218 conn(0x7fd4e4071da0 msgr2=0x7fd4e40721b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:51.140 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.141+0000 7fd4e8b1b640 1 -- 172.21.15.91:0/1561703218 shutdown_connections 2023-11-27T18:13:51.140 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.141+0000 7fd4e8b1b640 1 -- 172.21.15.91:0/1561703218 wait complete. 2023-11-27T18:13:51.140 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.145+0000 7fd4e8b1b640 1 Processor -- start 2023-11-27T18:13:51.140 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.145+0000 7fd4e8b1b640 1 -- start start 2023-11-27T18:13:51.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.145+0000 7fd4e8b1b640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd4e40c54f0 0x7fd4e413f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:51.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.145+0000 7fd4e8b1b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd4e40c58d0 0x7fd4e406b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:51.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.145+0000 7fd4e8b1b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd4e415ab20 0x7fd4e406bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:51.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.145+0000 7fd4e8b1b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e41efcc0 con 0x7fd4e415ab20 2023-11-27T18:13:51.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.145+0000 7fd4e8b1b640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e41f4160 con 0x7fd4e40c58d0 2023-11-27T18:13:51.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.145+0000 7fd4e8b1b640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e406b360 con 0x7fd4e40c54f0 2023-11-27T18:13:51.142 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.145+0000 7fd4e2d9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd4e415ab20 0x7fd4e406bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:51.142 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.145+0000 7fd4e2d9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd4e415ab20 0x7fd4e406bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40324/0 (socket says 172.21.15.91:40324) 2023-11-27T18:13:51.142 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.145+0000 7fd4e2d9d640 1 -- 172.21.15.91:0/131623146 learned_addr learned my addr 172.21.15.91:0/131623146 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:51.143 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.145+0000 7fd4e259c640 1 --2- 172.21.15.91:0/131623146 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd4e40c54f0 0x7fd4e413f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:51.145 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.149+0000 7fd4e1d9b640 1 --2- 172.21.15.91:0/131623146 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd4e40c58d0 0x7fd4e406b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:51.146 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.149+0000 7fd4e2d9d640 1 -- 172.21.15.91:0/131623146 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd4e40c54f0 msgr2=0x7fd4e413f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:51.146 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.149+0000 7fd4e2d9d640 1 --2- 172.21.15.91:0/131623146 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd4e40c54f0 0x7fd4e413f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:51.146 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.149+0000 7fd4e2d9d640 1 -- 172.21.15.91:0/131623146 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd4e40c58d0 msgr2=0x7fd4e406b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:51.146 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.149+0000 7fd4e2d9d640 1 --2- 172.21.15.91:0/131623146 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd4e40c58d0 0x7fd4e406b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:51.146 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.149+0000 7fd4e2d9d640 1 -- 172.21.15.91:0/131623146 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d40094d0 con 0x7fd4e415ab20 2023-11-27T18:13:51.149 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.153+0000 7fd4e2d9d640 1 --2- 172.21.15.91:0/131623146 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd4e415ab20 0x7fd4e406bd50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc00b970 tx=0x7fd4dc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:51.153 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.157+0000 7fd4daffd640 1 -- 172.21.15.91:0/131623146 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc00cb40 con 0x7fd4e415ab20 2023-11-27T18:13:51.153 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.157+0000 7fd4daffd640 1 -- 172.21.15.91:0/131623146 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4dc00cca0 con 0x7fd4e415ab20 2023-11-27T18:13:51.153 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.157+0000 7fd4daffd640 1 -- 172.21.15.91:0/131623146 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc014680 con 0x7fd4e415ab20 2023-11-27T18:13:51.153 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.157+0000 7fd4e8b1b640 1 -- 172.21.15.91:0/131623146 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4e41efef0 con 0x7fd4e415ab20 2023-11-27T18:13:51.154 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.157+0000 7fd4e8b1b640 1 -- 172.21.15.91:0/131623146 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4e41f0490 con 0x7fd4e415ab20 2023-11-27T18:13:51.154 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.157+0000 7fd4e8b1b640 1 -- 172.21.15.91:0/131623146 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4e40c7870 con 0x7fd4e415ab20 2023-11-27T18:13:51.176 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.181+0000 7fd4daffd640 1 -- 172.21.15.91:0/131623146 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fd4dc003980 con 0x7fd4e415ab20 2023-11-27T18:13:51.177 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.181+0000 7fd4daffd640 1 --2- 172.21.15.91:0/131623146 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fd4c4066870 0x7fd4c4068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:51.177 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.181+0000 7fd4e259c640 1 --2- 172.21.15.91:0/131623146 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fd4c4066870 0x7fd4c4068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:51.178 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.181+0000 7fd4e259c640 1 --2- 172.21.15.91:0/131623146 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fd4c4066870 0x7fd4c4068d30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd4d40ae000 tx=0x7fd4d40b5040 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:51.180 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.185+0000 7fd4daffd640 1 -- 172.21.15.91:0/131623146 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd4dc055020 con 0x7fd4e415ab20 2023-11-27T18:13:51.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.457+0000 7fd4daffd640 1 -- 172.21.15.91:0/131623146 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fd4dc051360 con 0x7fd4e415ab20 2023-11-27T18:13:51.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:51.669+0000 7fd4e8b1b640 1 -- 172.21.15.91:0/131623146 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd4e4144da0 con 0x7fd4e415ab20 2023-11-27T18:13:52.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.637+0000 7fd4daffd640 1 -- 172.21.15.91:0/131623146 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd4dc054980 con 0x7fd4e415ab20 2023-11-27T18:13:52.634 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.637+0000 7fd4e8b1b640 1 -- 172.21.15.91:0/131623146 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fd4c4066870 msgr2=0x7fd4c4068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:52.634 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.637+0000 7fd4e8b1b640 1 --2- 172.21.15.91:0/131623146 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fd4c4066870 0x7fd4c4068d30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd4d40ae000 tx=0x7fd4d40b5040 comp rx=0 tx=0).stop 2023-11-27T18:13:52.635 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.637+0000 7fd4e8b1b640 1 -- 172.21.15.91:0/131623146 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd4e415ab20 msgr2=0x7fd4e406bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:52.635 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.637+0000 7fd4e8b1b640 1 --2- 172.21.15.91:0/131623146 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd4e415ab20 0x7fd4e406bd50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc00b970 tx=0x7fd4dc00be30 comp rx=0 tx=0).stop 2023-11-27T18:13:52.635 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.637+0000 7fd4e8b1b640 1 -- 172.21.15.91:0/131623146 shutdown_connections 2023-11-27T18:13:52.635 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.637+0000 7fd4e8b1b640 1 --2- 172.21.15.91:0/131623146 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fd4c4066870 0x7fd4c4068d30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:52.635 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.637+0000 7fd4e8b1b640 1 --2- 172.21.15.91:0/131623146 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd4e415ab20 0x7fd4e406bd50 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:52.635 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.637+0000 7fd4e8b1b640 1 --2- 172.21.15.91:0/131623146 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd4e40c58d0 0x7fd4e406b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:52.635 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.637+0000 7fd4e8b1b640 1 --2- 172.21.15.91:0/131623146 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd4e40c54f0 0x7fd4e413f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:52.635 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.637+0000 7fd4e8b1b640 1 -- 172.21.15.91:0/131623146 >> 172.21.15.91:0/131623146 conn(0x7fd4e4071da0 msgr2=0x7fd4e4147bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:52.635 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.637+0000 7fd4e8b1b640 1 -- 172.21.15.91:0/131623146 shutdown_connections 2023-11-27T18:13:52.635 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.637+0000 7fd4e8b1b640 1 -- 172.21.15.91:0/131623146 wait complete. 2023-11-27T18:13:52.657 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'session_timeout': 300} 2023-11-27T18:13:52.657 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-27T18:13:52.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.793+0000 7f324be2d640 1 Processor -- start 2023-11-27T18:13:52.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.793+0000 7f324be2d640 1 -- start start 2023-11-27T18:13:52.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.793+0000 7f324be2d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f32440c40e0 0x7f32440c44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:52.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.793+0000 7f324be2d640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f324415aa00 con 0x7f3244072820 2023-11-27T18:13:52.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.793+0000 7f324be2d640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f324415acc0 con 0x7f32441576e0 2023-11-27T18:13:52.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.793+0000 7f324be2d640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32440c7090 con 0x7f32440c40e0 2023-11-27T18:13:52.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.793+0000 7f3249bc9640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f32440c40e0 0x7f32440c44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:52.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.793+0000 7f3249bc9640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f32440c40e0 0x7f32440c44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.91:59574/0 (socket says 172.21.15.91:59574) 2023-11-27T18:13:52.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.793+0000 7f3249bc9640 1 -- 172.21.15.91:0/1360937791 learned_addr learned my addr 172.21.15.91:0/1360937791 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:52.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.801+0000 7f3249bc9640 1 -- 172.21.15.91:0/1360937791 >> v1:172.21.15.94:6789/0 conn(0x7f32441576e0 legacy=0x7f3244157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:52.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.801+0000 7f3249bc9640 1 -- 172.21.15.91:0/1360937791 >> v1:172.21.15.91:6789/0 conn(0x7f3244072820 legacy=0x7f324406ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:52.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.801+0000 7f3249bc9640 1 -- 172.21.15.91:0/1360937791 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f324415afa0 con 0x7f32440c40e0 2023-11-27T18:13:52.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.817+0000 7f3249bc9640 1 --2- 172.21.15.91:0/1360937791 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f32440c40e0 0x7f32440c44c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3240009870 tx=0x7f324001c4c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6119117be533f2b server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:52.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.937+0000 7f3248bc7640 1 -- 172.21.15.91:0/1360937791 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32400ac630 con 0x7f32440c40e0 2023-11-27T18:13:52.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.937+0000 7f3248bc7640 1 -- 172.21.15.91:0/1360937791 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32400ac790 con 0x7f32440c40e0 2023-11-27T18:13:52.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.937+0000 7f3248bc7640 1 -- 172.21.15.91:0/1360937791 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32400acb20 con 0x7f32440c40e0 2023-11-27T18:13:52.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.937+0000 7f324be2d640 1 -- 172.21.15.91:0/1360937791 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f32440c40e0 msgr2=0x7f32440c44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:52.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.937+0000 7f324be2d640 1 --2- 172.21.15.91:0/1360937791 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f32440c40e0 0x7f32440c44c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3240009870 tx=0x7f324001c4c0 comp rx=0 tx=0).stop 2023-11-27T18:13:52.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.937+0000 7f324be2d640 1 -- 172.21.15.91:0/1360937791 shutdown_connections 2023-11-27T18:13:52.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.937+0000 7f324be2d640 1 --2- 172.21.15.91:0/1360937791 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f32440c40e0 0x7f32440c44c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:52.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.937+0000 7f324be2d640 1 -- 172.21.15.91:0/1360937791 >> 172.21.15.91:0/1360937791 conn(0x7f32440ca9d0 msgr2=0x7f32440cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:52.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.937+0000 7f324be2d640 1 -- 172.21.15.91:0/1360937791 shutdown_connections 2023-11-27T18:13:52.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.937+0000 7f324be2d640 1 -- 172.21.15.91:0/1360937791 wait complete. 2023-11-27T18:13:52.937 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.941+0000 7f324be2d640 1 Processor -- start 2023-11-27T18:13:52.937 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.941+0000 7f324be2d640 1 -- start start 2023-11-27T18:13:52.939 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.941+0000 7f324be2d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3244072820 0x7f3244148f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:52.939 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.941+0000 7f324be2d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32440c40e0 0x7f32441f0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:52.939 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.941+0000 7f324be2d640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f32441576e0 0x7f32441470e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:52.939 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.941+0000 7f324be2d640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32441494c0 con 0x7f32440c40e0 2023-11-27T18:13:52.939 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.941+0000 7f324be2d640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32441442a0 con 0x7f3244072820 2023-11-27T18:13:52.939 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.941+0000 7f324be2d640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32440beed0 con 0x7f32441576e0 2023-11-27T18:13:52.941 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.945+0000 7f32493c8640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32440c40e0 0x7f32441f0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:52.941 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.945+0000 7f32493c8640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32440c40e0 0x7f32441f0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40338/0 (socket says 172.21.15.91:40338) 2023-11-27T18:13:52.941 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.945+0000 7f32493c8640 1 -- 172.21.15.91:0/1169822715 learned_addr learned my addr 172.21.15.91:0/1169822715 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:52.943 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.945+0000 7f3249bc9640 1 --2- 172.21.15.91:0/1169822715 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3244072820 0x7f3244148f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:52.949 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.953+0000 7f3249bc9640 1 -- 172.21.15.91:0/1169822715 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f32441576e0 msgr2=0x7f32441470e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:52.949 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.953+0000 7f3249bc9640 1 --2- 172.21.15.91:0/1169822715 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f32441576e0 0x7f32441470e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:52.949 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.953+0000 7f3249bc9640 1 -- 172.21.15.91:0/1169822715 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32440c40e0 msgr2=0x7f32441f0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:52.949 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.953+0000 7f3249bc9640 1 --2- 172.21.15.91:0/1169822715 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32440c40e0 0x7f32441f0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:52.949 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.953+0000 7f3249bc9640 1 -- 172.21.15.91:0/1169822715 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32400094d0 con 0x7f3244072820 2023-11-27T18:13:52.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.953+0000 7f3249bc9640 1 --2- 172.21.15.91:0/1169822715 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3244072820 0x7f3244148f80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f32440cb970 tx=0x7f3240019260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:52.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.965+0000 7f323a7fc640 1 -- 172.21.15.91:0/1169822715 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32400b6600 con 0x7f3244072820 2023-11-27T18:13:52.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.965+0000 7f323a7fc640 1 -- 172.21.15.91:0/1169822715 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32400b6760 con 0x7f3244072820 2023-11-27T18:13:52.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.965+0000 7f323a7fc640 1 -- 172.21.15.91:0/1169822715 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32400b6af0 con 0x7f3244072820 2023-11-27T18:13:52.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.965+0000 7f324be2d640 1 -- 172.21.15.91:0/1169822715 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32441f1360 con 0x7f3244072820 2023-11-27T18:13:52.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.965+0000 7f324be2d640 1 -- 172.21.15.91:0/1169822715 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3244148250 con 0x7f3244072820 2023-11-27T18:13:52.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:52.965+0000 7f324be2d640 1 -- 172.21.15.91:0/1169822715 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f324404e850 con 0x7f3244072820 2023-11-27T18:13:53.274 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:53.273+0000 7f323a7fc640 1 -- 172.21.15.91:0/1169822715 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f32400b6c50 con 0x7f3244072820 2023-11-27T18:13:53.274 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:53.273+0000 7f323a7fc640 1 --2- 172.21.15.91:0/1169822715 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f3228066840 0x7f3228068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:53.274 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:53.277+0000 7f32493c8640 1 --2- 172.21.15.91:0/1169822715 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f3228066840 0x7f3228068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:53.274 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:53.277+0000 7f32493c8640 1 --2- 172.21.15.91:0/1169822715 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f3228066840 0x7f3228068d00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f32440c9ce0 tx=0x7f3234009040 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:53.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:53.285+0000 7f323a7fc640 1 -- 172.21.15.91:0/1169822715 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f32400f0280 con 0x7f3244072820 2023-11-27T18:13:53.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:53.321+0000 7f323a7fc640 1 -- 172.21.15.91:0/1169822715 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f32400ebec0 con 0x7f3244072820 2023-11-27T18:13:53.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:53.533+0000 7f324be2d640 1 -- 172.21.15.91:0/1169822715 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f32441f1360 con 0x7f3244072820 2023-11-27T18:13:54.170 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.173+0000 7f323a7fc640 1 -- 172.21.15.91:0/1169822715 <== mon.1 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f32441f1360 con 0x7f3244072820 2023-11-27T18:13:54.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.177+0000 7f324be2d640 1 -- 172.21.15.91:0/1169822715 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f3228066840 msgr2=0x7f3228068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:54.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.177+0000 7f324be2d640 1 --2- 172.21.15.91:0/1169822715 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f3228066840 0x7f3228068d00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f32440c9ce0 tx=0x7f3234009040 comp rx=0 tx=0).stop 2023-11-27T18:13:54.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.177+0000 7f324be2d640 1 -- 172.21.15.91:0/1169822715 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3244072820 msgr2=0x7f3244148f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:54.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.177+0000 7f324be2d640 1 --2- 172.21.15.91:0/1169822715 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3244072820 0x7f3244148f80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f32440cb970 tx=0x7f3240019260 comp rx=0 tx=0).stop 2023-11-27T18:13:54.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.177+0000 7f324be2d640 1 -- 172.21.15.91:0/1169822715 shutdown_connections 2023-11-27T18:13:54.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.177+0000 7f324be2d640 1 --2- 172.21.15.91:0/1169822715 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f3228066840 0x7f3228068d00 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:54.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.177+0000 7f324be2d640 1 --2- 172.21.15.91:0/1169822715 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f32441576e0 0x7f32441470e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:54.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.177+0000 7f324be2d640 1 --2- 172.21.15.91:0/1169822715 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32440c40e0 0x7f32441f0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:54.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.177+0000 7f324be2d640 1 --2- 172.21.15.91:0/1169822715 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3244072820 0x7f3244148f80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:54.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.177+0000 7f324be2d640 1 -- 172.21.15.91:0/1169822715 >> 172.21.15.91:0/1169822715 conn(0x7f32440ca9d0 msgr2=0x7f32441568e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:54.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.177+0000 7f324be2d640 1 -- 172.21.15.91:0/1169822715 shutdown_connections 2023-11-27T18:13:54.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.177+0000 7f324be2d640 1 -- 172.21.15.91:0/1169822715 wait complete. 2023-11-27T18:13:54.199 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2023-11-27T18:13:54.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.329+0000 7f777fc94640 1 Processor -- start 2023-11-27T18:13:54.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.329+0000 7f777fc94640 1 -- start start 2023-11-27T18:13:54.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.333+0000 7f777fc94640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f777813f640 0x7f7778072480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:54.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.333+0000 7f777fc94640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f777806a520 0x7f777806a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:54.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.333+0000 7f777fc94640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7778156640 con 0x7f77781598e0 2023-11-27T18:13:54.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.333+0000 7f777fc94640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7778070ce0 con 0x7f777813f640 2023-11-27T18:13:54.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.333+0000 7f777fc94640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77781562f0 con 0x7f777806a520 2023-11-27T18:13:54.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.333+0000 7f777da30640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f777813f640 0x7f7778072480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:54.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.333+0000 7f777da30640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f777813f640 0x7f7778072480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40352/0 (socket says 172.21.15.91:40352) 2023-11-27T18:13:54.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.333+0000 7f777da30640 1 -- 172.21.15.91:0/2436271452 learned_addr learned my addr 172.21.15.91:0/2436271452 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:54.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.333+0000 7f777e231640 1 --2- 172.21.15.91:0/2436271452 >> v2:172.21.15.94:3300/0 conn(0x7f777806a520 0x7f777806a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:54.333 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.337+0000 7f777da30640 1 -- 172.21.15.91:0/2436271452 >> v2:172.21.15.94:3300/0 conn(0x7f777806a520 msgr2=0x7f777806a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:54.333 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.337+0000 7f777da30640 1 --2- 172.21.15.91:0/2436271452 >> v2:172.21.15.94:3300/0 conn(0x7f777806a520 0x7f777806a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:54.333 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.337+0000 7f777da30640 1 -- 172.21.15.91:0/2436271452 >> v1:172.21.15.94:6789/0 conn(0x7f77781598e0 legacy=0x7f7778156ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:54.333 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.337+0000 7f777da30640 1 -- 172.21.15.91:0/2436271452 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7778159dd0 con 0x7f777813f640 2023-11-27T18:13:54.336 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.341+0000 7f777da30640 1 --2- 172.21.15.91:0/2436271452 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f777813f640 0x7f7778072480 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7778072410 tx=0x7f777001eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=382090896360e11e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:54.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.345+0000 7f777ca2e640 1 -- 172.21.15.91:0/2436271452 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f777000b2d0 con 0x7f777813f640 2023-11-27T18:13:54.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.345+0000 7f777ca2e640 1 -- 172.21.15.91:0/2436271452 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f777000b430 con 0x7f777813f640 2023-11-27T18:13:54.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.345+0000 7f777ca2e640 1 -- 172.21.15.91:0/2436271452 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77700a7b50 con 0x7f777813f640 2023-11-27T18:13:54.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.345+0000 7f777fc94640 1 -- 172.21.15.91:0/2436271452 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f777813f640 msgr2=0x7f7778072480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:54.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.345+0000 7f777fc94640 1 --2- 172.21.15.91:0/2436271452 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f777813f640 0x7f7778072480 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7778072410 tx=0x7f777001eb60 comp rx=0 tx=0).stop 2023-11-27T18:13:54.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.345+0000 7f777fc94640 1 -- 172.21.15.91:0/2436271452 shutdown_connections 2023-11-27T18:13:54.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.345+0000 7f777fc94640 1 --2- 172.21.15.91:0/2436271452 >> v2:172.21.15.94:3300/0 conn(0x7f777806a520 0x7f777806a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:54.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.345+0000 7f777fc94640 1 --2- 172.21.15.91:0/2436271452 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f777813f640 0x7f7778072480 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:54.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.345+0000 7f777fc94640 1 -- 172.21.15.91:0/2436271452 >> 172.21.15.91:0/2436271452 conn(0x7f77780ca9d0 msgr2=0x7f77780cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:54.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.345+0000 7f777fc94640 1 -- 172.21.15.91:0/2436271452 shutdown_connections 2023-11-27T18:13:54.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.345+0000 7f777fc94640 1 -- 172.21.15.91:0/2436271452 wait complete. 2023-11-27T18:13:54.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.349+0000 7f777fc94640 1 Processor -- start 2023-11-27T18:13:54.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.349+0000 7f777fc94640 1 -- start start 2023-11-27T18:13:54.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.349+0000 7f777fc94640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f777806a520 0x7f7778137e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:54.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.349+0000 7f777fc94640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f777813f640 0x7f7778158ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:54.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.349+0000 7f777fc94640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f77781598e0 0x7f77781f1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:54.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.349+0000 7f777fc94640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77780c1f80 con 0x7f777813f640 2023-11-27T18:13:54.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.349+0000 7f777fc94640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77781f1760 con 0x7f777806a520 2023-11-27T18:13:54.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.349+0000 7f777fc94640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77781edfc0 con 0x7f77781598e0 2023-11-27T18:13:54.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.349+0000 7f777d22f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f777813f640 0x7f7778158ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:54.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.349+0000 7f777d22f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f777813f640 0x7f7778158ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40366/0 (socket says 172.21.15.91:40366) 2023-11-27T18:13:54.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.349+0000 7f777d22f640 1 -- 172.21.15.91:0/2381433947 learned_addr learned my addr 172.21.15.91:0/2381433947 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:54.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.349+0000 7f777e231640 1 --2- 172.21.15.91:0/2381433947 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f77781598e0 0x7f77781f1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:54.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.349+0000 7f777da30640 1 --2- 172.21.15.91:0/2381433947 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f777806a520 0x7f7778137e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:54.350 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.353+0000 7f777d22f640 1 -- 172.21.15.91:0/2381433947 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f77781598e0 msgr2=0x7f77781f1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:54.350 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.353+0000 7f777d22f640 1 --2- 172.21.15.91:0/2381433947 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f77781598e0 0x7f77781f1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:54.350 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.353+0000 7f777d22f640 1 -- 172.21.15.91:0/2381433947 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f777806a520 msgr2=0x7f7778137e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:54.350 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.353+0000 7f777d22f640 1 --2- 172.21.15.91:0/2381433947 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f777806a520 0x7f7778137e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:54.350 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.353+0000 7f777d22f640 1 -- 172.21.15.91:0/2381433947 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f777000bd40 con 0x7f777813f640 2023-11-27T18:13:54.352 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.357+0000 7f777d22f640 1 --2- 172.21.15.91:0/2381433947 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f777813f640 0x7f7778158ba0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f776c00b3e0 tx=0x7f776c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:54.355 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.357+0000 7f77767fc640 1 -- 172.21.15.91:0/2381433947 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776c011830 con 0x7f777813f640 2023-11-27T18:13:54.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.357+0000 7f777fc94640 1 -- 172.21.15.91:0/2381433947 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77780c9c20 con 0x7f777813f640 2023-11-27T18:13:54.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.357+0000 7f777fc94640 1 -- 172.21.15.91:0/2381433947 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77780c24b0 con 0x7f777813f640 2023-11-27T18:13:54.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.361+0000 7f777fc94640 1 -- 172.21.15.91:0/2381433947 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77781f1910 con 0x7f777813f640 2023-11-27T18:13:54.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.361+0000 7f77767fc640 1 -- 172.21.15.91:0/2381433947 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f776c009210 con 0x7f777813f640 2023-11-27T18:13:54.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.361+0000 7f77767fc640 1 -- 172.21.15.91:0/2381433947 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776c011b90 con 0x7f777813f640 2023-11-27T18:13:54.646 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.649+0000 7f77767fc640 1 -- 172.21.15.91:0/2381433947 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f776c011cf0 con 0x7f777813f640 2023-11-27T18:13:54.646 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.649+0000 7f77767fc640 1 --2- 172.21.15.91:0/2381433947 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f77640667f0 0x7f7764068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:54.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.649+0000 7f777da30640 1 --2- 172.21.15.91:0/2381433947 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f77640667f0 0x7f7764068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:54.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.653+0000 7f777da30640 1 --2- 172.21.15.91:0/2381433947 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f77640667f0 0x7f7764068cb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f77700b0000 tx=0x7f77700a9070 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:54.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.677+0000 7f77767fc640 1 -- 172.21.15.91:0/2381433947 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f776c055df0 con 0x7f777813f640 2023-11-27T18:13:54.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.677+0000 7f77767fc640 1 -- 172.21.15.91:0/2381433947 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f776c0554c0 con 0x7f777813f640 2023-11-27T18:13:54.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:54.881+0000 7f777fc94640 1 -- 172.21.15.91:0/2381433947 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f777804e850 con 0x7f777813f640 2023-11-27T18:13:55.279 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.281+0000 7f77767fc640 1 -- 172.21.15.91:0/2381433947 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v9) v1 ==== 115+0+0 (secure 0 0 0) 0x7f776c055050 con 0x7f777813f640 2023-11-27T18:13:55.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.285+0000 7f777fc94640 1 -- 172.21.15.91:0/2381433947 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f77640667f0 msgr2=0x7f7764068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:55.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.285+0000 7f777fc94640 1 --2- 172.21.15.91:0/2381433947 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f77640667f0 0x7f7764068cb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f77700b0000 tx=0x7f77700a9070 comp rx=0 tx=0).stop 2023-11-27T18:13:55.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.285+0000 7f777fc94640 1 -- 172.21.15.91:0/2381433947 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f777813f640 msgr2=0x7f7778158ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:55.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.285+0000 7f777fc94640 1 --2- 172.21.15.91:0/2381433947 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f777813f640 0x7f7778158ba0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f776c00b3e0 tx=0x7f776c00b8a0 comp rx=0 tx=0).stop 2023-11-27T18:13:55.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.285+0000 7f777fc94640 1 -- 172.21.15.91:0/2381433947 shutdown_connections 2023-11-27T18:13:55.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.285+0000 7f777fc94640 1 --2- 172.21.15.91:0/2381433947 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f77640667f0 0x7f7764068cb0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:55.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.285+0000 7f777fc94640 1 --2- 172.21.15.91:0/2381433947 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f77781598e0 0x7f77781f1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:55.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.285+0000 7f777fc94640 1 --2- 172.21.15.91:0/2381433947 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f777813f640 0x7f7778158ba0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:55.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.285+0000 7f777fc94640 1 --2- 172.21.15.91:0/2381433947 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f777806a520 0x7f7778137e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:55.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.285+0000 7f777fc94640 1 -- 172.21.15.91:0/2381433947 >> 172.21.15.91:0/2381433947 conn(0x7f77780ca9d0 msgr2=0x7f7778073720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:55.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.285+0000 7f777fc94640 1 -- 172.21.15.91:0/2381433947 shutdown_connections 2023-11-27T18:13:55.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.285+0000 7f777fc94640 1 -- 172.21.15.91:0/2381433947 wait complete. 2023-11-27T18:13:55.301 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-27T18:13:55.301 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T18:13:55.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.425+0000 7fe15945d640 1 Processor -- start 2023-11-27T18:13:55.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.425+0000 7fe15945d640 1 -- start start 2023-11-27T18:13:55.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.425+0000 7fe15945d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe1541514c0 0x7fe1540c4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:55.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.425+0000 7fe15945d640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1541518a0 con 0x7fe1540c68b0 2023-11-27T18:13:55.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.425+0000 7fe15945d640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe15406b750 con 0x7fe154157ff0 2023-11-27T18:13:55.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.425+0000 7fe15945d640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1540c7b70 con 0x7fe1541514c0 2023-11-27T18:13:55.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.429+0000 7fe152ffd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe1541514c0 0x7fe1540c4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:55.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.429+0000 7fe152ffd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe1541514c0 0x7fe1540c4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.91:59630/0 (socket says 172.21.15.91:59630) 2023-11-27T18:13:55.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.429+0000 7fe152ffd640 1 -- 172.21.15.91:0/2478823359 learned_addr learned my addr 172.21.15.91:0/2478823359 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:55.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.437+0000 7fe152ffd640 1 -- 172.21.15.91:0/2478823359 >> v1:172.21.15.94:6789/0 conn(0x7fe154157ff0 legacy=0x7fe154161d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:55.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.437+0000 7fe152ffd640 1 -- 172.21.15.91:0/2478823359 >> v1:172.21.15.91:6789/0 conn(0x7fe1540c68b0 legacy=0x7fe1541578e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:55.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.437+0000 7fe152ffd640 1 -- 172.21.15.91:0/2478823359 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1541573e0 con 0x7fe1541514c0 2023-11-27T18:13:55.441 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.445+0000 7fe152ffd640 1 --2- 172.21.15.91:0/2478823359 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe1541514c0 0x7fe1540c4bb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe144009870 tx=0x7fe14401ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94d471e9bbb60fd9 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:55.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.565+0000 7fe1527fc640 1 -- 172.21.15.91:0/2478823359 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1440a89f0 con 0x7fe1541514c0 2023-11-27T18:13:55.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.565+0000 7fe1527fc640 1 -- 172.21.15.91:0/2478823359 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1440a8b50 con 0x7fe1541514c0 2023-11-27T18:13:55.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.565+0000 7fe1527fc640 1 -- 172.21.15.91:0/2478823359 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1440b0440 con 0x7fe1541514c0 2023-11-27T18:13:55.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.569+0000 7fe15945d640 1 -- 172.21.15.91:0/2478823359 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe1541514c0 msgr2=0x7fe1540c4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:55.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.569+0000 7fe15945d640 1 --2- 172.21.15.91:0/2478823359 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe1541514c0 0x7fe1540c4bb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe144009870 tx=0x7fe14401ecf0 comp rx=0 tx=0).stop 2023-11-27T18:13:55.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.569+0000 7fe15945d640 1 -- 172.21.15.91:0/2478823359 shutdown_connections 2023-11-27T18:13:55.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.569+0000 7fe15945d640 1 --2- 172.21.15.91:0/2478823359 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe1541514c0 0x7fe1540c4bb0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:55.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.569+0000 7fe15945d640 1 -- 172.21.15.91:0/2478823359 >> 172.21.15.91:0/2478823359 conn(0x7fe1540c7fa0 msgr2=0x7fe1540c83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:55.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.569+0000 7fe15945d640 1 -- 172.21.15.91:0/2478823359 shutdown_connections 2023-11-27T18:13:55.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.569+0000 7fe15945d640 1 -- 172.21.15.91:0/2478823359 wait complete. 2023-11-27T18:13:55.567 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.569+0000 7fe15945d640 1 Processor -- start 2023-11-27T18:13:55.567 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.569+0000 7fe15945d640 1 -- start start 2023-11-27T18:13:55.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.573+0000 7fe15945d640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe1540c68b0 0x7fe15414bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:55.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.573+0000 7fe15945d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe1541514c0 0x7fe15414f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:55.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.573+0000 7fe15945d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe154157ff0 0x7fe15414cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:55.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.573+0000 7fe15945d640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15415a1e0 con 0x7fe154157ff0 2023-11-27T18:13:55.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.573+0000 7fe15945d640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1540c3390 con 0x7fe1541514c0 2023-11-27T18:13:55.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.573+0000 7fe15945d640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1540c3670 con 0x7fe1540c68b0 2023-11-27T18:13:55.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.573+0000 7fe1537fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe154157ff0 0x7fe15414cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:55.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.573+0000 7fe152ffd640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe1540c68b0 0x7fe15414bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:55.571 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.573+0000 7fe1537fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe154157ff0 0x7fe15414cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40376/0 (socket says 172.21.15.91:40376) 2023-11-27T18:13:55.571 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.573+0000 7fe1537fe640 1 -- 172.21.15.91:0/3334037648 learned_addr learned my addr 172.21.15.91:0/3334037648 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:55.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.577+0000 7fe14a7fc640 1 --2- 172.21.15.91:0/3334037648 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe1541514c0 0x7fe15414f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:55.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.585+0000 7fe1537fe640 1 -- 172.21.15.91:0/3334037648 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe1540c68b0 msgr2=0x7fe15414bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:55.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.585+0000 7fe1537fe640 1 --2- 172.21.15.91:0/3334037648 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe1540c68b0 0x7fe15414bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:55.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.585+0000 7fe1537fe640 1 -- 172.21.15.91:0/3334037648 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe1541514c0 msgr2=0x7fe15414f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:55.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.585+0000 7fe1537fe640 1 --2- 172.21.15.91:0/3334037648 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe1541514c0 0x7fe15414f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:55.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.585+0000 7fe1537fe640 1 -- 172.21.15.91:0/3334037648 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1440094d0 con 0x7fe154157ff0 2023-11-27T18:13:55.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.589+0000 7fe1537fe640 1 --2- 172.21.15.91:0/3334037648 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe154157ff0 0x7fe15414cc00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe14c00c770 tx=0x7fe14c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:55.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.601+0000 7fe14bfff640 1 -- 172.21.15.91:0/3334037648 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14c003b80 con 0x7fe154157ff0 2023-11-27T18:13:55.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.601+0000 7fe14bfff640 1 -- 172.21.15.91:0/3334037648 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14c003ce0 con 0x7fe154157ff0 2023-11-27T18:13:55.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.601+0000 7fe15945d640 1 -- 172.21.15.91:0/3334037648 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1540c3950 con 0x7fe154157ff0 2023-11-27T18:13:55.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.601+0000 7fe14bfff640 1 -- 172.21.15.91:0/3334037648 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14c00aa90 con 0x7fe154157ff0 2023-11-27T18:13:55.601 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.601+0000 7fe15945d640 1 -- 172.21.15.91:0/3334037648 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1541585a0 con 0x7fe154157ff0 2023-11-27T18:13:55.602 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:55.605+0000 7fe15945d640 1 -- 172.21.15.91:0/3334037648 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe15414c920 con 0x7fe154157ff0 2023-11-27T18:13:56.036 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.041+0000 7fe14bfff640 1 -- 172.21.15.91:0/3334037648 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fe14c00abf0 con 0x7fe154157ff0 2023-11-27T18:13:56.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.041+0000 7fe14bfff640 1 --2- 172.21.15.91:0/3334037648 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe134066840 0x7fe134068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:56.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.041+0000 7fe152ffd640 1 --2- 172.21.15.91:0/3334037648 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe134066840 0x7fe134068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:56.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.041+0000 7fe152ffd640 1 --2- 172.21.15.91:0/3334037648 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe134066840 0x7fe134068d00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe1440b2000 tx=0x7fe1440aa070 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:56.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.073+0000 7fe14bfff640 1 -- 172.21.15.91:0/3334037648 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe14c055770 con 0x7fe154157ff0 2023-11-27T18:13:56.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.077+0000 7fe14bfff640 1 -- 172.21.15.91:0/3334037648 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fe14c051ab0 con 0x7fe154157ff0 2023-11-27T18:13:56.273 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.277+0000 7fe15945d640 1 -- 172.21.15.91:0/3334037648 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe15414c920 con 0x7fe154157ff0 2023-11-27T18:13:56.309 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.313+0000 7fe14bfff640 1 -- 172.21.15.91:0/3334037648 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6491 (secure 0 0 0) 0x7fe15414c920 con 0x7fe154157ff0 2023-11-27T18:13:56.310 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:13:56.310 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1156758494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1156758494},{"type":"v1","addr":"172.21.15.91:6835","nonce":1156758494}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4227,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/2636117364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2636117364},{"type":"v1","addr":"172.21.15.91:6837","nonce":2636117364}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6839/1813662020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6838","nonce":1813662020},{"type":"v1","addr":"172.21.15.91:6839","nonce":1813662020}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4243,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3605337236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3605337236},{"type":"v1","addr":"172.21.15.94:6833","nonce":3605337236}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4246,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/1691562292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1691562292},{"type":"v1","addr":"172.21.15.94:6835","nonce":1691562292}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T18:13:13.083833+0000","modified":"2023-11-27T18:13:54.891064+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":10,"addr":"172.21.15.94:6837/3938864244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":3938864244},{"type":"v1","addr":"172.21.15.94:6837","nonce":3938864244}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-27T18:13:56.310 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 9 2023-11-27T18:13:56.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.313+0000 7fe15945d640 1 -- 172.21.15.91:0/3334037648 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe134066840 msgr2=0x7fe134068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:56.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.313+0000 7fe15945d640 1 --2- 172.21.15.91:0/3334037648 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe134066840 0x7fe134068d00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe1440b2000 tx=0x7fe1440aa070 comp rx=0 tx=0).stop 2023-11-27T18:13:56.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.317+0000 7fe15945d640 1 -- 172.21.15.91:0/3334037648 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe154157ff0 msgr2=0x7fe15414cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:56.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.317+0000 7fe15945d640 1 --2- 172.21.15.91:0/3334037648 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe154157ff0 0x7fe15414cc00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe14c00c770 tx=0x7fe14c00cc30 comp rx=0 tx=0).stop 2023-11-27T18:13:56.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.317+0000 7fe15945d640 1 -- 172.21.15.91:0/3334037648 shutdown_connections 2023-11-27T18:13:56.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.317+0000 7fe15945d640 1 --2- 172.21.15.91:0/3334037648 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe134066840 0x7fe134068d00 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:56.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.317+0000 7fe15945d640 1 --2- 172.21.15.91:0/3334037648 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe154157ff0 0x7fe15414cc00 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:56.313 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.317+0000 7fe15945d640 1 --2- 172.21.15.91:0/3334037648 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe1541514c0 0x7fe15414f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:56.313 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.317+0000 7fe15945d640 1 --2- 172.21.15.91:0/3334037648 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe1540c68b0 0x7fe15414bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:56.313 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.317+0000 7fe15945d640 1 -- 172.21.15.91:0/3334037648 >> 172.21.15.91:0/3334037648 conn(0x7fe1540c7fa0 msgr2=0x7fe154144d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:56.313 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.317+0000 7fe15945d640 1 -- 172.21.15.91:0/3334037648 shutdown_connections 2023-11-27T18:13:56.313 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.317+0000 7fe15945d640 1 -- 172.21.15.91:0/3334037648 wait complete. 2023-11-27T18:13:56.330 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T18:13:56.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.457+0000 7fa3d8075640 1 Processor -- start 2023-11-27T18:13:56.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.457+0000 7fa3d8075640 1 -- start start 2023-11-27T18:13:56.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.457+0000 7fa3d8075640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa3d01532f0 0x7fa3d006d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:56.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.457+0000 7fa3d8075640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa3d00c67a0 0x7fa3d006dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:56.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.457+0000 7fa3d8075640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3d00c2110 con 0x7fa3d0152f10 2023-11-27T18:13:56.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.457+0000 7fa3d8075640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3d006ccd0 con 0x7fa3d00c67a0 2023-11-27T18:13:56.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.457+0000 7fa3d8075640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d00c05e0 con 0x7fa3d01532f0 2023-11-27T18:13:56.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.461+0000 7fa3d6612640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa3d00c67a0 0x7fa3d006dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:56.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.461+0000 7fa3d6612640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa3d00c67a0 0x7fa3d006dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.91:58336/0 (socket says 172.21.15.91:58336) 2023-11-27T18:13:56.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.461+0000 7fa3d6612640 1 -- 172.21.15.91:0/655169974 learned_addr learned my addr 172.21.15.91:0/655169974 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:56.464 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.469+0000 7fa3d6612640 1 -- 172.21.15.91:0/655169974 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa3d01532f0 msgr2=0x7fa3d006d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:56.464 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.469+0000 7fa3d6612640 1 --2- 172.21.15.91:0/655169974 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa3d01532f0 0x7fa3d006d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:56.464 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.469+0000 7fa3d6612640 1 -- 172.21.15.91:0/655169974 >> v1:172.21.15.94:6789/0 conn(0x7fa3d0152f10 legacy=0x7fa3d00bfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:56.464 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.469+0000 7fa3d6612640 1 -- 172.21.15.91:0/655169974 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d00c62f0 con 0x7fa3d00c67a0 2023-11-27T18:13:56.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.473+0000 7fa3d6612640 1 --2- 172.21.15.91:0/655169974 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3d00c67a0 0x7fa3d006dc50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8009e50 tx=0x7fa3c801c9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c980153549e39f7f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:56.484 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.485+0000 7fa3d4e0f640 1 -- 172.21.15.91:0/655169974 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c80a57a0 con 0x7fa3d00c67a0 2023-11-27T18:13:56.484 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.485+0000 7fa3d4e0f640 1 -- 172.21.15.91:0/655169974 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3c80a5900 con 0x7fa3d00c67a0 2023-11-27T18:13:56.484 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.485+0000 7fa3d4e0f640 1 -- 172.21.15.91:0/655169974 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c80a5c90 con 0x7fa3d00c67a0 2023-11-27T18:13:56.485 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.489+0000 7fa3d8075640 1 -- 172.21.15.91:0/655169974 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3d00c67a0 msgr2=0x7fa3d006dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:56.485 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.489+0000 7fa3d8075640 1 --2- 172.21.15.91:0/655169974 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3d00c67a0 0x7fa3d006dc50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8009e50 tx=0x7fa3c801c9a0 comp rx=0 tx=0).stop 2023-11-27T18:13:56.485 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.489+0000 7fa3d8075640 1 -- 172.21.15.91:0/655169974 shutdown_connections 2023-11-27T18:13:56.485 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.489+0000 7fa3d8075640 1 --2- 172.21.15.91:0/655169974 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3d00c67a0 0x7fa3d006dc50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:56.485 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.489+0000 7fa3d8075640 1 --2- 172.21.15.91:0/655169974 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa3d01532f0 0x7fa3d006d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:56.485 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.489+0000 7fa3d8075640 1 -- 172.21.15.91:0/655169974 >> 172.21.15.91:0/655169974 conn(0x7fa3d00c79b0 msgr2=0x7fa3d00c7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:56.485 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.489+0000 7fa3d8075640 1 -- 172.21.15.91:0/655169974 shutdown_connections 2023-11-27T18:13:56.485 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.489+0000 7fa3d8075640 1 -- 172.21.15.91:0/655169974 wait complete. 2023-11-27T18:13:56.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.489+0000 7fa3d8075640 1 Processor -- start 2023-11-27T18:13:56.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.489+0000 7fa3d8075640 1 -- start start 2023-11-27T18:13:56.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.489+0000 7fa3d8075640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa3d00c67a0 0x7fa3d013a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:56.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.489+0000 7fa3d8075640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa3d0152f10 0x7fa3d0151790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:56.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.489+0000 7fa3d8075640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3d01532f0 0x7fa3d0151cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:56.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.489+0000 7fa3d8075640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d013f820 con 0x7fa3d0152f10 2023-11-27T18:13:56.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.489+0000 7fa3d8075640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d01443e0 con 0x7fa3d01532f0 2023-11-27T18:13:56.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.489+0000 7fa3d8075640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d0160270 con 0x7fa3d00c67a0 2023-11-27T18:13:56.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.493+0000 7fa3d5610640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa3d0152f10 0x7fa3d0151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:56.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.501+0000 7fa3d5e11640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa3d00c67a0 0x7fa3d013a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:56.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.501+0000 7fa3d6612640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3d01532f0 0x7fa3d0151cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:56.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.525+0000 7fa3d5e11640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa3d00c67a0 0x7fa3d013a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.91:40720/0 (socket says 172.21.15.91:40720) 2023-11-27T18:13:56.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.525+0000 7fa3d5e11640 1 -- 172.21.15.91:0/1017719032 learned_addr learned my addr 172.21.15.91:0/1017719032 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:56.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.541+0000 7fa3d5e11640 1 -- 172.21.15.91:0/1017719032 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3d01532f0 msgr2=0x7fa3d0151cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:56.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.541+0000 7fa3d5e11640 1 --2- 172.21.15.91:0/1017719032 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3d01532f0 0x7fa3d0151cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:56.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.541+0000 7fa3d5e11640 1 -- 172.21.15.91:0/1017719032 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa3d0152f10 msgr2=0x7fa3d0151790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:56.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.541+0000 7fa3d5e11640 1 --2- 172.21.15.91:0/1017719032 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa3d0152f10 0x7fa3d0151790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:56.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.541+0000 7fa3d5e11640 1 -- 172.21.15.91:0/1017719032 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c8009b30 con 0x7fa3d00c67a0 2023-11-27T18:13:56.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.545+0000 7fa3d5e11640 1 --2- 172.21.15.91:0/1017719032 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa3d00c67a0 0x7fa3d013a190 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc00c4c0 tx=0x7fa3cc001e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:56.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.653+0000 7fa3c27fc640 1 -- 172.21.15.91:0/1017719032 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc005480 con 0x7fa3d00c67a0 2023-11-27T18:13:56.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.653+0000 7fa3c27fc640 1 -- 172.21.15.91:0/1017719032 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3cc003600 con 0x7fa3d00c67a0 2023-11-27T18:13:56.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.653+0000 7fa3c27fc640 1 -- 172.21.15.91:0/1017719032 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc003990 con 0x7fa3d00c67a0 2023-11-27T18:13:56.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.653+0000 7fa3d8075640 1 -- 172.21.15.91:0/1017719032 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3d0160510 con 0x7fa3d00c67a0 2023-11-27T18:13:56.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.653+0000 7fa3d8075640 1 -- 172.21.15.91:0/1017719032 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3d0160ad0 con 0x7fa3d00c67a0 2023-11-27T18:13:56.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.653+0000 7fa3d8075640 1 -- 172.21.15.91:0/1017719032 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3d0067150 con 0x7fa3d00c67a0 2023-11-27T18:13:56.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.957+0000 7fa3c27fc640 1 -- 172.21.15.91:0/1017719032 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fa3cc01b3b0 con 0x7fa3d00c67a0 2023-11-27T18:13:56.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.957+0000 7fa3c27fc640 1 --2- 172.21.15.91:0/1017719032 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa3b4068a80 0x7fa3b406af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:56.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.957+0000 7fa3d5610640 1 --2- 172.21.15.91:0/1017719032 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa3b4068a80 0x7fa3b406af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:56.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.957+0000 7fa3d5610640 1 --2- 172.21.15.91:0/1017719032 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa3b4068a80 0x7fa3b406af40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0072b30 tx=0x7fa3c4008040 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:56.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.965+0000 7fa3c27fc640 1 -- 172.21.15.91:0/1017719032 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa3cc054a70 con 0x7fa3d00c67a0 2023-11-27T18:13:56.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:56.993+0000 7fa3c27fc640 1 -- 172.21.15.91:0/1017719032 <== mon.2 v2:172.21.15.94:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fa3cc050db0 con 0x7fa3d00c67a0 2023-11-27T18:13:57.168 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.173+0000 7fa3d8075640 1 -- 172.21.15.91:0/1017719032 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3d004e930 con 0x7fa3d00c67a0 2023-11-27T18:13:57.336 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.337+0000 7fa3c27fc640 1 -- 172.21.15.91:0/1017719032 <== mon.2 v2:172.21.15.94:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+18279 (secure 0 0 0) 0x7fa3cc017090 con 0x7fa3d00c67a0 2023-11-27T18:13:57.336 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:13:57.336 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":30,"fsid":"08c8ebbf-7936-4c41-a995-d5600de2d072","created":"2023-11-27T18:12:06.484593+0000","modified":"2023-11-27T18:13:22.801287+0000","last_up_change":"2023-11-27T18:12:33.154694+0000","last_in_change":"2023-11-27T18:12:23.622113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T18:12:35.450305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T18:13:09.589619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T18:13:11.439236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-27T18:13:18.514694+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ad53c08-dd19-4ae6-87c5-fa15bea3b4ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6811","nonce":472303992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6813","nonce":472303992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6817","nonce":472303992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6815","nonce":472303992}]},"public_addr":"172.21.15.91:6811/472303992","cluster_addr":"172.21.15.91:6813/472303992","heartbeat_back_addr":"172.21.15.91:6817/472303992","heartbeat_front_addr":"172.21.15.91:6815/472303992","state":["exists","up"]},{"osd":1,"uuid":"f8b5f147-ed29-4329-a787-a12cc34a2569","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6827","nonce":12316911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6829","nonce":12316911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6833","nonce":12316911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6831","nonce":12316911}]},"public_addr":"172.21.15.91:6827/12316911","cluster_addr":"172.21.15.91:6829/12316911","heartbeat_back_addr":"172.21.15.91:6833/12316911","heartbeat_front_addr":"172.21.15.91:6831/12316911","state":["exists","up"]},{"osd":2,"uuid":"c3029f9a-1c48-4f5d-983a-172a614d8795","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6803","nonce":3776125919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6805","nonce":3776125919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6809","nonce":3776125919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6807","nonce":3776125919}]},"public_addr":"172.21.15.91:6803/3776125919","cluster_addr":"172.21.15.91:6805/3776125919","heartbeat_back_addr":"172.21.15.91:6809/3776125919","heartbeat_front_addr":"172.21.15.91:6807/3776125919","state":["exists","up"]},{"osd":3,"uuid":"ab4b6fb2-0126-491b-9224-54a6badc5da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6819","nonce":1297704794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6821","nonce":1297704794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6825","nonce":1297704794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6823","nonce":1297704794}]},"public_addr":"172.21.15.91:6819/1297704794","cluster_addr":"172.21.15.91:6821/1297704794","heartbeat_back_addr":"172.21.15.91:6825/1297704794","heartbeat_front_addr":"172.21.15.91:6823/1297704794","state":["exists","up"]},{"osd":4,"uuid":"695071a8-2de8-4cba-bf20-050021a03bb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6809","nonce":2501531833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6811","nonce":2501531833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6815","nonce":2501531833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6813","nonce":2501531833}]},"public_addr":"172.21.15.94:6809/2501531833","cluster_addr":"172.21.15.94:6811/2501531833","heartbeat_back_addr":"172.21.15.94:6815/2501531833","heartbeat_front_addr":"172.21.15.94:6813/2501531833","state":["exists","up"]},{"osd":5,"uuid":"ca01da14-a700-4845-8db2-f5e3370677e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6817","nonce":2448969592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6819","nonce":2448969592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6823","nonce":2448969592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6821","nonce":2448969592}]},"public_addr":"172.21.15.94:6817/2448969592","cluster_addr":"172.21.15.94:6819/2448969592","heartbeat_back_addr":"172.21.15.94:6823/2448969592","heartbeat_front_addr":"172.21.15.94:6821/2448969592","state":["exists","up"]},{"osd":6,"uuid":"4784bc77-6c33-4e47-abba-d37484982f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6825","nonce":3389553935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6827","nonce":3389553935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6831","nonce":3389553935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6829","nonce":3389553935}]},"public_addr":"172.21.15.94:6825/3389553935","cluster_addr":"172.21.15.94:6827/3389553935","heartbeat_back_addr":"172.21.15.94:6831/3389553935","heartbeat_front_addr":"172.21.15.94:6829/3389553935","state":["exists","up"]},{"osd":7,"uuid":"b954cf3f-4a4f-4a75-9f90-014f72c16d15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6801","nonce":1606498064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6803","nonce":1606498064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6807","nonce":1606498064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6805","nonce":1606498064}]},"public_addr":"172.21.15.94:6801/1606498064","cluster_addr":"172.21.15.94:6803/1606498064","heartbeat_back_addr":"172.21.15.94:6807/1606498064","heartbeat_front_addr":"172.21.15.94:6805/1606498064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.534968+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.506182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.339267+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.532432+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:28.935756+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.471559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.485014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.352978+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T18:13:57.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.341+0000 7fa3d8075640 1 -- 172.21.15.91:0/1017719032 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa3b4068a80 msgr2=0x7fa3b406af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:57.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.341+0000 7fa3d8075640 1 --2- 172.21.15.91:0/1017719032 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa3b4068a80 0x7fa3b406af40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0072b30 tx=0x7fa3c4008040 comp rx=0 tx=0).stop 2023-11-27T18:13:57.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.341+0000 7fa3d8075640 1 -- 172.21.15.91:0/1017719032 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa3d00c67a0 msgr2=0x7fa3d013a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:57.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.341+0000 7fa3d8075640 1 --2- 172.21.15.91:0/1017719032 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa3d00c67a0 0x7fa3d013a190 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc00c4c0 tx=0x7fa3cc001e80 comp rx=0 tx=0).stop 2023-11-27T18:13:57.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.341+0000 7fa3d8075640 1 -- 172.21.15.91:0/1017719032 shutdown_connections 2023-11-27T18:13:57.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.341+0000 7fa3d8075640 1 --2- 172.21.15.91:0/1017719032 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa3b4068a80 0x7fa3b406af40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:57.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.341+0000 7fa3d8075640 1 --2- 172.21.15.91:0/1017719032 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3d01532f0 0x7fa3d0151cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:57.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.341+0000 7fa3d8075640 1 --2- 172.21.15.91:0/1017719032 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa3d0152f10 0x7fa3d0151790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:57.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.341+0000 7fa3d8075640 1 --2- 172.21.15.91:0/1017719032 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa3d00c67a0 0x7fa3d013a190 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:57.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.341+0000 7fa3d8075640 1 -- 172.21.15.91:0/1017719032 >> 172.21.15.91:0/1017719032 conn(0x7fa3d00c79b0 msgr2=0x7fa3d014a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:57.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.341+0000 7fa3d8075640 1 -- 172.21.15.91:0/1017719032 shutdown_connections 2023-11-27T18:13:57.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.341+0000 7fa3d8075640 1 -- 172.21.15.91:0/1017719032 wait complete. 2023-11-27T18:13:57.364 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-27T18:13:57.364 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T18:13:57.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.493+0000 7f849ec1b640 1 Processor -- start 2023-11-27T18:13:57.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.493+0000 7f849ec1b640 1 -- start start 2023-11-27T18:13:57.489 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.493+0000 7f849ec1b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f8498151820 0x7f8498070e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:57.489 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.493+0000 7f849ec1b640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f84980c85c0 0x7f849806cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:57.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.493+0000 7f849ec1b640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8498072b70 con 0x7f84980c5f10 2023-11-27T18:13:57.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.493+0000 7f849ec1b640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84980c2d20 con 0x7f8498151820 2023-11-27T18:13:57.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.493+0000 7f849ec1b640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8498071350 con 0x7f84980c85c0 2023-11-27T18:13:57.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.493+0000 7f849c9b7640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f8498151820 0x7f8498070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:57.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.493+0000 7f849c9b7640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f8498151820 0x7f8498070e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44570/0 (socket says 172.21.15.91:44570) 2023-11-27T18:13:57.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.493+0000 7f849c9b7640 1 -- 172.21.15.91:0/4218619834 learned_addr learned my addr 172.21.15.91:0/4218619834 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:57.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.493+0000 7f8497fff640 1 --2- 172.21.15.91:0/4218619834 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f84980c85c0 0x7f849806cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:57.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.497+0000 7f849c9b7640 1 -- 172.21.15.91:0/4218619834 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f84980c85c0 msgr2=0x7f849806cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:57.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.497+0000 7f849c9b7640 1 --2- 172.21.15.91:0/4218619834 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f84980c85c0 0x7f849806cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:57.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.497+0000 7f849c9b7640 1 -- 172.21.15.91:0/4218619834 >> v1:172.21.15.94:6789/0 conn(0x7f84980c5f10 legacy=0x7f849806d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:57.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.497+0000 7f849c9b7640 1 -- 172.21.15.91:0/4218619834 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84980c6490 con 0x7f8498151820 2023-11-27T18:13:57.496 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.501+0000 7f849c9b7640 1 --2- 172.21.15.91:0/4218619834 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8498151820 0x7f8498070e10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8488009870 tx=0x7f848801ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6a8a65b99e4b818 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:57.500 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.505+0000 7f84977fe640 1 -- 172.21.15.91:0/4218619834 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84880a8a30 con 0x7f8498151820 2023-11-27T18:13:57.500 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.505+0000 7f84977fe640 1 -- 172.21.15.91:0/4218619834 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84880a8b90 con 0x7f8498151820 2023-11-27T18:13:57.500 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.505+0000 7f84977fe640 1 -- 172.21.15.91:0/4218619834 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84880b0440 con 0x7f8498151820 2023-11-27T18:13:57.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.505+0000 7f849ec1b640 1 -- 172.21.15.91:0/4218619834 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8498151820 msgr2=0x7f8498070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:57.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.505+0000 7f849ec1b640 1 --2- 172.21.15.91:0/4218619834 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8498151820 0x7f8498070e10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8488009870 tx=0x7f848801ed30 comp rx=0 tx=0).stop 2023-11-27T18:13:57.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.505+0000 7f849ec1b640 1 -- 172.21.15.91:0/4218619834 shutdown_connections 2023-11-27T18:13:57.502 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.505+0000 7f849ec1b640 1 --2- 172.21.15.91:0/4218619834 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f84980c85c0 0x7f849806cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:57.502 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.505+0000 7f849ec1b640 1 --2- 172.21.15.91:0/4218619834 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8498151820 0x7f8498070e10 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:57.502 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.505+0000 7f849ec1b640 1 -- 172.21.15.91:0/4218619834 >> 172.21.15.91:0/4218619834 conn(0x7f84980c79b0 msgr2=0x7f84980c7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:57.502 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.505+0000 7f849ec1b640 1 -- 172.21.15.91:0/4218619834 shutdown_connections 2023-11-27T18:13:57.502 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.505+0000 7f849ec1b640 1 -- 172.21.15.91:0/4218619834 wait complete. 2023-11-27T18:13:57.502 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.505+0000 7f849ec1b640 1 Processor -- start 2023-11-27T18:13:57.503 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.505+0000 7f849ec1b640 1 -- start start 2023-11-27T18:13:57.503 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.505+0000 7f849ec1b640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f84980c5f10 0x7f84981ed9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:57.503 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.505+0000 7f849ec1b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84980c85c0 0x7f84981551a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:57.503 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.505+0000 7f849ec1b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8498151820 0x7f8498157330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:57.504 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.505+0000 7f849ec1b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8498072460 con 0x7f8498151820 2023-11-27T18:13:57.504 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.505+0000 7f849ec1b640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f849814f0b0 con 0x7f84980c85c0 2023-11-27T18:13:57.504 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.505+0000 7f849ec1b640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8498156cd0 con 0x7f84980c5f10 2023-11-27T18:13:57.504 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.509+0000 7f849d1b8640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8498151820 0x7f8498157330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:57.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.509+0000 7f849d1b8640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8498151820 0x7f8498157330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44584/0 (socket says 172.21.15.91:44584) 2023-11-27T18:13:57.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.509+0000 7f849d1b8640 1 -- 172.21.15.91:0/3566659699 learned_addr learned my addr 172.21.15.91:0/3566659699 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:57.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.509+0000 7f849c9b7640 1 --2- 172.21.15.91:0/3566659699 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f84980c5f10 0x7f84981ed9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:57.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.509+0000 7f8497fff640 1 --2- 172.21.15.91:0/3566659699 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84980c85c0 0x7f84981551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:57.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.513+0000 7f849d1b8640 1 -- 172.21.15.91:0/3566659699 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f84980c5f10 msgr2=0x7f84981ed9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:57.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.513+0000 7f849d1b8640 1 --2- 172.21.15.91:0/3566659699 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f84980c5f10 0x7f84981ed9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:57.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.513+0000 7f849d1b8640 1 -- 172.21.15.91:0/3566659699 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84980c85c0 msgr2=0x7f84981551a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:57.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.513+0000 7f849d1b8640 1 --2- 172.21.15.91:0/3566659699 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84980c85c0 0x7f84981551a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:57.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.513+0000 7f849d1b8640 1 -- 172.21.15.91:0/3566659699 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84880094d0 con 0x7f8498151820 2023-11-27T18:13:57.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.513+0000 7f849d1b8640 1 --2- 172.21.15.91:0/3566659699 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8498151820 0x7f8498157330 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f849000c710 tx=0x7f849000cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:57.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.517+0000 7f84957fa640 1 -- 172.21.15.91:0/3566659699 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8490006d60 con 0x7f8498151820 2023-11-27T18:13:57.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.517+0000 7f84957fa640 1 -- 172.21.15.91:0/3566659699 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f849000ce20 con 0x7f8498151820 2023-11-27T18:13:57.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.517+0000 7f849ec1b640 1 -- 172.21.15.91:0/3566659699 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f849814f350 con 0x7f8498151820 2023-11-27T18:13:57.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.517+0000 7f84957fa640 1 -- 172.21.15.91:0/3566659699 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8490003bc0 con 0x7f8498151820 2023-11-27T18:13:57.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.517+0000 7f849ec1b640 1 -- 172.21.15.91:0/3566659699 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8498156fb0 con 0x7f8498151820 2023-11-27T18:13:57.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.517+0000 7f849ec1b640 1 -- 172.21.15.91:0/3566659699 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8498067150 con 0x7f8498151820 2023-11-27T18:13:57.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.537+0000 7f84957fa640 1 -- 172.21.15.91:0/3566659699 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f8490003d20 con 0x7f8498151820 2023-11-27T18:13:57.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.541+0000 7f84957fa640 1 --2- 172.21.15.91:0/3566659699 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f8484066840 0x7f8484068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:57.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.541+0000 7f849c9b7640 1 --2- 172.21.15.91:0/3566659699 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f8484066840 0x7f8484068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:57.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.541+0000 7f849c9b7640 1 --2- 172.21.15.91:0/3566659699 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f8484066840 0x7f8484068d00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f84880b2000 tx=0x7f84880aa070 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:57.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.833+0000 7f84957fa640 1 -- 172.21.15.91:0/3566659699 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f84900559a0 con 0x7f8498151820 2023-11-27T18:13:57.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.833+0000 7f84957fa640 1 -- 172.21.15.91:0/3566659699 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f84900ae280 con 0x7f8498151820 2023-11-27T18:13:57.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:57.993+0000 7f849ec1b640 1 -- 172.21.15.91:0/3566659699 --> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f84980c6a10 con 0x7f8484066840 2023-11-27T18:13:58.017 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.021+0000 7f84957fa640 1 -- 172.21.15.91:0/3566659699 <== mgr.4136 v2:172.21.15.91:6800/2814827118 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368493 (secure 0 0 0) 0x7f84880a8a10 con 0x7f8484066840 2023-11-27T18:13:58.022 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:13:58.026 INFO:teuthology.orchestra.run.smithi091.stderr:dumped all 2023-11-27T18:13:58.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.025+0000 7f849ec1b640 1 -- 172.21.15.91:0/3566659699 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f8484066840 msgr2=0x7f8484068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:58.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.025+0000 7f849ec1b640 1 --2- 172.21.15.91:0/3566659699 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f8484066840 0x7f8484068d00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f84880b2000 tx=0x7f84880aa070 comp rx=0 tx=0).stop 2023-11-27T18:13:58.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.025+0000 7f849ec1b640 1 -- 172.21.15.91:0/3566659699 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8498151820 msgr2=0x7f8498157330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:58.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.025+0000 7f849ec1b640 1 --2- 172.21.15.91:0/3566659699 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8498151820 0x7f8498157330 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f849000c710 tx=0x7f849000cbd0 comp rx=0 tx=0).stop 2023-11-27T18:13:58.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.025+0000 7f849ec1b640 1 -- 172.21.15.91:0/3566659699 shutdown_connections 2023-11-27T18:13:58.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.025+0000 7f849ec1b640 1 --2- 172.21.15.91:0/3566659699 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f8484066840 0x7f8484068d00 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:58.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.025+0000 7f849ec1b640 1 --2- 172.21.15.91:0/3566659699 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8498151820 0x7f8498157330 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:58.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.025+0000 7f849ec1b640 1 --2- 172.21.15.91:0/3566659699 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84980c85c0 0x7f84981551a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:58.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.025+0000 7f849ec1b640 1 --2- 172.21.15.91:0/3566659699 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f84980c5f10 0x7f84981ed9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:58.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.025+0000 7f849ec1b640 1 -- 172.21.15.91:0/3566659699 >> 172.21.15.91:0/3566659699 conn(0x7f84980c79b0 msgr2=0x7f84980ca0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:58.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.025+0000 7f849ec1b640 1 -- 172.21.15.91:0/3566659699 shutdown_connections 2023-11-27T18:13:58.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.025+0000 7f849ec1b640 1 -- 172.21.15.91:0/3566659699 wait complete. 2023-11-27T18:13:58.039 INFO:teuthology.orchestra.run.smithi091.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2023-11-27T18:13:57.109040+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235452,"kb_used_data":2652,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739268,"statfs":{"total":773094113280,"available":772853010432,"internally_reserved":0,"allocated":2715648,"data_stored":2186933,"data_compressed":67010,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005292"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.975533+0000","last_change":"2023-11-27T18:13:12.298503+0000","last_active":"2023-11-27T18:13:21.975533+0000","last_peered":"2023-11-27T18:13:21.975533+0000","last_clean":"2023-11-27T18:13:21.975533+0000","last_became_active":"2023-11-27T18:13:12.298140+0000","last_became_peered":"2023-11-27T18:13:12.298140+0000","last_unstale":"2023-11-27T18:13:21.975533+0000","last_undegraded":"2023-11-27T18:13:21.975533+0000","last_fullsized":"2023-11-27T18:13:21.975533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:04:02.661989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.141448+0000","last_change":"2023-11-27T18:13:14.416681+0000","last_active":"2023-11-27T18:13:22.141448+0000","last_peered":"2023-11-27T18:13:22.141448+0000","last_clean":"2023-11-27T18:13:22.141448+0000","last_became_active":"2023-11-27T18:13:14.416401+0000","last_became_peered":"2023-11-27T18:13:14.416401+0000","last_unstale":"2023-11-27T18:13:22.141448+0000","last_undegraded":"2023-11-27T18:13:22.141448+0000","last_fullsized":"2023-11-27T18:13:22.141448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:02:14.142363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.231066+0000","last_change":"2023-11-27T18:13:20.916435+0000","last_active":"2023-11-27T18:13:23.231066+0000","last_peered":"2023-11-27T18:13:23.231066+0000","last_clean":"2023-11-27T18:13:23.231066+0000","last_became_active":"2023-11-27T18:13:20.915358+0000","last_became_peered":"2023-11-27T18:13:20.915358+0000","last_unstale":"2023-11-27T18:13:23.231066+0000","last_undegraded":"2023-11-27T18:13:23.231066+0000","last_fullsized":"2023-11-27T18:13:23.231066+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:55:46.903556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.141645+0000","last_change":"2023-11-27T18:13:12.305296+0000","last_active":"2023-11-27T18:13:22.141645+0000","last_peered":"2023-11-27T18:13:22.141645+0000","last_clean":"2023-11-27T18:13:22.141645+0000","last_became_active":"2023-11-27T18:13:12.304981+0000","last_became_peered":"2023-11-27T18:13:12.304981+0000","last_unstale":"2023-11-27T18:13:22.141645+0000","last_undegraded":"2023-11-27T18:13:22.141645+0000","last_fullsized":"2023-11-27T18:13:22.141645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:04:30.721243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.142078+0000","last_change":"2023-11-27T18:13:14.366102+0000","last_active":"2023-11-27T18:13:22.142078+0000","last_peered":"2023-11-27T18:13:22.142078+0000","last_clean":"2023-11-27T18:13:22.142078+0000","last_became_active":"2023-11-27T18:13:14.365787+0000","last_became_peered":"2023-11-27T18:13:14.365787+0000","last_unstale":"2023-11-27T18:13:22.142078+0000","last_undegraded":"2023-11-27T18:13:22.142078+0000","last_fullsized":"2023-11-27T18:13:22.142078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:39:34.589545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.674201+0000","last_change":"2023-11-27T18:13:20.915811+0000","last_active":"2023-11-27T18:13:23.674201+0000","last_peered":"2023-11-27T18:13:23.674201+0000","last_clean":"2023-11-27T18:13:23.674201+0000","last_became_active":"2023-11-27T18:13:20.914864+0000","last_became_peered":"2023-11-27T18:13:20.914864+0000","last_unstale":"2023-11-27T18:13:23.674201+0000","last_undegraded":"2023-11-27T18:13:23.674201+0000","last_fullsized":"2023-11-27T18:13:23.674201+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:22:21.572863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140911+0000","last_change":"2023-11-27T18:13:12.272691+0000","last_active":"2023-11-27T18:13:22.140911+0000","last_peered":"2023-11-27T18:13:22.140911+0000","last_clean":"2023-11-27T18:13:22.140911+0000","last_became_active":"2023-11-27T18:13:12.272343+0000","last_became_peered":"2023-11-27T18:13:12.272343+0000","last_unstale":"2023-11-27T18:13:22.140911+0000","last_undegraded":"2023-11-27T18:13:22.140911+0000","last_fullsized":"2023-11-27T18:13:22.140911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:23:55.280753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140650+0000","last_change":"2023-11-27T18:13:15.804199+0000","last_active":"2023-11-27T18:13:22.140650+0000","last_peered":"2023-11-27T18:13:22.140650+0000","last_clean":"2023-11-27T18:13:22.140650+0000","last_became_active":"2023-11-27T18:13:15.803248+0000","last_became_peered":"2023-11-27T18:13:15.803248+0000","last_unstale":"2023-11-27T18:13:22.140650+0000","last_undegraded":"2023-11-27T18:13:22.140650+0000","last_fullsized":"2023-11-27T18:13:22.140650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:39:31.246554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.675082+0000","last_change":"2023-11-27T18:13:20.909371+0000","last_active":"2023-11-27T18:13:23.675082+0000","last_peered":"2023-11-27T18:13:23.675082+0000","last_clean":"2023-11-27T18:13:23.675082+0000","last_became_active":"2023-11-27T18:13:20.908285+0000","last_became_peered":"2023-11-27T18:13:20.908285+0000","last_unstale":"2023-11-27T18:13:23.675082+0000","last_undegraded":"2023-11-27T18:13:23.675082+0000","last_fullsized":"2023-11-27T18:13:23.675082+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:40:20.210205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140612+0000","last_change":"2023-11-27T18:13:12.274531+0000","last_active":"2023-11-27T18:13:22.140612+0000","last_peered":"2023-11-27T18:13:22.140612+0000","last_clean":"2023-11-27T18:13:22.140612+0000","last_became_active":"2023-11-27T18:13:12.274275+0000","last_became_peered":"2023-11-27T18:13:12.274275+0000","last_unstale":"2023-11-27T18:13:22.140612+0000","last_undegraded":"2023-11-27T18:13:22.140612+0000","last_fullsized":"2023-11-27T18:13:22.140612+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:02:12.938184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.143037+0000","last_change":"2023-11-27T18:13:14.422531+0000","last_active":"2023-11-27T18:13:22.143037+0000","last_peered":"2023-11-27T18:13:22.143037+0000","last_clean":"2023-11-27T18:13:22.143037+0000","last_became_active":"2023-11-27T18:13:14.421811+0000","last_became_peered":"2023-11-27T18:13:14.421811+0000","last_unstale":"2023-11-27T18:13:22.143037+0000","last_undegraded":"2023-11-27T18:13:22.143037+0000","last_fullsized":"2023-11-27T18:13:22.143037+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:17:17.491694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.675351+0000","last_change":"2023-11-27T18:13:20.907358+0000","last_active":"2023-11-27T18:13:23.675351+0000","last_peered":"2023-11-27T18:13:23.675351+0000","last_clean":"2023-11-27T18:13:23.675351+0000","last_became_active":"2023-11-27T18:13:20.906418+0000","last_became_peered":"2023-11-27T18:13:20.906418+0000","last_unstale":"2023-11-27T18:13:23.675351+0000","last_undegraded":"2023-11-27T18:13:23.675351+0000","last_fullsized":"2023-11-27T18:13:23.675351+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:26:43.789814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.143078+0000","last_change":"2023-11-27T18:13:14.421453+0000","last_active":"2023-11-27T18:13:22.143078+0000","last_peered":"2023-11-27T18:13:22.143078+0000","last_clean":"2023-11-27T18:13:22.143078+0000","last_became_active":"2023-11-27T18:13:14.418640+0000","last_became_peered":"2023-11-27T18:13:14.418640+0000","last_unstale":"2023-11-27T18:13:22.143078+0000","last_undegraded":"2023-11-27T18:13:22.143078+0000","last_fullsized":"2023-11-27T18:13:22.143078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:38:18.655528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.142971+0000","last_change":"2023-11-27T18:13:12.306690+0000","last_active":"2023-11-27T18:13:22.142971+0000","last_peered":"2023-11-27T18:13:22.142971+0000","last_clean":"2023-11-27T18:13:22.142971+0000","last_became_active":"2023-11-27T18:13:12.306331+0000","last_became_peered":"2023-11-27T18:13:12.306331+0000","last_unstale":"2023-11-27T18:13:22.142971+0000","last_undegraded":"2023-11-27T18:13:22.142971+0000","last_fullsized":"2023-11-27T18:13:22.142971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:39:32.646368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.321605+0000","last_change":"2023-11-27T18:13:20.929179+0000","last_active":"2023-11-27T18:13:23.321605+0000","last_peered":"2023-11-27T18:13:23.321605+0000","last_clean":"2023-11-27T18:13:23.321605+0000","last_became_active":"2023-11-27T18:13:20.927962+0000","last_became_peered":"2023-11-27T18:13:20.927962+0000","last_unstale":"2023-11-27T18:13:23.321605+0000","last_undegraded":"2023-11-27T18:13:23.321605+0000","last_fullsized":"2023-11-27T18:13:23.321605+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:05:49.936547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.927324+0000","last_change":"2023-11-27T18:13:14.368428+0000","last_active":"2023-11-27T18:13:21.927324+0000","last_peered":"2023-11-27T18:13:21.927324+0000","last_clean":"2023-11-27T18:13:21.927324+0000","last_became_active":"2023-11-27T18:13:14.368117+0000","last_became_peered":"2023-11-27T18:13:14.368117+0000","last_unstale":"2023-11-27T18:13:21.927324+0000","last_undegraded":"2023-11-27T18:13:21.927324+0000","last_fullsized":"2023-11-27T18:13:21.927324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:24:45.528760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.139380+0000","last_change":"2023-11-27T18:13:12.306963+0000","last_active":"2023-11-27T18:13:22.139380+0000","last_peered":"2023-11-27T18:13:22.139380+0000","last_clean":"2023-11-27T18:13:22.139380+0000","last_became_active":"2023-11-27T18:13:12.306644+0000","last_became_peered":"2023-11-27T18:13:12.306644+0000","last_unstale":"2023-11-27T18:13:22.139380+0000","last_undegraded":"2023-11-27T18:13:22.139380+0000","last_fullsized":"2023-11-27T18:13:22.139380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:55:43.829654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:24.442496+0000","last_change":"2023-11-27T18:13:20.930173+0000","last_active":"2023-11-27T18:13:24.442496+0000","last_peered":"2023-11-27T18:13:24.442496+0000","last_clean":"2023-11-27T18:13:24.442496+0000","last_became_active":"2023-11-27T18:13:20.928830+0000","last_became_peered":"2023-11-27T18:13:20.928830+0000","last_unstale":"2023-11-27T18:13:24.442496+0000","last_undegraded":"2023-11-27T18:13:24.442496+0000","last_fullsized":"2023-11-27T18:13:24.442496+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:38:26.343953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.974087+0000","last_change":"2023-11-27T18:13:14.378647+0000","last_active":"2023-11-27T18:13:21.974087+0000","last_peered":"2023-11-27T18:13:21.974087+0000","last_clean":"2023-11-27T18:13:21.974087+0000","last_became_active":"2023-11-27T18:13:14.378391+0000","last_became_peered":"2023-11-27T18:13:14.378391+0000","last_unstale":"2023-11-27T18:13:21.974087+0000","last_undegraded":"2023-11-27T18:13:21.974087+0000","last_fullsized":"2023-11-27T18:13:21.974087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:02:22.189845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.975536+0000","last_change":"2023-11-27T18:13:12.270283+0000","last_active":"2023-11-27T18:13:21.975536+0000","last_peered":"2023-11-27T18:13:21.975536+0000","last_clean":"2023-11-27T18:13:21.975536+0000","last_became_active":"2023-11-27T18:13:12.269795+0000","last_became_peered":"2023-11-27T18:13:12.269795+0000","last_unstale":"2023-11-27T18:13:21.975536+0000","last_undegraded":"2023-11-27T18:13:21.975536+0000","last_fullsized":"2023-11-27T18:13:21.975536+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:06:24.103678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.231936+0000","last_change":"2023-11-27T18:13:20.907340+0000","last_active":"2023-11-27T18:13:23.231936+0000","last_peered":"2023-11-27T18:13:23.231936+0000","last_clean":"2023-11-27T18:13:23.231936+0000","last_became_active":"2023-11-27T18:13:20.906609+0000","last_became_peered":"2023-11-27T18:13:20.906609+0000","last_unstale":"2023-11-27T18:13:23.231936+0000","last_undegraded":"2023-11-27T18:13:23.231936+0000","last_fullsized":"2023-11-27T18:13:23.231936+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:19:00.295457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.142648+0000","last_change":"2023-11-27T18:13:14.415177+0000","last_active":"2023-11-27T18:13:22.142648+0000","last_peered":"2023-11-27T18:13:22.142648+0000","last_clean":"2023-11-27T18:13:22.142648+0000","last_became_active":"2023-11-27T18:13:14.414888+0000","last_became_peered":"2023-11-27T18:13:14.414888+0000","last_unstale":"2023-11-27T18:13:22.142648+0000","last_undegraded":"2023-11-27T18:13:22.142648+0000","last_fullsized":"2023-11-27T18:13:22.142648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:41:49.599901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.139916+0000","last_change":"2023-11-27T18:13:12.273724+0000","last_active":"2023-11-27T18:13:22.139916+0000","last_peered":"2023-11-27T18:13:22.139916+0000","last_clean":"2023-11-27T18:13:22.139916+0000","last_became_active":"2023-11-27T18:13:12.273356+0000","last_became_peered":"2023-11-27T18:13:12.273356+0000","last_unstale":"2023-11-27T18:13:22.139916+0000","last_undegraded":"2023-11-27T18:13:22.139916+0000","last_fullsized":"2023-11-27T18:13:22.139916+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:15:14.235633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.675747+0000","last_change":"2023-11-27T18:13:20.935910+0000","last_active":"2023-11-27T18:13:23.675747+0000","last_peered":"2023-11-27T18:13:23.675747+0000","last_clean":"2023-11-27T18:13:23.675747+0000","last_became_active":"2023-11-27T18:13:20.934797+0000","last_became_peered":"2023-11-27T18:13:20.934797+0000","last_unstale":"2023-11-27T18:13:23.675747+0000","last_undegraded":"2023-11-27T18:13:23.675747+0000","last_fullsized":"2023-11-27T18:13:23.675747+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:00:35.425015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.974788+0000","last_change":"2023-11-27T18:13:14.376557+0000","last_active":"2023-11-27T18:13:21.974788+0000","last_peered":"2023-11-27T18:13:21.974788+0000","last_clean":"2023-11-27T18:13:21.974788+0000","last_became_active":"2023-11-27T18:13:14.376304+0000","last_became_peered":"2023-11-27T18:13:14.376304+0000","last_unstale":"2023-11-27T18:13:21.974788+0000","last_undegraded":"2023-11-27T18:13:21.974788+0000","last_fullsized":"2023-11-27T18:13:21.974788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:37:22.787246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.145694+0000","last_change":"2023-11-27T18:13:12.307806+0000","last_active":"2023-11-27T18:13:22.145694+0000","last_peered":"2023-11-27T18:13:22.145694+0000","last_clean":"2023-11-27T18:13:22.145694+0000","last_became_active":"2023-11-27T18:13:12.307492+0000","last_became_peered":"2023-11-27T18:13:12.307492+0000","last_unstale":"2023-11-27T18:13:22.145694+0000","last_undegraded":"2023-11-27T18:13:22.145694+0000","last_fullsized":"2023-11-27T18:13:22.145694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:34:06.981997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.674551+0000","last_change":"2023-11-27T18:13:20.918671+0000","last_active":"2023-11-27T18:13:23.674551+0000","last_peered":"2023-11-27T18:13:23.674551+0000","last_clean":"2023-11-27T18:13:23.674551+0000","last_became_active":"2023-11-27T18:13:20.917507+0000","last_became_peered":"2023-11-27T18:13:20.917507+0000","last_unstale":"2023-11-27T18:13:23.674551+0000","last_undegraded":"2023-11-27T18:13:23.674551+0000","last_fullsized":"2023-11-27T18:13:23.674551+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:00:52.213234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.975274+0000","last_change":"2023-11-27T18:13:14.377644+0000","last_active":"2023-11-27T18:13:21.975274+0000","last_peered":"2023-11-27T18:13:21.975274+0000","last_clean":"2023-11-27T18:13:21.975274+0000","last_became_active":"2023-11-27T18:13:14.377289+0000","last_became_peered":"2023-11-27T18:13:14.377289+0000","last_unstale":"2023-11-27T18:13:21.975274+0000","last_undegraded":"2023-11-27T18:13:21.975274+0000","last_fullsized":"2023-11-27T18:13:21.975274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:55:42.641433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.975026+0000","last_change":"2023-11-27T18:13:12.267960+0000","last_active":"2023-11-27T18:13:21.975026+0000","last_peered":"2023-11-27T18:13:21.975026+0000","last_clean":"2023-11-27T18:13:21.975026+0000","last_became_active":"2023-11-27T18:13:12.267552+0000","last_became_peered":"2023-11-27T18:13:12.267552+0000","last_unstale":"2023-11-27T18:13:21.975026+0000","last_undegraded":"2023-11-27T18:13:21.975026+0000","last_fullsized":"2023-11-27T18:13:21.975026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:26:13.819717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.288385+0000","last_change":"2023-11-27T18:13:20.929780+0000","last_active":"2023-11-27T18:13:23.288385+0000","last_peered":"2023-11-27T18:13:23.288385+0000","last_clean":"2023-11-27T18:13:23.288385+0000","last_became_active":"2023-11-27T18:13:20.929370+0000","last_became_peered":"2023-11-27T18:13:20.929370+0000","last_unstale":"2023-11-27T18:13:23.288385+0000","last_undegraded":"2023-11-27T18:13:23.288385+0000","last_fullsized":"2023-11-27T18:13:23.288385+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:04:33.249483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140988+0000","last_change":"2023-11-27T18:13:14.369764+0000","last_active":"2023-11-27T18:13:22.140988+0000","last_peered":"2023-11-27T18:13:22.140988+0000","last_clean":"2023-11-27T18:13:22.140988+0000","last_became_active":"2023-11-27T18:13:14.369472+0000","last_became_peered":"2023-11-27T18:13:14.369472+0000","last_unstale":"2023-11-27T18:13:22.140988+0000","last_undegraded":"2023-11-27T18:13:22.140988+0000","last_fullsized":"2023-11-27T18:13:22.140988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:35:38.706782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.143297+0000","last_change":"2023-11-27T18:13:12.310761+0000","last_active":"2023-11-27T18:13:22.143297+0000","last_peered":"2023-11-27T18:13:22.143297+0000","last_clean":"2023-11-27T18:13:22.143297+0000","last_became_active":"2023-11-27T18:13:12.310495+0000","last_became_peered":"2023-11-27T18:13:12.310495+0000","last_unstale":"2023-11-27T18:13:22.143297+0000","last_undegraded":"2023-11-27T18:13:22.143297+0000","last_fullsized":"2023-11-27T18:13:22.143297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:48:59.333816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.935576+0000","last_change":"2023-11-27T18:13:20.907638+0000","last_active":"2023-11-27T18:13:23.935576+0000","last_peered":"2023-11-27T18:13:23.935576+0000","last_clean":"2023-11-27T18:13:23.935576+0000","last_became_active":"2023-11-27T18:13:20.907229+0000","last_became_peered":"2023-11-27T18:13:20.907229+0000","last_unstale":"2023-11-27T18:13:23.935576+0000","last_undegraded":"2023-11-27T18:13:23.935576+0000","last_fullsized":"2023-11-27T18:13:23.935576+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:49:08.226420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.071564+0000","last_change":"2023-11-27T18:13:15.851127+0000","last_active":"2023-11-27T18:13:22.071564+0000","last_peered":"2023-11-27T18:13:22.071564+0000","last_clean":"2023-11-27T18:13:22.071564+0000","last_became_active":"2023-11-27T18:13:15.850263+0000","last_became_peered":"2023-11-27T18:13:15.850263+0000","last_unstale":"2023-11-27T18:13:22.071564+0000","last_undegraded":"2023-11-27T18:13:22.071564+0000","last_fullsized":"2023-11-27T18:13:22.071564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:48:39.587974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.139967+0000","last_change":"2023-11-27T18:13:12.310451+0000","last_active":"2023-11-27T18:13:22.139967+0000","last_peered":"2023-11-27T18:13:22.139967+0000","last_clean":"2023-11-27T18:13:22.139967+0000","last_became_active":"2023-11-27T18:13:12.310138+0000","last_became_peered":"2023-11-27T18:13:12.310138+0000","last_unstale":"2023-11-27T18:13:22.139967+0000","last_undegraded":"2023-11-27T18:13:22.139967+0000","last_fullsized":"2023-11-27T18:13:22.139967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:03:09.046171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.934474+0000","last_change":"2023-11-27T18:13:20.896960+0000","last_active":"2023-11-27T18:13:23.934474+0000","last_peered":"2023-11-27T18:13:23.934474+0000","last_clean":"2023-11-27T18:13:23.934474+0000","last_became_active":"2023-11-27T18:13:20.896156+0000","last_became_peered":"2023-11-27T18:13:20.896156+0000","last_unstale":"2023-11-27T18:13:23.934474+0000","last_undegraded":"2023-11-27T18:13:23.934474+0000","last_fullsized":"2023-11-27T18:13:23.934474+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:00:52.213234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140720+0000","last_change":"2023-11-27T18:13:14.421498+0000","last_active":"2023-11-27T18:13:22.140720+0000","last_peered":"2023-11-27T18:13:22.140720+0000","last_clean":"2023-11-27T18:13:22.140720+0000","last_became_active":"2023-11-27T18:13:14.421125+0000","last_became_peered":"2023-11-27T18:13:14.421125+0000","last_unstale":"2023-11-27T18:13:22.140720+0000","last_undegraded":"2023-11-27T18:13:22.140720+0000","last_fullsized":"2023-11-27T18:13:22.140720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:52:30.225572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.143659+0000","last_change":"2023-11-27T18:13:12.301922+0000","last_active":"2023-11-27T18:13:22.143659+0000","last_peered":"2023-11-27T18:13:22.143659+0000","last_clean":"2023-11-27T18:13:22.143659+0000","last_became_active":"2023-11-27T18:13:12.301617+0000","last_became_peered":"2023-11-27T18:13:12.301617+0000","last_unstale":"2023-11-27T18:13:22.143659+0000","last_undegraded":"2023-11-27T18:13:22.143659+0000","last_fullsized":"2023-11-27T18:13:22.143659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:00:43.320630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.935898+0000","last_change":"2023-11-27T18:13:20.905013+0000","last_active":"2023-11-27T18:13:23.935898+0000","last_peered":"2023-11-27T18:13:23.935898+0000","last_clean":"2023-11-27T18:13:23.935898+0000","last_became_active":"2023-11-27T18:13:20.903019+0000","last_became_peered":"2023-11-27T18:13:20.903019+0000","last_unstale":"2023-11-27T18:13:23.935898+0000","last_undegraded":"2023-11-27T18:13:23.935898+0000","last_fullsized":"2023-11-27T18:13:23.935898+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:34:15.874601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.138615+0000","last_change":"2023-11-27T18:13:14.378913+0000","last_active":"2023-11-27T18:13:22.138615+0000","last_peered":"2023-11-27T18:13:22.138615+0000","last_clean":"2023-11-27T18:13:22.138615+0000","last_became_active":"2023-11-27T18:13:14.378644+0000","last_became_peered":"2023-11-27T18:13:14.378644+0000","last_unstale":"2023-11-27T18:13:22.138615+0000","last_undegraded":"2023-11-27T18:13:22.138615+0000","last_fullsized":"2023-11-27T18:13:22.138615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:19:02.523860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.926631+0000","last_change":"2023-11-27T18:13:12.305733+0000","last_active":"2023-11-27T18:13:21.926631+0000","last_peered":"2023-11-27T18:13:21.926631+0000","last_clean":"2023-11-27T18:13:21.926631+0000","last_became_active":"2023-11-27T18:13:12.305380+0000","last_became_peered":"2023-11-27T18:13:12.305380+0000","last_unstale":"2023-11-27T18:13:21.926631+0000","last_undegraded":"2023-11-27T18:13:21.926631+0000","last_fullsized":"2023-11-27T18:13:21.926631+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:34:46.886091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.936019+0000","last_change":"2023-11-27T18:13:20.913672+0000","last_active":"2023-11-27T18:13:23.936019+0000","last_peered":"2023-11-27T18:13:23.936019+0000","last_clean":"2023-11-27T18:13:23.936019+0000","last_became_active":"2023-11-27T18:13:20.913137+0000","last_became_peered":"2023-11-27T18:13:20.913137+0000","last_unstale":"2023-11-27T18:13:23.936019+0000","last_undegraded":"2023-11-27T18:13:23.936019+0000","last_fullsized":"2023-11-27T18:13:23.936019+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:40:20.210205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.138829+0000","last_change":"2023-11-27T18:13:14.413781+0000","last_active":"2023-11-27T18:13:22.138829+0000","last_peered":"2023-11-27T18:13:22.138829+0000","last_clean":"2023-11-27T18:13:22.138829+0000","last_became_active":"2023-11-27T18:13:14.413413+0000","last_became_peered":"2023-11-27T18:13:14.413413+0000","last_unstale":"2023-11-27T18:13:22.138829+0000","last_undegraded":"2023-11-27T18:13:22.138829+0000","last_fullsized":"2023-11-27T18:13:22.138829+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:04:03.068428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.142629+0000","last_change":"2023-11-27T18:13:12.315822+0000","last_active":"2023-11-27T18:13:22.142629+0000","last_peered":"2023-11-27T18:13:22.142629+0000","last_clean":"2023-11-27T18:13:22.142629+0000","last_became_active":"2023-11-27T18:13:12.315610+0000","last_became_peered":"2023-11-27T18:13:12.315610+0000","last_unstale":"2023-11-27T18:13:22.142629+0000","last_undegraded":"2023-11-27T18:13:22.142629+0000","last_fullsized":"2023-11-27T18:13:22.142629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:39:33.385367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:24.439052+0000","last_change":"2023-11-27T18:13:20.912891+0000","last_active":"2023-11-27T18:13:24.439052+0000","last_peered":"2023-11-27T18:13:24.439052+0000","last_clean":"2023-11-27T18:13:24.439052+0000","last_became_active":"2023-11-27T18:13:20.912453+0000","last_became_peered":"2023-11-27T18:13:20.912453+0000","last_unstale":"2023-11-27T18:13:24.439052+0000","last_undegraded":"2023-11-27T18:13:24.439052+0000","last_fullsized":"2023-11-27T18:13:24.439052+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:35:44.943527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.975967+0000","last_change":"2023-11-27T18:13:14.414468+0000","last_active":"2023-11-27T18:13:21.975967+0000","last_peered":"2023-11-27T18:13:21.975967+0000","last_clean":"2023-11-27T18:13:21.975967+0000","last_became_active":"2023-11-27T18:13:14.414156+0000","last_became_peered":"2023-11-27T18:13:14.414156+0000","last_unstale":"2023-11-27T18:13:21.975967+0000","last_undegraded":"2023-11-27T18:13:21.975967+0000","last_fullsized":"2023-11-27T18:13:21.975967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:46:11.500006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.143074+0000","last_change":"2023-11-27T18:13:12.308337+0000","last_active":"2023-11-27T18:13:22.143074+0000","last_peered":"2023-11-27T18:13:22.143074+0000","last_clean":"2023-11-27T18:13:22.143074+0000","last_became_active":"2023-11-27T18:13:12.308050+0000","last_became_peered":"2023-11-27T18:13:12.308050+0000","last_unstale":"2023-11-27T18:13:22.143074+0000","last_undegraded":"2023-11-27T18:13:22.143074+0000","last_fullsized":"2023-11-27T18:13:22.143074+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:14:09.398956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"20'117","reported_seq":170,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140186+0000","last_change":"2023-11-27T18:12:38.371836+0000","last_active":"2023-11-27T18:13:22.140186+0000","last_peered":"2023-11-27T18:13:22.140186+0000","last_clean":"2023-11-27T18:13:22.140186+0000","last_became_active":"2023-11-27T18:12:38.370748+0000","last_became_peered":"2023-11-27T18:12:38.370748+0000","last_unstale":"2023-11-27T18:13:22.140186+0000","last_undegraded":"2023-11-27T18:13:22.140186+0000","last_fullsized":"2023-11-27T18:13:22.140186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:12:36.259476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:12:36.259476+0000","last_clean_scrub_stamp":"2023-11-27T18:12:36.259476+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:25:36.712765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.322281+0000","last_change":"2023-11-27T18:13:20.928359+0000","last_active":"2023-11-27T18:13:23.322281+0000","last_peered":"2023-11-27T18:13:23.322281+0000","last_clean":"2023-11-27T18:13:23.322281+0000","last_became_active":"2023-11-27T18:13:20.926559+0000","last_became_peered":"2023-11-27T18:13:20.926559+0000","last_unstale":"2023-11-27T18:13:23.322281+0000","last_undegraded":"2023-11-27T18:13:23.322281+0000","last_fullsized":"2023-11-27T18:13:23.322281+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:47:06.255647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.143121+0000","last_change":"2023-11-27T18:13:14.422275+0000","last_active":"2023-11-27T18:13:22.143121+0000","last_peered":"2023-11-27T18:13:22.143121+0000","last_clean":"2023-11-27T18:13:22.143121+0000","last_became_active":"2023-11-27T18:13:14.419636+0000","last_became_peered":"2023-11-27T18:13:14.419636+0000","last_unstale":"2023-11-27T18:13:22.143121+0000","last_undegraded":"2023-11-27T18:13:22.143121+0000","last_fullsized":"2023-11-27T18:13:22.143121+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:29:10.027795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.141172+0000","last_change":"2023-11-27T18:13:12.268222+0000","last_active":"2023-11-27T18:13:22.141172+0000","last_peered":"2023-11-27T18:13:22.141172+0000","last_clean":"2023-11-27T18:13:22.141172+0000","last_became_active":"2023-11-27T18:13:12.267764+0000","last_became_peered":"2023-11-27T18:13:12.267764+0000","last_unstale":"2023-11-27T18:13:22.141172+0000","last_undegraded":"2023-11-27T18:13:22.141172+0000","last_fullsized":"2023-11-27T18:13:22.141172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:48:38.383796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.674846+0000","last_change":"2023-11-27T18:13:20.917055+0000","last_active":"2023-11-27T18:13:23.674846+0000","last_peered":"2023-11-27T18:13:23.674846+0000","last_clean":"2023-11-27T18:13:23.674846+0000","last_became_active":"2023-11-27T18:13:20.914157+0000","last_became_peered":"2023-11-27T18:13:20.914157+0000","last_unstale":"2023-11-27T18:13:23.674846+0000","last_undegraded":"2023-11-27T18:13:23.674846+0000","last_fullsized":"2023-11-27T18:13:23.674846+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:34:15.874601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140538+0000","last_change":"2023-11-27T18:13:14.363559+0000","last_active":"2023-11-27T18:13:22.140538+0000","last_peered":"2023-11-27T18:13:22.140538+0000","last_clean":"2023-11-27T18:13:22.140538+0000","last_became_active":"2023-11-27T18:13:14.363285+0000","last_became_peered":"2023-11-27T18:13:14.363285+0000","last_unstale":"2023-11-27T18:13:22.140538+0000","last_undegraded":"2023-11-27T18:13:22.140538+0000","last_fullsized":"2023-11-27T18:13:22.140538+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:00:44.524809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140713+0000","last_change":"2023-11-27T18:13:12.312477+0000","last_active":"2023-11-27T18:13:22.140713+0000","last_peered":"2023-11-27T18:13:22.140713+0000","last_clean":"2023-11-27T18:13:22.140713+0000","last_became_active":"2023-11-27T18:13:12.312038+0000","last_became_peered":"2023-11-27T18:13:12.312038+0000","last_unstale":"2023-11-27T18:13:22.140713+0000","last_undegraded":"2023-11-27T18:13:22.140713+0000","last_fullsized":"2023-11-27T18:13:22.140713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:35:37.502604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:24.439241+0000","last_change":"2023-11-27T18:13:20.913830+0000","last_active":"2023-11-27T18:13:24.439241+0000","last_peered":"2023-11-27T18:13:24.439241+0000","last_clean":"2023-11-27T18:13:24.439241+0000","last_became_active":"2023-11-27T18:13:20.912734+0000","last_became_peered":"2023-11-27T18:13:20.912734+0000","last_unstale":"2023-11-27T18:13:24.439241+0000","last_undegraded":"2023-11-27T18:13:24.439241+0000","last_fullsized":"2023-11-27T18:13:24.439241+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:35:39.280506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.141013+0000","last_change":"2023-11-27T18:13:14.364027+0000","last_active":"2023-11-27T18:13:22.141013+0000","last_peered":"2023-11-27T18:13:22.141013+0000","last_clean":"2023-11-27T18:13:22.141013+0000","last_became_active":"2023-11-27T18:13:14.363772+0000","last_became_peered":"2023-11-27T18:13:14.363772+0000","last_unstale":"2023-11-27T18:13:22.141013+0000","last_undegraded":"2023-11-27T18:13:22.141013+0000","last_fullsized":"2023-11-27T18:13:22.141013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:40:12.521779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.974905+0000","last_change":"2023-11-27T18:13:12.304785+0000","last_active":"2023-11-27T18:13:21.974905+0000","last_peered":"2023-11-27T18:13:21.974905+0000","last_clean":"2023-11-27T18:13:21.974905+0000","last_became_active":"2023-11-27T18:13:12.304400+0000","last_became_peered":"2023-11-27T18:13:12.304400+0000","last_unstale":"2023-11-27T18:13:21.974905+0000","last_undegraded":"2023-11-27T18:13:21.974905+0000","last_fullsized":"2023-11-27T18:13:21.974905+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:37:52.292054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.320761+0000","last_change":"2023-11-27T18:13:20.922959+0000","last_active":"2023-11-27T18:13:23.320761+0000","last_peered":"2023-11-27T18:13:23.320761+0000","last_clean":"2023-11-27T18:13:23.320761+0000","last_became_active":"2023-11-27T18:13:20.918984+0000","last_became_peered":"2023-11-27T18:13:20.918984+0000","last_unstale":"2023-11-27T18:13:23.320761+0000","last_undegraded":"2023-11-27T18:13:23.320761+0000","last_fullsized":"2023-11-27T18:13:23.320761+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:59:33.426999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.071789+0000","last_change":"2023-11-27T18:13:15.852939+0000","last_active":"2023-11-27T18:13:22.071789+0000","last_peered":"2023-11-27T18:13:22.071789+0000","last_clean":"2023-11-27T18:13:22.071789+0000","last_became_active":"2023-11-27T18:13:15.852339+0000","last_became_peered":"2023-11-27T18:13:15.852339+0000","last_unstale":"2023-11-27T18:13:22.071789+0000","last_undegraded":"2023-11-27T18:13:22.071789+0000","last_fullsized":"2023-11-27T18:13:22.071789+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:31:25.796567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140369+0000","last_change":"2023-11-27T18:13:12.311109+0000","last_active":"2023-11-27T18:13:22.140369+0000","last_peered":"2023-11-27T18:13:22.140369+0000","last_clean":"2023-11-27T18:13:22.140369+0000","last_became_active":"2023-11-27T18:13:12.310921+0000","last_became_peered":"2023-11-27T18:13:12.310921+0000","last_unstale":"2023-11-27T18:13:22.140369+0000","last_undegraded":"2023-11-27T18:13:22.140369+0000","last_fullsized":"2023-11-27T18:13:22.140369+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:05:04.546929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.292365+0000","last_change":"2023-11-27T18:13:20.925265+0000","last_active":"2023-11-27T18:13:23.292365+0000","last_peered":"2023-11-27T18:13:23.292365+0000","last_clean":"2023-11-27T18:13:23.292365+0000","last_became_active":"2023-11-27T18:13:20.924209+0000","last_became_peered":"2023-11-27T18:13:20.924209+0000","last_unstale":"2023-11-27T18:13:23.292365+0000","last_undegraded":"2023-11-27T18:13:23.292365+0000","last_fullsized":"2023-11-27T18:13:23.292365+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:31:33.484992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.142532+0000","last_change":"2023-11-27T18:13:14.421768+0000","last_active":"2023-11-27T18:13:22.142532+0000","last_peered":"2023-11-27T18:13:22.142532+0000","last_clean":"2023-11-27T18:13:22.142532+0000","last_became_active":"2023-11-27T18:13:14.421377+0000","last_became_peered":"2023-11-27T18:13:14.421377+0000","last_unstale":"2023-11-27T18:13:22.142532+0000","last_undegraded":"2023-11-27T18:13:22.142532+0000","last_fullsized":"2023-11-27T18:13:22.142532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:00:27.736589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"24'8","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.974338+0000","last_change":"2023-11-27T18:13:12.178547+0000","last_active":"2023-11-27T18:13:21.974338+0000","last_peered":"2023-11-27T18:13:21.974338+0000","last_clean":"2023-11-27T18:13:21.974338+0000","last_became_active":"2023-11-27T18:13:12.177997+0000","last_became_peered":"2023-11-27T18:13:12.177997+0000","last_unstale":"2023-11-27T18:13:21.974338+0000","last_undegraded":"2023-11-27T18:13:21.974338+0000","last_fullsized":"2023-11-27T18:13:21.974338+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:29:10.535816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:24.439272+0000","last_change":"2023-11-27T18:13:20.914541+0000","last_active":"2023-11-27T18:13:24.439272+0000","last_peered":"2023-11-27T18:13:24.439272+0000","last_clean":"2023-11-27T18:13:24.439272+0000","last_became_active":"2023-11-27T18:13:20.914144+0000","last_became_peered":"2023-11-27T18:13:20.914144+0000","last_unstale":"2023-11-27T18:13:24.439272+0000","last_undegraded":"2023-11-27T18:13:24.439272+0000","last_fullsized":"2023-11-27T18:13:24.439272+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:29:17.716220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140030+0000","last_change":"2023-11-27T18:13:15.802553+0000","last_active":"2023-11-27T18:13:22.140030+0000","last_peered":"2023-11-27T18:13:22.140030+0000","last_clean":"2023-11-27T18:13:22.140030+0000","last_became_active":"2023-11-27T18:13:15.801804+0000","last_became_peered":"2023-11-27T18:13:15.801804+0000","last_unstale":"2023-11-27T18:13:22.140030+0000","last_undegraded":"2023-11-27T18:13:22.140030+0000","last_fullsized":"2023-11-27T18:13:22.140030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:50:47.259554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.141046+0000","last_change":"2023-11-27T18:13:12.300863+0000","last_active":"2023-11-27T18:13:22.141046+0000","last_peered":"2023-11-27T18:13:22.141046+0000","last_clean":"2023-11-27T18:13:22.141046+0000","last_became_active":"2023-11-27T18:13:12.300585+0000","last_became_peered":"2023-11-27T18:13:12.300585+0000","last_unstale":"2023-11-27T18:13:22.141046+0000","last_undegraded":"2023-11-27T18:13:22.141046+0000","last_fullsized":"2023-11-27T18:13:22.141046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:27:04.532776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:24.439678+0000","last_change":"2023-11-27T18:13:20.915245+0000","last_active":"2023-11-27T18:13:24.439678+0000","last_peered":"2023-11-27T18:13:24.439678+0000","last_clean":"2023-11-27T18:13:24.439678+0000","last_became_active":"2023-11-27T18:13:20.914216+0000","last_became_peered":"2023-11-27T18:13:20.914216+0000","last_unstale":"2023-11-27T18:13:24.439678+0000","last_undegraded":"2023-11-27T18:13:24.439678+0000","last_fullsized":"2023-11-27T18:13:24.439678+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:56:44.418239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.142871+0000","last_change":"2023-11-27T18:13:14.415225+0000","last_active":"2023-11-27T18:13:22.142871+0000","last_peered":"2023-11-27T18:13:22.142871+0000","last_clean":"2023-11-27T18:13:22.142871+0000","last_became_active":"2023-11-27T18:13:14.414918+0000","last_became_peered":"2023-11-27T18:13:14.414918+0000","last_unstale":"2023-11-27T18:13:22.142871+0000","last_undegraded":"2023-11-27T18:13:22.142871+0000","last_fullsized":"2023-11-27T18:13:22.142871+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:35:31.592080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.143589+0000","last_change":"2023-11-27T18:13:12.305081+0000","last_active":"2023-11-27T18:13:22.143589+0000","last_peered":"2023-11-27T18:13:22.143589+0000","last_clean":"2023-11-27T18:13:22.143589+0000","last_became_active":"2023-11-27T18:13:12.304777+0000","last_became_peered":"2023-11-27T18:13:12.304777+0000","last_unstale":"2023-11-27T18:13:22.143589+0000","last_undegraded":"2023-11-27T18:13:22.143589+0000","last_fullsized":"2023-11-27T18:13:22.143589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:22:12.680259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.936710+0000","last_change":"2023-11-27T18:13:20.904088+0000","last_active":"2023-11-27T18:13:23.936710+0000","last_peered":"2023-11-27T18:13:23.936710+0000","last_clean":"2023-11-27T18:13:23.936710+0000","last_became_active":"2023-11-27T18:13:20.902282+0000","last_became_peered":"2023-11-27T18:13:20.902282+0000","last_unstale":"2023-11-27T18:13:23.936710+0000","last_undegraded":"2023-11-27T18:13:23.936710+0000","last_fullsized":"2023-11-27T18:13:23.936710+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:26:43.789814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140899+0000","last_change":"2023-11-27T18:13:14.415302+0000","last_active":"2023-11-27T18:13:22.140899+0000","last_peered":"2023-11-27T18:13:22.140899+0000","last_clean":"2023-11-27T18:13:22.140899+0000","last_became_active":"2023-11-27T18:13:14.415004+0000","last_became_peered":"2023-11-27T18:13:14.415004+0000","last_unstale":"2023-11-27T18:13:22.140899+0000","last_undegraded":"2023-11-27T18:13:22.140899+0000","last_fullsized":"2023-11-27T18:13:22.140899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:34:11.170873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.927564+0000","last_change":"2023-11-27T18:13:12.268542+0000","last_active":"2023-11-27T18:13:21.927564+0000","last_peered":"2023-11-27T18:13:21.927564+0000","last_clean":"2023-11-27T18:13:21.927564+0000","last_became_active":"2023-11-27T18:13:12.268237+0000","last_became_peered":"2023-11-27T18:13:12.268237+0000","last_unstale":"2023-11-27T18:13:21.927564+0000","last_undegraded":"2023-11-27T18:13:21.927564+0000","last_fullsized":"2023-11-27T18:13:21.927564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:15:07.514381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.321930+0000","last_change":"2023-11-27T18:13:20.900393+0000","last_active":"2023-11-27T18:13:23.321930+0000","last_peered":"2023-11-27T18:13:23.321930+0000","last_clean":"2023-11-27T18:13:23.321930+0000","last_became_active":"2023-11-27T18:13:20.899358+0000","last_became_peered":"2023-11-27T18:13:20.899358+0000","last_unstale":"2023-11-27T18:13:23.321930+0000","last_undegraded":"2023-11-27T18:13:23.321930+0000","last_fullsized":"2023-11-27T18:13:23.321930+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:27:58.837417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140744+0000","last_change":"2023-11-27T18:13:14.371842+0000","last_active":"2023-11-27T18:13:22.140744+0000","last_peered":"2023-11-27T18:13:22.140744+0000","last_clean":"2023-11-27T18:13:22.140744+0000","last_became_active":"2023-11-27T18:13:14.371637+0000","last_became_peered":"2023-11-27T18:13:14.371637+0000","last_unstale":"2023-11-27T18:13:22.140744+0000","last_undegraded":"2023-11-27T18:13:22.140744+0000","last_fullsized":"2023-11-27T18:13:22.140744+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:22:13.884437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"30'10","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:33.656056+0000","last_change":"2023-11-27T18:13:12.248404+0000","last_active":"2023-11-27T18:13:33.656056+0000","last_peered":"2023-11-27T18:13:33.656056+0000","last_clean":"2023-11-27T18:13:33.656056+0000","last_became_active":"2023-11-27T18:13:12.248077+0000","last_became_peered":"2023-11-27T18:13:12.248077+0000","last_unstale":"2023-11-27T18:13:33.656056+0000","last_undegraded":"2023-11-27T18:13:33.656056+0000","last_fullsized":"2023-11-27T18:13:33.656056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:34:21.166265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.288672+0000","last_change":"2023-11-27T18:13:20.919046+0000","last_active":"2023-11-27T18:13:23.288672+0000","last_peered":"2023-11-27T18:13:23.288672+0000","last_clean":"2023-11-27T18:13:23.288672+0000","last_became_active":"2023-11-27T18:13:20.918381+0000","last_became_peered":"2023-11-27T18:13:20.918381+0000","last_unstale":"2023-11-27T18:13:23.288672+0000","last_undegraded":"2023-11-27T18:13:23.288672+0000","last_fullsized":"2023-11-27T18:13:23.288672+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:17:07.092549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.143486+0000","last_change":"2023-11-27T18:13:14.415453+0000","last_active":"2023-11-27T18:13:22.143486+0000","last_peered":"2023-11-27T18:13:22.143486+0000","last_clean":"2023-11-27T18:13:22.143486+0000","last_became_active":"2023-11-27T18:13:14.415026+0000","last_became_peered":"2023-11-27T18:13:14.415026+0000","last_unstale":"2023-11-27T18:13:22.143486+0000","last_undegraded":"2023-11-27T18:13:22.143486+0000","last_fullsized":"2023-11-27T18:13:22.143486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:35:37.255102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.927427+0000","last_change":"2023-11-27T18:13:12.180737+0000","last_active":"2023-11-27T18:13:21.927427+0000","last_peered":"2023-11-27T18:13:21.927427+0000","last_clean":"2023-11-27T18:13:21.927427+0000","last_became_active":"2023-11-27T18:13:12.180112+0000","last_became_peered":"2023-11-27T18:13:12.180112+0000","last_unstale":"2023-11-27T18:13:21.927427+0000","last_undegraded":"2023-11-27T18:13:21.927427+0000","last_fullsized":"2023-11-27T18:13:21.927427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:24:22.455257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.674772+0000","last_change":"2023-11-27T18:13:20.925012+0000","last_active":"2023-11-27T18:13:23.674772+0000","last_peered":"2023-11-27T18:13:23.674772+0000","last_clean":"2023-11-27T18:13:23.674772+0000","last_became_active":"2023-11-27T18:13:20.921675+0000","last_became_peered":"2023-11-27T18:13:20.921675+0000","last_unstale":"2023-11-27T18:13:23.674772+0000","last_undegraded":"2023-11-27T18:13:23.674772+0000","last_fullsized":"2023-11-27T18:13:23.674772+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:49:08.226420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.142147+0000","last_change":"2023-11-27T18:13:14.415432+0000","last_active":"2023-11-27T18:13:22.142147+0000","last_peered":"2023-11-27T18:13:22.142147+0000","last_clean":"2023-11-27T18:13:22.142147+0000","last_became_active":"2023-11-27T18:13:14.415142+0000","last_became_peered":"2023-11-27T18:13:14.415142+0000","last_unstale":"2023-11-27T18:13:22.142147+0000","last_undegraded":"2023-11-27T18:13:22.142147+0000","last_fullsized":"2023-11-27T18:13:22.142147+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:39:33.850547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.142528+0000","last_change":"2023-11-27T18:13:12.273729+0000","last_active":"2023-11-27T18:13:22.142528+0000","last_peered":"2023-11-27T18:13:22.142528+0000","last_clean":"2023-11-27T18:13:22.142528+0000","last_became_active":"2023-11-27T18:13:12.273400+0000","last_became_peered":"2023-11-27T18:13:12.273400+0000","last_unstale":"2023-11-27T18:13:22.142528+0000","last_undegraded":"2023-11-27T18:13:22.142528+0000","last_fullsized":"2023-11-27T18:13:22.142528+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:31:10.508092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.230824+0000","last_change":"2023-11-27T18:13:20.912482+0000","last_active":"2023-11-27T18:13:23.230824+0000","last_peered":"2023-11-27T18:13:23.230824+0000","last_clean":"2023-11-27T18:13:23.230824+0000","last_became_active":"2023-11-27T18:13:20.912063+0000","last_became_peered":"2023-11-27T18:13:20.912063+0000","last_unstale":"2023-11-27T18:13:23.230824+0000","last_undegraded":"2023-11-27T18:13:23.230824+0000","last_fullsized":"2023-11-27T18:13:23.230824+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:11:56.997205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.071693+0000","last_change":"2023-11-27T18:13:15.911622+0000","last_active":"2023-11-27T18:13:22.071693+0000","last_peered":"2023-11-27T18:13:22.071693+0000","last_clean":"2023-11-27T18:13:22.071693+0000","last_became_active":"2023-11-27T18:13:15.911255+0000","last_became_peered":"2023-11-27T18:13:15.911255+0000","last_unstale":"2023-11-27T18:13:22.071693+0000","last_undegraded":"2023-11-27T18:13:22.071693+0000","last_fullsized":"2023-11-27T18:13:22.071693+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:04:03.068428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.141411+0000","last_change":"2023-11-27T18:13:12.168028+0000","last_active":"2023-11-27T18:13:22.141411+0000","last_peered":"2023-11-27T18:13:22.141411+0000","last_clean":"2023-11-27T18:13:22.141411+0000","last_became_active":"2023-11-27T18:13:12.167740+0000","last_became_peered":"2023-11-27T18:13:12.167740+0000","last_unstale":"2023-11-27T18:13:22.141411+0000","last_undegraded":"2023-11-27T18:13:22.141411+0000","last_fullsized":"2023-11-27T18:13:22.141411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:34:21.166265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.289002+0000","last_change":"2023-11-27T18:13:20.915480+0000","last_active":"2023-11-27T18:13:23.289002+0000","last_peered":"2023-11-27T18:13:23.289002+0000","last_clean":"2023-11-27T18:13:23.289002+0000","last_became_active":"2023-11-27T18:13:20.914607+0000","last_became_peered":"2023-11-27T18:13:20.914607+0000","last_unstale":"2023-11-27T18:13:23.289002+0000","last_undegraded":"2023-11-27T18:13:23.289002+0000","last_fullsized":"2023-11-27T18:13:23.289002+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:07:38.034431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.290409+0000","last_change":"2023-11-27T18:13:20.930508+0000","last_active":"2023-11-27T18:13:23.290409+0000","last_peered":"2023-11-27T18:13:23.290409+0000","last_clean":"2023-11-27T18:13:23.290409+0000","last_became_active":"2023-11-27T18:13:20.930060+0000","last_became_peered":"2023-11-27T18:13:20.930060+0000","last_unstale":"2023-11-27T18:13:23.290409+0000","last_undegraded":"2023-11-27T18:13:23.290409+0000","last_fullsized":"2023-11-27T18:13:23.290409+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:43:18.464867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.975017+0000","last_change":"2023-11-27T18:13:14.380263+0000","last_active":"2023-11-27T18:13:21.975017+0000","last_peered":"2023-11-27T18:13:21.975017+0000","last_clean":"2023-11-27T18:13:21.975017+0000","last_became_active":"2023-11-27T18:13:14.379936+0000","last_became_peered":"2023-11-27T18:13:14.379936+0000","last_unstale":"2023-11-27T18:13:21.975017+0000","last_undegraded":"2023-11-27T18:13:21.975017+0000","last_fullsized":"2023-11-27T18:13:21.975017+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:50:34.713768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.142604+0000","last_change":"2023-11-27T18:13:12.300977+0000","last_active":"2023-11-27T18:13:22.142604+0000","last_peered":"2023-11-27T18:13:22.142604+0000","last_clean":"2023-11-27T18:13:22.142604+0000","last_became_active":"2023-11-27T18:13:12.300624+0000","last_became_peered":"2023-11-27T18:13:12.300624+0000","last_unstale":"2023-11-27T18:13:22.142604+0000","last_undegraded":"2023-11-27T18:13:22.142604+0000","last_fullsized":"2023-11-27T18:13:22.142604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:52:29.021393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.322456+0000","last_change":"2023-11-27T18:13:20.919870+0000","last_active":"2023-11-27T18:13:23.322456+0000","last_peered":"2023-11-27T18:13:23.322456+0000","last_clean":"2023-11-27T18:13:23.322456+0000","last_became_active":"2023-11-27T18:13:20.918816+0000","last_became_peered":"2023-11-27T18:13:20.918816+0000","last_unstale":"2023-11-27T18:13:23.322456+0000","last_undegraded":"2023-11-27T18:13:23.322456+0000","last_fullsized":"2023-11-27T18:13:23.322456+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:41:38.778382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.138717+0000","last_change":"2023-11-27T18:13:14.369562+0000","last_active":"2023-11-27T18:13:22.138717+0000","last_peered":"2023-11-27T18:13:22.138717+0000","last_clean":"2023-11-27T18:13:22.138717+0000","last_became_active":"2023-11-27T18:13:14.368880+0000","last_became_peered":"2023-11-27T18:13:14.368880+0000","last_unstale":"2023-11-27T18:13:22.138717+0000","last_undegraded":"2023-11-27T18:13:22.138717+0000","last_fullsized":"2023-11-27T18:13:22.138717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:22:13.884437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.139062+0000","last_change":"2023-11-27T18:13:12.270113+0000","last_active":"2023-11-27T18:13:22.139062+0000","last_peered":"2023-11-27T18:13:22.139062+0000","last_clean":"2023-11-27T18:13:22.139062+0000","last_became_active":"2023-11-27T18:13:12.269755+0000","last_became_peered":"2023-11-27T18:13:12.269755+0000","last_unstale":"2023-11-27T18:13:22.139062+0000","last_undegraded":"2023-11-27T18:13:22.139062+0000","last_fullsized":"2023-11-27T18:13:22.139062+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:51:01.410940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.143492+0000","last_change":"2023-11-27T18:13:12.307568+0000","last_active":"2023-11-27T18:13:22.143492+0000","last_peered":"2023-11-27T18:13:22.143492+0000","last_clean":"2023-11-27T18:13:22.143492+0000","last_became_active":"2023-11-27T18:13:12.307299+0000","last_became_peered":"2023-11-27T18:13:12.307299+0000","last_unstale":"2023-11-27T18:13:22.143492+0000","last_undegraded":"2023-11-27T18:13:22.143492+0000","last_fullsized":"2023-11-27T18:13:22.143492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:19:01.319681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.974648+0000","last_change":"2023-11-27T18:13:14.378937+0000","last_active":"2023-11-27T18:13:21.974648+0000","last_peered":"2023-11-27T18:13:21.974648+0000","last_clean":"2023-11-27T18:13:21.974648+0000","last_became_active":"2023-11-27T18:13:14.378635+0000","last_became_peered":"2023-11-27T18:13:14.378635+0000","last_unstale":"2023-11-27T18:13:21.974648+0000","last_undegraded":"2023-11-27T18:13:21.974648+0000","last_fullsized":"2023-11-27T18:13:21.974648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:06:40.533610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.290577+0000","last_change":"2023-11-27T18:13:20.903249+0000","last_active":"2023-11-27T18:13:23.290577+0000","last_peered":"2023-11-27T18:13:23.290577+0000","last_clean":"2023-11-27T18:13:23.290577+0000","last_became_active":"2023-11-27T18:13:20.902571+0000","last_became_peered":"2023-11-27T18:13:20.902571+0000","last_unstale":"2023-11-27T18:13:23.290577+0000","last_undegraded":"2023-11-27T18:13:23.290577+0000","last_fullsized":"2023-11-27T18:13:23.290577+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:41:48.892641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.139766+0000","last_change":"2023-11-27T18:13:12.304324+0000","last_active":"2023-11-27T18:13:22.139766+0000","last_peered":"2023-11-27T18:13:22.139766+0000","last_clean":"2023-11-27T18:13:22.139766+0000","last_became_active":"2023-11-27T18:13:12.303988+0000","last_became_peered":"2023-11-27T18:13:12.303988+0000","last_unstale":"2023-11-27T18:13:22.139766+0000","last_undegraded":"2023-11-27T18:13:22.139766+0000","last_fullsized":"2023-11-27T18:13:22.139766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:47:59.518332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140188+0000","last_change":"2023-11-27T18:13:15.803183+0000","last_active":"2023-11-27T18:13:22.140188+0000","last_peered":"2023-11-27T18:13:22.140188+0000","last_clean":"2023-11-27T18:13:22.140188+0000","last_became_active":"2023-11-27T18:13:15.802420+0000","last_became_peered":"2023-11-27T18:13:15.802420+0000","last_unstale":"2023-11-27T18:13:22.140188+0000","last_undegraded":"2023-11-27T18:13:22.140188+0000","last_fullsized":"2023-11-27T18:13:22.140188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:51:02.615119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.231473+0000","last_change":"2023-11-27T18:13:20.920758+0000","last_active":"2023-11-27T18:13:23.231473+0000","last_peered":"2023-11-27T18:13:23.231473+0000","last_clean":"2023-11-27T18:13:23.231473+0000","last_became_active":"2023-11-27T18:13:20.920367+0000","last_became_peered":"2023-11-27T18:13:20.920367+0000","last_unstale":"2023-11-27T18:13:23.231473+0000","last_undegraded":"2023-11-27T18:13:23.231473+0000","last_fullsized":"2023-11-27T18:13:23.231473+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:51:50.506446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.070839+0000","last_change":"2023-11-27T18:13:15.849183+0000","last_active":"2023-11-27T18:13:22.070839+0000","last_peered":"2023-11-27T18:13:22.070839+0000","last_clean":"2023-11-27T18:13:22.070839+0000","last_became_active":"2023-11-27T18:13:15.848503+0000","last_became_peered":"2023-11-27T18:13:15.848503+0000","last_unstale":"2023-11-27T18:13:22.070839+0000","last_undegraded":"2023-11-27T18:13:22.070839+0000","last_fullsized":"2023-11-27T18:13:22.070839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:14:48.774302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.926420+0000","last_change":"2023-11-27T18:13:14.336349+0000","last_active":"2023-11-27T18:13:21.926420+0000","last_peered":"2023-11-27T18:13:21.926420+0000","last_clean":"2023-11-27T18:13:21.926420+0000","last_became_active":"2023-11-27T18:13:14.336072+0000","last_became_peered":"2023-11-27T18:13:14.336072+0000","last_unstale":"2023-11-27T18:13:21.926420+0000","last_undegraded":"2023-11-27T18:13:21.926420+0000","last_fullsized":"2023-11-27T18:13:21.926420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:54:58.777656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.142882+0000","last_change":"2023-11-27T18:13:14.421713+0000","last_active":"2023-11-27T18:13:22.142882+0000","last_peered":"2023-11-27T18:13:22.142882+0000","last_clean":"2023-11-27T18:13:22.142882+0000","last_became_active":"2023-11-27T18:13:14.418679+0000","last_became_peered":"2023-11-27T18:13:14.418679+0000","last_unstale":"2023-11-27T18:13:22.142882+0000","last_undegraded":"2023-11-27T18:13:22.142882+0000","last_fullsized":"2023-11-27T18:13:22.142882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:53:03.917430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.139686+0000","last_change":"2023-11-27T18:13:14.376601+0000","last_active":"2023-11-27T18:13:22.139686+0000","last_peered":"2023-11-27T18:13:22.139686+0000","last_clean":"2023-11-27T18:13:22.139686+0000","last_became_active":"2023-11-27T18:13:14.376292+0000","last_became_peered":"2023-11-27T18:13:14.376292+0000","last_unstale":"2023-11-27T18:13:22.139686+0000","last_undegraded":"2023-11-27T18:13:22.139686+0000","last_fullsized":"2023-11-27T18:13:22.139686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:52:30.225572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140984+0000","last_change":"2023-11-27T18:13:14.367285+0000","last_active":"2023-11-27T18:13:22.140984+0000","last_peered":"2023-11-27T18:13:22.140984+0000","last_clean":"2023-11-27T18:13:22.140984+0000","last_became_active":"2023-11-27T18:13:14.366983+0000","last_became_peered":"2023-11-27T18:13:14.366983+0000","last_unstale":"2023-11-27T18:13:22.140984+0000","last_undegraded":"2023-11-27T18:13:22.140984+0000","last_fullsized":"2023-11-27T18:13:22.140984+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:04:31.925421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.141444+0000","last_change":"2023-11-27T18:13:14.375744+0000","last_active":"2023-11-27T18:13:22.141444+0000","last_peered":"2023-11-27T18:13:22.141444+0000","last_clean":"2023-11-27T18:13:22.141444+0000","last_became_active":"2023-11-27T18:13:14.375466+0000","last_became_peered":"2023-11-27T18:13:14.375466+0000","last_unstale":"2023-11-27T18:13:22.141444+0000","last_undegraded":"2023-11-27T18:13:22.141444+0000","last_fullsized":"2023-11-27T18:13:22.141444+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:03:10.250350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.071591+0000","last_change":"2023-11-27T18:13:15.911021+0000","last_active":"2023-11-27T18:13:22.071591+0000","last_peered":"2023-11-27T18:13:22.071591+0000","last_clean":"2023-11-27T18:13:22.071591+0000","last_became_active":"2023-11-27T18:13:15.910418+0000","last_became_peered":"2023-11-27T18:13:15.910418+0000","last_unstale":"2023-11-27T18:13:22.071591+0000","last_undegraded":"2023-11-27T18:13:22.071591+0000","last_fullsized":"2023-11-27T18:13:22.071591+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:55:45.033833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.141861+0000","last_change":"2023-11-27T18:13:14.368483+0000","last_active":"2023-11-27T18:13:22.141861+0000","last_peered":"2023-11-27T18:13:22.141861+0000","last_clean":"2023-11-27T18:13:22.141861+0000","last_became_active":"2023-11-27T18:13:14.366249+0000","last_became_peered":"2023-11-27T18:13:14.366249+0000","last_unstale":"2023-11-27T18:13:22.141861+0000","last_undegraded":"2023-11-27T18:13:22.141861+0000","last_fullsized":"2023-11-27T18:13:22.141861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:52:43.071209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.142531+0000","last_change":"2023-11-27T18:13:14.415379+0000","last_active":"2023-11-27T18:13:22.142531+0000","last_peered":"2023-11-27T18:13:22.142531+0000","last_clean":"2023-11-27T18:13:22.142531+0000","last_became_active":"2023-11-27T18:13:14.414873+0000","last_became_peered":"2023-11-27T18:13:14.414873+0000","last_unstale":"2023-11-27T18:13:22.142531+0000","last_undegraded":"2023-11-27T18:13:22.142531+0000","last_fullsized":"2023-11-27T18:13:22.142531+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:40:12.521779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.138566+0000","last_change":"2023-11-27T18:13:14.416351+0000","last_active":"2023-11-27T18:13:22.138566+0000","last_peered":"2023-11-27T18:13:22.138566+0000","last_clean":"2023-11-27T18:13:22.138566+0000","last_became_active":"2023-11-27T18:13:14.416072+0000","last_became_peered":"2023-11-27T18:13:14.416072+0000","last_unstale":"2023-11-27T18:13:22.138566+0000","last_undegraded":"2023-11-27T18:13:22.138566+0000","last_fullsized":"2023-11-27T18:13:22.138566+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:31:11.712270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140105+0000","last_change":"2023-11-27T18:13:15.801534+0000","last_active":"2023-11-27T18:13:22.140105+0000","last_peered":"2023-11-27T18:13:22.140105+0000","last_clean":"2023-11-27T18:13:22.140105+0000","last_became_active":"2023-11-27T18:13:15.800699+0000","last_became_peered":"2023-11-27T18:13:15.800699+0000","last_unstale":"2023-11-27T18:13:22.140105+0000","last_undegraded":"2023-11-27T18:13:22.140105+0000","last_fullsized":"2023-11-27T18:13:22.140105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:39:39.512202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.974431+0000","last_change":"2023-11-27T18:13:14.413935+0000","last_active":"2023-11-27T18:13:21.974431+0000","last_peered":"2023-11-27T18:13:21.974431+0000","last_clean":"2023-11-27T18:13:21.974431+0000","last_became_active":"2023-11-27T18:13:14.413567+0000","last_became_peered":"2023-11-27T18:13:14.413567+0000","last_unstale":"2023-11-27T18:13:21.974431+0000","last_undegraded":"2023-11-27T18:13:21.974431+0000","last_fullsized":"2023-11-27T18:13:21.974431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:51:07.667299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140494+0000","last_change":"2023-11-27T18:13:14.363105+0000","last_active":"2023-11-27T18:13:22.140494+0000","last_peered":"2023-11-27T18:13:22.140494+0000","last_clean":"2023-11-27T18:13:22.140494+0000","last_became_active":"2023-11-27T18:13:14.362805+0000","last_became_peered":"2023-11-27T18:13:14.362805+0000","last_unstale":"2023-11-27T18:13:22.140494+0000","last_undegraded":"2023-11-27T18:13:22.140494+0000","last_fullsized":"2023-11-27T18:13:22.140494+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:19:02.523860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.143343+0000","last_change":"2023-11-27T18:13:14.416119+0000","last_active":"2023-11-27T18:13:22.143343+0000","last_peered":"2023-11-27T18:13:22.143343+0000","last_clean":"2023-11-27T18:13:22.143343+0000","last_became_active":"2023-11-27T18:13:14.415661+0000","last_became_peered":"2023-11-27T18:13:14.415661+0000","last_unstale":"2023-11-27T18:13:22.143343+0000","last_undegraded":"2023-11-27T18:13:22.143343+0000","last_fullsized":"2023-11-27T18:13:22.143343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:56:36.729814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.927866+0000","last_change":"2023-11-27T18:13:14.413859+0000","last_active":"2023-11-27T18:13:21.927866+0000","last_peered":"2023-11-27T18:13:21.927866+0000","last_clean":"2023-11-27T18:13:21.927866+0000","last_became_active":"2023-11-27T18:13:14.413542+0000","last_became_peered":"2023-11-27T18:13:14.413542+0000","last_unstale":"2023-11-27T18:13:21.927866+0000","last_undegraded":"2023-11-27T18:13:21.927866+0000","last_fullsized":"2023-11-27T18:13:21.927866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:24:16.125984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.145639+0000","last_change":"2023-11-27T18:13:14.417018+0000","last_active":"2023-11-27T18:13:22.145639+0000","last_peered":"2023-11-27T18:13:22.145639+0000","last_clean":"2023-11-27T18:13:22.145639+0000","last_became_active":"2023-11-27T18:13:14.416556+0000","last_became_peered":"2023-11-27T18:13:14.416556+0000","last_unstale":"2023-11-27T18:13:22.145639+0000","last_undegraded":"2023-11-27T18:13:22.145639+0000","last_fullsized":"2023-11-27T18:13:22.145639+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:03:59.054125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.142510+0000","last_change":"2023-11-27T18:13:14.419437+0000","last_active":"2023-11-27T18:13:22.142510+0000","last_peered":"2023-11-27T18:13:22.142510+0000","last_clean":"2023-11-27T18:13:22.142510+0000","last_became_active":"2023-11-27T18:13:14.418823+0000","last_became_peered":"2023-11-27T18:13:14.418823+0000","last_unstale":"2023-11-27T18:13:22.142510+0000","last_undegraded":"2023-11-27T18:13:22.142510+0000","last_fullsized":"2023-11-27T18:13:22.142510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:26:36.101388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.138403+0000","last_change":"2023-11-27T18:13:14.368373+0000","last_active":"2023-11-27T18:13:22.138403+0000","last_peered":"2023-11-27T18:13:22.138403+0000","last_clean":"2023-11-27T18:13:22.138403+0000","last_became_active":"2023-11-27T18:13:14.368100+0000","last_became_peered":"2023-11-27T18:13:14.368100+0000","last_unstale":"2023-11-27T18:13:22.138403+0000","last_undegraded":"2023-11-27T18:13:22.138403+0000","last_fullsized":"2023-11-27T18:13:22.138403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:27:05.736955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.139108+0000","last_change":"2023-11-27T18:13:14.376812+0000","last_active":"2023-11-27T18:13:22.139108+0000","last_peered":"2023-11-27T18:13:22.139108+0000","last_clean":"2023-11-27T18:13:22.139108+0000","last_became_active":"2023-11-27T18:13:14.376559+0000","last_became_peered":"2023-11-27T18:13:14.376559+0000","last_unstale":"2023-11-27T18:13:22.139108+0000","last_undegraded":"2023-11-27T18:13:22.139108+0000","last_fullsized":"2023-11-27T18:13:22.139108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:31:25.796567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140209+0000","last_change":"2023-11-27T18:13:14.367518+0000","last_active":"2023-11-27T18:13:22.140209+0000","last_peered":"2023-11-27T18:13:22.140209+0000","last_clean":"2023-11-27T18:13:22.140209+0000","last_became_active":"2023-11-27T18:13:14.367298+0000","last_became_peered":"2023-11-27T18:13:14.367298+0000","last_unstale":"2023-11-27T18:13:22.140209+0000","last_undegraded":"2023-11-27T18:13:22.140209+0000","last_fullsized":"2023-11-27T18:13:22.140209+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:48:00.722511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140440+0000","last_change":"2023-11-27T18:13:14.364130+0000","last_active":"2023-11-27T18:13:22.140440+0000","last_peered":"2023-11-27T18:13:22.140440+0000","last_clean":"2023-11-27T18:13:22.140440+0000","last_became_active":"2023-11-27T18:13:14.363776+0000","last_became_peered":"2023-11-27T18:13:14.363776+0000","last_unstale":"2023-11-27T18:13:22.140440+0000","last_undegraded":"2023-11-27T18:13:22.140440+0000","last_fullsized":"2023-11-27T18:13:22.140440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:14:10.603135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140667+0000","last_change":"2023-11-27T18:13:14.423459+0000","last_active":"2023-11-27T18:13:22.140667+0000","last_peered":"2023-11-27T18:13:22.140667+0000","last_clean":"2023-11-27T18:13:22.140667+0000","last_became_active":"2023-11-27T18:13:14.423099+0000","last_became_peered":"2023-11-27T18:13:14.423099+0000","last_unstale":"2023-11-27T18:13:22.140667+0000","last_undegraded":"2023-11-27T18:13:22.140667+0000","last_fullsized":"2023-11-27T18:13:22.140667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:39:33.850547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.142197+0000","last_change":"2023-11-27T18:13:14.420348+0000","last_active":"2023-11-27T18:13:22.142197+0000","last_peered":"2023-11-27T18:13:22.142197+0000","last_clean":"2023-11-27T18:13:22.142197+0000","last_became_active":"2023-11-27T18:13:14.419780+0000","last_became_peered":"2023-11-27T18:13:14.419780+0000","last_unstale":"2023-11-27T18:13:22.142197+0000","last_undegraded":"2023-11-27T18:13:22.142197+0000","last_fullsized":"2023-11-27T18:13:22.142197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:49:00.537995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.141371+0000","last_change":"2023-11-27T18:13:15.910347+0000","last_active":"2023-11-27T18:13:22.141371+0000","last_peered":"2023-11-27T18:13:22.141371+0000","last_clean":"2023-11-27T18:13:22.141371+0000","last_became_active":"2023-11-27T18:13:15.909918+0000","last_became_peered":"2023-11-27T18:13:15.909918+0000","last_unstale":"2023-11-27T18:13:22.141371+0000","last_undegraded":"2023-11-27T18:13:22.141371+0000","last_fullsized":"2023-11-27T18:13:22.141371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:14:48.774302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.138428+0000","last_change":"2023-11-27T18:13:14.369974+0000","last_active":"2023-11-27T18:13:22.138428+0000","last_peered":"2023-11-27T18:13:22.138428+0000","last_clean":"2023-11-27T18:13:22.138428+0000","last_became_active":"2023-11-27T18:13:14.369285+0000","last_became_peered":"2023-11-27T18:13:14.369285+0000","last_unstale":"2023-11-27T18:13:22.138428+0000","last_undegraded":"2023-11-27T18:13:22.138428+0000","last_fullsized":"2023-11-27T18:13:22.138428+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:23:56.484932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.141001+0000","last_change":"2023-11-27T18:13:14.385745+0000","last_active":"2023-11-27T18:13:22.141001+0000","last_peered":"2023-11-27T18:13:22.141001+0000","last_clean":"2023-11-27T18:13:22.141001+0000","last_became_active":"2023-11-27T18:13:14.385566+0000","last_became_peered":"2023-11-27T18:13:14.385566+0000","last_unstale":"2023-11-27T18:13:22.141001+0000","last_undegraded":"2023-11-27T18:13:22.141001+0000","last_fullsized":"2023-11-27T18:13:22.141001+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:52:43.071209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.071894+0000","last_change":"2023-11-27T18:13:15.848952+0000","last_active":"2023-11-27T18:13:22.071894+0000","last_peered":"2023-11-27T18:13:22.071894+0000","last_clean":"2023-11-27T18:13:22.071894+0000","last_became_active":"2023-11-27T18:13:15.848237+0000","last_became_peered":"2023-11-27T18:13:15.848237+0000","last_unstale":"2023-11-27T18:13:22.071894+0000","last_undegraded":"2023-11-27T18:13:22.071894+0000","last_fullsized":"2023-11-27T18:13:22.071894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:39:39.512202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140762+0000","last_change":"2023-11-27T18:13:14.373247+0000","last_active":"2023-11-27T18:13:22.140762+0000","last_peered":"2023-11-27T18:13:22.140762+0000","last_clean":"2023-11-27T18:13:22.140762+0000","last_became_active":"2023-11-27T18:13:14.372974+0000","last_became_peered":"2023-11-27T18:13:14.372974+0000","last_unstale":"2023-11-27T18:13:22.140762+0000","last_undegraded":"2023-11-27T18:13:22.140762+0000","last_fullsized":"2023-11-27T18:13:22.140762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:39:34.589545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.071176+0000","last_change":"2023-11-27T18:13:15.851685+0000","last_active":"2023-11-27T18:13:22.071176+0000","last_peered":"2023-11-27T18:13:22.071176+0000","last_clean":"2023-11-27T18:13:22.071176+0000","last_became_active":"2023-11-27T18:13:15.850353+0000","last_became_peered":"2023-11-27T18:13:15.850353+0000","last_unstale":"2023-11-27T18:13:22.071176+0000","last_undegraded":"2023-11-27T18:13:22.071176+0000","last_fullsized":"2023-11-27T18:13:22.071176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:51:02.615119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140426+0000","last_change":"2023-11-27T18:13:14.381126+0000","last_active":"2023-11-27T18:13:22.140426+0000","last_peered":"2023-11-27T18:13:22.140426+0000","last_clean":"2023-11-27T18:13:22.140426+0000","last_became_active":"2023-11-27T18:13:14.380714+0000","last_became_peered":"2023-11-27T18:13:14.380714+0000","last_unstale":"2023-11-27T18:13:22.140426+0000","last_undegraded":"2023-11-27T18:13:22.140426+0000","last_fullsized":"2023-11-27T18:13:22.140426+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:14:10.603135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.141208+0000","last_change":"2023-11-27T18:13:14.368254+0000","last_active":"2023-11-27T18:13:22.141208+0000","last_peered":"2023-11-27T18:13:22.141208+0000","last_clean":"2023-11-27T18:13:22.141208+0000","last_became_active":"2023-11-27T18:13:14.367978+0000","last_became_peered":"2023-11-27T18:13:14.367978+0000","last_unstale":"2023-11-27T18:13:22.141208+0000","last_undegraded":"2023-11-27T18:13:22.141208+0000","last_fullsized":"2023-11-27T18:13:22.141208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:05:05.751108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140257+0000","last_change":"2023-11-27T18:13:14.419332+0000","last_active":"2023-11-27T18:13:22.140257+0000","last_peered":"2023-11-27T18:13:22.140257+0000","last_clean":"2023-11-27T18:13:22.140257+0000","last_became_active":"2023-11-27T18:13:14.418928+0000","last_became_peered":"2023-11-27T18:13:14.418928+0000","last_unstale":"2023-11-27T18:13:22.140257+0000","last_undegraded":"2023-11-27T18:13:22.140257+0000","last_fullsized":"2023-11-27T18:13:22.140257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:34:08.186176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67010,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719476755,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31560,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340280,"statfs":{"total":96636764160,"available":96604446720,"internally_reserved":0,"allocated":385024,"data_stored":714358,"data_compressed":33505,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":17.553999999999998,"5min":17.553999999999998,"15min":17.553999999999998},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":1.2090000000000001}]},{"osd":1,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":5.4550000000000001,"5min":5.4550000000000001,"15min":5.4550000000000001},"last":1.526},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":5.3040000000000003,"5min":5.3040000000000003,"15min":5.3040000000000003},"last":0.86899999999999999}]},{"osd":2,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":7.8540000000000001,"5min":7.8540000000000001,"15min":7.8540000000000001},"last":1.159}]},{"osd":3,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":1.3300000000000001}]},{"osd":4,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":7.7759999999999998,"5min":7.7759999999999998,"15min":7.7759999999999998},"last":1.2789999999999999},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":1.1259999999999999}]},{"osd":6,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":7.8200000000000003,"5min":7.8200000000000003,"15min":7.8200000000000003},"last":1.3859999999999999}]},{"osd":7,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.3290000000000002,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.2690000000000001,"5min":2.2690000000000001,"15min":2.2690000000000001},"last":1.421}]}]},{"osd":7,"up_from":16,"seq":68719476755,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":323584,"data_stored":124841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":2.0600000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.83399999999999996}]},{"osd":1,"last update":"Mon Nov 27 18:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":2.1890000000000001,"5min":2.1890000000000001,"15min":2.1890000000000001},"last":0.75},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.6190000000000002,"5min":2.6190000000000002,"15min":2.6190000000000002},"last":1.278}]},{"osd":2,"last update":"Mon Nov 27 18:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.5649999999999999,"5min":2.5649999999999999,"15min":2.5649999999999999},"last":1.54},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.97199999999999998}]},{"osd":3,"last update":"Mon Nov 27 18:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":1.087},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":4.391,"5min":4.391,"15min":4.391},"last":1.391}]},{"osd":4,"last update":"Mon Nov 27 18:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.484,"5min":2.484,"15min":2.484},"last":1.0149999999999999}]},{"osd":5,"last update":"Mon Nov 27 18:13:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":4.8440000000000003,"5min":4.8440000000000003,"15min":4.8440000000000003},"last":1.468},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":1.1220000000000001}]},{"osd":6,"last update":"Mon Nov 27 18:13:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":2.258,"5min":2.258,"15min":2.258},"last":1.2310000000000001}]}]},{"osd":6,"up_from":16,"seq":68719476755,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":315392,"data_stored":124717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":1.1499999999999999},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.2}]},{"osd":1,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":1.0289999999999999}]},{"osd":2,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":1.093},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.95599999999999996}]},{"osd":3,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":1.2330000000000001}]},{"osd":4,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":1.343}]},{"osd":5,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":1.3140000000000001},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.278}]},{"osd":7,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":2.1779999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.256},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":1.365}]}]},{"osd":3,"up_from":16,"seq":68719476753,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":319488,"data_stored":125299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.624}]},{"osd":1,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.67200000000000004}]},{"osd":2,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.76600000000000001}]},{"osd":4,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":1.0369999999999999}]},{"osd":5,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.81699999999999995}]},{"osd":6,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":1.101}]},{"osd":7,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.008},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":1.073}]}]},{"osd":2,"up_from":16,"seq":68719476754,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":128559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.8680000000000001,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":0.70499999999999996}]},{"osd":1,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.91600000000000004}]},{"osd":3,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.78400000000000003}]},{"osd":4,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.6160000000000001,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":1.014},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":1.2969999999999999}]},{"osd":5,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":1.3560000000000001},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.89100000000000001}]},{"osd":6,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.155}]},{"osd":7,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.399},{"interface":"front","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.98699999999999999}]}]},{"osd":1,"up_from":16,"seq":68719476754,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":385024,"data_stored":715155,"data_compressed":33505,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:13:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.623},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":0.90500000000000003}]},{"osd":2,"last update":"Mon Nov 27 18:13:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.72399999999999998}]},{"osd":3,"last update":"Mon Nov 27 18:13:38 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":1.0960000000000001}]},{"osd":4,"last update":"Mon Nov 27 18:13:38 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":1.0640000000000001},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":1.04}]},{"osd":5,"last update":"Mon Nov 27 18:13:38 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":1.1870000000000001},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.01}]},{"osd":6,"last update":"Mon Nov 27 18:13:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":1.3380000000000001}]},{"osd":7,"last update":"Mon Nov 27 18:13:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.8149999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":1.2629999999999999},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":1.141}]}]},{"osd":0,"up_from":16,"seq":68719476755,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":124773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.61399999999999999}]},{"osd":2,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.90100000000000002}]},{"osd":3,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.71899999999999997}]},{"osd":4,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":1.032},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.98799999999999999}]},{"osd":5,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":1.1759999999999999},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.96399999999999997}]},{"osd":6,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":1.117}]},{"osd":7,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.351,"5min":1.351,"15min":1.351},"last":1.0920000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509459,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31504,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340336,"statfs":{"total":96636764160,"available":96604504064,"internally_reserved":0,"allocated":335872,"data_stored":129231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.498},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.68799999999999994}]},{"osd":1,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.64600000000000002}]},{"osd":2,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.80700000000000005}]},{"osd":3,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.98699999999999999}]},{"osd":5,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.0629999999999999}]},{"osd":6,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.95799999999999996}]},{"osd":7,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":1.014},{"interface":"front","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":1.0349999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33505,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33505,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T18:13:58.046 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T18:13:58.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.209+0000 7f8502c87640 1 Processor -- start 2023-11-27T18:13:58.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.209+0000 7f8502c87640 1 -- start start 2023-11-27T18:13:58.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.213+0000 7f8502c87640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f84fc0c89c0 0x7f84fc0c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:58.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.213+0000 7f8502c87640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f84fc15d380 0x7f84fc163fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:58.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.213+0000 7f8502c87640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84fc06dfe0 con 0x7f84fc06eed0 2023-11-27T18:13:58.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.213+0000 7f8502c87640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84fc0c2680 con 0x7f84fc15d380 2023-11-27T18:13:58.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.213+0000 7f8502c87640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84fc06fef0 con 0x7f84fc0c89c0 2023-11-27T18:13:58.209 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.213+0000 7f84fbfff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f84fc06eed0 0x7f84fc15cc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:34082/0 (socket says 172.21.15.91:34082) 2023-11-27T18:13:58.209 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.213+0000 7f84fbfff640 1 -- 172.21.15.91:0/665392821 learned_addr learned my addr 172.21.15.91:0/665392821 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:13:58.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.217+0000 7f84fb7fe640 1 -- 172.21.15.91:0/665392821 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2334566333 0 0) 0x7f84fc06dfe0 con 0x7f84fc06eed0 2023-11-27T18:13:58.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.217+0000 7f84fb7fe640 1 -- 172.21.15.91:0/665392821 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84e4003530 con 0x7f84fc06eed0 2023-11-27T18:13:58.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.221+0000 7f84fb7fe640 1 -- 172.21.15.91:0/665392821 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 68961014 0 0) 0x7f84e4003530 con 0x7f84fc06eed0 2023-11-27T18:13:58.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.221+0000 7f84fb7fe640 1 -- 172.21.15.91:0/665392821 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f84fc0c89c0 msgr2=0x7f84fc0c8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:58.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.221+0000 7f84fb7fe640 1 --2- 172.21.15.91:0/665392821 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f84fc0c89c0 0x7f84fc0c8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:58.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.221+0000 7f84fb7fe640 1 -- 172.21.15.91:0/665392821 >> v2:172.21.15.94:3300/0 conn(0x7f84fc15d380 msgr2=0x7f84fc163fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:58.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.221+0000 7f84fb7fe640 1 --2- 172.21.15.91:0/665392821 >> v2:172.21.15.94:3300/0 conn(0x7f84fc15d380 0x7f84fc163fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:58.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.221+0000 7f84fb7fe640 1 -- 172.21.15.91:0/665392821 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84fc0c23a0 con 0x7f84fc06eed0 2023-11-27T18:13:58.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.221+0000 7f84fb7fe640 1 -- 172.21.15.91:0/665392821 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3378743932 0 0) 0x7f84f0001680 con 0x7f84fc06eed0 2023-11-27T18:13:58.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.221+0000 7f84fb7fe640 1 -- 172.21.15.91:0/665392821 >> v1:172.21.15.91:6789/0 conn(0x7f84fc06eed0 legacy=0x7f84fc15cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:58.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.221+0000 7f84fb7fe640 1 --2- 172.21.15.91:0/665392821 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84e4003980 0x7f84e4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:58.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.221+0000 7f84fb7fe640 1 --2- 172.21.15.91:0/665392821 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f84fc0c89c0 0x7f84e40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:58.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.221+0000 7f84fb7fe640 1 --2- 172.21.15.91:0/665392821 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f84e4004e30 0x7f84e400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:58.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.221+0000 7f84fb7fe640 1 -- 172.21.15.91:0/665392821 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84fc0c2680 con 0x7f84e4004e30 2023-11-27T18:13:58.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.221+0000 7f84fb7fe640 1 -- 172.21.15.91:0/665392821 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84fc06fef0 con 0x7f84e4003980 2023-11-27T18:13:58.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.221+0000 7f84fb7fe640 1 -- 172.21.15.91:0/665392821 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e40055f0 con 0x7f84fc0c89c0 2023-11-27T18:13:58.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.221+0000 7f8501224640 1 --2- 172.21.15.91:0/665392821 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f84e4004e30 0x7f84e400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:58.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.225+0000 7f8501224640 1 -- 172.21.15.91:0/665392821 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f84fc0c89c0 msgr2=0x7f84e40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:58.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.225+0000 7f8501224640 1 --2- 172.21.15.91:0/665392821 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f84fc0c89c0 0x7f84e40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:58.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.225+0000 7f8501224640 1 -- 172.21.15.91:0/665392821 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84e4003980 msgr2=0x7f84e4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:58.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.225+0000 7f8501224640 1 --2- 172.21.15.91:0/665392821 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84e4003980 0x7f84e4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:58.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.225+0000 7f8501224640 1 -- 172.21.15.91:0/665392821 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e4003530 con 0x7f84e4004e30 2023-11-27T18:13:58.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.229+0000 7f8501224640 1 --2- 172.21.15.91:0/665392821 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f84e4004e30 0x7f84e400b990 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f84f4009ca0 tx=0x7f84f401cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdf0903ba15b876e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:58.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.233+0000 7f84fb7fe640 1 -- 172.21.15.91:0/665392821 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f40a5c60 con 0x7f84e4004e30 2023-11-27T18:13:58.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.233+0000 7f84fb7fe640 1 -- 172.21.15.91:0/665392821 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f40a5de0 con 0x7f84e4004e30 2023-11-27T18:13:58.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.233+0000 7f84fb7fe640 1 -- 172.21.15.91:0/665392821 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f40ad680 con 0x7f84e4004e30 2023-11-27T18:13:58.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.233+0000 7f8502c87640 1 -- 172.21.15.91:0/665392821 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f84e4004e30 msgr2=0x7f84e400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:58.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.233+0000 7f8502c87640 1 --2- 172.21.15.91:0/665392821 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f84e4004e30 0x7f84e400b990 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f84f4009ca0 tx=0x7f84f401cc50 comp rx=0 tx=0).stop 2023-11-27T18:13:58.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.233+0000 7f8501224640 1 -- 172.21.15.91:0/665392821 reap_dead start 2023-11-27T18:13:58.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.233+0000 7f8502c87640 1 -- 172.21.15.91:0/665392821 shutdown_connections 2023-11-27T18:13:58.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.233+0000 7f8502c87640 1 -- 172.21.15.91:0/665392821 >> 172.21.15.91:0/665392821 conn(0x7f84fc0723b0 msgr2=0x7f84fc06b630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:58.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.233+0000 7f8502c87640 1 -- 172.21.15.91:0/665392821 shutdown_connections 2023-11-27T18:13:58.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.237+0000 7f8502c87640 1 -- 172.21.15.91:0/665392821 wait complete. 2023-11-27T18:13:58.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.237+0000 7f8502c87640 1 Processor -- start 2023-11-27T18:13:58.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.237+0000 7f8502c87640 1 -- start start 2023-11-27T18:13:58.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.237+0000 7f8502c87640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f84e4004e30 0x7f84fc14f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:58.234 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.237+0000 7f8502c87640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f84fc1e2de0 0x7f84fc1e3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:58.234 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.237+0000 7f8502c87640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84fc1595a0 0x7f84fc1573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:58.234 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.237+0000 7f8502c87640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84fc150380 con 0x7f84e4004e30 2023-11-27T18:13:58.234 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.237+0000 7f8502c87640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84fc14fec0 con 0x7f84fc1595a0 2023-11-27T18:13:58.234 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.237+0000 7f8502c87640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84fc1f3730 con 0x7f84fc1e2de0 2023-11-27T18:13:58.234 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.237+0000 7f8500a23640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f84e4004e30 0x7f84fc14f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:58.234 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.237+0000 7f8500a23640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f84e4004e30 0x7f84fc14f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44610/0 (socket says 172.21.15.91:44610) 2023-11-27T18:13:58.235 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.237+0000 7f8500a23640 1 -- 172.21.15.91:0/2453203187 learned_addr learned my addr 172.21.15.91:0/2453203187 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:58.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.241+0000 7f8500a23640 1 -- 172.21.15.91:0/2453203187 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f84fc1e2de0 msgr2=0x7f84fc1e3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:58.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.241+0000 7f8500a23640 1 --2- 172.21.15.91:0/2453203187 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f84fc1e2de0 0x7f84fc1e3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:58.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.241+0000 7f8500a23640 1 -- 172.21.15.91:0/2453203187 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84fc1595a0 msgr2=0x7f84fc1573d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:58.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.241+0000 7f8500a23640 1 --2- 172.21.15.91:0/2453203187 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84fc1595a0 0x7f84fc1573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:58.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.241+0000 7f8500a23640 1 -- 172.21.15.91:0/2453203187 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84fc157240 con 0x7f84e4004e30 2023-11-27T18:13:58.241 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.245+0000 7f8500a23640 1 --2- 172.21.15.91:0/2453203187 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f84e4004e30 0x7f84fc14f980 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f84ec00b450 tx=0x7f84ec00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:58.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.249+0000 7f84f97fa640 1 -- 172.21.15.91:0/2453203187 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ec011830 con 0x7f84e4004e30 2023-11-27T18:13:58.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.249+0000 7f84f97fa640 1 -- 172.21.15.91:0/2453203187 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84ec011990 con 0x7f84e4004e30 2023-11-27T18:13:58.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.249+0000 7f84f97fa640 1 -- 172.21.15.91:0/2453203187 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ec011d80 con 0x7f84e4004e30 2023-11-27T18:13:58.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.249+0000 7f8502c87640 1 -- 172.21.15.91:0/2453203187 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84fc1500c0 con 0x7f84e4004e30 2023-11-27T18:13:58.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.249+0000 7f8502c87640 1 -- 172.21.15.91:0/2453203187 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84fc1f30e0 con 0x7f84e4004e30 2023-11-27T18:13:58.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.249+0000 7f8502c87640 1 -- 172.21.15.91:0/2453203187 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84fc04e930 con 0x7f84e4004e30 2023-11-27T18:13:58.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.525+0000 7f84f97fa640 1 -- 172.21.15.91:0/2453203187 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f84ec01a400 con 0x7f84e4004e30 2023-11-27T18:13:58.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.525+0000 7f84f97fa640 1 --2- 172.21.15.91:0/2453203187 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f84e8066840 0x7f84e8068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:58.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.525+0000 7f84fbfff640 1 --2- 172.21.15.91:0/2453203187 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f84e8066840 0x7f84e8068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:58.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.529+0000 7f84fbfff640 1 --2- 172.21.15.91:0/2453203187 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f84e8066840 0x7f84e8068d00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f84fc158700 tx=0x7f84f00015d0 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:58.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.569+0000 7f84f97fa640 1 -- 172.21.15.91:0/2453203187 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f84ec00f2e0 con 0x7f84e4004e30 2023-11-27T18:13:58.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.569+0000 7f84f97fa640 1 -- 172.21.15.91:0/2453203187 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f84ec051b10 con 0x7f84e4004e30 2023-11-27T18:13:58.735 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.737+0000 7f8502c87640 1 -- 172.21.15.91:0/2453203187 --> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f84fc0c3680 con 0x7f84e8066840 2023-11-27T18:13:58.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.753+0000 7f84f97fa640 1 -- 172.21.15.91:0/2453203187 <== mgr.4136 v2:172.21.15.91:6800/2814827118 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368493 (secure 0 0 0) 0x7f84fc0c3680 con 0x7f84e8066840 2023-11-27T18:13:58.755 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:13:58.758 INFO:teuthology.orchestra.run.smithi091.stderr:dumped all 2023-11-27T18:13:58.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.757+0000 7f8502c87640 1 -- 172.21.15.91:0/2453203187 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f84e8066840 msgr2=0x7f84e8068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:58.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.757+0000 7f8502c87640 1 --2- 172.21.15.91:0/2453203187 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f84e8066840 0x7f84e8068d00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f84fc158700 tx=0x7f84f00015d0 comp rx=0 tx=0).stop 2023-11-27T18:13:58.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.757+0000 7f8502c87640 1 -- 172.21.15.91:0/2453203187 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f84e4004e30 msgr2=0x7f84fc14f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:58.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.757+0000 7f8502c87640 1 --2- 172.21.15.91:0/2453203187 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f84e4004e30 0x7f84fc14f980 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f84ec00b450 tx=0x7f84ec00b910 comp rx=0 tx=0).stop 2023-11-27T18:13:58.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.757+0000 7f8502c87640 1 -- 172.21.15.91:0/2453203187 shutdown_connections 2023-11-27T18:13:58.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.757+0000 7f8502c87640 1 --2- 172.21.15.91:0/2453203187 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f84e8066840 0x7f84e8068d00 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:58.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.757+0000 7f8502c87640 1 --2- 172.21.15.91:0/2453203187 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f84fc1e2de0 0x7f84fc1e3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:58.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.757+0000 7f8502c87640 1 --2- 172.21.15.91:0/2453203187 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84fc1595a0 0x7f84fc1573d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:58.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.757+0000 7f8502c87640 1 --2- 172.21.15.91:0/2453203187 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f84e4004e30 0x7f84fc14f980 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:58.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.757+0000 7f8502c87640 1 -- 172.21.15.91:0/2453203187 >> 172.21.15.91:0/2453203187 conn(0x7f84fc0723b0 msgr2=0x7f84fc1549b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:58.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.757+0000 7f8502c87640 1 -- 172.21.15.91:0/2453203187 shutdown_connections 2023-11-27T18:13:58.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.757+0000 7f8502c87640 1 -- 172.21.15.91:0/2453203187 wait complete. 2023-11-27T18:13:58.774 INFO:teuthology.orchestra.run.smithi091.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2023-11-27T18:13:57.109040+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235452,"kb_used_data":2652,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739268,"statfs":{"total":773094113280,"available":772853010432,"internally_reserved":0,"allocated":2715648,"data_stored":2186933,"data_compressed":67010,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005292"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.975533+0000","last_change":"2023-11-27T18:13:12.298503+0000","last_active":"2023-11-27T18:13:21.975533+0000","last_peered":"2023-11-27T18:13:21.975533+0000","last_clean":"2023-11-27T18:13:21.975533+0000","last_became_active":"2023-11-27T18:13:12.298140+0000","last_became_peered":"2023-11-27T18:13:12.298140+0000","last_unstale":"2023-11-27T18:13:21.975533+0000","last_undegraded":"2023-11-27T18:13:21.975533+0000","last_fullsized":"2023-11-27T18:13:21.975533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:04:02.661989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.141448+0000","last_change":"2023-11-27T18:13:14.416681+0000","last_active":"2023-11-27T18:13:22.141448+0000","last_peered":"2023-11-27T18:13:22.141448+0000","last_clean":"2023-11-27T18:13:22.141448+0000","last_became_active":"2023-11-27T18:13:14.416401+0000","last_became_peered":"2023-11-27T18:13:14.416401+0000","last_unstale":"2023-11-27T18:13:22.141448+0000","last_undegraded":"2023-11-27T18:13:22.141448+0000","last_fullsized":"2023-11-27T18:13:22.141448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:02:14.142363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.231066+0000","last_change":"2023-11-27T18:13:20.916435+0000","last_active":"2023-11-27T18:13:23.231066+0000","last_peered":"2023-11-27T18:13:23.231066+0000","last_clean":"2023-11-27T18:13:23.231066+0000","last_became_active":"2023-11-27T18:13:20.915358+0000","last_became_peered":"2023-11-27T18:13:20.915358+0000","last_unstale":"2023-11-27T18:13:23.231066+0000","last_undegraded":"2023-11-27T18:13:23.231066+0000","last_fullsized":"2023-11-27T18:13:23.231066+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:55:46.903556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.141645+0000","last_change":"2023-11-27T18:13:12.305296+0000","last_active":"2023-11-27T18:13:22.141645+0000","last_peered":"2023-11-27T18:13:22.141645+0000","last_clean":"2023-11-27T18:13:22.141645+0000","last_became_active":"2023-11-27T18:13:12.304981+0000","last_became_peered":"2023-11-27T18:13:12.304981+0000","last_unstale":"2023-11-27T18:13:22.141645+0000","last_undegraded":"2023-11-27T18:13:22.141645+0000","last_fullsized":"2023-11-27T18:13:22.141645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:04:30.721243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.142078+0000","last_change":"2023-11-27T18:13:14.366102+0000","last_active":"2023-11-27T18:13:22.142078+0000","last_peered":"2023-11-27T18:13:22.142078+0000","last_clean":"2023-11-27T18:13:22.142078+0000","last_became_active":"2023-11-27T18:13:14.365787+0000","last_became_peered":"2023-11-27T18:13:14.365787+0000","last_unstale":"2023-11-27T18:13:22.142078+0000","last_undegraded":"2023-11-27T18:13:22.142078+0000","last_fullsized":"2023-11-27T18:13:22.142078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:39:34.589545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.674201+0000","last_change":"2023-11-27T18:13:20.915811+0000","last_active":"2023-11-27T18:13:23.674201+0000","last_peered":"2023-11-27T18:13:23.674201+0000","last_clean":"2023-11-27T18:13:23.674201+0000","last_became_active":"2023-11-27T18:13:20.914864+0000","last_became_peered":"2023-11-27T18:13:20.914864+0000","last_unstale":"2023-11-27T18:13:23.674201+0000","last_undegraded":"2023-11-27T18:13:23.674201+0000","last_fullsized":"2023-11-27T18:13:23.674201+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:22:21.572863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140911+0000","last_change":"2023-11-27T18:13:12.272691+0000","last_active":"2023-11-27T18:13:22.140911+0000","last_peered":"2023-11-27T18:13:22.140911+0000","last_clean":"2023-11-27T18:13:22.140911+0000","last_became_active":"2023-11-27T18:13:12.272343+0000","last_became_peered":"2023-11-27T18:13:12.272343+0000","last_unstale":"2023-11-27T18:13:22.140911+0000","last_undegraded":"2023-11-27T18:13:22.140911+0000","last_fullsized":"2023-11-27T18:13:22.140911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:23:55.280753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140650+0000","last_change":"2023-11-27T18:13:15.804199+0000","last_active":"2023-11-27T18:13:22.140650+0000","last_peered":"2023-11-27T18:13:22.140650+0000","last_clean":"2023-11-27T18:13:22.140650+0000","last_became_active":"2023-11-27T18:13:15.803248+0000","last_became_peered":"2023-11-27T18:13:15.803248+0000","last_unstale":"2023-11-27T18:13:22.140650+0000","last_undegraded":"2023-11-27T18:13:22.140650+0000","last_fullsized":"2023-11-27T18:13:22.140650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:39:31.246554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.675082+0000","last_change":"2023-11-27T18:13:20.909371+0000","last_active":"2023-11-27T18:13:23.675082+0000","last_peered":"2023-11-27T18:13:23.675082+0000","last_clean":"2023-11-27T18:13:23.675082+0000","last_became_active":"2023-11-27T18:13:20.908285+0000","last_became_peered":"2023-11-27T18:13:20.908285+0000","last_unstale":"2023-11-27T18:13:23.675082+0000","last_undegraded":"2023-11-27T18:13:23.675082+0000","last_fullsized":"2023-11-27T18:13:23.675082+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:40:20.210205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140612+0000","last_change":"2023-11-27T18:13:12.274531+0000","last_active":"2023-11-27T18:13:22.140612+0000","last_peered":"2023-11-27T18:13:22.140612+0000","last_clean":"2023-11-27T18:13:22.140612+0000","last_became_active":"2023-11-27T18:13:12.274275+0000","last_became_peered":"2023-11-27T18:13:12.274275+0000","last_unstale":"2023-11-27T18:13:22.140612+0000","last_undegraded":"2023-11-27T18:13:22.140612+0000","last_fullsized":"2023-11-27T18:13:22.140612+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:02:12.938184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.143037+0000","last_change":"2023-11-27T18:13:14.422531+0000","last_active":"2023-11-27T18:13:22.143037+0000","last_peered":"2023-11-27T18:13:22.143037+0000","last_clean":"2023-11-27T18:13:22.143037+0000","last_became_active":"2023-11-27T18:13:14.421811+0000","last_became_peered":"2023-11-27T18:13:14.421811+0000","last_unstale":"2023-11-27T18:13:22.143037+0000","last_undegraded":"2023-11-27T18:13:22.143037+0000","last_fullsized":"2023-11-27T18:13:22.143037+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:17:17.491694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.675351+0000","last_change":"2023-11-27T18:13:20.907358+0000","last_active":"2023-11-27T18:13:23.675351+0000","last_peered":"2023-11-27T18:13:23.675351+0000","last_clean":"2023-11-27T18:13:23.675351+0000","last_became_active":"2023-11-27T18:13:20.906418+0000","last_became_peered":"2023-11-27T18:13:20.906418+0000","last_unstale":"2023-11-27T18:13:23.675351+0000","last_undegraded":"2023-11-27T18:13:23.675351+0000","last_fullsized":"2023-11-27T18:13:23.675351+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:26:43.789814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.143078+0000","last_change":"2023-11-27T18:13:14.421453+0000","last_active":"2023-11-27T18:13:22.143078+0000","last_peered":"2023-11-27T18:13:22.143078+0000","last_clean":"2023-11-27T18:13:22.143078+0000","last_became_active":"2023-11-27T18:13:14.418640+0000","last_became_peered":"2023-11-27T18:13:14.418640+0000","last_unstale":"2023-11-27T18:13:22.143078+0000","last_undegraded":"2023-11-27T18:13:22.143078+0000","last_fullsized":"2023-11-27T18:13:22.143078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:38:18.655528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.142971+0000","last_change":"2023-11-27T18:13:12.306690+0000","last_active":"2023-11-27T18:13:22.142971+0000","last_peered":"2023-11-27T18:13:22.142971+0000","last_clean":"2023-11-27T18:13:22.142971+0000","last_became_active":"2023-11-27T18:13:12.306331+0000","last_became_peered":"2023-11-27T18:13:12.306331+0000","last_unstale":"2023-11-27T18:13:22.142971+0000","last_undegraded":"2023-11-27T18:13:22.142971+0000","last_fullsized":"2023-11-27T18:13:22.142971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:39:32.646368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.321605+0000","last_change":"2023-11-27T18:13:20.929179+0000","last_active":"2023-11-27T18:13:23.321605+0000","last_peered":"2023-11-27T18:13:23.321605+0000","last_clean":"2023-11-27T18:13:23.321605+0000","last_became_active":"2023-11-27T18:13:20.927962+0000","last_became_peered":"2023-11-27T18:13:20.927962+0000","last_unstale":"2023-11-27T18:13:23.321605+0000","last_undegraded":"2023-11-27T18:13:23.321605+0000","last_fullsized":"2023-11-27T18:13:23.321605+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:05:49.936547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.927324+0000","last_change":"2023-11-27T18:13:14.368428+0000","last_active":"2023-11-27T18:13:21.927324+0000","last_peered":"2023-11-27T18:13:21.927324+0000","last_clean":"2023-11-27T18:13:21.927324+0000","last_became_active":"2023-11-27T18:13:14.368117+0000","last_became_peered":"2023-11-27T18:13:14.368117+0000","last_unstale":"2023-11-27T18:13:21.927324+0000","last_undegraded":"2023-11-27T18:13:21.927324+0000","last_fullsized":"2023-11-27T18:13:21.927324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:24:45.528760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.139380+0000","last_change":"2023-11-27T18:13:12.306963+0000","last_active":"2023-11-27T18:13:22.139380+0000","last_peered":"2023-11-27T18:13:22.139380+0000","last_clean":"2023-11-27T18:13:22.139380+0000","last_became_active":"2023-11-27T18:13:12.306644+0000","last_became_peered":"2023-11-27T18:13:12.306644+0000","last_unstale":"2023-11-27T18:13:22.139380+0000","last_undegraded":"2023-11-27T18:13:22.139380+0000","last_fullsized":"2023-11-27T18:13:22.139380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:55:43.829654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:24.442496+0000","last_change":"2023-11-27T18:13:20.930173+0000","last_active":"2023-11-27T18:13:24.442496+0000","last_peered":"2023-11-27T18:13:24.442496+0000","last_clean":"2023-11-27T18:13:24.442496+0000","last_became_active":"2023-11-27T18:13:20.928830+0000","last_became_peered":"2023-11-27T18:13:20.928830+0000","last_unstale":"2023-11-27T18:13:24.442496+0000","last_undegraded":"2023-11-27T18:13:24.442496+0000","last_fullsized":"2023-11-27T18:13:24.442496+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:38:26.343953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.974087+0000","last_change":"2023-11-27T18:13:14.378647+0000","last_active":"2023-11-27T18:13:21.974087+0000","last_peered":"2023-11-27T18:13:21.974087+0000","last_clean":"2023-11-27T18:13:21.974087+0000","last_became_active":"2023-11-27T18:13:14.378391+0000","last_became_peered":"2023-11-27T18:13:14.378391+0000","last_unstale":"2023-11-27T18:13:21.974087+0000","last_undegraded":"2023-11-27T18:13:21.974087+0000","last_fullsized":"2023-11-27T18:13:21.974087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:02:22.189845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.975536+0000","last_change":"2023-11-27T18:13:12.270283+0000","last_active":"2023-11-27T18:13:21.975536+0000","last_peered":"2023-11-27T18:13:21.975536+0000","last_clean":"2023-11-27T18:13:21.975536+0000","last_became_active":"2023-11-27T18:13:12.269795+0000","last_became_peered":"2023-11-27T18:13:12.269795+0000","last_unstale":"2023-11-27T18:13:21.975536+0000","last_undegraded":"2023-11-27T18:13:21.975536+0000","last_fullsized":"2023-11-27T18:13:21.975536+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:06:24.103678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.231936+0000","last_change":"2023-11-27T18:13:20.907340+0000","last_active":"2023-11-27T18:13:23.231936+0000","last_peered":"2023-11-27T18:13:23.231936+0000","last_clean":"2023-11-27T18:13:23.231936+0000","last_became_active":"2023-11-27T18:13:20.906609+0000","last_became_peered":"2023-11-27T18:13:20.906609+0000","last_unstale":"2023-11-27T18:13:23.231936+0000","last_undegraded":"2023-11-27T18:13:23.231936+0000","last_fullsized":"2023-11-27T18:13:23.231936+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:19:00.295457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.142648+0000","last_change":"2023-11-27T18:13:14.415177+0000","last_active":"2023-11-27T18:13:22.142648+0000","last_peered":"2023-11-27T18:13:22.142648+0000","last_clean":"2023-11-27T18:13:22.142648+0000","last_became_active":"2023-11-27T18:13:14.414888+0000","last_became_peered":"2023-11-27T18:13:14.414888+0000","last_unstale":"2023-11-27T18:13:22.142648+0000","last_undegraded":"2023-11-27T18:13:22.142648+0000","last_fullsized":"2023-11-27T18:13:22.142648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:41:49.599901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.139916+0000","last_change":"2023-11-27T18:13:12.273724+0000","last_active":"2023-11-27T18:13:22.139916+0000","last_peered":"2023-11-27T18:13:22.139916+0000","last_clean":"2023-11-27T18:13:22.139916+0000","last_became_active":"2023-11-27T18:13:12.273356+0000","last_became_peered":"2023-11-27T18:13:12.273356+0000","last_unstale":"2023-11-27T18:13:22.139916+0000","last_undegraded":"2023-11-27T18:13:22.139916+0000","last_fullsized":"2023-11-27T18:13:22.139916+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:15:14.235633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.675747+0000","last_change":"2023-11-27T18:13:20.935910+0000","last_active":"2023-11-27T18:13:23.675747+0000","last_peered":"2023-11-27T18:13:23.675747+0000","last_clean":"2023-11-27T18:13:23.675747+0000","last_became_active":"2023-11-27T18:13:20.934797+0000","last_became_peered":"2023-11-27T18:13:20.934797+0000","last_unstale":"2023-11-27T18:13:23.675747+0000","last_undegraded":"2023-11-27T18:13:23.675747+0000","last_fullsized":"2023-11-27T18:13:23.675747+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:00:35.425015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.974788+0000","last_change":"2023-11-27T18:13:14.376557+0000","last_active":"2023-11-27T18:13:21.974788+0000","last_peered":"2023-11-27T18:13:21.974788+0000","last_clean":"2023-11-27T18:13:21.974788+0000","last_became_active":"2023-11-27T18:13:14.376304+0000","last_became_peered":"2023-11-27T18:13:14.376304+0000","last_unstale":"2023-11-27T18:13:21.974788+0000","last_undegraded":"2023-11-27T18:13:21.974788+0000","last_fullsized":"2023-11-27T18:13:21.974788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:37:22.787246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.145694+0000","last_change":"2023-11-27T18:13:12.307806+0000","last_active":"2023-11-27T18:13:22.145694+0000","last_peered":"2023-11-27T18:13:22.145694+0000","last_clean":"2023-11-27T18:13:22.145694+0000","last_became_active":"2023-11-27T18:13:12.307492+0000","last_became_peered":"2023-11-27T18:13:12.307492+0000","last_unstale":"2023-11-27T18:13:22.145694+0000","last_undegraded":"2023-11-27T18:13:22.145694+0000","last_fullsized":"2023-11-27T18:13:22.145694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:34:06.981997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.674551+0000","last_change":"2023-11-27T18:13:20.918671+0000","last_active":"2023-11-27T18:13:23.674551+0000","last_peered":"2023-11-27T18:13:23.674551+0000","last_clean":"2023-11-27T18:13:23.674551+0000","last_became_active":"2023-11-27T18:13:20.917507+0000","last_became_peered":"2023-11-27T18:13:20.917507+0000","last_unstale":"2023-11-27T18:13:23.674551+0000","last_undegraded":"2023-11-27T18:13:23.674551+0000","last_fullsized":"2023-11-27T18:13:23.674551+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:00:52.213234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.975274+0000","last_change":"2023-11-27T18:13:14.377644+0000","last_active":"2023-11-27T18:13:21.975274+0000","last_peered":"2023-11-27T18:13:21.975274+0000","last_clean":"2023-11-27T18:13:21.975274+0000","last_became_active":"2023-11-27T18:13:14.377289+0000","last_became_peered":"2023-11-27T18:13:14.377289+0000","last_unstale":"2023-11-27T18:13:21.975274+0000","last_undegraded":"2023-11-27T18:13:21.975274+0000","last_fullsized":"2023-11-27T18:13:21.975274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:55:42.641433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.975026+0000","last_change":"2023-11-27T18:13:12.267960+0000","last_active":"2023-11-27T18:13:21.975026+0000","last_peered":"2023-11-27T18:13:21.975026+0000","last_clean":"2023-11-27T18:13:21.975026+0000","last_became_active":"2023-11-27T18:13:12.267552+0000","last_became_peered":"2023-11-27T18:13:12.267552+0000","last_unstale":"2023-11-27T18:13:21.975026+0000","last_undegraded":"2023-11-27T18:13:21.975026+0000","last_fullsized":"2023-11-27T18:13:21.975026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:26:13.819717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.288385+0000","last_change":"2023-11-27T18:13:20.929780+0000","last_active":"2023-11-27T18:13:23.288385+0000","last_peered":"2023-11-27T18:13:23.288385+0000","last_clean":"2023-11-27T18:13:23.288385+0000","last_became_active":"2023-11-27T18:13:20.929370+0000","last_became_peered":"2023-11-27T18:13:20.929370+0000","last_unstale":"2023-11-27T18:13:23.288385+0000","last_undegraded":"2023-11-27T18:13:23.288385+0000","last_fullsized":"2023-11-27T18:13:23.288385+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:04:33.249483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140988+0000","last_change":"2023-11-27T18:13:14.369764+0000","last_active":"2023-11-27T18:13:22.140988+0000","last_peered":"2023-11-27T18:13:22.140988+0000","last_clean":"2023-11-27T18:13:22.140988+0000","last_became_active":"2023-11-27T18:13:14.369472+0000","last_became_peered":"2023-11-27T18:13:14.369472+0000","last_unstale":"2023-11-27T18:13:22.140988+0000","last_undegraded":"2023-11-27T18:13:22.140988+0000","last_fullsized":"2023-11-27T18:13:22.140988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:35:38.706782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.143297+0000","last_change":"2023-11-27T18:13:12.310761+0000","last_active":"2023-11-27T18:13:22.143297+0000","last_peered":"2023-11-27T18:13:22.143297+0000","last_clean":"2023-11-27T18:13:22.143297+0000","last_became_active":"2023-11-27T18:13:12.310495+0000","last_became_peered":"2023-11-27T18:13:12.310495+0000","last_unstale":"2023-11-27T18:13:22.143297+0000","last_undegraded":"2023-11-27T18:13:22.143297+0000","last_fullsized":"2023-11-27T18:13:22.143297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:48:59.333816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.935576+0000","last_change":"2023-11-27T18:13:20.907638+0000","last_active":"2023-11-27T18:13:23.935576+0000","last_peered":"2023-11-27T18:13:23.935576+0000","last_clean":"2023-11-27T18:13:23.935576+0000","last_became_active":"2023-11-27T18:13:20.907229+0000","last_became_peered":"2023-11-27T18:13:20.907229+0000","last_unstale":"2023-11-27T18:13:23.935576+0000","last_undegraded":"2023-11-27T18:13:23.935576+0000","last_fullsized":"2023-11-27T18:13:23.935576+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:49:08.226420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.071564+0000","last_change":"2023-11-27T18:13:15.851127+0000","last_active":"2023-11-27T18:13:22.071564+0000","last_peered":"2023-11-27T18:13:22.071564+0000","last_clean":"2023-11-27T18:13:22.071564+0000","last_became_active":"2023-11-27T18:13:15.850263+0000","last_became_peered":"2023-11-27T18:13:15.850263+0000","last_unstale":"2023-11-27T18:13:22.071564+0000","last_undegraded":"2023-11-27T18:13:22.071564+0000","last_fullsized":"2023-11-27T18:13:22.071564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:48:39.587974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.139967+0000","last_change":"2023-11-27T18:13:12.310451+0000","last_active":"2023-11-27T18:13:22.139967+0000","last_peered":"2023-11-27T18:13:22.139967+0000","last_clean":"2023-11-27T18:13:22.139967+0000","last_became_active":"2023-11-27T18:13:12.310138+0000","last_became_peered":"2023-11-27T18:13:12.310138+0000","last_unstale":"2023-11-27T18:13:22.139967+0000","last_undegraded":"2023-11-27T18:13:22.139967+0000","last_fullsized":"2023-11-27T18:13:22.139967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:03:09.046171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.934474+0000","last_change":"2023-11-27T18:13:20.896960+0000","last_active":"2023-11-27T18:13:23.934474+0000","last_peered":"2023-11-27T18:13:23.934474+0000","last_clean":"2023-11-27T18:13:23.934474+0000","last_became_active":"2023-11-27T18:13:20.896156+0000","last_became_peered":"2023-11-27T18:13:20.896156+0000","last_unstale":"2023-11-27T18:13:23.934474+0000","last_undegraded":"2023-11-27T18:13:23.934474+0000","last_fullsized":"2023-11-27T18:13:23.934474+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:00:52.213234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140720+0000","last_change":"2023-11-27T18:13:14.421498+0000","last_active":"2023-11-27T18:13:22.140720+0000","last_peered":"2023-11-27T18:13:22.140720+0000","last_clean":"2023-11-27T18:13:22.140720+0000","last_became_active":"2023-11-27T18:13:14.421125+0000","last_became_peered":"2023-11-27T18:13:14.421125+0000","last_unstale":"2023-11-27T18:13:22.140720+0000","last_undegraded":"2023-11-27T18:13:22.140720+0000","last_fullsized":"2023-11-27T18:13:22.140720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:52:30.225572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.143659+0000","last_change":"2023-11-27T18:13:12.301922+0000","last_active":"2023-11-27T18:13:22.143659+0000","last_peered":"2023-11-27T18:13:22.143659+0000","last_clean":"2023-11-27T18:13:22.143659+0000","last_became_active":"2023-11-27T18:13:12.301617+0000","last_became_peered":"2023-11-27T18:13:12.301617+0000","last_unstale":"2023-11-27T18:13:22.143659+0000","last_undegraded":"2023-11-27T18:13:22.143659+0000","last_fullsized":"2023-11-27T18:13:22.143659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:00:43.320630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.935898+0000","last_change":"2023-11-27T18:13:20.905013+0000","last_active":"2023-11-27T18:13:23.935898+0000","last_peered":"2023-11-27T18:13:23.935898+0000","last_clean":"2023-11-27T18:13:23.935898+0000","last_became_active":"2023-11-27T18:13:20.903019+0000","last_became_peered":"2023-11-27T18:13:20.903019+0000","last_unstale":"2023-11-27T18:13:23.935898+0000","last_undegraded":"2023-11-27T18:13:23.935898+0000","last_fullsized":"2023-11-27T18:13:23.935898+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:34:15.874601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.138615+0000","last_change":"2023-11-27T18:13:14.378913+0000","last_active":"2023-11-27T18:13:22.138615+0000","last_peered":"2023-11-27T18:13:22.138615+0000","last_clean":"2023-11-27T18:13:22.138615+0000","last_became_active":"2023-11-27T18:13:14.378644+0000","last_became_peered":"2023-11-27T18:13:14.378644+0000","last_unstale":"2023-11-27T18:13:22.138615+0000","last_undegraded":"2023-11-27T18:13:22.138615+0000","last_fullsized":"2023-11-27T18:13:22.138615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:19:02.523860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.926631+0000","last_change":"2023-11-27T18:13:12.305733+0000","last_active":"2023-11-27T18:13:21.926631+0000","last_peered":"2023-11-27T18:13:21.926631+0000","last_clean":"2023-11-27T18:13:21.926631+0000","last_became_active":"2023-11-27T18:13:12.305380+0000","last_became_peered":"2023-11-27T18:13:12.305380+0000","last_unstale":"2023-11-27T18:13:21.926631+0000","last_undegraded":"2023-11-27T18:13:21.926631+0000","last_fullsized":"2023-11-27T18:13:21.926631+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:34:46.886091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.936019+0000","last_change":"2023-11-27T18:13:20.913672+0000","last_active":"2023-11-27T18:13:23.936019+0000","last_peered":"2023-11-27T18:13:23.936019+0000","last_clean":"2023-11-27T18:13:23.936019+0000","last_became_active":"2023-11-27T18:13:20.913137+0000","last_became_peered":"2023-11-27T18:13:20.913137+0000","last_unstale":"2023-11-27T18:13:23.936019+0000","last_undegraded":"2023-11-27T18:13:23.936019+0000","last_fullsized":"2023-11-27T18:13:23.936019+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:40:20.210205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.138829+0000","last_change":"2023-11-27T18:13:14.413781+0000","last_active":"2023-11-27T18:13:22.138829+0000","last_peered":"2023-11-27T18:13:22.138829+0000","last_clean":"2023-11-27T18:13:22.138829+0000","last_became_active":"2023-11-27T18:13:14.413413+0000","last_became_peered":"2023-11-27T18:13:14.413413+0000","last_unstale":"2023-11-27T18:13:22.138829+0000","last_undegraded":"2023-11-27T18:13:22.138829+0000","last_fullsized":"2023-11-27T18:13:22.138829+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:04:03.068428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.142629+0000","last_change":"2023-11-27T18:13:12.315822+0000","last_active":"2023-11-27T18:13:22.142629+0000","last_peered":"2023-11-27T18:13:22.142629+0000","last_clean":"2023-11-27T18:13:22.142629+0000","last_became_active":"2023-11-27T18:13:12.315610+0000","last_became_peered":"2023-11-27T18:13:12.315610+0000","last_unstale":"2023-11-27T18:13:22.142629+0000","last_undegraded":"2023-11-27T18:13:22.142629+0000","last_fullsized":"2023-11-27T18:13:22.142629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:39:33.385367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:24.439052+0000","last_change":"2023-11-27T18:13:20.912891+0000","last_active":"2023-11-27T18:13:24.439052+0000","last_peered":"2023-11-27T18:13:24.439052+0000","last_clean":"2023-11-27T18:13:24.439052+0000","last_became_active":"2023-11-27T18:13:20.912453+0000","last_became_peered":"2023-11-27T18:13:20.912453+0000","last_unstale":"2023-11-27T18:13:24.439052+0000","last_undegraded":"2023-11-27T18:13:24.439052+0000","last_fullsized":"2023-11-27T18:13:24.439052+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:35:44.943527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.975967+0000","last_change":"2023-11-27T18:13:14.414468+0000","last_active":"2023-11-27T18:13:21.975967+0000","last_peered":"2023-11-27T18:13:21.975967+0000","last_clean":"2023-11-27T18:13:21.975967+0000","last_became_active":"2023-11-27T18:13:14.414156+0000","last_became_peered":"2023-11-27T18:13:14.414156+0000","last_unstale":"2023-11-27T18:13:21.975967+0000","last_undegraded":"2023-11-27T18:13:21.975967+0000","last_fullsized":"2023-11-27T18:13:21.975967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:46:11.500006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.143074+0000","last_change":"2023-11-27T18:13:12.308337+0000","last_active":"2023-11-27T18:13:22.143074+0000","last_peered":"2023-11-27T18:13:22.143074+0000","last_clean":"2023-11-27T18:13:22.143074+0000","last_became_active":"2023-11-27T18:13:12.308050+0000","last_became_peered":"2023-11-27T18:13:12.308050+0000","last_unstale":"2023-11-27T18:13:22.143074+0000","last_undegraded":"2023-11-27T18:13:22.143074+0000","last_fullsized":"2023-11-27T18:13:22.143074+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:14:09.398956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"20'117","reported_seq":170,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140186+0000","last_change":"2023-11-27T18:12:38.371836+0000","last_active":"2023-11-27T18:13:22.140186+0000","last_peered":"2023-11-27T18:13:22.140186+0000","last_clean":"2023-11-27T18:13:22.140186+0000","last_became_active":"2023-11-27T18:12:38.370748+0000","last_became_peered":"2023-11-27T18:12:38.370748+0000","last_unstale":"2023-11-27T18:13:22.140186+0000","last_undegraded":"2023-11-27T18:13:22.140186+0000","last_fullsized":"2023-11-27T18:13:22.140186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:12:36.259476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:12:36.259476+0000","last_clean_scrub_stamp":"2023-11-27T18:12:36.259476+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:25:36.712765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.322281+0000","last_change":"2023-11-27T18:13:20.928359+0000","last_active":"2023-11-27T18:13:23.322281+0000","last_peered":"2023-11-27T18:13:23.322281+0000","last_clean":"2023-11-27T18:13:23.322281+0000","last_became_active":"2023-11-27T18:13:20.926559+0000","last_became_peered":"2023-11-27T18:13:20.926559+0000","last_unstale":"2023-11-27T18:13:23.322281+0000","last_undegraded":"2023-11-27T18:13:23.322281+0000","last_fullsized":"2023-11-27T18:13:23.322281+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:47:06.255647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.143121+0000","last_change":"2023-11-27T18:13:14.422275+0000","last_active":"2023-11-27T18:13:22.143121+0000","last_peered":"2023-11-27T18:13:22.143121+0000","last_clean":"2023-11-27T18:13:22.143121+0000","last_became_active":"2023-11-27T18:13:14.419636+0000","last_became_peered":"2023-11-27T18:13:14.419636+0000","last_unstale":"2023-11-27T18:13:22.143121+0000","last_undegraded":"2023-11-27T18:13:22.143121+0000","last_fullsized":"2023-11-27T18:13:22.143121+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:29:10.027795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.141172+0000","last_change":"2023-11-27T18:13:12.268222+0000","last_active":"2023-11-27T18:13:22.141172+0000","last_peered":"2023-11-27T18:13:22.141172+0000","last_clean":"2023-11-27T18:13:22.141172+0000","last_became_active":"2023-11-27T18:13:12.267764+0000","last_became_peered":"2023-11-27T18:13:12.267764+0000","last_unstale":"2023-11-27T18:13:22.141172+0000","last_undegraded":"2023-11-27T18:13:22.141172+0000","last_fullsized":"2023-11-27T18:13:22.141172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:48:38.383796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.674846+0000","last_change":"2023-11-27T18:13:20.917055+0000","last_active":"2023-11-27T18:13:23.674846+0000","last_peered":"2023-11-27T18:13:23.674846+0000","last_clean":"2023-11-27T18:13:23.674846+0000","last_became_active":"2023-11-27T18:13:20.914157+0000","last_became_peered":"2023-11-27T18:13:20.914157+0000","last_unstale":"2023-11-27T18:13:23.674846+0000","last_undegraded":"2023-11-27T18:13:23.674846+0000","last_fullsized":"2023-11-27T18:13:23.674846+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:34:15.874601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140538+0000","last_change":"2023-11-27T18:13:14.363559+0000","last_active":"2023-11-27T18:13:22.140538+0000","last_peered":"2023-11-27T18:13:22.140538+0000","last_clean":"2023-11-27T18:13:22.140538+0000","last_became_active":"2023-11-27T18:13:14.363285+0000","last_became_peered":"2023-11-27T18:13:14.363285+0000","last_unstale":"2023-11-27T18:13:22.140538+0000","last_undegraded":"2023-11-27T18:13:22.140538+0000","last_fullsized":"2023-11-27T18:13:22.140538+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:00:44.524809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140713+0000","last_change":"2023-11-27T18:13:12.312477+0000","last_active":"2023-11-27T18:13:22.140713+0000","last_peered":"2023-11-27T18:13:22.140713+0000","last_clean":"2023-11-27T18:13:22.140713+0000","last_became_active":"2023-11-27T18:13:12.312038+0000","last_became_peered":"2023-11-27T18:13:12.312038+0000","last_unstale":"2023-11-27T18:13:22.140713+0000","last_undegraded":"2023-11-27T18:13:22.140713+0000","last_fullsized":"2023-11-27T18:13:22.140713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:35:37.502604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:24.439241+0000","last_change":"2023-11-27T18:13:20.913830+0000","last_active":"2023-11-27T18:13:24.439241+0000","last_peered":"2023-11-27T18:13:24.439241+0000","last_clean":"2023-11-27T18:13:24.439241+0000","last_became_active":"2023-11-27T18:13:20.912734+0000","last_became_peered":"2023-11-27T18:13:20.912734+0000","last_unstale":"2023-11-27T18:13:24.439241+0000","last_undegraded":"2023-11-27T18:13:24.439241+0000","last_fullsized":"2023-11-27T18:13:24.439241+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:35:39.280506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.141013+0000","last_change":"2023-11-27T18:13:14.364027+0000","last_active":"2023-11-27T18:13:22.141013+0000","last_peered":"2023-11-27T18:13:22.141013+0000","last_clean":"2023-11-27T18:13:22.141013+0000","last_became_active":"2023-11-27T18:13:14.363772+0000","last_became_peered":"2023-11-27T18:13:14.363772+0000","last_unstale":"2023-11-27T18:13:22.141013+0000","last_undegraded":"2023-11-27T18:13:22.141013+0000","last_fullsized":"2023-11-27T18:13:22.141013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:40:12.521779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.974905+0000","last_change":"2023-11-27T18:13:12.304785+0000","last_active":"2023-11-27T18:13:21.974905+0000","last_peered":"2023-11-27T18:13:21.974905+0000","last_clean":"2023-11-27T18:13:21.974905+0000","last_became_active":"2023-11-27T18:13:12.304400+0000","last_became_peered":"2023-11-27T18:13:12.304400+0000","last_unstale":"2023-11-27T18:13:21.974905+0000","last_undegraded":"2023-11-27T18:13:21.974905+0000","last_fullsized":"2023-11-27T18:13:21.974905+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:37:52.292054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.320761+0000","last_change":"2023-11-27T18:13:20.922959+0000","last_active":"2023-11-27T18:13:23.320761+0000","last_peered":"2023-11-27T18:13:23.320761+0000","last_clean":"2023-11-27T18:13:23.320761+0000","last_became_active":"2023-11-27T18:13:20.918984+0000","last_became_peered":"2023-11-27T18:13:20.918984+0000","last_unstale":"2023-11-27T18:13:23.320761+0000","last_undegraded":"2023-11-27T18:13:23.320761+0000","last_fullsized":"2023-11-27T18:13:23.320761+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:59:33.426999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.071789+0000","last_change":"2023-11-27T18:13:15.852939+0000","last_active":"2023-11-27T18:13:22.071789+0000","last_peered":"2023-11-27T18:13:22.071789+0000","last_clean":"2023-11-27T18:13:22.071789+0000","last_became_active":"2023-11-27T18:13:15.852339+0000","last_became_peered":"2023-11-27T18:13:15.852339+0000","last_unstale":"2023-11-27T18:13:22.071789+0000","last_undegraded":"2023-11-27T18:13:22.071789+0000","last_fullsized":"2023-11-27T18:13:22.071789+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:31:25.796567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140369+0000","last_change":"2023-11-27T18:13:12.311109+0000","last_active":"2023-11-27T18:13:22.140369+0000","last_peered":"2023-11-27T18:13:22.140369+0000","last_clean":"2023-11-27T18:13:22.140369+0000","last_became_active":"2023-11-27T18:13:12.310921+0000","last_became_peered":"2023-11-27T18:13:12.310921+0000","last_unstale":"2023-11-27T18:13:22.140369+0000","last_undegraded":"2023-11-27T18:13:22.140369+0000","last_fullsized":"2023-11-27T18:13:22.140369+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:05:04.546929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.292365+0000","last_change":"2023-11-27T18:13:20.925265+0000","last_active":"2023-11-27T18:13:23.292365+0000","last_peered":"2023-11-27T18:13:23.292365+0000","last_clean":"2023-11-27T18:13:23.292365+0000","last_became_active":"2023-11-27T18:13:20.924209+0000","last_became_peered":"2023-11-27T18:13:20.924209+0000","last_unstale":"2023-11-27T18:13:23.292365+0000","last_undegraded":"2023-11-27T18:13:23.292365+0000","last_fullsized":"2023-11-27T18:13:23.292365+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:31:33.484992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.142532+0000","last_change":"2023-11-27T18:13:14.421768+0000","last_active":"2023-11-27T18:13:22.142532+0000","last_peered":"2023-11-27T18:13:22.142532+0000","last_clean":"2023-11-27T18:13:22.142532+0000","last_became_active":"2023-11-27T18:13:14.421377+0000","last_became_peered":"2023-11-27T18:13:14.421377+0000","last_unstale":"2023-11-27T18:13:22.142532+0000","last_undegraded":"2023-11-27T18:13:22.142532+0000","last_fullsized":"2023-11-27T18:13:22.142532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:00:27.736589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"24'8","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.974338+0000","last_change":"2023-11-27T18:13:12.178547+0000","last_active":"2023-11-27T18:13:21.974338+0000","last_peered":"2023-11-27T18:13:21.974338+0000","last_clean":"2023-11-27T18:13:21.974338+0000","last_became_active":"2023-11-27T18:13:12.177997+0000","last_became_peered":"2023-11-27T18:13:12.177997+0000","last_unstale":"2023-11-27T18:13:21.974338+0000","last_undegraded":"2023-11-27T18:13:21.974338+0000","last_fullsized":"2023-11-27T18:13:21.974338+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:29:10.535816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:24.439272+0000","last_change":"2023-11-27T18:13:20.914541+0000","last_active":"2023-11-27T18:13:24.439272+0000","last_peered":"2023-11-27T18:13:24.439272+0000","last_clean":"2023-11-27T18:13:24.439272+0000","last_became_active":"2023-11-27T18:13:20.914144+0000","last_became_peered":"2023-11-27T18:13:20.914144+0000","last_unstale":"2023-11-27T18:13:24.439272+0000","last_undegraded":"2023-11-27T18:13:24.439272+0000","last_fullsized":"2023-11-27T18:13:24.439272+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:29:17.716220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140030+0000","last_change":"2023-11-27T18:13:15.802553+0000","last_active":"2023-11-27T18:13:22.140030+0000","last_peered":"2023-11-27T18:13:22.140030+0000","last_clean":"2023-11-27T18:13:22.140030+0000","last_became_active":"2023-11-27T18:13:15.801804+0000","last_became_peered":"2023-11-27T18:13:15.801804+0000","last_unstale":"2023-11-27T18:13:22.140030+0000","last_undegraded":"2023-11-27T18:13:22.140030+0000","last_fullsized":"2023-11-27T18:13:22.140030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:50:47.259554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.141046+0000","last_change":"2023-11-27T18:13:12.300863+0000","last_active":"2023-11-27T18:13:22.141046+0000","last_peered":"2023-11-27T18:13:22.141046+0000","last_clean":"2023-11-27T18:13:22.141046+0000","last_became_active":"2023-11-27T18:13:12.300585+0000","last_became_peered":"2023-11-27T18:13:12.300585+0000","last_unstale":"2023-11-27T18:13:22.141046+0000","last_undegraded":"2023-11-27T18:13:22.141046+0000","last_fullsized":"2023-11-27T18:13:22.141046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:27:04.532776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:24.439678+0000","last_change":"2023-11-27T18:13:20.915245+0000","last_active":"2023-11-27T18:13:24.439678+0000","last_peered":"2023-11-27T18:13:24.439678+0000","last_clean":"2023-11-27T18:13:24.439678+0000","last_became_active":"2023-11-27T18:13:20.914216+0000","last_became_peered":"2023-11-27T18:13:20.914216+0000","last_unstale":"2023-11-27T18:13:24.439678+0000","last_undegraded":"2023-11-27T18:13:24.439678+0000","last_fullsized":"2023-11-27T18:13:24.439678+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:56:44.418239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.142871+0000","last_change":"2023-11-27T18:13:14.415225+0000","last_active":"2023-11-27T18:13:22.142871+0000","last_peered":"2023-11-27T18:13:22.142871+0000","last_clean":"2023-11-27T18:13:22.142871+0000","last_became_active":"2023-11-27T18:13:14.414918+0000","last_became_peered":"2023-11-27T18:13:14.414918+0000","last_unstale":"2023-11-27T18:13:22.142871+0000","last_undegraded":"2023-11-27T18:13:22.142871+0000","last_fullsized":"2023-11-27T18:13:22.142871+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:35:31.592080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.143589+0000","last_change":"2023-11-27T18:13:12.305081+0000","last_active":"2023-11-27T18:13:22.143589+0000","last_peered":"2023-11-27T18:13:22.143589+0000","last_clean":"2023-11-27T18:13:22.143589+0000","last_became_active":"2023-11-27T18:13:12.304777+0000","last_became_peered":"2023-11-27T18:13:12.304777+0000","last_unstale":"2023-11-27T18:13:22.143589+0000","last_undegraded":"2023-11-27T18:13:22.143589+0000","last_fullsized":"2023-11-27T18:13:22.143589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:22:12.680259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.936710+0000","last_change":"2023-11-27T18:13:20.904088+0000","last_active":"2023-11-27T18:13:23.936710+0000","last_peered":"2023-11-27T18:13:23.936710+0000","last_clean":"2023-11-27T18:13:23.936710+0000","last_became_active":"2023-11-27T18:13:20.902282+0000","last_became_peered":"2023-11-27T18:13:20.902282+0000","last_unstale":"2023-11-27T18:13:23.936710+0000","last_undegraded":"2023-11-27T18:13:23.936710+0000","last_fullsized":"2023-11-27T18:13:23.936710+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:26:43.789814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140899+0000","last_change":"2023-11-27T18:13:14.415302+0000","last_active":"2023-11-27T18:13:22.140899+0000","last_peered":"2023-11-27T18:13:22.140899+0000","last_clean":"2023-11-27T18:13:22.140899+0000","last_became_active":"2023-11-27T18:13:14.415004+0000","last_became_peered":"2023-11-27T18:13:14.415004+0000","last_unstale":"2023-11-27T18:13:22.140899+0000","last_undegraded":"2023-11-27T18:13:22.140899+0000","last_fullsized":"2023-11-27T18:13:22.140899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:34:11.170873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.927564+0000","last_change":"2023-11-27T18:13:12.268542+0000","last_active":"2023-11-27T18:13:21.927564+0000","last_peered":"2023-11-27T18:13:21.927564+0000","last_clean":"2023-11-27T18:13:21.927564+0000","last_became_active":"2023-11-27T18:13:12.268237+0000","last_became_peered":"2023-11-27T18:13:12.268237+0000","last_unstale":"2023-11-27T18:13:21.927564+0000","last_undegraded":"2023-11-27T18:13:21.927564+0000","last_fullsized":"2023-11-27T18:13:21.927564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:15:07.514381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.321930+0000","last_change":"2023-11-27T18:13:20.900393+0000","last_active":"2023-11-27T18:13:23.321930+0000","last_peered":"2023-11-27T18:13:23.321930+0000","last_clean":"2023-11-27T18:13:23.321930+0000","last_became_active":"2023-11-27T18:13:20.899358+0000","last_became_peered":"2023-11-27T18:13:20.899358+0000","last_unstale":"2023-11-27T18:13:23.321930+0000","last_undegraded":"2023-11-27T18:13:23.321930+0000","last_fullsized":"2023-11-27T18:13:23.321930+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:27:58.837417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140744+0000","last_change":"2023-11-27T18:13:14.371842+0000","last_active":"2023-11-27T18:13:22.140744+0000","last_peered":"2023-11-27T18:13:22.140744+0000","last_clean":"2023-11-27T18:13:22.140744+0000","last_became_active":"2023-11-27T18:13:14.371637+0000","last_became_peered":"2023-11-27T18:13:14.371637+0000","last_unstale":"2023-11-27T18:13:22.140744+0000","last_undegraded":"2023-11-27T18:13:22.140744+0000","last_fullsized":"2023-11-27T18:13:22.140744+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:22:13.884437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"30'10","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:33.656056+0000","last_change":"2023-11-27T18:13:12.248404+0000","last_active":"2023-11-27T18:13:33.656056+0000","last_peered":"2023-11-27T18:13:33.656056+0000","last_clean":"2023-11-27T18:13:33.656056+0000","last_became_active":"2023-11-27T18:13:12.248077+0000","last_became_peered":"2023-11-27T18:13:12.248077+0000","last_unstale":"2023-11-27T18:13:33.656056+0000","last_undegraded":"2023-11-27T18:13:33.656056+0000","last_fullsized":"2023-11-27T18:13:33.656056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:34:21.166265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.288672+0000","last_change":"2023-11-27T18:13:20.919046+0000","last_active":"2023-11-27T18:13:23.288672+0000","last_peered":"2023-11-27T18:13:23.288672+0000","last_clean":"2023-11-27T18:13:23.288672+0000","last_became_active":"2023-11-27T18:13:20.918381+0000","last_became_peered":"2023-11-27T18:13:20.918381+0000","last_unstale":"2023-11-27T18:13:23.288672+0000","last_undegraded":"2023-11-27T18:13:23.288672+0000","last_fullsized":"2023-11-27T18:13:23.288672+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:17:07.092549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.143486+0000","last_change":"2023-11-27T18:13:14.415453+0000","last_active":"2023-11-27T18:13:22.143486+0000","last_peered":"2023-11-27T18:13:22.143486+0000","last_clean":"2023-11-27T18:13:22.143486+0000","last_became_active":"2023-11-27T18:13:14.415026+0000","last_became_peered":"2023-11-27T18:13:14.415026+0000","last_unstale":"2023-11-27T18:13:22.143486+0000","last_undegraded":"2023-11-27T18:13:22.143486+0000","last_fullsized":"2023-11-27T18:13:22.143486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:35:37.255102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.927427+0000","last_change":"2023-11-27T18:13:12.180737+0000","last_active":"2023-11-27T18:13:21.927427+0000","last_peered":"2023-11-27T18:13:21.927427+0000","last_clean":"2023-11-27T18:13:21.927427+0000","last_became_active":"2023-11-27T18:13:12.180112+0000","last_became_peered":"2023-11-27T18:13:12.180112+0000","last_unstale":"2023-11-27T18:13:21.927427+0000","last_undegraded":"2023-11-27T18:13:21.927427+0000","last_fullsized":"2023-11-27T18:13:21.927427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:24:22.455257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.674772+0000","last_change":"2023-11-27T18:13:20.925012+0000","last_active":"2023-11-27T18:13:23.674772+0000","last_peered":"2023-11-27T18:13:23.674772+0000","last_clean":"2023-11-27T18:13:23.674772+0000","last_became_active":"2023-11-27T18:13:20.921675+0000","last_became_peered":"2023-11-27T18:13:20.921675+0000","last_unstale":"2023-11-27T18:13:23.674772+0000","last_undegraded":"2023-11-27T18:13:23.674772+0000","last_fullsized":"2023-11-27T18:13:23.674772+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:49:08.226420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.142147+0000","last_change":"2023-11-27T18:13:14.415432+0000","last_active":"2023-11-27T18:13:22.142147+0000","last_peered":"2023-11-27T18:13:22.142147+0000","last_clean":"2023-11-27T18:13:22.142147+0000","last_became_active":"2023-11-27T18:13:14.415142+0000","last_became_peered":"2023-11-27T18:13:14.415142+0000","last_unstale":"2023-11-27T18:13:22.142147+0000","last_undegraded":"2023-11-27T18:13:22.142147+0000","last_fullsized":"2023-11-27T18:13:22.142147+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:39:33.850547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.142528+0000","last_change":"2023-11-27T18:13:12.273729+0000","last_active":"2023-11-27T18:13:22.142528+0000","last_peered":"2023-11-27T18:13:22.142528+0000","last_clean":"2023-11-27T18:13:22.142528+0000","last_became_active":"2023-11-27T18:13:12.273400+0000","last_became_peered":"2023-11-27T18:13:12.273400+0000","last_unstale":"2023-11-27T18:13:22.142528+0000","last_undegraded":"2023-11-27T18:13:22.142528+0000","last_fullsized":"2023-11-27T18:13:22.142528+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:31:10.508092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.230824+0000","last_change":"2023-11-27T18:13:20.912482+0000","last_active":"2023-11-27T18:13:23.230824+0000","last_peered":"2023-11-27T18:13:23.230824+0000","last_clean":"2023-11-27T18:13:23.230824+0000","last_became_active":"2023-11-27T18:13:20.912063+0000","last_became_peered":"2023-11-27T18:13:20.912063+0000","last_unstale":"2023-11-27T18:13:23.230824+0000","last_undegraded":"2023-11-27T18:13:23.230824+0000","last_fullsized":"2023-11-27T18:13:23.230824+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:11:56.997205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.071693+0000","last_change":"2023-11-27T18:13:15.911622+0000","last_active":"2023-11-27T18:13:22.071693+0000","last_peered":"2023-11-27T18:13:22.071693+0000","last_clean":"2023-11-27T18:13:22.071693+0000","last_became_active":"2023-11-27T18:13:15.911255+0000","last_became_peered":"2023-11-27T18:13:15.911255+0000","last_unstale":"2023-11-27T18:13:22.071693+0000","last_undegraded":"2023-11-27T18:13:22.071693+0000","last_fullsized":"2023-11-27T18:13:22.071693+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:04:03.068428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.141411+0000","last_change":"2023-11-27T18:13:12.168028+0000","last_active":"2023-11-27T18:13:22.141411+0000","last_peered":"2023-11-27T18:13:22.141411+0000","last_clean":"2023-11-27T18:13:22.141411+0000","last_became_active":"2023-11-27T18:13:12.167740+0000","last_became_peered":"2023-11-27T18:13:12.167740+0000","last_unstale":"2023-11-27T18:13:22.141411+0000","last_undegraded":"2023-11-27T18:13:22.141411+0000","last_fullsized":"2023-11-27T18:13:22.141411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:34:21.166265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.289002+0000","last_change":"2023-11-27T18:13:20.915480+0000","last_active":"2023-11-27T18:13:23.289002+0000","last_peered":"2023-11-27T18:13:23.289002+0000","last_clean":"2023-11-27T18:13:23.289002+0000","last_became_active":"2023-11-27T18:13:20.914607+0000","last_became_peered":"2023-11-27T18:13:20.914607+0000","last_unstale":"2023-11-27T18:13:23.289002+0000","last_undegraded":"2023-11-27T18:13:23.289002+0000","last_fullsized":"2023-11-27T18:13:23.289002+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:07:38.034431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.290409+0000","last_change":"2023-11-27T18:13:20.930508+0000","last_active":"2023-11-27T18:13:23.290409+0000","last_peered":"2023-11-27T18:13:23.290409+0000","last_clean":"2023-11-27T18:13:23.290409+0000","last_became_active":"2023-11-27T18:13:20.930060+0000","last_became_peered":"2023-11-27T18:13:20.930060+0000","last_unstale":"2023-11-27T18:13:23.290409+0000","last_undegraded":"2023-11-27T18:13:23.290409+0000","last_fullsized":"2023-11-27T18:13:23.290409+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:43:18.464867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.975017+0000","last_change":"2023-11-27T18:13:14.380263+0000","last_active":"2023-11-27T18:13:21.975017+0000","last_peered":"2023-11-27T18:13:21.975017+0000","last_clean":"2023-11-27T18:13:21.975017+0000","last_became_active":"2023-11-27T18:13:14.379936+0000","last_became_peered":"2023-11-27T18:13:14.379936+0000","last_unstale":"2023-11-27T18:13:21.975017+0000","last_undegraded":"2023-11-27T18:13:21.975017+0000","last_fullsized":"2023-11-27T18:13:21.975017+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:50:34.713768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.142604+0000","last_change":"2023-11-27T18:13:12.300977+0000","last_active":"2023-11-27T18:13:22.142604+0000","last_peered":"2023-11-27T18:13:22.142604+0000","last_clean":"2023-11-27T18:13:22.142604+0000","last_became_active":"2023-11-27T18:13:12.300624+0000","last_became_peered":"2023-11-27T18:13:12.300624+0000","last_unstale":"2023-11-27T18:13:22.142604+0000","last_undegraded":"2023-11-27T18:13:22.142604+0000","last_fullsized":"2023-11-27T18:13:22.142604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:52:29.021393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.322456+0000","last_change":"2023-11-27T18:13:20.919870+0000","last_active":"2023-11-27T18:13:23.322456+0000","last_peered":"2023-11-27T18:13:23.322456+0000","last_clean":"2023-11-27T18:13:23.322456+0000","last_became_active":"2023-11-27T18:13:20.918816+0000","last_became_peered":"2023-11-27T18:13:20.918816+0000","last_unstale":"2023-11-27T18:13:23.322456+0000","last_undegraded":"2023-11-27T18:13:23.322456+0000","last_fullsized":"2023-11-27T18:13:23.322456+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:41:38.778382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.138717+0000","last_change":"2023-11-27T18:13:14.369562+0000","last_active":"2023-11-27T18:13:22.138717+0000","last_peered":"2023-11-27T18:13:22.138717+0000","last_clean":"2023-11-27T18:13:22.138717+0000","last_became_active":"2023-11-27T18:13:14.368880+0000","last_became_peered":"2023-11-27T18:13:14.368880+0000","last_unstale":"2023-11-27T18:13:22.138717+0000","last_undegraded":"2023-11-27T18:13:22.138717+0000","last_fullsized":"2023-11-27T18:13:22.138717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:22:13.884437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.139062+0000","last_change":"2023-11-27T18:13:12.270113+0000","last_active":"2023-11-27T18:13:22.139062+0000","last_peered":"2023-11-27T18:13:22.139062+0000","last_clean":"2023-11-27T18:13:22.139062+0000","last_became_active":"2023-11-27T18:13:12.269755+0000","last_became_peered":"2023-11-27T18:13:12.269755+0000","last_unstale":"2023-11-27T18:13:22.139062+0000","last_undegraded":"2023-11-27T18:13:22.139062+0000","last_fullsized":"2023-11-27T18:13:22.139062+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:51:01.410940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.143492+0000","last_change":"2023-11-27T18:13:12.307568+0000","last_active":"2023-11-27T18:13:22.143492+0000","last_peered":"2023-11-27T18:13:22.143492+0000","last_clean":"2023-11-27T18:13:22.143492+0000","last_became_active":"2023-11-27T18:13:12.307299+0000","last_became_peered":"2023-11-27T18:13:12.307299+0000","last_unstale":"2023-11-27T18:13:22.143492+0000","last_undegraded":"2023-11-27T18:13:22.143492+0000","last_fullsized":"2023-11-27T18:13:22.143492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:19:01.319681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.974648+0000","last_change":"2023-11-27T18:13:14.378937+0000","last_active":"2023-11-27T18:13:21.974648+0000","last_peered":"2023-11-27T18:13:21.974648+0000","last_clean":"2023-11-27T18:13:21.974648+0000","last_became_active":"2023-11-27T18:13:14.378635+0000","last_became_peered":"2023-11-27T18:13:14.378635+0000","last_unstale":"2023-11-27T18:13:21.974648+0000","last_undegraded":"2023-11-27T18:13:21.974648+0000","last_fullsized":"2023-11-27T18:13:21.974648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:06:40.533610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.290577+0000","last_change":"2023-11-27T18:13:20.903249+0000","last_active":"2023-11-27T18:13:23.290577+0000","last_peered":"2023-11-27T18:13:23.290577+0000","last_clean":"2023-11-27T18:13:23.290577+0000","last_became_active":"2023-11-27T18:13:20.902571+0000","last_became_peered":"2023-11-27T18:13:20.902571+0000","last_unstale":"2023-11-27T18:13:23.290577+0000","last_undegraded":"2023-11-27T18:13:23.290577+0000","last_fullsized":"2023-11-27T18:13:23.290577+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:41:48.892641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.139766+0000","last_change":"2023-11-27T18:13:12.304324+0000","last_active":"2023-11-27T18:13:22.139766+0000","last_peered":"2023-11-27T18:13:22.139766+0000","last_clean":"2023-11-27T18:13:22.139766+0000","last_became_active":"2023-11-27T18:13:12.303988+0000","last_became_peered":"2023-11-27T18:13:12.303988+0000","last_unstale":"2023-11-27T18:13:22.139766+0000","last_undegraded":"2023-11-27T18:13:22.139766+0000","last_fullsized":"2023-11-27T18:13:22.139766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:47:59.518332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140188+0000","last_change":"2023-11-27T18:13:15.803183+0000","last_active":"2023-11-27T18:13:22.140188+0000","last_peered":"2023-11-27T18:13:22.140188+0000","last_clean":"2023-11-27T18:13:22.140188+0000","last_became_active":"2023-11-27T18:13:15.802420+0000","last_became_peered":"2023-11-27T18:13:15.802420+0000","last_unstale":"2023-11-27T18:13:22.140188+0000","last_undegraded":"2023-11-27T18:13:22.140188+0000","last_fullsized":"2023-11-27T18:13:22.140188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:51:02.615119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.231473+0000","last_change":"2023-11-27T18:13:20.920758+0000","last_active":"2023-11-27T18:13:23.231473+0000","last_peered":"2023-11-27T18:13:23.231473+0000","last_clean":"2023-11-27T18:13:23.231473+0000","last_became_active":"2023-11-27T18:13:20.920367+0000","last_became_peered":"2023-11-27T18:13:20.920367+0000","last_unstale":"2023-11-27T18:13:23.231473+0000","last_undegraded":"2023-11-27T18:13:23.231473+0000","last_fullsized":"2023-11-27T18:13:23.231473+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:51:50.506446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.070839+0000","last_change":"2023-11-27T18:13:15.849183+0000","last_active":"2023-11-27T18:13:22.070839+0000","last_peered":"2023-11-27T18:13:22.070839+0000","last_clean":"2023-11-27T18:13:22.070839+0000","last_became_active":"2023-11-27T18:13:15.848503+0000","last_became_peered":"2023-11-27T18:13:15.848503+0000","last_unstale":"2023-11-27T18:13:22.070839+0000","last_undegraded":"2023-11-27T18:13:22.070839+0000","last_fullsized":"2023-11-27T18:13:22.070839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:14:48.774302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.926420+0000","last_change":"2023-11-27T18:13:14.336349+0000","last_active":"2023-11-27T18:13:21.926420+0000","last_peered":"2023-11-27T18:13:21.926420+0000","last_clean":"2023-11-27T18:13:21.926420+0000","last_became_active":"2023-11-27T18:13:14.336072+0000","last_became_peered":"2023-11-27T18:13:14.336072+0000","last_unstale":"2023-11-27T18:13:21.926420+0000","last_undegraded":"2023-11-27T18:13:21.926420+0000","last_fullsized":"2023-11-27T18:13:21.926420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:54:58.777656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.142882+0000","last_change":"2023-11-27T18:13:14.421713+0000","last_active":"2023-11-27T18:13:22.142882+0000","last_peered":"2023-11-27T18:13:22.142882+0000","last_clean":"2023-11-27T18:13:22.142882+0000","last_became_active":"2023-11-27T18:13:14.418679+0000","last_became_peered":"2023-11-27T18:13:14.418679+0000","last_unstale":"2023-11-27T18:13:22.142882+0000","last_undegraded":"2023-11-27T18:13:22.142882+0000","last_fullsized":"2023-11-27T18:13:22.142882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:53:03.917430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.139686+0000","last_change":"2023-11-27T18:13:14.376601+0000","last_active":"2023-11-27T18:13:22.139686+0000","last_peered":"2023-11-27T18:13:22.139686+0000","last_clean":"2023-11-27T18:13:22.139686+0000","last_became_active":"2023-11-27T18:13:14.376292+0000","last_became_peered":"2023-11-27T18:13:14.376292+0000","last_unstale":"2023-11-27T18:13:22.139686+0000","last_undegraded":"2023-11-27T18:13:22.139686+0000","last_fullsized":"2023-11-27T18:13:22.139686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:52:30.225572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140984+0000","last_change":"2023-11-27T18:13:14.367285+0000","last_active":"2023-11-27T18:13:22.140984+0000","last_peered":"2023-11-27T18:13:22.140984+0000","last_clean":"2023-11-27T18:13:22.140984+0000","last_became_active":"2023-11-27T18:13:14.366983+0000","last_became_peered":"2023-11-27T18:13:14.366983+0000","last_unstale":"2023-11-27T18:13:22.140984+0000","last_undegraded":"2023-11-27T18:13:22.140984+0000","last_fullsized":"2023-11-27T18:13:22.140984+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:04:31.925421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.141444+0000","last_change":"2023-11-27T18:13:14.375744+0000","last_active":"2023-11-27T18:13:22.141444+0000","last_peered":"2023-11-27T18:13:22.141444+0000","last_clean":"2023-11-27T18:13:22.141444+0000","last_became_active":"2023-11-27T18:13:14.375466+0000","last_became_peered":"2023-11-27T18:13:14.375466+0000","last_unstale":"2023-11-27T18:13:22.141444+0000","last_undegraded":"2023-11-27T18:13:22.141444+0000","last_fullsized":"2023-11-27T18:13:22.141444+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:03:10.250350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.071591+0000","last_change":"2023-11-27T18:13:15.911021+0000","last_active":"2023-11-27T18:13:22.071591+0000","last_peered":"2023-11-27T18:13:22.071591+0000","last_clean":"2023-11-27T18:13:22.071591+0000","last_became_active":"2023-11-27T18:13:15.910418+0000","last_became_peered":"2023-11-27T18:13:15.910418+0000","last_unstale":"2023-11-27T18:13:22.071591+0000","last_undegraded":"2023-11-27T18:13:22.071591+0000","last_fullsized":"2023-11-27T18:13:22.071591+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:55:45.033833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.141861+0000","last_change":"2023-11-27T18:13:14.368483+0000","last_active":"2023-11-27T18:13:22.141861+0000","last_peered":"2023-11-27T18:13:22.141861+0000","last_clean":"2023-11-27T18:13:22.141861+0000","last_became_active":"2023-11-27T18:13:14.366249+0000","last_became_peered":"2023-11-27T18:13:14.366249+0000","last_unstale":"2023-11-27T18:13:22.141861+0000","last_undegraded":"2023-11-27T18:13:22.141861+0000","last_fullsized":"2023-11-27T18:13:22.141861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:52:43.071209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.142531+0000","last_change":"2023-11-27T18:13:14.415379+0000","last_active":"2023-11-27T18:13:22.142531+0000","last_peered":"2023-11-27T18:13:22.142531+0000","last_clean":"2023-11-27T18:13:22.142531+0000","last_became_active":"2023-11-27T18:13:14.414873+0000","last_became_peered":"2023-11-27T18:13:14.414873+0000","last_unstale":"2023-11-27T18:13:22.142531+0000","last_undegraded":"2023-11-27T18:13:22.142531+0000","last_fullsized":"2023-11-27T18:13:22.142531+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:40:12.521779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.138566+0000","last_change":"2023-11-27T18:13:14.416351+0000","last_active":"2023-11-27T18:13:22.138566+0000","last_peered":"2023-11-27T18:13:22.138566+0000","last_clean":"2023-11-27T18:13:22.138566+0000","last_became_active":"2023-11-27T18:13:14.416072+0000","last_became_peered":"2023-11-27T18:13:14.416072+0000","last_unstale":"2023-11-27T18:13:22.138566+0000","last_undegraded":"2023-11-27T18:13:22.138566+0000","last_fullsized":"2023-11-27T18:13:22.138566+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:31:11.712270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140105+0000","last_change":"2023-11-27T18:13:15.801534+0000","last_active":"2023-11-27T18:13:22.140105+0000","last_peered":"2023-11-27T18:13:22.140105+0000","last_clean":"2023-11-27T18:13:22.140105+0000","last_became_active":"2023-11-27T18:13:15.800699+0000","last_became_peered":"2023-11-27T18:13:15.800699+0000","last_unstale":"2023-11-27T18:13:22.140105+0000","last_undegraded":"2023-11-27T18:13:22.140105+0000","last_fullsized":"2023-11-27T18:13:22.140105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:39:39.512202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.974431+0000","last_change":"2023-11-27T18:13:14.413935+0000","last_active":"2023-11-27T18:13:21.974431+0000","last_peered":"2023-11-27T18:13:21.974431+0000","last_clean":"2023-11-27T18:13:21.974431+0000","last_became_active":"2023-11-27T18:13:14.413567+0000","last_became_peered":"2023-11-27T18:13:14.413567+0000","last_unstale":"2023-11-27T18:13:21.974431+0000","last_undegraded":"2023-11-27T18:13:21.974431+0000","last_fullsized":"2023-11-27T18:13:21.974431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:51:07.667299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140494+0000","last_change":"2023-11-27T18:13:14.363105+0000","last_active":"2023-11-27T18:13:22.140494+0000","last_peered":"2023-11-27T18:13:22.140494+0000","last_clean":"2023-11-27T18:13:22.140494+0000","last_became_active":"2023-11-27T18:13:14.362805+0000","last_became_peered":"2023-11-27T18:13:14.362805+0000","last_unstale":"2023-11-27T18:13:22.140494+0000","last_undegraded":"2023-11-27T18:13:22.140494+0000","last_fullsized":"2023-11-27T18:13:22.140494+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:19:02.523860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.143343+0000","last_change":"2023-11-27T18:13:14.416119+0000","last_active":"2023-11-27T18:13:22.143343+0000","last_peered":"2023-11-27T18:13:22.143343+0000","last_clean":"2023-11-27T18:13:22.143343+0000","last_became_active":"2023-11-27T18:13:14.415661+0000","last_became_peered":"2023-11-27T18:13:14.415661+0000","last_unstale":"2023-11-27T18:13:22.143343+0000","last_undegraded":"2023-11-27T18:13:22.143343+0000","last_fullsized":"2023-11-27T18:13:22.143343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:56:36.729814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.927866+0000","last_change":"2023-11-27T18:13:14.413859+0000","last_active":"2023-11-27T18:13:21.927866+0000","last_peered":"2023-11-27T18:13:21.927866+0000","last_clean":"2023-11-27T18:13:21.927866+0000","last_became_active":"2023-11-27T18:13:14.413542+0000","last_became_peered":"2023-11-27T18:13:14.413542+0000","last_unstale":"2023-11-27T18:13:21.927866+0000","last_undegraded":"2023-11-27T18:13:21.927866+0000","last_fullsized":"2023-11-27T18:13:21.927866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:24:16.125984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.145639+0000","last_change":"2023-11-27T18:13:14.417018+0000","last_active":"2023-11-27T18:13:22.145639+0000","last_peered":"2023-11-27T18:13:22.145639+0000","last_clean":"2023-11-27T18:13:22.145639+0000","last_became_active":"2023-11-27T18:13:14.416556+0000","last_became_peered":"2023-11-27T18:13:14.416556+0000","last_unstale":"2023-11-27T18:13:22.145639+0000","last_undegraded":"2023-11-27T18:13:22.145639+0000","last_fullsized":"2023-11-27T18:13:22.145639+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:03:59.054125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.142510+0000","last_change":"2023-11-27T18:13:14.419437+0000","last_active":"2023-11-27T18:13:22.142510+0000","last_peered":"2023-11-27T18:13:22.142510+0000","last_clean":"2023-11-27T18:13:22.142510+0000","last_became_active":"2023-11-27T18:13:14.418823+0000","last_became_peered":"2023-11-27T18:13:14.418823+0000","last_unstale":"2023-11-27T18:13:22.142510+0000","last_undegraded":"2023-11-27T18:13:22.142510+0000","last_fullsized":"2023-11-27T18:13:22.142510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:26:36.101388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.138403+0000","last_change":"2023-11-27T18:13:14.368373+0000","last_active":"2023-11-27T18:13:22.138403+0000","last_peered":"2023-11-27T18:13:22.138403+0000","last_clean":"2023-11-27T18:13:22.138403+0000","last_became_active":"2023-11-27T18:13:14.368100+0000","last_became_peered":"2023-11-27T18:13:14.368100+0000","last_unstale":"2023-11-27T18:13:22.138403+0000","last_undegraded":"2023-11-27T18:13:22.138403+0000","last_fullsized":"2023-11-27T18:13:22.138403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:27:05.736955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.139108+0000","last_change":"2023-11-27T18:13:14.376812+0000","last_active":"2023-11-27T18:13:22.139108+0000","last_peered":"2023-11-27T18:13:22.139108+0000","last_clean":"2023-11-27T18:13:22.139108+0000","last_became_active":"2023-11-27T18:13:14.376559+0000","last_became_peered":"2023-11-27T18:13:14.376559+0000","last_unstale":"2023-11-27T18:13:22.139108+0000","last_undegraded":"2023-11-27T18:13:22.139108+0000","last_fullsized":"2023-11-27T18:13:22.139108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:31:25.796567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140209+0000","last_change":"2023-11-27T18:13:14.367518+0000","last_active":"2023-11-27T18:13:22.140209+0000","last_peered":"2023-11-27T18:13:22.140209+0000","last_clean":"2023-11-27T18:13:22.140209+0000","last_became_active":"2023-11-27T18:13:14.367298+0000","last_became_peered":"2023-11-27T18:13:14.367298+0000","last_unstale":"2023-11-27T18:13:22.140209+0000","last_undegraded":"2023-11-27T18:13:22.140209+0000","last_fullsized":"2023-11-27T18:13:22.140209+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:48:00.722511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140440+0000","last_change":"2023-11-27T18:13:14.364130+0000","last_active":"2023-11-27T18:13:22.140440+0000","last_peered":"2023-11-27T18:13:22.140440+0000","last_clean":"2023-11-27T18:13:22.140440+0000","last_became_active":"2023-11-27T18:13:14.363776+0000","last_became_peered":"2023-11-27T18:13:14.363776+0000","last_unstale":"2023-11-27T18:13:22.140440+0000","last_undegraded":"2023-11-27T18:13:22.140440+0000","last_fullsized":"2023-11-27T18:13:22.140440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:14:10.603135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140667+0000","last_change":"2023-11-27T18:13:14.423459+0000","last_active":"2023-11-27T18:13:22.140667+0000","last_peered":"2023-11-27T18:13:22.140667+0000","last_clean":"2023-11-27T18:13:22.140667+0000","last_became_active":"2023-11-27T18:13:14.423099+0000","last_became_peered":"2023-11-27T18:13:14.423099+0000","last_unstale":"2023-11-27T18:13:22.140667+0000","last_undegraded":"2023-11-27T18:13:22.140667+0000","last_fullsized":"2023-11-27T18:13:22.140667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:39:33.850547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.142197+0000","last_change":"2023-11-27T18:13:14.420348+0000","last_active":"2023-11-27T18:13:22.142197+0000","last_peered":"2023-11-27T18:13:22.142197+0000","last_clean":"2023-11-27T18:13:22.142197+0000","last_became_active":"2023-11-27T18:13:14.419780+0000","last_became_peered":"2023-11-27T18:13:14.419780+0000","last_unstale":"2023-11-27T18:13:22.142197+0000","last_undegraded":"2023-11-27T18:13:22.142197+0000","last_fullsized":"2023-11-27T18:13:22.142197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:49:00.537995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.141371+0000","last_change":"2023-11-27T18:13:15.910347+0000","last_active":"2023-11-27T18:13:22.141371+0000","last_peered":"2023-11-27T18:13:22.141371+0000","last_clean":"2023-11-27T18:13:22.141371+0000","last_became_active":"2023-11-27T18:13:15.909918+0000","last_became_peered":"2023-11-27T18:13:15.909918+0000","last_unstale":"2023-11-27T18:13:22.141371+0000","last_undegraded":"2023-11-27T18:13:22.141371+0000","last_fullsized":"2023-11-27T18:13:22.141371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:14:48.774302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.138428+0000","last_change":"2023-11-27T18:13:14.369974+0000","last_active":"2023-11-27T18:13:22.138428+0000","last_peered":"2023-11-27T18:13:22.138428+0000","last_clean":"2023-11-27T18:13:22.138428+0000","last_became_active":"2023-11-27T18:13:14.369285+0000","last_became_peered":"2023-11-27T18:13:14.369285+0000","last_unstale":"2023-11-27T18:13:22.138428+0000","last_undegraded":"2023-11-27T18:13:22.138428+0000","last_fullsized":"2023-11-27T18:13:22.138428+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:23:56.484932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.141001+0000","last_change":"2023-11-27T18:13:14.385745+0000","last_active":"2023-11-27T18:13:22.141001+0000","last_peered":"2023-11-27T18:13:22.141001+0000","last_clean":"2023-11-27T18:13:22.141001+0000","last_became_active":"2023-11-27T18:13:14.385566+0000","last_became_peered":"2023-11-27T18:13:14.385566+0000","last_unstale":"2023-11-27T18:13:22.141001+0000","last_undegraded":"2023-11-27T18:13:22.141001+0000","last_fullsized":"2023-11-27T18:13:22.141001+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:52:43.071209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.071894+0000","last_change":"2023-11-27T18:13:15.848952+0000","last_active":"2023-11-27T18:13:22.071894+0000","last_peered":"2023-11-27T18:13:22.071894+0000","last_clean":"2023-11-27T18:13:22.071894+0000","last_became_active":"2023-11-27T18:13:15.848237+0000","last_became_peered":"2023-11-27T18:13:15.848237+0000","last_unstale":"2023-11-27T18:13:22.071894+0000","last_undegraded":"2023-11-27T18:13:22.071894+0000","last_fullsized":"2023-11-27T18:13:22.071894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:39:39.512202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140762+0000","last_change":"2023-11-27T18:13:14.373247+0000","last_active":"2023-11-27T18:13:22.140762+0000","last_peered":"2023-11-27T18:13:22.140762+0000","last_clean":"2023-11-27T18:13:22.140762+0000","last_became_active":"2023-11-27T18:13:14.372974+0000","last_became_peered":"2023-11-27T18:13:14.372974+0000","last_unstale":"2023-11-27T18:13:22.140762+0000","last_undegraded":"2023-11-27T18:13:22.140762+0000","last_fullsized":"2023-11-27T18:13:22.140762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:39:34.589545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.071176+0000","last_change":"2023-11-27T18:13:15.851685+0000","last_active":"2023-11-27T18:13:22.071176+0000","last_peered":"2023-11-27T18:13:22.071176+0000","last_clean":"2023-11-27T18:13:22.071176+0000","last_became_active":"2023-11-27T18:13:15.850353+0000","last_became_peered":"2023-11-27T18:13:15.850353+0000","last_unstale":"2023-11-27T18:13:22.071176+0000","last_undegraded":"2023-11-27T18:13:22.071176+0000","last_fullsized":"2023-11-27T18:13:22.071176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:51:02.615119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140426+0000","last_change":"2023-11-27T18:13:14.381126+0000","last_active":"2023-11-27T18:13:22.140426+0000","last_peered":"2023-11-27T18:13:22.140426+0000","last_clean":"2023-11-27T18:13:22.140426+0000","last_became_active":"2023-11-27T18:13:14.380714+0000","last_became_peered":"2023-11-27T18:13:14.380714+0000","last_unstale":"2023-11-27T18:13:22.140426+0000","last_undegraded":"2023-11-27T18:13:22.140426+0000","last_fullsized":"2023-11-27T18:13:22.140426+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:14:10.603135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.141208+0000","last_change":"2023-11-27T18:13:14.368254+0000","last_active":"2023-11-27T18:13:22.141208+0000","last_peered":"2023-11-27T18:13:22.141208+0000","last_clean":"2023-11-27T18:13:22.141208+0000","last_became_active":"2023-11-27T18:13:14.367978+0000","last_became_peered":"2023-11-27T18:13:14.367978+0000","last_unstale":"2023-11-27T18:13:22.141208+0000","last_undegraded":"2023-11-27T18:13:22.141208+0000","last_fullsized":"2023-11-27T18:13:22.141208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:05:05.751108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140257+0000","last_change":"2023-11-27T18:13:14.419332+0000","last_active":"2023-11-27T18:13:22.140257+0000","last_peered":"2023-11-27T18:13:22.140257+0000","last_clean":"2023-11-27T18:13:22.140257+0000","last_became_active":"2023-11-27T18:13:14.418928+0000","last_became_peered":"2023-11-27T18:13:14.418928+0000","last_unstale":"2023-11-27T18:13:22.140257+0000","last_undegraded":"2023-11-27T18:13:22.140257+0000","last_fullsized":"2023-11-27T18:13:22.140257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:34:08.186176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67010,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719476755,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31560,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340280,"statfs":{"total":96636764160,"available":96604446720,"internally_reserved":0,"allocated":385024,"data_stored":714358,"data_compressed":33505,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":17.553999999999998,"5min":17.553999999999998,"15min":17.553999999999998},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":1.2090000000000001}]},{"osd":1,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":5.4550000000000001,"5min":5.4550000000000001,"15min":5.4550000000000001},"last":1.526},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":5.3040000000000003,"5min":5.3040000000000003,"15min":5.3040000000000003},"last":0.86899999999999999}]},{"osd":2,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":7.8540000000000001,"5min":7.8540000000000001,"15min":7.8540000000000001},"last":1.159}]},{"osd":3,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":1.3300000000000001}]},{"osd":4,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":7.7759999999999998,"5min":7.7759999999999998,"15min":7.7759999999999998},"last":1.2789999999999999},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":1.1259999999999999}]},{"osd":6,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":7.8200000000000003,"5min":7.8200000000000003,"15min":7.8200000000000003},"last":1.3859999999999999}]},{"osd":7,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.3290000000000002,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.2690000000000001,"5min":2.2690000000000001,"15min":2.2690000000000001},"last":1.421}]}]},{"osd":7,"up_from":16,"seq":68719476755,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":323584,"data_stored":124841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":2.0600000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.83399999999999996}]},{"osd":1,"last update":"Mon Nov 27 18:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":2.1890000000000001,"5min":2.1890000000000001,"15min":2.1890000000000001},"last":0.75},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.6190000000000002,"5min":2.6190000000000002,"15min":2.6190000000000002},"last":1.278}]},{"osd":2,"last update":"Mon Nov 27 18:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.5649999999999999,"5min":2.5649999999999999,"15min":2.5649999999999999},"last":1.54},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.97199999999999998}]},{"osd":3,"last update":"Mon Nov 27 18:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":1.087},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":4.391,"5min":4.391,"15min":4.391},"last":1.391}]},{"osd":4,"last update":"Mon Nov 27 18:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.484,"5min":2.484,"15min":2.484},"last":1.0149999999999999}]},{"osd":5,"last update":"Mon Nov 27 18:13:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":4.8440000000000003,"5min":4.8440000000000003,"15min":4.8440000000000003},"last":1.468},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":1.1220000000000001}]},{"osd":6,"last update":"Mon Nov 27 18:13:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":2.258,"5min":2.258,"15min":2.258},"last":1.2310000000000001}]}]},{"osd":6,"up_from":16,"seq":68719476755,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":315392,"data_stored":124717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":1.1499999999999999},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.2}]},{"osd":1,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":1.0289999999999999}]},{"osd":2,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":1.093},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.95599999999999996}]},{"osd":3,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":1.2330000000000001}]},{"osd":4,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":1.343}]},{"osd":5,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":1.3140000000000001},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.278}]},{"osd":7,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":2.1779999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.256},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":1.365}]}]},{"osd":3,"up_from":16,"seq":68719476753,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":319488,"data_stored":125299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.624}]},{"osd":1,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.67200000000000004}]},{"osd":2,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.76600000000000001}]},{"osd":4,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":1.0369999999999999}]},{"osd":5,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.81699999999999995}]},{"osd":6,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":1.101}]},{"osd":7,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.008},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":1.073}]}]},{"osd":2,"up_from":16,"seq":68719476754,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":128559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.8680000000000001,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":0.70499999999999996}]},{"osd":1,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.91600000000000004}]},{"osd":3,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.78400000000000003}]},{"osd":4,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.6160000000000001,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":1.014},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":1.2969999999999999}]},{"osd":5,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":1.3560000000000001},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.89100000000000001}]},{"osd":6,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.155}]},{"osd":7,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.399},{"interface":"front","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.98699999999999999}]}]},{"osd":1,"up_from":16,"seq":68719476754,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":385024,"data_stored":715155,"data_compressed":33505,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:13:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.623},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":0.90500000000000003}]},{"osd":2,"last update":"Mon Nov 27 18:13:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.72399999999999998}]},{"osd":3,"last update":"Mon Nov 27 18:13:38 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":1.0960000000000001}]},{"osd":4,"last update":"Mon Nov 27 18:13:38 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":1.0640000000000001},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":1.04}]},{"osd":5,"last update":"Mon Nov 27 18:13:38 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":1.1870000000000001},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.01}]},{"osd":6,"last update":"Mon Nov 27 18:13:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":1.3380000000000001}]},{"osd":7,"last update":"Mon Nov 27 18:13:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.8149999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":1.2629999999999999},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":1.141}]}]},{"osd":0,"up_from":16,"seq":68719476755,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":124773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.61399999999999999}]},{"osd":2,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.90100000000000002}]},{"osd":3,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.71899999999999997}]},{"osd":4,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":1.032},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.98799999999999999}]},{"osd":5,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":1.1759999999999999},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.96399999999999997}]},{"osd":6,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":1.117}]},{"osd":7,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.351,"5min":1.351,"15min":1.351},"last":1.0920000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509459,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31504,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340336,"statfs":{"total":96636764160,"available":96604504064,"internally_reserved":0,"allocated":335872,"data_stored":129231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.498},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.68799999999999994}]},{"osd":1,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.64600000000000002}]},{"osd":2,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.80700000000000005}]},{"osd":3,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.98699999999999999}]},{"osd":5,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.0629999999999999}]},{"osd":6,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.95799999999999996}]},{"osd":7,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":1.014},{"interface":"front","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":1.0349999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33505,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33505,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T18:13:58.781 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-27T18:13:58.781 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-27T18:13:58.781 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-27T18:13:58.781 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-27T18:13:58.782 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-27T18:13:58.939 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.941+0000 7f72f28a0640 1 Processor -- start 2023-11-27T18:13:58.939 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.941+0000 7f72f28a0640 1 -- start start 2023-11-27T18:13:58.940 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.945+0000 7f72f28a0640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f72ec1504c0 0x7f72ec15a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:58.940 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.945+0000 7f72f28a0640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f72ec0c8610 0x7f72ec071f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:58.940 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.945+0000 7f72f28a0640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72ec15a900 con 0x7f72ec1508a0 2023-11-27T18:13:58.941 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.945+0000 7f72f28a0640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72ec0c1b10 con 0x7f72ec0c8610 2023-11-27T18:13:58.941 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.945+0000 7f72f28a0640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72ec1563c0 con 0x7f72ec1504c0 2023-11-27T18:13:58.941 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.945+0000 7f72f0e3d640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f72ec1508a0 0x7f72ec0c6680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:34094/0 (socket says 172.21.15.91:34094) 2023-11-27T18:13:58.941 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.945+0000 7f72f0e3d640 1 -- 172.21.15.91:0/2578439099 learned_addr learned my addr 172.21.15.91:0/2578439099 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:13:58.942 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.945+0000 7f72ebfff640 1 --2- 172.21.15.91:0/2578439099 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f72ec1504c0 0x7f72ec15a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:58.942 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.945+0000 7f72e3fff640 1 --2- 172.21.15.91:0/2578439099 >> v2:172.21.15.94:3300/0 conn(0x7f72ec0c8610 0x7f72ec071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:58.943 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.945+0000 7f72eb7fe640 1 -- 172.21.15.91:0/2578439099 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3387344765 0 0) 0x7f72ec15a900 con 0x7f72ec1508a0 2023-11-27T18:13:58.943 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.945+0000 7f72eb7fe640 1 -- 172.21.15.91:0/2578439099 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72d8003530 con 0x7f72ec1508a0 2023-11-27T18:13:58.948 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.949+0000 7f72eb7fe640 1 -- 172.21.15.91:0/2578439099 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3264656568 0 0) 0x7f72d8003530 con 0x7f72ec1508a0 2023-11-27T18:13:58.948 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.949+0000 7f72eb7fe640 1 -- 172.21.15.91:0/2578439099 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f72ec1504c0 msgr2=0x7f72ec15a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:58.948 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.949+0000 7f72eb7fe640 1 --2- 172.21.15.91:0/2578439099 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f72ec1504c0 0x7f72ec15a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:58.948 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.949+0000 7f72eb7fe640 1 -- 172.21.15.91:0/2578439099 >> v2:172.21.15.94:3300/0 conn(0x7f72ec0c8610 msgr2=0x7f72ec071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:58.948 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.949+0000 7f72eb7fe640 1 --2- 172.21.15.91:0/2578439099 >> v2:172.21.15.94:3300/0 conn(0x7f72ec0c8610 0x7f72ec071f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:58.948 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.949+0000 7f72eb7fe640 1 -- 172.21.15.91:0/2578439099 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72ec0c6200 con 0x7f72ec1508a0 2023-11-27T18:13:58.948 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.949+0000 7f72eb7fe640 1 -- 172.21.15.91:0/2578439099 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3378743932 0 0) 0x7f72e4001a00 con 0x7f72ec1508a0 2023-11-27T18:13:58.949 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.949+0000 7f72eb7fe640 1 -- 172.21.15.91:0/2578439099 >> v1:172.21.15.91:6789/0 conn(0x7f72ec1508a0 legacy=0x7f72ec0c6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:58.949 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.949+0000 7f72eb7fe640 1 --2- 172.21.15.91:0/2578439099 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f72d8003980 0x7f72d8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:58.949 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.949+0000 7f72eb7fe640 1 --2- 172.21.15.91:0/2578439099 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72d80047d0 0x7f72d8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:58.949 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.949+0000 7f72eb7fe640 1 --2- 172.21.15.91:0/2578439099 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f72ec1504c0 0x7f72d8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:58.949 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.949+0000 7f72eb7fe640 1 -- 172.21.15.91:0/2578439099 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ec1563c0 con 0x7f72d8003980 2023-11-27T18:13:58.949 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.949+0000 7f72eb7fe640 1 -- 172.21.15.91:0/2578439099 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d800b990 con 0x7f72d80047d0 2023-11-27T18:13:58.949 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.949+0000 7f72eb7fe640 1 -- 172.21.15.91:0/2578439099 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72d800bb00 con 0x7f72ec1504c0 2023-11-27T18:13:58.950 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.953+0000 7f72ebfff640 1 --2- 172.21.15.91:0/2578439099 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f72d8003980 0x7f72d8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:58.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.957+0000 7f72ebfff640 1 -- 172.21.15.91:0/2578439099 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f72ec1504c0 msgr2=0x7f72d8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:58.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.957+0000 7f72ebfff640 1 --2- 172.21.15.91:0/2578439099 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f72ec1504c0 0x7f72d8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:58.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.957+0000 7f72ebfff640 1 -- 172.21.15.91:0/2578439099 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72d80047d0 msgr2=0x7f72d8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:58.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.957+0000 7f72ebfff640 1 --2- 172.21.15.91:0/2578439099 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72d80047d0 0x7f72d8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:58.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.957+0000 7f72ebfff640 1 -- 172.21.15.91:0/2578439099 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d8003530 con 0x7f72d8003980 2023-11-27T18:13:58.957 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.961+0000 7f72ebfff640 1 --2- 172.21.15.91:0/2578439099 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f72d8003980 0x7f72d8003da0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f72dc009ae0 tx=0x7f72dc01ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd0c007fc9bd7ab3 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:58.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.965+0000 7f72eb7fe640 1 -- 172.21.15.91:0/2578439099 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72dc0a55a0 con 0x7f72d8003980 2023-11-27T18:13:58.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.965+0000 7f72eb7fe640 1 -- 172.21.15.91:0/2578439099 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72dc0a5700 con 0x7f72d8003980 2023-11-27T18:13:58.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.965+0000 7f72eb7fe640 1 -- 172.21.15.91:0/2578439099 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72dc0a5ab0 con 0x7f72d8003980 2023-11-27T18:13:58.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.965+0000 7f72f28a0640 1 -- 172.21.15.91:0/2578439099 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f72d8003980 msgr2=0x7f72d8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:58.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.965+0000 7f72f28a0640 1 --2- 172.21.15.91:0/2578439099 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f72d8003980 0x7f72d8003da0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f72dc009ae0 tx=0x7f72dc01ca90 comp rx=0 tx=0).stop 2023-11-27T18:13:58.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.965+0000 7f72f0e3d640 1 -- 172.21.15.91:0/2578439099 reap_dead start 2023-11-27T18:13:58.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.965+0000 7f72f28a0640 1 -- 172.21.15.91:0/2578439099 shutdown_connections 2023-11-27T18:13:58.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.965+0000 7f72f28a0640 1 -- 172.21.15.91:0/2578439099 >> 172.21.15.91:0/2578439099 conn(0x7f72ec0c79b0 msgr2=0x7f72ec0c7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:58.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.965+0000 7f72f28a0640 1 -- 172.21.15.91:0/2578439099 shutdown_connections 2023-11-27T18:13:58.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.965+0000 7f72f28a0640 1 -- 172.21.15.91:0/2578439099 wait complete. 2023-11-27T18:13:58.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.965+0000 7f72f28a0640 1 Processor -- start 2023-11-27T18:13:58.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.965+0000 7f72f28a0640 1 -- start start 2023-11-27T18:13:58.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.969+0000 7f72f28a0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72ec13cb90 0x7f72ec0c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:58.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.969+0000 7f72f28a0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f72ec13cf70 0x7f72ec0c9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:58.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.969+0000 7f72f28a0640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f72ec153680 0x7f72ec1f0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:58.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.969+0000 7f72f28a0640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ec0ca580 con 0x7f72ec13cf70 2023-11-27T18:13:58.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.969+0000 7f72f28a0640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ec0c4fd0 con 0x7f72ec13cb90 2023-11-27T18:13:58.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.969+0000 7f72f28a0640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72ec151eb0 con 0x7f72ec153680 2023-11-27T18:13:58.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.969+0000 7f72e3fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f72ec13cf70 0x7f72ec0c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:58.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.969+0000 7f72e3fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f72ec13cf70 0x7f72ec0c9360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44626/0 (socket says 172.21.15.91:44626) 2023-11-27T18:13:58.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.969+0000 7f72e3fff640 1 -- 172.21.15.91:0/4017789266 learned_addr learned my addr 172.21.15.91:0/4017789266 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:58.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.969+0000 7f72ebfff640 1 --2- 172.21.15.91:0/4017789266 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72ec13cb90 0x7f72ec0c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:58.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.969+0000 7f72f0e3d640 1 --2- 172.21.15.91:0/4017789266 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f72ec153680 0x7f72ec1f0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:58.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.973+0000 7f72e3fff640 1 -- 172.21.15.91:0/4017789266 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f72ec153680 msgr2=0x7f72ec1f0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:58.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.973+0000 7f72e3fff640 1 --2- 172.21.15.91:0/4017789266 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f72ec153680 0x7f72ec1f0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:58.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.973+0000 7f72e3fff640 1 -- 172.21.15.91:0/4017789266 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72ec13cb90 msgr2=0x7f72ec0c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:58.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.973+0000 7f72e3fff640 1 --2- 172.21.15.91:0/4017789266 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72ec13cb90 0x7f72ec0c8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:58.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.973+0000 7f72e3fff640 1 -- 172.21.15.91:0/4017789266 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72ec0c2a70 con 0x7f72ec13cf70 2023-11-27T18:13:58.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.973+0000 7f72e3fff640 1 --2- 172.21.15.91:0/4017789266 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f72ec13cf70 0x7f72ec0c9360 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f72d400e7f0 tx=0x7f72d400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:58.975 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.977+0000 7f72e97fa640 1 -- 172.21.15.91:0/4017789266 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d400c940 con 0x7f72ec13cf70 2023-11-27T18:13:58.975 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.977+0000 7f72e97fa640 1 -- 172.21.15.91:0/4017789266 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d400caa0 con 0x7f72ec13cf70 2023-11-27T18:13:58.975 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.977+0000 7f72e97fa640 1 -- 172.21.15.91:0/4017789266 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d400ce30 con 0x7f72ec13cf70 2023-11-27T18:13:58.975 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.977+0000 7f72f28a0640 1 -- 172.21.15.91:0/4017789266 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72ec0c32e0 con 0x7f72ec13cf70 2023-11-27T18:13:58.975 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.977+0000 7f72f28a0640 1 -- 172.21.15.91:0/4017789266 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72ec0c2760 con 0x7f72ec13cf70 2023-11-27T18:13:58.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:58.981+0000 7f72f28a0640 1 -- 172.21.15.91:0/4017789266 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72ec067150 con 0x7f72ec13cf70 2023-11-27T18:13:58.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.001+0000 7f72e97fa640 1 -- 172.21.15.91:0/4017789266 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f72d4013470 con 0x7f72ec13cf70 2023-11-27T18:13:58.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.001+0000 7f72e97fa640 1 --2- 172.21.15.91:0/4017789266 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f72cc066870 0x7f72cc068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:58.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.001+0000 7f72ebfff640 1 --2- 172.21.15.91:0/4017789266 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f72cc066870 0x7f72cc068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:58.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.001+0000 7f72ebfff640 1 --2- 172.21.15.91:0/4017789266 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f72cc066870 0x7f72cc068d30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f72dc0af000 tx=0x7f72dc0046d0 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:58.999 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.001+0000 7f72e97fa640 1 -- 172.21.15.91:0/4017789266 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f72d4055850 con 0x7f72ec13cf70 2023-11-27T18:13:59.272 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.277+0000 7f72e97fa640 1 -- 172.21.15.91:0/4017789266 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f72d4051b90 con 0x7f72ec13cf70 2023-11-27T18:13:59.476 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.481+0000 7f72f28a0640 1 -- 172.21.15.91:0/4017789266 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f72ec153de0 con 0x7f72ec13cf70 2023-11-27T18:13:59.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.685+0000 7f72e97fa640 1 -- 172.21.15.91:0/4017789266 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v7) v1 ==== 74+0+164563 (secure 0 0 0) 0x7f72d4021020 con 0x7f72ec13cf70 2023-11-27T18:13:59.683 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:13:59.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.689+0000 7f72f28a0640 1 -- 172.21.15.91:0/4017789266 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f72cc066870 msgr2=0x7f72cc068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:59.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.689+0000 7f72f28a0640 1 --2- 172.21.15.91:0/4017789266 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f72cc066870 0x7f72cc068d30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f72dc0af000 tx=0x7f72dc0046d0 comp rx=0 tx=0).stop 2023-11-27T18:13:59.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.689+0000 7f72f28a0640 1 -- 172.21.15.91:0/4017789266 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f72ec13cf70 msgr2=0x7f72ec0c9360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:59.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.689+0000 7f72f28a0640 1 --2- 172.21.15.91:0/4017789266 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f72ec13cf70 0x7f72ec0c9360 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f72d400e7f0 tx=0x7f72d400ecb0 comp rx=0 tx=0).stop 2023-11-27T18:13:59.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.689+0000 7f72f28a0640 1 -- 172.21.15.91:0/4017789266 shutdown_connections 2023-11-27T18:13:59.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.689+0000 7f72f28a0640 1 --2- 172.21.15.91:0/4017789266 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f72cc066870 0x7f72cc068d30 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:59.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.689+0000 7f72f28a0640 1 --2- 172.21.15.91:0/4017789266 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f72ec153680 0x7f72ec1f0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:59.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.689+0000 7f72f28a0640 1 --2- 172.21.15.91:0/4017789266 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f72ec13cf70 0x7f72ec0c9360 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:59.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.689+0000 7f72f28a0640 1 --2- 172.21.15.91:0/4017789266 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72ec13cb90 0x7f72ec0c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:59.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.689+0000 7f72f28a0640 1 -- 172.21.15.91:0/4017789266 >> 172.21.15.91:0/4017789266 conn(0x7f72ec0c79b0 msgr2=0x7f72ec0b0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:59.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.689+0000 7f72f28a0640 1 -- 172.21.15.91:0/4017789266 shutdown_connections 2023-11-27T18:13:59.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.689+0000 7f72f28a0640 1 -- 172.21.15.91:0/4017789266 wait complete. 2023-11-27T18:13:59.705 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":7,"active_gid":4136,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":2814827118},{"type":"v1","addr":"172.21.15.91:6801","nonce":2814827118}]},"active_addr":"172.21.15.91:6801/2814827118","active_change":"2023-11-27T18:12:18.208596+0000","active_mgr_features":4540701272860131327,"available":true,"standbys":[{"gid":4100,"name":"x","mgr_features":4540701272860131327,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":10,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.91:0","nonce":3016505842}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.91:0","nonce":743233250}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.91:0","nonce":3769225108}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.91:0","nonce":2233211319}]}]} 2023-11-27T18:13:59.708 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-27T18:13:59.708 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-27T18:13:59.708 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T18:13:59.828 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.833+0000 7f0452bfa640 1 Processor -- start 2023-11-27T18:13:59.828 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.833+0000 7f0452bfa640 1 -- start start 2023-11-27T18:13:59.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.833+0000 7f0452bfa640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f044c070cc0 0x7f044c157e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:59.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.833+0000 7f0452bfa640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f044c0710a0 0x7f044c1512b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:59.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.833+0000 7f0452bfa640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f044c15a9b0 con 0x7f044c0c7a80 2023-11-27T18:13:59.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.833+0000 7f0452bfa640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f044c0b0440 con 0x7f044c0710a0 2023-11-27T18:13:59.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.833+0000 7f0452bfa640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f044c158350 con 0x7f044c070cc0 2023-11-27T18:13:59.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.833+0000 7f0451197640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f044c0710a0 0x7f044c1512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:59.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.833+0000 7f0451197640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f044c0710a0 0x7f044c1512b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44636/0 (socket says 172.21.15.91:44636) 2023-11-27T18:13:59.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.833+0000 7f0451197640 1 -- 172.21.15.91:0/2179537700 learned_addr learned my addr 172.21.15.91:0/2179537700 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:59.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.841+0000 7f0451197640 1 -- 172.21.15.91:0/2179537700 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f044c070cc0 msgr2=0x7f044c157e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:13:59.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.841+0000 7f0451197640 1 --2- 172.21.15.91:0/2179537700 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f044c070cc0 0x7f044c157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:59.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.841+0000 7f0451197640 1 -- 172.21.15.91:0/2179537700 >> v1:172.21.15.91:6789/0 conn(0x7f044c0c7a80 legacy=0x7f044c15b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:59.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.841+0000 7f0451197640 1 -- 172.21.15.91:0/2179537700 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f044c0c2330 con 0x7f044c0710a0 2023-11-27T18:13:59.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.845+0000 7f0451197640 1 --2- 172.21.15.91:0/2179537700 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f044c0710a0 0x7f044c1512b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0444009e50 tx=0x7f044401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f52ee526ded4ffe8 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:59.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.849+0000 7f044b7fe640 1 -- 172.21.15.91:0/2179537700 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04440a57c0 con 0x7f044c0710a0 2023-11-27T18:13:59.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.849+0000 7f044b7fe640 1 -- 172.21.15.91:0/2179537700 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04440a5920 con 0x7f044c0710a0 2023-11-27T18:13:59.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.849+0000 7f044b7fe640 1 -- 172.21.15.91:0/2179537700 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04440a5cb0 con 0x7f044c0710a0 2023-11-27T18:13:59.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.849+0000 7f0452bfa640 1 -- 172.21.15.91:0/2179537700 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f044c0710a0 msgr2=0x7f044c1512b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:59.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.849+0000 7f0452bfa640 1 --2- 172.21.15.91:0/2179537700 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f044c0710a0 0x7f044c1512b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0444009e50 tx=0x7f044401c9e0 comp rx=0 tx=0).stop 2023-11-27T18:13:59.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.849+0000 7f0452bfa640 1 -- 172.21.15.91:0/2179537700 shutdown_connections 2023-11-27T18:13:59.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.849+0000 7f0452bfa640 1 --2- 172.21.15.91:0/2179537700 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f044c0710a0 0x7f044c1512b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:59.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.849+0000 7f0452bfa640 1 --2- 172.21.15.91:0/2179537700 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f044c070cc0 0x7f044c157e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:59.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.849+0000 7f0452bfa640 1 -- 172.21.15.91:0/2179537700 >> 172.21.15.91:0/2179537700 conn(0x7f044c06a520 msgr2=0x7f044c06a930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:13:59.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.849+0000 7f0452bfa640 1 -- 172.21.15.91:0/2179537700 shutdown_connections 2023-11-27T18:13:59.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.849+0000 7f0452bfa640 1 -- 172.21.15.91:0/2179537700 wait complete. 2023-11-27T18:13:59.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.849+0000 7f0452bfa640 1 Processor -- start 2023-11-27T18:13:59.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.849+0000 7f0452bfa640 1 -- start start 2023-11-27T18:13:59.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.853+0000 7f0452bfa640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f044c070cc0 0x7f044c1f6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:59.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.853+0000 7f0452bfa640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f044c0710a0 0x7f044c0b2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:59.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.853+0000 7f0452bfa640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f044c0c7a80 0x7f044c140730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:59.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.853+0000 7f0452bfa640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f044c142480 con 0x7f044c070cc0 2023-11-27T18:13:59.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.853+0000 7f0452bfa640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f044c1f7370 con 0x7f044c0710a0 2023-11-27T18:13:59.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.853+0000 7f0452bfa640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f044c14dc80 con 0x7f044c0c7a80 2023-11-27T18:13:59.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.853+0000 7f0450996640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f044c070cc0 0x7f044c1f6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:59.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.853+0000 7f0450996640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f044c070cc0 0x7f044c1f6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44652/0 (socket says 172.21.15.91:44652) 2023-11-27T18:13:59.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.853+0000 7f0450996640 1 -- 172.21.15.91:0/1097556865 learned_addr learned my addr 172.21.15.91:0/1097556865 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:13:59.852 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.857+0000 7f0450996640 1 -- 172.21.15.91:0/1097556865 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f044c0c7a80 msgr2=0x7f044c140730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:59.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.857+0000 7f0450996640 1 --2- 172.21.15.91:0/1097556865 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f044c0c7a80 0x7f044c140730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:59.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.857+0000 7f0450996640 1 -- 172.21.15.91:0/1097556865 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f044c0710a0 msgr2=0x7f044c0b2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:13:59.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.857+0000 7f0450996640 1 --2- 172.21.15.91:0/1097556865 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f044c0710a0 0x7f044c0b2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:13:59.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.857+0000 7f0450996640 1 -- 172.21.15.91:0/1097556865 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0444009b30 con 0x7f044c070cc0 2023-11-27T18:13:59.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.857+0000 7f0450996640 1 --2- 172.21.15.91:0/1097556865 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f044c070cc0 0x7f044c1f6e30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f044000b410 tx=0x7f044000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:13:59.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.861+0000 7f04497fa640 1 -- 172.21.15.91:0/1097556865 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0440011830 con 0x7f044c070cc0 2023-11-27T18:13:59.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.861+0000 7f04497fa640 1 -- 172.21.15.91:0/1097556865 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0440011990 con 0x7f044c070cc0 2023-11-27T18:13:59.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.861+0000 7f0452bfa640 1 -- 172.21.15.91:0/1097556865 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f044c1412c0 con 0x7f044c070cc0 2023-11-27T18:13:59.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.861+0000 7f04497fa640 1 -- 172.21.15.91:0/1097556865 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0440011d40 con 0x7f044c070cc0 2023-11-27T18:13:59.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.861+0000 7f0452bfa640 1 -- 172.21.15.91:0/1097556865 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f044c141870 con 0x7f044c070cc0 2023-11-27T18:13:59.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.861+0000 7f0452bfa640 1 -- 172.21.15.91:0/1097556865 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f044c0c30d0 con 0x7f044c070cc0 2023-11-27T18:13:59.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.881+0000 7f04497fa640 1 -- 172.21.15.91:0/1097556865 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f0440023430 con 0x7f044c070cc0 2023-11-27T18:13:59.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.885+0000 7f04497fa640 1 --2- 172.21.15.91:0/1097556865 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f0430066840 0x7f0430068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:13:59.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.885+0000 7f044bfff640 1 --2- 172.21.15.91:0/1097556865 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f0430066840 0x7f0430068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:13:59.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:13:59.885+0000 7f044bfff640 1 --2- 172.21.15.91:0/1097556865 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f0430066840 0x7f0430068d00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0438000f70 tx=0x7f04380079c0 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:00.147 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.149+0000 7f04497fa640 1 -- 172.21.15.91:0/1097556865 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f04400559b0 con 0x7f044c070cc0 2023-11-27T18:14:00.147 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.149+0000 7f04497fa640 1 -- 172.21.15.91:0/1097556865 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f04400515f0 con 0x7f044c070cc0 2023-11-27T18:14:00.308 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.313+0000 7f0452bfa640 1 -- 172.21.15.91:0/1097556865 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f044c0c8970 con 0x7f044c070cc0 2023-11-27T18:14:00.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.393+0000 7f04497fa640 1 -- 172.21.15.91:0/1097556865 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f0440015070 con 0x7f044c070cc0 2023-11-27T18:14:00.389 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:14:00.389 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":30,"fsid":"08c8ebbf-7936-4c41-a995-d5600de2d072","created":"2023-11-27T18:12:06.484593+0000","modified":"2023-11-27T18:13:22.801287+0000","last_up_change":"2023-11-27T18:12:33.154694+0000","last_in_change":"2023-11-27T18:12:23.622113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T18:12:35.450305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T18:13:09.589619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T18:13:11.439236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-27T18:13:18.514694+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ad53c08-dd19-4ae6-87c5-fa15bea3b4ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6811","nonce":472303992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6813","nonce":472303992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6817","nonce":472303992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6815","nonce":472303992}]},"public_addr":"172.21.15.91:6811/472303992","cluster_addr":"172.21.15.91:6813/472303992","heartbeat_back_addr":"172.21.15.91:6817/472303992","heartbeat_front_addr":"172.21.15.91:6815/472303992","state":["exists","up"]},{"osd":1,"uuid":"f8b5f147-ed29-4329-a787-a12cc34a2569","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6827","nonce":12316911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6829","nonce":12316911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6833","nonce":12316911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6831","nonce":12316911}]},"public_addr":"172.21.15.91:6827/12316911","cluster_addr":"172.21.15.91:6829/12316911","heartbeat_back_addr":"172.21.15.91:6833/12316911","heartbeat_front_addr":"172.21.15.91:6831/12316911","state":["exists","up"]},{"osd":2,"uuid":"c3029f9a-1c48-4f5d-983a-172a614d8795","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6803","nonce":3776125919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6805","nonce":3776125919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6809","nonce":3776125919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6807","nonce":3776125919}]},"public_addr":"172.21.15.91:6803/3776125919","cluster_addr":"172.21.15.91:6805/3776125919","heartbeat_back_addr":"172.21.15.91:6809/3776125919","heartbeat_front_addr":"172.21.15.91:6807/3776125919","state":["exists","up"]},{"osd":3,"uuid":"ab4b6fb2-0126-491b-9224-54a6badc5da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6819","nonce":1297704794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6821","nonce":1297704794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6825","nonce":1297704794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6823","nonce":1297704794}]},"public_addr":"172.21.15.91:6819/1297704794","cluster_addr":"172.21.15.91:6821/1297704794","heartbeat_back_addr":"172.21.15.91:6825/1297704794","heartbeat_front_addr":"172.21.15.91:6823/1297704794","state":["exists","up"]},{"osd":4,"uuid":"695071a8-2de8-4cba-bf20-050021a03bb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6809","nonce":2501531833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6811","nonce":2501531833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6815","nonce":2501531833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6813","nonce":2501531833}]},"public_addr":"172.21.15.94:6809/2501531833","cluster_addr":"172.21.15.94:6811/2501531833","heartbeat_back_addr":"172.21.15.94:6815/2501531833","heartbeat_front_addr":"172.21.15.94:6813/2501531833","state":["exists","up"]},{"osd":5,"uuid":"ca01da14-a700-4845-8db2-f5e3370677e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6817","nonce":2448969592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6819","nonce":2448969592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6823","nonce":2448969592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6821","nonce":2448969592}]},"public_addr":"172.21.15.94:6817/2448969592","cluster_addr":"172.21.15.94:6819/2448969592","heartbeat_back_addr":"172.21.15.94:6823/2448969592","heartbeat_front_addr":"172.21.15.94:6821/2448969592","state":["exists","up"]},{"osd":6,"uuid":"4784bc77-6c33-4e47-abba-d37484982f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6825","nonce":3389553935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6827","nonce":3389553935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6831","nonce":3389553935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6829","nonce":3389553935}]},"public_addr":"172.21.15.94:6825/3389553935","cluster_addr":"172.21.15.94:6827/3389553935","heartbeat_back_addr":"172.21.15.94:6831/3389553935","heartbeat_front_addr":"172.21.15.94:6829/3389553935","state":["exists","up"]},{"osd":7,"uuid":"b954cf3f-4a4f-4a75-9f90-014f72c16d15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6801","nonce":1606498064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6803","nonce":1606498064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6807","nonce":1606498064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6805","nonce":1606498064}]},"public_addr":"172.21.15.94:6801/1606498064","cluster_addr":"172.21.15.94:6803/1606498064","heartbeat_back_addr":"172.21.15.94:6807/1606498064","heartbeat_front_addr":"172.21.15.94:6805/1606498064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.534968+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.506182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.339267+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.532432+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:28.935756+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.471559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.485014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.352978+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T18:14:00.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.393+0000 7f0452bfa640 1 -- 172.21.15.91:0/1097556865 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f0430066840 msgr2=0x7f0430068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:00.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.393+0000 7f0452bfa640 1 --2- 172.21.15.91:0/1097556865 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f0430066840 0x7f0430068d00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0438000f70 tx=0x7f04380079c0 comp rx=0 tx=0).stop 2023-11-27T18:14:00.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.393+0000 7f0452bfa640 1 -- 172.21.15.91:0/1097556865 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f044c070cc0 msgr2=0x7f044c1f6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:00.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.393+0000 7f0452bfa640 1 --2- 172.21.15.91:0/1097556865 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f044c070cc0 0x7f044c1f6e30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f044000b410 tx=0x7f044000b8d0 comp rx=0 tx=0).stop 2023-11-27T18:14:00.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.393+0000 7f0452bfa640 1 -- 172.21.15.91:0/1097556865 shutdown_connections 2023-11-27T18:14:00.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.393+0000 7f0452bfa640 1 --2- 172.21.15.91:0/1097556865 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f0430066840 0x7f0430068d00 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:00.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.393+0000 7f0452bfa640 1 --2- 172.21.15.91:0/1097556865 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f044c0c7a80 0x7f044c140730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:00.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.393+0000 7f0452bfa640 1 --2- 172.21.15.91:0/1097556865 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f044c0710a0 0x7f044c0b2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:00.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.393+0000 7f0452bfa640 1 --2- 172.21.15.91:0/1097556865 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f044c070cc0 0x7f044c1f6e30 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:00.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.393+0000 7f0452bfa640 1 -- 172.21.15.91:0/1097556865 >> 172.21.15.91:0/1097556865 conn(0x7f044c06a520 msgr2=0x7f044c0c32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:00.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.393+0000 7f0452bfa640 1 -- 172.21.15.91:0/1097556865 shutdown_connections 2023-11-27T18:14:00.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.393+0000 7f0452bfa640 1 -- 172.21.15.91:0/1097556865 wait complete. 2023-11-27T18:14:00.413 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-27T18:14:00.414 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T18:14:00.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.541+0000 7f527a03e640 1 Processor -- start 2023-11-27T18:14:00.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.541+0000 7f527a03e640 1 -- start start 2023-11-27T18:14:00.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.541+0000 7f527a03e640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f52741516f0 0x7f52740c1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:00.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.541+0000 7f527a03e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f5274157f70 0x7f52740cccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:00.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.541+0000 7f527a03e640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52740c2fe0 con 0x7f52740c8ff0 2023-11-27T18:14:00.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.541+0000 7f527a03e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52740c85a0 con 0x7f5274157f70 2023-11-27T18:14:00.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.541+0000 7f527a03e640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52740c7f00 con 0x7f52741516f0 2023-11-27T18:14:00.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.541+0000 7f5273fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f5274157f70 0x7f52740cccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:00.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.541+0000 7f5272ffd640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f52740c8ff0 0x7f52740c3470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:34116/0 (socket says 172.21.15.91:34116) 2023-11-27T18:14:00.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.541+0000 7f5272ffd640 1 -- 172.21.15.91:0/2945320653 learned_addr learned my addr 172.21.15.91:0/2945320653 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:14:00.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.541+0000 7f52737fe640 1 --2- 172.21.15.91:0/2945320653 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f52741516f0 0x7f52740c1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:00.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.545+0000 7f5273fff640 1 -- 172.21.15.91:0/2945320653 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f52741516f0 msgr2=0x7f52740c1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:00.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.545+0000 7f5273fff640 1 --2- 172.21.15.91:0/2945320653 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f52741516f0 0x7f52740c1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:00.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.545+0000 7f5273fff640 1 -- 172.21.15.91:0/2945320653 >> v1:172.21.15.91:6789/0 conn(0x7f52740c8ff0 legacy=0x7f52740c3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:00.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.545+0000 7f5273fff640 1 -- 172.21.15.91:0/2945320653 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52740c26b0 con 0x7f5274157f70 2023-11-27T18:14:00.548 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.553+0000 7f5273fff640 1 --2- 172.21.15.91:0/2945320653 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5274157f70 0x7f52740cccc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f526c009d90 tx=0x7f526c01f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fc7282ef924099c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:00.553 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.557+0000 7f52727fc640 1 -- 172.21.15.91:0/2945320653 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c0af600 con 0x7f5274157f70 2023-11-27T18:14:00.554 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.557+0000 7f52727fc640 1 -- 172.21.15.91:0/2945320653 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f526c0ab050 con 0x7f5274157f70 2023-11-27T18:14:00.554 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.557+0000 7f52727fc640 1 -- 172.21.15.91:0/2945320653 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c0af980 con 0x7f5274157f70 2023-11-27T18:14:00.554 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.557+0000 7f527a03e640 1 -- 172.21.15.91:0/2945320653 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5274157f70 msgr2=0x7f52740cccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:00.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.557+0000 7f527a03e640 1 --2- 172.21.15.91:0/2945320653 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5274157f70 0x7f52740cccc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f526c009d90 tx=0x7f526c01f130 comp rx=0 tx=0).stop 2023-11-27T18:14:00.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.557+0000 7f527a03e640 1 -- 172.21.15.91:0/2945320653 shutdown_connections 2023-11-27T18:14:00.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.557+0000 7f527a03e640 1 --2- 172.21.15.91:0/2945320653 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5274157f70 0x7f52740cccc0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:00.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.557+0000 7f527a03e640 1 --2- 172.21.15.91:0/2945320653 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f52741516f0 0x7f52740c1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:00.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.557+0000 7f527a03e640 1 -- 172.21.15.91:0/2945320653 >> 172.21.15.91:0/2945320653 conn(0x7f527406a520 msgr2=0x7f527406a930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:00.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.557+0000 7f527a03e640 1 -- 172.21.15.91:0/2945320653 shutdown_connections 2023-11-27T18:14:00.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.557+0000 7f527a03e640 1 -- 172.21.15.91:0/2945320653 wait complete. 2023-11-27T18:14:00.556 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.557+0000 7f527a03e640 1 Processor -- start 2023-11-27T18:14:00.556 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.557+0000 7f527a03e640 1 -- start start 2023-11-27T18:14:00.556 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.561+0000 7f527a03e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f52740c8ff0 0x7f52741f3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:00.557 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.561+0000 7f527a03e640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f52741516f0 0x7f52741ef5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:00.557 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.561+0000 7f527a03e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5274157f70 0x7f5274150430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:00.557 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.561+0000 7f527a03e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527406d480 con 0x7f5274157f70 2023-11-27T18:14:00.557 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.561+0000 7f527a03e640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52741efaf0 con 0x7f52740c8ff0 2023-11-27T18:14:00.557 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.561+0000 7f527a03e640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52740cc530 con 0x7f52741516f0 2023-11-27T18:14:00.557 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.561+0000 7f5273fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5274157f70 0x7f5274150430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:00.558 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.561+0000 7f5273fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5274157f70 0x7f5274150430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44668/0 (socket says 172.21.15.91:44668) 2023-11-27T18:14:00.558 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.561+0000 7f5273fff640 1 -- 172.21.15.91:0/1526720630 learned_addr learned my addr 172.21.15.91:0/1526720630 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:00.558 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.561+0000 7f52737fe640 1 --2- 172.21.15.91:0/1526720630 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f52740c8ff0 0x7f52741f3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:00.558 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.561+0000 7f5272ffd640 1 --2- 172.21.15.91:0/1526720630 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f52741516f0 0x7f52741ef5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:00.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.565+0000 7f5273fff640 1 -- 172.21.15.91:0/1526720630 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f52741516f0 msgr2=0x7f52741ef5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:00.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.565+0000 7f5273fff640 1 --2- 172.21.15.91:0/1526720630 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f52741516f0 0x7f52741ef5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:00.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.565+0000 7f5273fff640 1 -- 172.21.15.91:0/1526720630 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f52740c8ff0 msgr2=0x7f52741f3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:00.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.565+0000 7f5273fff640 1 --2- 172.21.15.91:0/1526720630 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f52740c8ff0 0x7f52741f3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:00.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.565+0000 7f5273fff640 1 -- 172.21.15.91:0/1526720630 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f526c009a70 con 0x7f5274157f70 2023-11-27T18:14:00.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.565+0000 7f5273fff640 1 --2- 172.21.15.91:0/1526720630 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5274157f70 0x7f5274150430 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f526c01d7e0 tx=0x7f526c01bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:00.566 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.569+0000 7f526bfff640 1 -- 172.21.15.91:0/1526720630 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c0afca0 con 0x7f5274157f70 2023-11-27T18:14:00.566 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.569+0000 7f526bfff640 1 -- 172.21.15.91:0/1526720630 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f526c0afe00 con 0x7f5274157f70 2023-11-27T18:14:00.566 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.569+0000 7f526bfff640 1 -- 172.21.15.91:0/1526720630 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c0ba660 con 0x7f5274157f70 2023-11-27T18:14:00.566 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.569+0000 7f527a03e640 1 -- 172.21.15.91:0/1526720630 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52741f31f0 con 0x7f5274157f70 2023-11-27T18:14:00.567 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.569+0000 7f527a03e640 1 -- 172.21.15.91:0/1526720630 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52740cc740 con 0x7f5274157f70 2023-11-27T18:14:00.567 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.569+0000 7f527a03e640 1 -- 172.21.15.91:0/1526720630 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52741f3380 con 0x7f5274157f70 2023-11-27T18:14:00.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.589+0000 7f526bfff640 1 -- 172.21.15.91:0/1526720630 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f526c0ba7c0 con 0x7f5274157f70 2023-11-27T18:14:00.585 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.589+0000 7f526bfff640 1 --2- 172.21.15.91:0/1526720630 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f5254066870 0x7f5254068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:00.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.589+0000 7f52737fe640 1 --2- 172.21.15.91:0/1526720630 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f5254066870 0x7f5254068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:00.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.589+0000 7f52737fe640 1 --2- 172.21.15.91:0/1526720630 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f5254066870 0x7f5254068d30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5264009ac0 tx=0x7f5264009190 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:00.588 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.593+0000 7f526bfff640 1 -- 172.21.15.91:0/1526720630 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f526c0f3da0 con 0x7f5274157f70 2023-11-27T18:14:00.852 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:00.857+0000 7f526bfff640 1 -- 172.21.15.91:0/1526720630 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f526c0f00e0 con 0x7f5274157f70 2023-11-27T18:14:01.011 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.013+0000 7f527a03e640 1 -- 172.21.15.91:0/1526720630 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52741477b0 con 0x7f5274157f70 2023-11-27T18:14:01.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.057+0000 7f526bfff640 1 -- 172.21.15.91:0/1526720630 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f526c0b4070 con 0x7f5274157f70 2023-11-27T18:14:01.054 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:14:01.054 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":30,"fsid":"08c8ebbf-7936-4c41-a995-d5600de2d072","created":"2023-11-27T18:12:06.484593+0000","modified":"2023-11-27T18:13:22.801287+0000","last_up_change":"2023-11-27T18:12:33.154694+0000","last_in_change":"2023-11-27T18:12:23.622113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T18:12:35.450305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T18:13:09.589619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T18:13:11.439236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-27T18:13:18.514694+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ad53c08-dd19-4ae6-87c5-fa15bea3b4ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6811","nonce":472303992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6813","nonce":472303992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6817","nonce":472303992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6815","nonce":472303992}]},"public_addr":"172.21.15.91:6811/472303992","cluster_addr":"172.21.15.91:6813/472303992","heartbeat_back_addr":"172.21.15.91:6817/472303992","heartbeat_front_addr":"172.21.15.91:6815/472303992","state":["exists","up"]},{"osd":1,"uuid":"f8b5f147-ed29-4329-a787-a12cc34a2569","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6827","nonce":12316911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6829","nonce":12316911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6833","nonce":12316911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6831","nonce":12316911}]},"public_addr":"172.21.15.91:6827/12316911","cluster_addr":"172.21.15.91:6829/12316911","heartbeat_back_addr":"172.21.15.91:6833/12316911","heartbeat_front_addr":"172.21.15.91:6831/12316911","state":["exists","up"]},{"osd":2,"uuid":"c3029f9a-1c48-4f5d-983a-172a614d8795","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6803","nonce":3776125919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6805","nonce":3776125919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6809","nonce":3776125919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6807","nonce":3776125919}]},"public_addr":"172.21.15.91:6803/3776125919","cluster_addr":"172.21.15.91:6805/3776125919","heartbeat_back_addr":"172.21.15.91:6809/3776125919","heartbeat_front_addr":"172.21.15.91:6807/3776125919","state":["exists","up"]},{"osd":3,"uuid":"ab4b6fb2-0126-491b-9224-54a6badc5da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6819","nonce":1297704794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6821","nonce":1297704794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6825","nonce":1297704794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6823","nonce":1297704794}]},"public_addr":"172.21.15.91:6819/1297704794","cluster_addr":"172.21.15.91:6821/1297704794","heartbeat_back_addr":"172.21.15.91:6825/1297704794","heartbeat_front_addr":"172.21.15.91:6823/1297704794","state":["exists","up"]},{"osd":4,"uuid":"695071a8-2de8-4cba-bf20-050021a03bb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6809","nonce":2501531833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6811","nonce":2501531833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6815","nonce":2501531833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6813","nonce":2501531833}]},"public_addr":"172.21.15.94:6809/2501531833","cluster_addr":"172.21.15.94:6811/2501531833","heartbeat_back_addr":"172.21.15.94:6815/2501531833","heartbeat_front_addr":"172.21.15.94:6813/2501531833","state":["exists","up"]},{"osd":5,"uuid":"ca01da14-a700-4845-8db2-f5e3370677e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6817","nonce":2448969592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6819","nonce":2448969592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6823","nonce":2448969592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6821","nonce":2448969592}]},"public_addr":"172.21.15.94:6817/2448969592","cluster_addr":"172.21.15.94:6819/2448969592","heartbeat_back_addr":"172.21.15.94:6823/2448969592","heartbeat_front_addr":"172.21.15.94:6821/2448969592","state":["exists","up"]},{"osd":6,"uuid":"4784bc77-6c33-4e47-abba-d37484982f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6825","nonce":3389553935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6827","nonce":3389553935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6831","nonce":3389553935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6829","nonce":3389553935}]},"public_addr":"172.21.15.94:6825/3389553935","cluster_addr":"172.21.15.94:6827/3389553935","heartbeat_back_addr":"172.21.15.94:6831/3389553935","heartbeat_front_addr":"172.21.15.94:6829/3389553935","state":["exists","up"]},{"osd":7,"uuid":"b954cf3f-4a4f-4a75-9f90-014f72c16d15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6801","nonce":1606498064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6803","nonce":1606498064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6807","nonce":1606498064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6805","nonce":1606498064}]},"public_addr":"172.21.15.94:6801/1606498064","cluster_addr":"172.21.15.94:6803/1606498064","heartbeat_back_addr":"172.21.15.94:6807/1606498064","heartbeat_front_addr":"172.21.15.94:6805/1606498064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.534968+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.506182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.339267+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.532432+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:28.935756+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.471559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.485014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.352978+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T18:14:01.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.061+0000 7f527a03e640 1 -- 172.21.15.91:0/1526720630 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f5254066870 msgr2=0x7f5254068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.061+0000 7f527a03e640 1 --2- 172.21.15.91:0/1526720630 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f5254066870 0x7f5254068d30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5264009ac0 tx=0x7f5264009190 comp rx=0 tx=0).stop 2023-11-27T18:14:01.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.061+0000 7f527a03e640 1 -- 172.21.15.91:0/1526720630 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5274157f70 msgr2=0x7f5274150430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.061+0000 7f527a03e640 1 --2- 172.21.15.91:0/1526720630 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5274157f70 0x7f5274150430 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f526c01d7e0 tx=0x7f526c01bed0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.061+0000 7f527a03e640 1 -- 172.21.15.91:0/1526720630 shutdown_connections 2023-11-27T18:14:01.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.061+0000 7f527a03e640 1 --2- 172.21.15.91:0/1526720630 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f5254066870 0x7f5254068d30 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.061+0000 7f527a03e640 1 --2- 172.21.15.91:0/1526720630 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f52741516f0 0x7f52741ef5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.061+0000 7f527a03e640 1 --2- 172.21.15.91:0/1526720630 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5274157f70 0x7f5274150430 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.061+0000 7f527a03e640 1 --2- 172.21.15.91:0/1526720630 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f52740c8ff0 0x7f52741f3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.061+0000 7f527a03e640 1 -- 172.21.15.91:0/1526720630 >> 172.21.15.91:0/1526720630 conn(0x7f527406a520 msgr2=0x7f5274143ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:01.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.061+0000 7f527a03e640 1 -- 172.21.15.91:0/1526720630 shutdown_connections 2023-11-27T18:14:01.058 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.061+0000 7f527a03e640 1 -- 172.21.15.91:0/1526720630 wait complete. 2023-11-27T18:14:01.075 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-27T18:14:01.076 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-27T18:14:01.076 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-27T18:14:01.076 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-27T18:14:01.077 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-27T18:14:01.077 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-27T18:14:01.077 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-27T18:14:01.078 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-27T18:14:01.265 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.269+0000 7f966885f640 1 Processor -- start 2023-11-27T18:14:01.266 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.269+0000 7f966885f640 1 -- start start 2023-11-27T18:14:01.267 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.269+0000 7f966885f640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f965c0d4fd0 0x7f965c04c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.267 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.269+0000 7f966885f640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f965c04c7f0 con 0x7f965c034770 2023-11-27T18:14:01.267 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.269+0000 7f966885f640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f965c04b960 con 0x7f965c0db410 2023-11-27T18:14:01.267 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.269+0000 7f966885f640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f965c04bf20 con 0x7f965c0d4fd0 2023-11-27T18:14:01.268 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.269+0000 7faa96bd8640 1 Processor -- start 2023-11-27T18:14:01.268 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.269+0000 7faa96bd8640 1 -- start start 2023-11-27T18:14:01.268 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.273+0000 7faa96bd8640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7faa90070ee0 0x7faa900c73c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.268 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.273+0000 7faa96bd8640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa900c7900 0x7faa9016a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.268 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.273+0000 7faa96bd8640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa9016a680 con 0x7faa90070b00 2023-11-27T18:14:01.268 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.273+0000 7faa96bd8640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa90071700 con 0x7faa900c7900 2023-11-27T18:14:01.268 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.273+0000 7faa96bd8640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa90166c00 con 0x7faa90070ee0 2023-11-27T18:14:01.274 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.277+0000 7fb240922640 1 Processor -- start 2023-11-27T18:14:01.274 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.277+0000 7fb240922640 1 -- start start 2023-11-27T18:14:01.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.277+0000 7fb240922640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb23c06adf0 0x7fb23c157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.277+0000 7fb240922640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb23c072800 0x7fb23c157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.277+0000 7fb240922640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb23c15db00 con 0x7fb23c06b1d0 2023-11-27T18:14:01.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.277+0000 7fb240922640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb23c160ef0 con 0x7fb23c072800 2023-11-27T18:14:01.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.277+0000 7fb240922640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb23c15d8f0 con 0x7fb23c06adf0 2023-11-27T18:14:01.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.281+0000 7fa6270a6640 1 Processor -- start 2023-11-27T18:14:01.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.281+0000 7fa6270a6640 1 -- start start 2023-11-27T18:14:01.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.281+0000 7fe3a55ce640 1 Processor -- start 2023-11-27T18:14:01.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.281+0000 7fe3a55ce640 1 -- start start 2023-11-27T18:14:01.277 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.281+0000 7fa6270a6640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa618047200 0x7fa618007db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.277 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.281+0000 7fa6270a6640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6180decf0 con 0x7fa618046410 2023-11-27T18:14:01.277 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.281+0000 7fe3a55ce640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fe3a0151730 0x7fe3a00c7c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.277 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.281+0000 7fe3a55ce640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe3a015b240 0x7fe3a00b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.277 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.281+0000 7fe3a55ce640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe3a00ccbe0 0x7fe3a00cd070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.278 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.281+0000 7fe3a55ce640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3a00c9f80 con 0x7fe3a0151730 2023-11-27T18:14:01.278 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.281+0000 7fe3a55ce640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3a00c9090 con 0x7fe3a00ccbe0 2023-11-27T18:14:01.278 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.281+0000 7fe3a55ce640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a00c9370 con 0x7fe3a015b240 2023-11-27T18:14:01.278 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.281+0000 7fa6270a6640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6180477d0 con 0x7fa618047d40 2023-11-27T18:14:01.278 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.281+0000 7fa6270a6640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6180defb0 con 0x7fa618047200 2023-11-27T18:14:01.278 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.281+0000 7f04b0b6d640 1 Processor -- start 2023-11-27T18:14:01.279 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.281+0000 7f04b0b6d640 1 -- start start 2023-11-27T18:14:01.279 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.281+0000 7f04b0b6d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f04a40d6b70 0x7f04a40dd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.279 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.281+0000 7f04b0b6d640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f04a404e6f0 0x7f04a4047310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.279 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.281+0000 7f04b0b6d640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04a40e0a50 con 0x7f04a4052300 2023-11-27T18:14:01.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.281+0000 7f04b0b6d640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04a40d6f50 con 0x7f04a40d6b70 2023-11-27T18:14:01.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.281+0000 7f04b0b6d640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04a404dc20 con 0x7f04a404e6f0 2023-11-27T18:14:01.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.293+0000 7fe6b92ed640 1 Processor -- start 2023-11-27T18:14:01.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.293+0000 7fe6b92ed640 1 -- start start 2023-11-27T18:14:01.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.293+0000 7fe6b92ed640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe6ac0d9220 0x7fe6ac0df9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.293+0000 7fe6b92ed640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fe6ac0379d0 0x7fe6ac038600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.293+0000 7fe6b92ed640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6ac038170 con 0x7fe6ac038b40 2023-11-27T18:14:01.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.293+0000 7fe6b92ed640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6ac0dfef0 con 0x7fe6ac0379d0 2023-11-27T18:14:01.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.293+0000 7fe6b92ed640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ac038fb0 con 0x7fe6ac0d9220 2023-11-27T18:14:01.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.293+0000 7f27ac39e640 1 Processor -- start 2023-11-27T18:14:01.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.293+0000 7f27ac39e640 1 -- start start 2023-11-27T18:14:01.292 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.293+0000 7f27ac39e640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f27a41514c0 0x7f27a406e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.293+0000 7f27ac39e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f27a41571c0 0x7f27a40ccad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.293+0000 7f27ac39e640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27a40c8820 con 0x7f27a40b1f20 2023-11-27T18:14:01.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.293+0000 7f27ac39e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27a40c70f0 con 0x7f27a41571c0 2023-11-27T18:14:01.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.297+0000 7f27ac39e640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27a41518a0 con 0x7f27a41514c0 2023-11-27T18:14:01.305 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.309+0000 7f96637fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f965c0d4fd0 0x7f965c04c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:01.308 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.313+0000 7f96637fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f965c0d4fd0 0x7f965c04c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44682/0 (socket says 172.21.15.91:44682) 2023-11-27T18:14:01.308 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.313+0000 7f96637fe640 1 -- 172.21.15.91:0/2670408562 learned_addr learned my addr 172.21.15.91:0/2670408562 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:01.310 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.313+0000 7fb239d9b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb23c072800 0x7fb23c157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:01.313 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.317+0000 7fb239d9b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb23c072800 0x7fb23c157cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44700/0 (socket says 172.21.15.91:44700) 2023-11-27T18:14:01.313 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.317+0000 7fb239d9b640 1 -- 172.21.15.91:0/733350756 learned_addr learned my addr 172.21.15.91:0/733350756 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:01.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.321+0000 7f96637fe640 1 -- 172.21.15.91:0/2670408562 >> v1:172.21.15.94:6789/0 conn(0x7f965c0db410 legacy=0x7f965c0e5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:01.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.321+0000 7f96637fe640 1 -- 172.21.15.91:0/2670408562 >> v1:172.21.15.91:6789/0 conn(0x7f965c034770 legacy=0x7f965c0dad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:01.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.321+0000 7f96637fe640 1 -- 172.21.15.91:0/2670408562 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f965c04bc40 con 0x7f965c0d4fd0 2023-11-27T18:14:01.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.321+0000 7faa963d7640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa900c7900 0x7faa9016a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:01.324 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.325+0000 7fb239d9b640 1 -- 172.21.15.91:0/733350756 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb23c06adf0 msgr2=0x7fb23c157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:01.324 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.325+0000 7fb239d9b640 1 --2- 172.21.15.91:0/733350756 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb23c06adf0 0x7fb23c157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.325+0000 7fb239d9b640 1 -- 172.21.15.91:0/733350756 >> v1:172.21.15.94:6789/0 conn(0x7fb23c06b1d0 legacy=0x7fb23c0caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:01.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.325+0000 7fb239d9b640 1 -- 172.21.15.91:0/733350756 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb23c15dde0 con 0x7fb23c072800 2023-11-27T18:14:01.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.325+0000 7faa963d7640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa900c7900 0x7faa9016a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44688/0 (socket says 172.21.15.91:44688) 2023-11-27T18:14:01.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.325+0000 7faa963d7640 1 -- 172.21.15.91:0/436323758 learned_addr learned my addr 172.21.15.91:0/436323758 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:01.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.325+0000 7f27aa93b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f27a41571c0 0x7f27a40ccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:01.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.325+0000 7f96637fe640 1 --2- 172.21.15.91:0/2670408562 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f965c0d4fd0 0x7f965c04c2b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9650008870 tx=0x7f96500211c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23ff4a940af5f301 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:01.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.325+0000 7f27aa93b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f27a41571c0 0x7f27a40ccad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44716/0 (socket says 172.21.15.91:44716) 2023-11-27T18:14:01.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.325+0000 7f27aa93b640 1 -- 172.21.15.91:0/3088728049 learned_addr learned my addr 172.21.15.91:0/3088728049 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:01.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.329+0000 7fe6b37fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fe6ac0379d0 0x7fe6ac038600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:01.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.329+0000 7fe6b37fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fe6ac0379d0 0x7fe6ac038600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44710/0 (socket says 172.21.15.91:44710) 2023-11-27T18:14:01.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.329+0000 7fe6b37fe640 1 -- 172.21.15.91:0/1161723215 learned_addr learned my addr 172.21.15.91:0/1161723215 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:01.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.333+0000 7f27aa93b640 1 -- 172.21.15.91:0/3088728049 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f27a41514c0 msgr2=0x7f27a406e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:01.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.333+0000 7f27aa93b640 1 --2- 172.21.15.91:0/3088728049 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f27a41514c0 0x7f27a406e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.333+0000 7f27aa93b640 1 -- 172.21.15.91:0/3088728049 >> v1:172.21.15.91:6789/0 conn(0x7f27a40b1f20 legacy=0x7f27a415b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:01.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.333+0000 7f27aa93b640 1 -- 172.21.15.91:0/3088728049 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a406f140 con 0x7f27a41571c0 2023-11-27T18:14:01.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.333+0000 7fe39effd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fe3a0151730 0x7fe3a00c7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:01.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.333+0000 7fe39effd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fe3a0151730 0x7fe3a00c7c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44708/0 (socket says 172.21.15.91:44708) 2023-11-27T18:14:01.332 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.333+0000 7fe39effd640 1 -- 172.21.15.91:0/1799646046 learned_addr learned my addr 172.21.15.91:0/1799646046 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:01.334 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.337+0000 7fe6b37fe640 1 -- 172.21.15.91:0/1161723215 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe6ac0d9220 msgr2=0x7fe6ac0df9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:01.334 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.337+0000 7fe6b37fe640 1 --2- 172.21.15.91:0/1161723215 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe6ac0d9220 0x7fe6ac0df9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.334 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.337+0000 7fe6b37fe640 1 -- 172.21.15.91:0/1161723215 >> v1:172.21.15.91:6789/0 conn(0x7fe6ac038b40 legacy=0x7fe6ac050160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.334 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.337+0000 7fe6b37fe640 1 -- 172.21.15.91:0/1161723215 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6ac037310 con 0x7fe6ac0379d0 2023-11-27T18:14:01.335 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.337+0000 7fa6260a4640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fa618046410 0x7fa61804bbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:34128/0 (socket says 172.21.15.91:34128) 2023-11-27T18:14:01.335 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.337+0000 7fa6260a4640 1 -- 172.21.15.91:0/4052937676 learned_addr learned my addr 172.21.15.91:0/4052937676 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:14:01.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.341+0000 7fe39effd640 1 -- 172.21.15.91:0/1799646046 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe3a015b240 msgr2=0x7fe3a00b0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:01.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.341+0000 7fe39effd640 1 --2- 172.21.15.91:0/1799646046 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe3a015b240 0x7fe3a00b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.341+0000 7fe39effd640 1 -- 172.21.15.91:0/1799646046 >> v2:172.21.15.94:3300/0 conn(0x7fe3a00ccbe0 msgr2=0x7fe3a00cd070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:01.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.341+0000 7fe39effd640 1 --2- 172.21.15.91:0/1799646046 >> v2:172.21.15.94:3300/0 conn(0x7fe3a00ccbe0 0x7fe3a00cd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.341+0000 7fe39effd640 1 -- 172.21.15.91:0/1799646046 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a00c9650 con 0x7fe3a0151730 2023-11-27T18:14:01.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.345+0000 7fb239d9b640 1 --2- 172.21.15.91:0/733350756 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb23c072800 0x7fb23c157cb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb22c009870 tx=0x7fb22c01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fd723bbeb7b434f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:01.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.349+0000 7faa963d7640 1 -- 172.21.15.91:0/436323758 >> v2:172.21.15.94:3300/0 conn(0x7faa90070ee0 msgr2=0x7faa900c73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:01.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.349+0000 7faa963d7640 1 --2- 172.21.15.91:0/436323758 >> v2:172.21.15.94:3300/0 conn(0x7faa90070ee0 0x7faa900c73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.349+0000 7faa963d7640 1 -- 172.21.15.91:0/436323758 >> v1:172.21.15.94:6789/0 conn(0x7faa90070b00 legacy=0x7faa900719b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:01.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.349+0000 7faa963d7640 1 -- 172.21.15.91:0/436323758 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa90071420 con 0x7faa900c7900 2023-11-27T18:14:01.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.349+0000 7f27aa93b640 1 --2- 172.21.15.91:0/3088728049 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f27a41571c0 0x7f27a40ccad0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f279c009e50 tx=0x7f279c01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=992b5f89f86fa48c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:01.349 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.353+0000 7fa6268a5640 1 --2- 172.21.15.91:0/4052937676 >> v2:172.21.15.94:3300/0 conn(0x7fa618047200 0x7fa618007db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:01.353 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.357+0000 7fa6250a2640 1 -- 172.21.15.91:0/4052937676 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1818793622 0 0) 0x7fa6180decf0 con 0x7fa618046410 2023-11-27T18:14:01.353 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.357+0000 7fa6250a2640 1 -- 172.21.15.91:0/4052937676 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa60c003530 con 0x7fa618046410 2023-11-27T18:14:01.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.357+0000 7fe39effd640 1 --2- 172.21.15.91:0/1799646046 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe3a0151730 0x7fe3a00c7c50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe3a00c8520 tx=0x7fe39401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feb2106ebde5647a server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:01.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.357+0000 7f04aaffd640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f04a404e6f0 0x7f04a4047310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:01.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.357+0000 7f04aaffd640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f04a404e6f0 0x7f04a4047310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.91:40860/0 (socket says 172.21.15.91:40860) 2023-11-27T18:14:01.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.357+0000 7f04aaffd640 1 -- 172.21.15.91:0/1568543253 learned_addr learned my addr 172.21.15.91:0/1568543253 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:01.355 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.357+0000 7fb23959a640 1 -- 172.21.15.91:0/733350756 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22c0a89b0 con 0x7fb23c072800 2023-11-27T18:14:01.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.357+0000 7fb23959a640 1 -- 172.21.15.91:0/733350756 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb22c0a8b10 con 0x7fb23c072800 2023-11-27T18:14:01.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.357+0000 7fb23959a640 1 -- 172.21.15.91:0/733350756 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22c0a8ea0 con 0x7fb23c072800 2023-11-27T18:14:01.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.357+0000 7fb240922640 1 -- 172.21.15.91:0/733350756 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb23c072800 msgr2=0x7fb23c157cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.357+0000 7fb240922640 1 --2- 172.21.15.91:0/733350756 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb23c072800 0x7fb23c157cb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb22c009870 tx=0x7fb22c01ecf0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.357+0000 7fb240922640 1 -- 172.21.15.91:0/733350756 shutdown_connections 2023-11-27T18:14:01.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.357+0000 7fb240922640 1 --2- 172.21.15.91:0/733350756 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb23c072800 0x7fb23c157cb0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.357+0000 7fb240922640 1 --2- 172.21.15.91:0/733350756 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb23c06adf0 0x7fb23c157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.357+0000 7fb240922640 1 -- 172.21.15.91:0/733350756 >> 172.21.15.91:0/733350756 conn(0x7fb23c06cf80 msgr2=0x7fb23c06d390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:01.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.357+0000 7fb240922640 1 -- 172.21.15.91:0/733350756 shutdown_connections 2023-11-27T18:14:01.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.357+0000 7fb240922640 1 -- 172.21.15.91:0/733350756 wait complete. 2023-11-27T18:14:01.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.361+0000 7faa963d7640 1 --2- 172.21.15.91:0/436323758 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faa900c7900 0x7faa9016a140 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7faa90167290 tx=0x7faa8001ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=450c120aa2b9e3f5 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:01.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.361+0000 7f27a9138640 1 -- 172.21.15.91:0/3088728049 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f279c0a5740 con 0x7f27a41571c0 2023-11-27T18:14:01.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.361+0000 7f27a9138640 1 -- 172.21.15.91:0/3088728049 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f279c0a58a0 con 0x7f27a41571c0 2023-11-27T18:14:01.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.361+0000 7f27a9138640 1 -- 172.21.15.91:0/3088728049 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f279c0a5c30 con 0x7f27a41571c0 2023-11-27T18:14:01.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.361+0000 7fb240922640 1 Processor -- start 2023-11-27T18:14:01.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.361+0000 7fb240922640 1 -- start start 2023-11-27T18:14:01.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.361+0000 7f27ac39e640 1 -- 172.21.15.91:0/3088728049 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f27a41571c0 msgr2=0x7f27a40ccad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.361+0000 7f27ac39e640 1 --2- 172.21.15.91:0/3088728049 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f27a41571c0 0x7f27a40ccad0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f279c009e50 tx=0x7f279c01c9d0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.361+0000 7f27ac39e640 1 -- 172.21.15.91:0/3088728049 shutdown_connections 2023-11-27T18:14:01.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.361+0000 7f27ac39e640 1 --2- 172.21.15.91:0/3088728049 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f27a41571c0 0x7f27a40ccad0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.361+0000 7f27ac39e640 1 --2- 172.21.15.91:0/3088728049 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f27a41514c0 0x7f27a406e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.361+0000 7f27ac39e640 1 -- 172.21.15.91:0/3088728049 >> 172.21.15.91:0/3088728049 conn(0x7f27a4070a80 msgr2=0x7f27a4070e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:01.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.361+0000 7f27ac39e640 1 -- 172.21.15.91:0/3088728049 shutdown_connections 2023-11-27T18:14:01.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.361+0000 7f27ac39e640 1 -- 172.21.15.91:0/3088728049 wait complete. 2023-11-27T18:14:01.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.361+0000 7fb240922640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb23c06adf0 0x7fb23c0ca860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.361+0000 7fb240922640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb23c06b1d0 0x7fb23c150320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.361+0000 7fb240922640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb23c072800 0x7fb23c15ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.361+0000 7fb240922640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb23c14fc60 con 0x7fb23c072800 2023-11-27T18:14:01.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.361+0000 7fb240922640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb23c0cb180 con 0x7fb23c06adf0 2023-11-27T18:14:01.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.361+0000 7fb240922640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb23c0caea0 con 0x7fb23c06b1d0 2023-11-27T18:14:01.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.361+0000 7f27ac39e640 1 Processor -- start 2023-11-27T18:14:01.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.361+0000 7f27ac39e640 1 -- start start 2023-11-27T18:14:01.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.361+0000 7f27ac39e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f27a40b1f20 0x7f27a406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.361+0000 7f27ac39e640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f27a41514c0 0x7f27a4142cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.361+0000 7f27ac39e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27a41571c0 0x7f27a4140710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.361+0000 7f27ac39e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a41422b0 con 0x7f27a40b1f20 2023-11-27T18:14:01.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.361+0000 7f27ac39e640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a414dc60 con 0x7f27a41571c0 2023-11-27T18:14:01.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.361+0000 7f27ac39e640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27a414e1e0 con 0x7f27a41514c0 2023-11-27T18:14:01.362 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.365+0000 7f96627fc640 1 -- 172.21.15.91:0/2670408562 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96500b3410 con 0x7f965c0d4fd0 2023-11-27T18:14:01.362 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.365+0000 7f96627fc640 1 -- 172.21.15.91:0/2670408562 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96500ad030 con 0x7f965c0d4fd0 2023-11-27T18:14:01.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.365+0000 7f96627fc640 1 -- 172.21.15.91:0/2670408562 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96500b3790 con 0x7f965c0d4fd0 2023-11-27T18:14:01.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.365+0000 7f966885f640 1 -- 172.21.15.91:0/2670408562 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f965c0d4fd0 msgr2=0x7f965c04c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.365+0000 7f966885f640 1 --2- 172.21.15.91:0/2670408562 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f965c0d4fd0 0x7f965c04c2b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9650008870 tx=0x7f96500211c0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.365+0000 7f966885f640 1 -- 172.21.15.91:0/2670408562 shutdown_connections 2023-11-27T18:14:01.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.365+0000 7f966885f640 1 --2- 172.21.15.91:0/2670408562 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f965c0d4fd0 0x7f965c04c2b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.365+0000 7f966885f640 1 -- 172.21.15.91:0/2670408562 >> 172.21.15.91:0/2670408562 conn(0x7f965c050160 msgr2=0x7f965c050570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:01.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.365+0000 7f966885f640 1 -- 172.21.15.91:0/2670408562 shutdown_connections 2023-11-27T18:14:01.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.365+0000 7f966885f640 1 -- 172.21.15.91:0/2670408562 wait complete. 2023-11-27T18:14:01.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.365+0000 7f966885f640 1 Processor -- start 2023-11-27T18:14:01.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.365+0000 7f966885f640 1 -- start start 2023-11-27T18:14:01.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.365+0000 7f966885f640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f965c034770 0x7f965c04e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.369+0000 7f966885f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f965c0d4fd0 0x7f965c174c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.369+0000 7f966885f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f965c0db410 0x7f965c0cff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.369+0000 7f966885f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f965c0cbb80 con 0x7f965c0db410 2023-11-27T18:14:01.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.369+0000 7f966885f640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f965c175170 con 0x7f965c0d4fd0 2023-11-27T18:14:01.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.369+0000 7f966885f640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f965c04ef20 con 0x7f965c034770 2023-11-27T18:14:01.365 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.369+0000 7fe6b37fe640 1 --2- 172.21.15.91:0/1161723215 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe6ac0379d0 0x7fe6ac038600 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe6a0009870 tx=0x7fe6a001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebfb4f71504fcf81 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:01.365 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.369+0000 7fe39dffb640 1 -- 172.21.15.91:0/1799646046 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3940a89b0 con 0x7fe3a0151730 2023-11-27T18:14:01.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.369+0000 7fe39dffb640 1 -- 172.21.15.91:0/1799646046 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3940a8b10 con 0x7fe3a0151730 2023-11-27T18:14:01.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.369+0000 7fe39dffb640 1 -- 172.21.15.91:0/1799646046 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3940a8ea0 con 0x7fe3a0151730 2023-11-27T18:14:01.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.369+0000 7fa6268a5640 1 -- 172.21.15.91:0/4052937676 >> v1:172.21.15.94:6789/0 conn(0x7fa618047d40 legacy=0x7fa6180e7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:01.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.369+0000 7fa6268a5640 1 -- 172.21.15.91:0/4052937676 >> v1:172.21.15.91:6789/0 conn(0x7fa618046410 legacy=0x7fa61804bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.369+0000 7fa6268a5640 1 -- 172.21.15.91:0/4052937676 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6180df290 con 0x7fa618047200 2023-11-27T18:14:01.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.369+0000 7fe3a55ce640 1 -- 172.21.15.91:0/1799646046 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe3a0151730 msgr2=0x7fe3a00c7c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.369+0000 7fe3a55ce640 1 --2- 172.21.15.91:0/1799646046 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe3a0151730 0x7fe3a00c7c50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe3a00c8520 tx=0x7fe39401ecf0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.369+0000 7fe3a55ce640 1 -- 172.21.15.91:0/1799646046 shutdown_connections 2023-11-27T18:14:01.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.369+0000 7fe3a55ce640 1 --2- 172.21.15.91:0/1799646046 >> v2:172.21.15.94:3300/0 conn(0x7fe3a00ccbe0 0x7fe3a00cd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.369+0000 7fe3a55ce640 1 --2- 172.21.15.91:0/1799646046 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe3a015b240 0x7fe3a00b0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.369+0000 7fe3a55ce640 1 --2- 172.21.15.91:0/1799646046 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe3a0151730 0x7fe3a00c7c50 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.369+0000 7fe3a55ce640 1 -- 172.21.15.91:0/1799646046 >> 172.21.15.91:0/1799646046 conn(0x7fe3a006a520 msgr2=0x7fe3a006a930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:01.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.369+0000 7fe3a55ce640 1 -- 172.21.15.91:0/1799646046 shutdown_connections 2023-11-27T18:14:01.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.369+0000 7fe3a55ce640 1 -- 172.21.15.91:0/1799646046 wait complete. 2023-11-27T18:14:01.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.369+0000 7f04ab7fe640 1 --2- 172.21.15.91:0/1568543253 >> v2:172.21.15.94:3300/0 conn(0x7f04a40d6b70 0x7f04a40dd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:01.369 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.373+0000 7fe3a55ce640 1 Processor -- start 2023-11-27T18:14:01.369 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.373+0000 7fe3a55ce640 1 -- start start 2023-11-27T18:14:01.369 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.373+0000 7fe3a55ce640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe3a00ccbe0 0x7fe3a0157ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.369 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.373+0000 7fe3a55ce640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe3a0151730 0x7fe3a00cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.369 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.373+0000 7fe3a55ce640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe3a015b240 0x7fe3a00cb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.369 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.373+0000 7fe3a55ce640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a0157a40 con 0x7fe3a00ccbe0 2023-11-27T18:14:01.369 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.373+0000 7fe3a55ce640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a00b28e0 con 0x7fe3a015b240 2023-11-27T18:14:01.369 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.373+0000 7fe3a55ce640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a00cb730 con 0x7fe3a0151730 2023-11-27T18:14:01.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.373+0000 7fa6268a5640 1 --2- 172.21.15.91:0/4052937676 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa618047200 0x7fa618007db0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa620064230 tx=0x7fa620097040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b89ae1bc9e4b3ef server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:01.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.377+0000 7f04aaffd640 1 -- 172.21.15.91:0/1568543253 >> v2:172.21.15.94:3300/0 conn(0x7f04a40d6b70 msgr2=0x7f04a40dd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:01.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.377+0000 7f04aaffd640 1 --2- 172.21.15.91:0/1568543253 >> v2:172.21.15.94:3300/0 conn(0x7f04a40d6b70 0x7f04a40dd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.377+0000 7f04aaffd640 1 -- 172.21.15.91:0/1568543253 >> v1:172.21.15.94:6789/0 conn(0x7f04a4052300 legacy=0x7f04a404ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:01.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.377+0000 7f04aaffd640 1 -- 172.21.15.91:0/1568543253 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a404d2f0 con 0x7f04a404e6f0 2023-11-27T18:14:01.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.381+0000 7fb23a59c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb23c06adf0 0x7fb23c0ca860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:01.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.381+0000 7faa94bd4640 1 -- 172.21.15.91:0/436323758 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa800a89b0 con 0x7faa900c7900 2023-11-27T18:14:01.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.381+0000 7faa94bd4640 1 -- 172.21.15.91:0/436323758 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa800a8b10 con 0x7faa900c7900 2023-11-27T18:14:01.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.381+0000 7faa94bd4640 1 -- 172.21.15.91:0/436323758 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa800a8ea0 con 0x7faa900c7900 2023-11-27T18:14:01.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.381+0000 7faa96bd8640 1 -- 172.21.15.91:0/436323758 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faa900c7900 msgr2=0x7faa9016a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.381+0000 7faa96bd8640 1 --2- 172.21.15.91:0/436323758 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faa900c7900 0x7faa9016a140 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7faa90167290 tx=0x7faa8001ecb0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.381+0000 7faa96bd8640 1 -- 172.21.15.91:0/436323758 shutdown_connections 2023-11-27T18:14:01.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.381+0000 7faa96bd8640 1 --2- 172.21.15.91:0/436323758 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faa900c7900 0x7faa9016a140 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.381+0000 7faa96bd8640 1 --2- 172.21.15.91:0/436323758 >> v2:172.21.15.94:3300/0 conn(0x7faa90070ee0 0x7faa900c73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.381+0000 7faa96bd8640 1 -- 172.21.15.91:0/436323758 >> 172.21.15.91:0/436323758 conn(0x7faa9006c6f0 msgr2=0x7faa9006cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:01.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.381+0000 7faa96bd8640 1 -- 172.21.15.91:0/436323758 shutdown_connections 2023-11-27T18:14:01.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.381+0000 7faa96bd8640 1 -- 172.21.15.91:0/436323758 wait complete. 2023-11-27T18:14:01.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.381+0000 7fb23a59c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb23c06adf0 0x7fb23c0ca860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.91:58476/0 (socket says 172.21.15.91:58476) 2023-11-27T18:14:01.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.381+0000 7fb23a59c640 1 -- 172.21.15.91:0/958812821 learned_addr learned my addr 172.21.15.91:0/958812821 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:01.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.381+0000 7fe6b2ffd640 1 -- 172.21.15.91:0/1161723215 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a00aa610 con 0x7fe6ac0379d0 2023-11-27T18:14:01.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.381+0000 7fe6b2ffd640 1 -- 172.21.15.91:0/1161723215 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6a00a6040 con 0x7fe6ac0379d0 2023-11-27T18:14:01.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.381+0000 7fe6b2ffd640 1 -- 172.21.15.91:0/1161723215 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a00aa990 con 0x7fe6ac0379d0 2023-11-27T18:14:01.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.381+0000 7faa96bd8640 1 Processor -- start 2023-11-27T18:14:01.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.381+0000 7fe6b92ed640 1 -- 172.21.15.91:0/1161723215 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe6ac0379d0 msgr2=0x7fe6ac038600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.381+0000 7fe6b92ed640 1 --2- 172.21.15.91:0/1161723215 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe6ac0379d0 0x7fe6ac038600 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe6a0009870 tx=0x7fe6a001c4b0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.381+0000 7faa96bd8640 1 -- start start 2023-11-27T18:14:01.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.381+0000 7fe6b92ed640 1 -- 172.21.15.91:0/1161723215 shutdown_connections 2023-11-27T18:14:01.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.381+0000 7fe6b92ed640 1 --2- 172.21.15.91:0/1161723215 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe6ac0379d0 0x7fe6ac038600 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.381+0000 7fe6b92ed640 1 --2- 172.21.15.91:0/1161723215 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe6ac0d9220 0x7fe6ac0df9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.381+0000 7fe6b92ed640 1 -- 172.21.15.91:0/1161723215 >> 172.21.15.91:0/1161723215 conn(0x7fe6ac0545f0 msgr2=0x7fe6ac054a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:01.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.381+0000 7fe6b92ed640 1 -- 172.21.15.91:0/1161723215 shutdown_connections 2023-11-27T18:14:01.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.381+0000 7fe6b92ed640 1 -- 172.21.15.91:0/1161723215 wait complete. 2023-11-27T18:14:01.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.385+0000 7faa96bd8640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faa90070b00 0x7faa901592a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.385+0000 7faa96bd8640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faa90070ee0 0x7faa900c9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.385+0000 7faa96bd8640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faa900c7900 0x7faa90204b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.385+0000 7faa96bd8640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa90159f90 con 0x7faa90070b00 2023-11-27T18:14:01.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.385+0000 7faa96bd8640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa900827f0 con 0x7faa90070ee0 2023-11-27T18:14:01.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.385+0000 7faa96bd8640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa902043e0 con 0x7faa900c7900 2023-11-27T18:14:01.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.385+0000 7f27aa93b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27a41571c0 0x7f27a4140710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:01.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.385+0000 7fe6b92ed640 1 Processor -- start 2023-11-27T18:14:01.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.385+0000 7fe6b92ed640 1 -- start start 2023-11-27T18:14:01.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.385+0000 7fe6b92ed640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe6ac0379d0 0x7fe6ac04da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.385+0000 7fe6b92ed640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6ac038b40 0x7fe6ac0db7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.385+0000 7fe6b92ed640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe6ac0d9220 0x7fe6ac17b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.385+0000 7fe6b92ed640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ac0dc9d0 con 0x7fe6ac0d9220 2023-11-27T18:14:01.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.385+0000 7fe6b92ed640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ac04cfb0 con 0x7fe6ac038b40 2023-11-27T18:14:01.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.385+0000 7fe6b92ed640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ac178ac0 con 0x7fe6ac0379d0 2023-11-27T18:14:01.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.385+0000 7fb23ad9d640 1 --2- 172.21.15.91:0/958812821 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb23c072800 0x7fb23c15ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:01.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.385+0000 7f27aa13a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f27a40b1f20 0x7f27a406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:01.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.385+0000 7f27aa13a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f27a40b1f20 0x7f27a406b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44726/0 (socket says 172.21.15.91:44726) 2023-11-27T18:14:01.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.385+0000 7f27aa13a640 1 -- 172.21.15.91:0/837523779 learned_addr learned my addr 172.21.15.91:0/837523779 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:01.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.389+0000 7fb23a59c640 1 -- 172.21.15.91:0/958812821 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb23c06b1d0 msgr2=0x7fb23c150320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.389+0000 7fb23a59c640 1 --2- 172.21.15.91:0/958812821 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb23c06b1d0 0x7fb23c150320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.389+0000 7fb23a59c640 1 -- 172.21.15.91:0/958812821 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb23c072800 msgr2=0x7fb23c15ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.389+0000 7fb23a59c640 1 --2- 172.21.15.91:0/958812821 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb23c072800 0x7fb23c15ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.387 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.389+0000 7fb23a59c640 1 -- 172.21.15.91:0/958812821 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb22c0094d0 con 0x7fb23c06adf0 2023-11-27T18:14:01.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.393+0000 7f9663fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f965c0db410 0x7f965c0cff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:01.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.397+0000 7f27aa13a640 1 -- 172.21.15.91:0/837523779 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f27a41514c0 msgr2=0x7f27a4142cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.397+0000 7f27aa13a640 1 --2- 172.21.15.91:0/837523779 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f27a41514c0 0x7f27a4142cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.397+0000 7f27aa13a640 1 -- 172.21.15.91:0/837523779 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27a41571c0 msgr2=0x7f27a4140710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.397+0000 7f27aa13a640 1 --2- 172.21.15.91:0/837523779 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27a41571c0 0x7f27a4140710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.397+0000 7f27aa13a640 1 -- 172.21.15.91:0/837523779 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f279c009b30 con 0x7f27a40b1f20 2023-11-27T18:14:01.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.397+0000 7f04aaffd640 1 --2- 172.21.15.91:0/1568543253 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f04a404e6f0 0x7f04a4047310 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0498009870 tx=0x7f049801ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87c7c5f27a0dad1 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:01.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.401+0000 7f96637fe640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f965c034770 0x7f965c04e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:01.397 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.401+0000 7fe39effd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe3a00ccbe0 0x7fe3a0157ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:01.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.401+0000 7f9663fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f965c0db410 0x7f965c0cff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44742/0 (socket says 172.21.15.91:44742) 2023-11-27T18:14:01.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.401+0000 7f9663fff640 1 -- 172.21.15.91:0/1705174888 learned_addr learned my addr 172.21.15.91:0/1705174888 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:01.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.405+0000 7fb23a59c640 1 --2- 172.21.15.91:0/958812821 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb23c06adf0 0x7fb23c0ca860 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb23000b550 tx=0x7fb23000ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:01.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.405+0000 7f27aa13a640 1 --2- 172.21.15.91:0/837523779 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f27a40b1f20 0x7f27a406b750 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f27a000b580 tx=0x7f27a000ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:01.402 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.405+0000 7fe39f7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe3a015b240 0x7fe3a00cb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:01.402 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.405+0000 7fe39effd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe3a00ccbe0 0x7fe3a0157ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44748/0 (socket says 172.21.15.91:44748) 2023-11-27T18:14:01.402 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.405+0000 7fe39effd640 1 -- 172.21.15.91:0/2342405923 learned_addr learned my addr 172.21.15.91:0/2342405923 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:01.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.413+0000 7faa963d7640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faa900c7900 0x7faa90204b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:01.415 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.417+0000 7f9662ffd640 1 --2- 172.21.15.91:0/1705174888 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f965c0d4fd0 0x7f965c174c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:01.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.421+0000 7f96637fe640 1 -- 172.21.15.91:0/1705174888 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f965c0d4fd0 msgr2=0x7f965c174c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.421+0000 7f96637fe640 1 --2- 172.21.15.91:0/1705174888 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f965c0d4fd0 0x7f965c174c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.421+0000 7f96637fe640 1 -- 172.21.15.91:0/1705174888 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f965c0db410 msgr2=0x7f965c0cff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.421+0000 7f96637fe640 1 --2- 172.21.15.91:0/1705174888 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f965c0db410 0x7f965c0cff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.421+0000 7f96637fe640 1 -- 172.21.15.91:0/1705174888 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9650008550 con 0x7f965c034770 2023-11-27T18:14:01.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.425+0000 7fa6250a2640 1 -- 172.21.15.91:0/4052937676 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62011fdb0 con 0x7fa618047200 2023-11-27T18:14:01.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.425+0000 7fa6250a2640 1 -- 172.21.15.91:0/4052937676 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa620127440 con 0x7fa618047200 2023-11-27T18:14:01.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.425+0000 7fa6250a2640 1 -- 172.21.15.91:0/4052937676 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa620127870 con 0x7fa618047200 2023-11-27T18:14:01.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.425+0000 7faa963d7640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faa900c7900 0x7faa90204b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.91:40916/0 (socket says 172.21.15.91:40916) 2023-11-27T18:14:01.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.425+0000 7faa963d7640 1 -- 172.21.15.91:0/405626344 learned_addr learned my addr 172.21.15.91:0/405626344 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:01.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.429+0000 7fa6270a6640 1 -- 172.21.15.91:0/4052937676 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa618047200 msgr2=0x7fa618007db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.429+0000 7fa6270a6640 1 --2- 172.21.15.91:0/4052937676 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa618047200 0x7fa618007db0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa620064230 tx=0x7fa620097040 comp rx=0 tx=0).stop 2023-11-27T18:14:01.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.429+0000 7fa6270a6640 1 -- 172.21.15.91:0/4052937676 shutdown_connections 2023-11-27T18:14:01.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.429+0000 7fa6270a6640 1 --2- 172.21.15.91:0/4052937676 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa618047200 0x7fa618007db0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.429+0000 7fa6270a6640 1 -- 172.21.15.91:0/4052937676 >> 172.21.15.91:0/4052937676 conn(0x7fa618051270 msgr2=0x7fa618051680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:01.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.429+0000 7fa6270a6640 1 -- 172.21.15.91:0/4052937676 shutdown_connections 2023-11-27T18:14:01.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.429+0000 7fa6270a6640 1 -- 172.21.15.91:0/4052937676 wait complete. 2023-11-27T18:14:01.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.429+0000 7fa6270a6640 1 Processor -- start 2023-11-27T18:14:01.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.429+0000 7fa6270a6640 1 -- start start 2023-11-27T18:14:01.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.429+0000 7fa6270a6640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa618046410 0x7fa61804f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.429+0000 7fa6270a6640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa618047200 0x7fa618035f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.429+0000 7fa6270a6640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa618047d40 0x7fa6180c5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.427 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.429+0000 7fa6270a6640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa618035a80 con 0x7fa618047d40 2023-11-27T18:14:01.427 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.429+0000 7fa6270a6640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61804f820 con 0x7fa618046410 2023-11-27T18:14:01.427 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.429+0000 7fa6270a6640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6180c9c50 con 0x7fa618047200 2023-11-27T18:14:01.427 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.429+0000 7fe39e7fc640 1 --2- 172.21.15.91:0/2342405923 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe3a0151730 0x7fe3a00cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:01.439 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.441+0000 7fe39f7fe640 1 -- 172.21.15.91:0/2342405923 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe3a0151730 msgr2=0x7fe3a00cacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.439 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.441+0000 7fe39f7fe640 1 --2- 172.21.15.91:0/2342405923 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe3a0151730 0x7fe3a00cacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.439 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.441+0000 7fe39f7fe640 1 -- 172.21.15.91:0/2342405923 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe3a00ccbe0 msgr2=0x7fe3a0157ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.439 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.441+0000 7fe39f7fe640 1 --2- 172.21.15.91:0/2342405923 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe3a00ccbe0 0x7fe3a0157ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.439 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.441+0000 7fe39f7fe640 1 -- 172.21.15.91:0/2342405923 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3940094d0 con 0x7fe3a015b240 2023-11-27T18:14:01.442 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.445+0000 7faa963d7640 1 -- 172.21.15.91:0/405626344 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faa90070ee0 msgr2=0x7faa900c9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.442 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.445+0000 7faa963d7640 1 --2- 172.21.15.91:0/405626344 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faa90070ee0 0x7faa900c9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.442 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.445+0000 7faa963d7640 1 -- 172.21.15.91:0/405626344 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faa90070b00 msgr2=0x7faa901592a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.443 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.445+0000 7faa963d7640 1 --2- 172.21.15.91:0/405626344 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faa90070b00 0x7faa901592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.443 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.445+0000 7faa963d7640 1 -- 172.21.15.91:0/405626344 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa800094d0 con 0x7faa900c7900 2023-11-27T18:14:01.448 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.453+0000 7f96637fe640 1 --2- 172.21.15.91:0/1705174888 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f965c034770 0x7f965c04e4f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f96500b2000 tx=0x7f965001fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:01.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.453+0000 7fe6b3fff640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe6ac0379d0 0x7fe6ac04da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:01.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.461+0000 7fe39f7fe640 1 --2- 172.21.15.91:0/2342405923 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe3a015b240 0x7fe3a00cb1f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe39800be20 tx=0x7fe39800bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:01.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.461+0000 7faa963d7640 1 --2- 172.21.15.91:0/405626344 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faa900c7900 0x7faa90204b10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7faa8001d360 tx=0x7faa8001ba50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:01.462 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.465+0000 7fe6b37fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6ac038b40 0x7fe6ac0db7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:01.463 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.465+0000 7fe6b37fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6ac038b40 0x7fe6ac0db7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.91:58520/0 (socket says 172.21.15.91:58520) 2023-11-27T18:14:01.463 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.465+0000 7fe6b37fe640 1 -- 172.21.15.91:0/3469198932 learned_addr learned my addr 172.21.15.91:0/3469198932 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:01.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.473+0000 7f279affd640 1 -- 172.21.15.91:0/837523779 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a0010610 con 0x7f27a40b1f20 2023-11-27T18:14:01.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.473+0000 7f27ac39e640 1 -- 172.21.15.91:0/837523779 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27a4161510 con 0x7f27a40b1f20 2023-11-27T18:14:01.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.473+0000 7f27ac39e640 1 -- 172.21.15.91:0/837523779 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27a4161790 con 0x7f27a40b1f20 2023-11-27T18:14:01.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.473+0000 7f27ac39e640 1 -- 172.21.15.91:0/837523779 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f27a415abc0 con 0x7f27a40b1f20 2023-11-27T18:14:01.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.477+0000 7fa6260a4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa618046410 0x7fa61804f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:01.477 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.481+0000 7fa6260a4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa618046410 0x7fa61804f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.91:58522/0 (socket says 172.21.15.91:58522) 2023-11-27T18:14:01.477 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.481+0000 7fa6260a4640 1 -- 172.21.15.91:0/2049377943 learned_addr learned my addr 172.21.15.91:0/2049377943 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:01.478 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.481+0000 7f04aa7fc640 1 -- 172.21.15.91:0/1568543253 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04980a89b0 con 0x7f04a404e6f0 2023-11-27T18:14:01.479 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.481+0000 7f04aa7fc640 1 -- 172.21.15.91:0/1568543253 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04980a8b10 con 0x7f04a404e6f0 2023-11-27T18:14:01.479 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.481+0000 7f04aa7fc640 1 -- 172.21.15.91:0/1568543253 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04980a8ea0 con 0x7f04a404e6f0 2023-11-27T18:14:01.479 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.481+0000 7f04b0b6d640 1 -- 172.21.15.91:0/1568543253 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f04a404e6f0 msgr2=0x7f04a4047310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.480 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.481+0000 7f04b0b6d640 1 --2- 172.21.15.91:0/1568543253 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f04a404e6f0 0x7f04a4047310 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0498009870 tx=0x7f049801ecf0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.480 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.481+0000 7f04b0b6d640 1 -- 172.21.15.91:0/1568543253 shutdown_connections 2023-11-27T18:14:01.480 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.481+0000 7f04b0b6d640 1 --2- 172.21.15.91:0/1568543253 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f04a404e6f0 0x7f04a4047310 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.480 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.481+0000 7f04b0b6d640 1 --2- 172.21.15.91:0/1568543253 >> v2:172.21.15.94:3300/0 conn(0x7f04a40d6b70 0x7f04a40dd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.480 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.481+0000 7f04b0b6d640 1 -- 172.21.15.91:0/1568543253 >> 172.21.15.91:0/1568543253 conn(0x7f04a400e060 msgr2=0x7f04a400e470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:01.480 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.481+0000 7f04b0b6d640 1 -- 172.21.15.91:0/1568543253 shutdown_connections 2023-11-27T18:14:01.480 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.481+0000 7f04b0b6d640 1 -- 172.21.15.91:0/1568543253 wait complete. 2023-11-27T18:14:01.484 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.485+0000 7f04b0b6d640 1 Processor -- start 2023-11-27T18:14:01.484 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.485+0000 7f04b0b6d640 1 -- start start 2023-11-27T18:14:01.487 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.485+0000 7f04b0b6d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f04a404e6f0 0x7f04a4037f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.487 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.485+0000 7f04b0b6d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f04a4052300 0x7f04a4172240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.487 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.485+0000 7f04b0b6d640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f04a40d6b70 0x7f04a41757b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.485+0000 7f04b0b6d640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a40d3d50 con 0x7f04a4052300 2023-11-27T18:14:01.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.485+0000 7f04b0b6d640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a40cfe90 con 0x7f04a404e6f0 2023-11-27T18:14:01.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.485+0000 7f04b0b6d640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04a4168a80 con 0x7f04a40d6b70 2023-11-27T18:14:01.489 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.485+0000 7fe6b8aec640 1 --2- 172.21.15.91:0/3469198932 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe6ac0d9220 0x7fe6ac17b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:01.489 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.489+0000 7fe6b3fff640 1 -- 172.21.15.91:0/3469198932 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6ac038b40 msgr2=0x7fe6ac0db7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.489+0000 7fe6b3fff640 1 --2- 172.21.15.91:0/3469198932 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6ac038b40 0x7fe6ac0db7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.489+0000 7fe6b3fff640 1 -- 172.21.15.91:0/3469198932 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe6ac0d9220 msgr2=0x7fe6ac17b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.489+0000 7fe6b3fff640 1 --2- 172.21.15.91:0/3469198932 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe6ac0d9220 0x7fe6ac17b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.489+0000 7fe6b3fff640 1 -- 172.21.15.91:0/3469198932 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a00094d0 con 0x7fe6ac0379d0 2023-11-27T18:14:01.492 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.489+0000 7fa6260a4640 1 -- 172.21.15.91:0/2049377943 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa618047200 msgr2=0x7fa618035f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.492 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.489+0000 7fa6260a4640 1 --2- 172.21.15.91:0/2049377943 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa618047200 0x7fa618035f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.492 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.489+0000 7fa6260a4640 1 -- 172.21.15.91:0/2049377943 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa618047d40 msgr2=0x7fa6180c5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.492 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.489+0000 7fa6260a4640 1 --2- 172.21.15.91:0/2049377943 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa618047d40 0x7fa6180c5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.492 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.489+0000 7fa6260a4640 1 -- 172.21.15.91:0/2049377943 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa618034b90 con 0x7fa618046410 2023-11-27T18:14:01.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.501+0000 7f279affd640 1 -- 172.21.15.91:0/837523779 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27a0010770 con 0x7f27a40b1f20 2023-11-27T18:14:01.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.501+0000 7f279affd640 1 -- 172.21.15.91:0/837523779 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a0009300 con 0x7f27a40b1f20 2023-11-27T18:14:01.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.501+0000 7fb22affd640 1 -- 172.21.15.91:0/958812821 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb230010870 con 0x7fb23c06adf0 2023-11-27T18:14:01.499 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.501+0000 7fb22affd640 1 -- 172.21.15.91:0/958812821 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2300109f0 con 0x7fb23c06adf0 2023-11-27T18:14:01.499 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.501+0000 7fb240922640 1 -- 172.21.15.91:0/958812821 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb23c156a40 con 0x7fb23c06adf0 2023-11-27T18:14:01.499 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.501+0000 7fb22affd640 1 -- 172.21.15.91:0/958812821 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb230010da0 con 0x7fb23c06adf0 2023-11-27T18:14:01.499 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.501+0000 7fb240922640 1 -- 172.21.15.91:0/958812821 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb23c157000 con 0x7fb23c06adf0 2023-11-27T18:14:01.499 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.501+0000 7f279affd640 1 -- 172.21.15.91:0/837523779 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f27a0010ba0 con 0x7f27a40b1f20 2023-11-27T18:14:01.500 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.501+0000 7fb240922640 1 -- 172.21.15.91:0/958812821 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb23c0c0b20 con 0x7fb23c06adf0 2023-11-27T18:14:01.500 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.501+0000 7f279affd640 1 --2- 172.21.15.91:0/837523779 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f2788066820 0x7f2788068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.500 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.501+0000 7f27a9939640 1 --2- 172.21.15.91:0/837523779 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f2788066820 0x7f2788068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:01.500 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.501+0000 7f27a9939640 1 --2- 172.21.15.91:0/837523779 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f2788066820 0x7f2788068ce0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f27a40cd7c0 tx=0x7f2794006bb0 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:01.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.505+0000 7fa6260a4640 1 --2- 172.21.15.91:0/2049377943 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa618046410 0x7fa61804f2e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa61c00c450 tx=0x7fa61c00c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:01.503 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.505+0000 7f279affd640 1 -- 172.21.15.91:0/837523779 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f27a00559c0 con 0x7f27a40b1f20 2023-11-27T18:14:01.503 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.505+0000 7f279affd640 1 --2- 172.21.15.91:0/837523779 >> [v2:172.21.15.94:6824/3389553935,v1:172.21.15.94:6825/3389553935] conn(0x7f278806fce0 0x7f2788072120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.503 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.505+0000 7f279affd640 1 -- 172.21.15.91:0/837523779 --> [v2:172.21.15.94:6824/3389553935,v1:172.21.15.94:6825/3389553935] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f27880727f0 con 0x7f278806fce0 2023-11-27T18:14:01.503 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.505+0000 7f279affd640 1 -- 172.21.15.91:0/837523779 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27a0055090 con 0x7f27a40b1f20 2023-11-27T18:14:01.503 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.505+0000 7f27aa93b640 1 --2- 172.21.15.91:0/837523779 >> [v2:172.21.15.94:6824/3389553935,v1:172.21.15.94:6825/3389553935] conn(0x7f278806fce0 0x7f2788072120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:01.504 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.509+0000 7f27aa93b640 1 --2- 172.21.15.91:0/837523779 >> [v2:172.21.15.94:6824/3389553935,v1:172.21.15.94:6825/3389553935] conn(0x7f278806fce0 0x7f2788072120 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:01.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.509+0000 7faa867fc640 1 -- 172.21.15.91:0/405626344 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa800b0da0 con 0x7faa900c7900 2023-11-27T18:14:01.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.509+0000 7faa867fc640 1 -- 172.21.15.91:0/405626344 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa800ba440 con 0x7faa900c7900 2023-11-27T18:14:01.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.509+0000 7faa867fc640 1 -- 172.21.15.91:0/405626344 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa800ba7f0 con 0x7faa900c7900 2023-11-27T18:14:01.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.509+0000 7faa96bd8640 1 -- 172.21.15.91:0/405626344 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa90204680 con 0x7faa900c7900 2023-11-27T18:14:01.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.509+0000 7faa96bd8640 1 -- 172.21.15.91:0/405626344 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa9015a9e0 con 0x7faa900c7900 2023-11-27T18:14:01.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.509+0000 7faa96bd8640 1 -- 172.21.15.91:0/405626344 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faa90166890 con 0x7faa900c7900 2023-11-27T18:14:01.506 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.509+0000 7fe6b3fff640 1 --2- 172.21.15.91:0/3469198932 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe6ac0379d0 0x7fe6ac04da50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe6a800b440 tx=0x7fe6a800b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:01.506 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.509+0000 7f279affd640 1 -- 172.21.15.91:0/837523779 <== osd.6 v2:172.21.15.94:6824/3389553935 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f27880727f0 con 0x7f278806fce0 2023-11-27T18:14:01.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.513+0000 7f04aaffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f04a4052300 0x7f04a4172240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:01.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.513+0000 7f04aaffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f04a4052300 0x7f04a4172240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44784/0 (socket says 172.21.15.91:44784) 2023-11-27T18:14:01.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.513+0000 7f04aaffd640 1 -- 172.21.15.91:0/1130174658 learned_addr learned my addr 172.21.15.91:0/1130174658 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:01.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.513+0000 7f04abfff640 1 --2- 172.21.15.91:0/1130174658 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f04a40d6b70 0x7f04a41757b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:01.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.517+0000 7fe3877fe640 1 -- 172.21.15.91:0/2342405923 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39800ce70 con 0x7fe3a015b240 2023-11-27T18:14:01.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.517+0000 7fe3877fe640 1 -- 172.21.15.91:0/2342405923 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe398014440 con 0x7fe3a015b240 2023-11-27T18:14:01.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.517+0000 7fe3877fe640 1 -- 172.21.15.91:0/2342405923 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe398014810 con 0x7fe3a015b240 2023-11-27T18:14:01.513 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.517+0000 7fe3a55ce640 1 -- 172.21.15.91:0/2342405923 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3a00cc120 con 0x7fe3a015b240 2023-11-27T18:14:01.513 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.517+0000 7fe3a55ce640 1 -- 172.21.15.91:0/2342405923 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3a01f05c0 con 0x7fe3a015b240 2023-11-27T18:14:01.513 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.517+0000 7fe3a55ce640 1 -- 172.21.15.91:0/2342405923 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe3a015b6a0 con 0x7fe3a015b240 2023-11-27T18:14:01.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.517+0000 7f04aaffd640 1 -- 172.21.15.91:0/1130174658 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f04a40d6b70 msgr2=0x7f04a41757b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.517+0000 7f04aaffd640 1 --2- 172.21.15.91:0/1130174658 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f04a40d6b70 0x7f04a41757b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.517+0000 7f04aaffd640 1 -- 172.21.15.91:0/1130174658 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f04a404e6f0 msgr2=0x7f04a4037f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.517+0000 7f04aaffd640 1 --2- 172.21.15.91:0/1130174658 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f04a404e6f0 0x7f04a4037f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.517+0000 7f04aaffd640 1 -- 172.21.15.91:0/1130174658 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04980094d0 con 0x7f04a4052300 2023-11-27T18:14:01.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.521+0000 7f04aaffd640 1 --2- 172.21.15.91:0/1130174658 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f04a4052300 0x7f04a4172240 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f04980b3040 tx=0x7f049801ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:01.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.525+0000 7f27ac39e640 1 -- 172.21.15.91:0/837523779 --> [v2:172.21.15.94:6824/3389553935,v1:172.21.15.94:6825/3389553935] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f27a415a8e0 con 0x7f278806fce0 2023-11-27T18:14:01.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.525+0000 7f0497fff640 1 -- 172.21.15.91:0/1130174658 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04980ba600 con 0x7f04a4052300 2023-11-27T18:14:01.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.525+0000 7f0497fff640 1 -- 172.21.15.91:0/1130174658 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04980ba780 con 0x7f04a4052300 2023-11-27T18:14:01.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.525+0000 7f0497fff640 1 -- 172.21.15.91:0/1130174658 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04980bab30 con 0x7f04a4052300 2023-11-27T18:14:01.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.525+0000 7f04b0b6d640 1 -- 172.21.15.91:0/1130174658 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04a41685f0 con 0x7f04a4052300 2023-11-27T18:14:01.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.525+0000 7f04b0b6d640 1 -- 172.21.15.91:0/1130174658 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04a40d3a70 con 0x7f04a4052300 2023-11-27T18:14:01.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.525+0000 7f04b0b6d640 1 -- 172.21.15.91:0/1130174658 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f04a40e0120 con 0x7f04a4052300 2023-11-27T18:14:01.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.525+0000 7f279affd640 1 -- 172.21.15.91:0/837523779 <== osd.6 v2:172.21.15.94:6824/3389553935 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f279c0091b0 con 0x7f278806fce0 2023-11-27T18:14:01.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.525+0000 7f27ac39e640 1 -- 172.21.15.91:0/837523779 >> [v2:172.21.15.94:6824/3389553935,v1:172.21.15.94:6825/3389553935] conn(0x7f278806fce0 msgr2=0x7f2788072120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.525+0000 7f27ac39e640 1 --2- 172.21.15.91:0/837523779 >> [v2:172.21.15.94:6824/3389553935,v1:172.21.15.94:6825/3389553935] conn(0x7f278806fce0 0x7f2788072120 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.525+0000 7f27ac39e640 1 -- 172.21.15.91:0/837523779 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f2788066820 msgr2=0x7f2788068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.525+0000 7f27ac39e640 1 --2- 172.21.15.91:0/837523779 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f2788066820 0x7f2788068ce0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f27a40cd7c0 tx=0x7f2794006bb0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.525+0000 7f27ac39e640 1 -- 172.21.15.91:0/837523779 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f27a40b1f20 msgr2=0x7f27a406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.525+0000 7f27ac39e640 1 --2- 172.21.15.91:0/837523779 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f27a40b1f20 0x7f27a406b750 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f27a000b580 tx=0x7f27a000ba40 comp rx=0 tx=0).stop 2023-11-27T18:14:01.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.525+0000 7f27aa93b640 1 -- 172.21.15.91:0/837523779 reap_dead start 2023-11-27T18:14:01.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.525+0000 7f27ac39e640 1 -- 172.21.15.91:0/837523779 shutdown_connections 2023-11-27T18:14:01.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.525+0000 7f27ac39e640 1 -- 172.21.15.91:0/837523779 >> 172.21.15.91:0/837523779 conn(0x7f27a4070a80 msgr2=0x7f27a415b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:01.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.525+0000 7f27ac39e640 1 -- 172.21.15.91:0/837523779 shutdown_connections 2023-11-27T18:14:01.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.525+0000 7f27ac39e640 1 -- 172.21.15.91:0/837523779 wait complete. 2023-11-27T18:14:01.537 INFO:teuthology.orchestra.run.smithi091.stdout:68719476757 2023-11-27T18:14:01.538 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-27T18:14:01.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.545+0000 7f0497fff640 1 -- 172.21.15.91:0/1130174658 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f04980bac90 con 0x7f04a4052300 2023-11-27T18:14:01.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.545+0000 7f0497fff640 1 --2- 172.21.15.91:0/1130174658 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f04900667f0 0x7f0490068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.545+0000 7f04ab7fe640 1 --2- 172.21.15.91:0/1130174658 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f04900667f0 0x7f0490068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:01.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.545+0000 7f04ab7fe640 1 --2- 172.21.15.91:0/1130174658 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f04900667f0 0x7f0490068cb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f04a000b850 tx=0x7f04a0008040 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:01.548 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.549+0000 7f0497fff640 1 -- 172.21.15.91:0/1130174658 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f04980c2360 con 0x7f04a4052300 2023-11-27T18:14:01.548 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.553+0000 7f0497fff640 1 --2- 172.21.15.91:0/1130174658 >> [v2:172.21.15.94:6816/2448969592,v1:172.21.15.94:6817/2448969592] conn(0x7f049006fcb0 0x7f04900720f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.548 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.553+0000 7f0497fff640 1 -- 172.21.15.91:0/1130174658 --> [v2:172.21.15.94:6816/2448969592,v1:172.21.15.94:6817/2448969592] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f04900727c0 con 0x7f049006fcb0 2023-11-27T18:14:01.548 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.553+0000 7f0497fff640 1 -- 172.21.15.91:0/1130174658 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f04980f0400 con 0x7f04a4052300 2023-11-27T18:14:01.548 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.553+0000 7f04abfff640 1 --2- 172.21.15.91:0/1130174658 >> [v2:172.21.15.94:6816/2448969592,v1:172.21.15.94:6817/2448969592] conn(0x7f049006fcb0 0x7f04900720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:01.549 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.553+0000 7f04abfff640 1 --2- 172.21.15.91:0/1130174658 >> [v2:172.21.15.94:6816/2448969592,v1:172.21.15.94:6817/2448969592] conn(0x7f049006fcb0 0x7f04900720f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:01.552 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.557+0000 7f0497fff640 1 -- 172.21.15.91:0/1130174658 <== osd.5 v2:172.21.15.94:6816/2448969592 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f04ac095960 con 0x7f049006fcb0 2023-11-27T18:14:01.566 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.569+0000 7f04b0b6d640 1 -- 172.21.15.91:0/1130174658 --> [v2:172.21.15.94:6816/2448969592,v1:172.21.15.94:6817/2448969592] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f04a404d5b0 con 0x7f049006fcb0 2023-11-27T18:14:01.567 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.569+0000 7f0497fff640 1 -- 172.21.15.91:0/1130174658 <== osd.5 v2:172.21.15.94:6816/2448969592 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f04ac08f020 con 0x7f049006fcb0 2023-11-27T18:14:01.568 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.569+0000 7f04b0b6d640 1 -- 172.21.15.91:0/1130174658 >> [v2:172.21.15.94:6816/2448969592,v1:172.21.15.94:6817/2448969592] conn(0x7f049006fcb0 msgr2=0x7f04900720f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.568 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.569+0000 7f04b0b6d640 1 --2- 172.21.15.91:0/1130174658 >> [v2:172.21.15.94:6816/2448969592,v1:172.21.15.94:6817/2448969592] conn(0x7f049006fcb0 0x7f04900720f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.568 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.569+0000 7f04b0b6d640 1 -- 172.21.15.91:0/1130174658 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f04900667f0 msgr2=0x7f0490068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.568 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.569+0000 7f04b0b6d640 1 --2- 172.21.15.91:0/1130174658 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f04900667f0 0x7f0490068cb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f04a000b850 tx=0x7f04a0008040 comp rx=0 tx=0).stop 2023-11-27T18:14:01.568 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.569+0000 7f04b0b6d640 1 -- 172.21.15.91:0/1130174658 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f04a4052300 msgr2=0x7f04a4172240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.568 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.569+0000 7f04b0b6d640 1 --2- 172.21.15.91:0/1130174658 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f04a4052300 0x7f04a4172240 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f04980b3040 tx=0x7f049801ba90 comp rx=0 tx=0).stop 2023-11-27T18:14:01.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.569+0000 7f04abfff640 1 -- 172.21.15.91:0/1130174658 reap_dead start 2023-11-27T18:14:01.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.569+0000 7f04b0b6d640 1 -- 172.21.15.91:0/1130174658 shutdown_connections 2023-11-27T18:14:01.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.569+0000 7f04b0b6d640 1 -- 172.21.15.91:0/1130174658 >> 172.21.15.91:0/1130174658 conn(0x7f04a400e060 msgr2=0x7f04a40d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:01.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.569+0000 7f04b0b6d640 1 -- 172.21.15.91:0/1130174658 shutdown_connections 2023-11-27T18:14:01.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.569+0000 7f04b0b6d640 1 -- 172.21.15.91:0/1130174658 wait complete. 2023-11-27T18:14:01.575 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.577+0000 7faa867fc640 1 -- 172.21.15.91:0/405626344 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7faa800ba950 con 0x7faa900c7900 2023-11-27T18:14:01.575 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.577+0000 7faa867fc640 1 --2- 172.21.15.91:0/405626344 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7faa74066870 0x7faa74068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.575 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.577+0000 7faa95bd6640 1 --2- 172.21.15.91:0/405626344 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7faa74066870 0x7faa74068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:01.576 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.581+0000 7faa95bd6640 1 --2- 172.21.15.91:0/405626344 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7faa74066870 0x7faa74068d30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7faa8c009650 tx=0x7faa8c006bb0 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:01.584 INFO:teuthology.orchestra.run.smithi091.stdout:68719476757 2023-11-27T18:14:01.585 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-27T18:14:01.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.589+0000 7faa867fc640 1 -- 172.21.15.91:0/405626344 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7faa800f3f20 con 0x7faa900c7900 2023-11-27T18:14:01.591 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.589+0000 7faa867fc640 1 --2- 172.21.15.91:0/405626344 >> [v2:172.21.15.94:6808/2501531833,v1:172.21.15.94:6809/2501531833] conn(0x7faa7406fdb0 0x7faa740721f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.591 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.589+0000 7faa867fc640 1 -- 172.21.15.91:0/405626344 --> [v2:172.21.15.94:6808/2501531833,v1:172.21.15.94:6809/2501531833] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faa740728c0 con 0x7faa7406fdb0 2023-11-27T18:14:01.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.589+0000 7faa953d5640 1 --2- 172.21.15.91:0/405626344 >> [v2:172.21.15.94:6808/2501531833,v1:172.21.15.94:6809/2501531833] conn(0x7faa7406fdb0 0x7faa740721f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:01.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.589+0000 7faa953d5640 1 --2- 172.21.15.91:0/405626344 >> [v2:172.21.15.94:6808/2501531833,v1:172.21.15.94:6809/2501531833] conn(0x7faa7406fdb0 0x7faa740721f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:01.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.593+0000 7faa867fc640 1 -- 172.21.15.91:0/405626344 <== osd.4 v2:172.21.15.94:6808/2501531833 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7faa740728c0 con 0x7faa7406fdb0 2023-11-27T18:14:01.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.605+0000 7f964ffff640 1 -- 172.21.15.91:0/1705174888 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96500c4070 con 0x7f965c034770 2023-11-27T18:14:01.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.605+0000 7f964ffff640 1 -- 172.21.15.91:0/1705174888 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96500be420 con 0x7f965c034770 2023-11-27T18:14:01.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.605+0000 7f964ffff640 1 -- 172.21.15.91:0/1705174888 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96500be7f0 con 0x7f965c034770 2023-11-27T18:14:01.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.605+0000 7f966885f640 1 -- 172.21.15.91:0/1705174888 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f965c04f990 con 0x7f965c034770 2023-11-27T18:14:01.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.605+0000 7f966885f640 1 -- 172.21.15.91:0/1705174888 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f965c1722c0 con 0x7f965c034770 2023-11-27T18:14:01.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.609+0000 7f966885f640 1 -- 172.21.15.91:0/1705174888 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f965c007030 con 0x7f965c034770 2023-11-27T18:14:01.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.609+0000 7faa96bd8640 1 -- 172.21.15.91:0/405626344 --> [v2:172.21.15.94:6808/2501531833,v1:172.21.15.94:6809/2501531833] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7faa901665b0 con 0x7faa7406fdb0 2023-11-27T18:14:01.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.609+0000 7faa867fc640 1 -- 172.21.15.91:0/405626344 <== osd.4 v2:172.21.15.94:6808/2501531833 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7faa8800a7a0 con 0x7faa7406fdb0 2023-11-27T18:14:01.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.609+0000 7faa96bd8640 1 -- 172.21.15.91:0/405626344 >> [v2:172.21.15.94:6808/2501531833,v1:172.21.15.94:6809/2501531833] conn(0x7faa7406fdb0 msgr2=0x7faa740721f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.609+0000 7faa96bd8640 1 --2- 172.21.15.91:0/405626344 >> [v2:172.21.15.94:6808/2501531833,v1:172.21.15.94:6809/2501531833] conn(0x7faa7406fdb0 0x7faa740721f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.609+0000 7faa96bd8640 1 -- 172.21.15.91:0/405626344 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7faa74066870 msgr2=0x7faa74068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.609+0000 7faa96bd8640 1 --2- 172.21.15.91:0/405626344 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7faa74066870 0x7faa74068d30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7faa8c009650 tx=0x7faa8c006bb0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.609+0000 7faa96bd8640 1 -- 172.21.15.91:0/405626344 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faa900c7900 msgr2=0x7faa90204b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.609+0000 7faa96bd8640 1 --2- 172.21.15.91:0/405626344 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faa900c7900 0x7faa90204b10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7faa8001d360 tx=0x7faa8001ba50 comp rx=0 tx=0).stop 2023-11-27T18:14:01.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.609+0000 7faa963d7640 1 -- 172.21.15.91:0/405626344 reap_dead start 2023-11-27T18:14:01.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.609+0000 7faa96bd8640 1 -- 172.21.15.91:0/405626344 shutdown_connections 2023-11-27T18:14:01.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.609+0000 7faa96bd8640 1 -- 172.21.15.91:0/405626344 >> 172.21.15.91:0/405626344 conn(0x7faa9006c6f0 msgr2=0x7faa9006e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:01.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.609+0000 7faa96bd8640 1 -- 172.21.15.91:0/405626344 shutdown_connections 2023-11-27T18:14:01.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.609+0000 7faa96bd8640 1 -- 172.21.15.91:0/405626344 wait complete. 2023-11-27T18:14:01.622 INFO:teuthology.orchestra.run.smithi091.stdout:64424509461 2023-11-27T18:14:01.622 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-27T18:14:01.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.649+0000 7f60e74b4640 1 Processor -- start 2023-11-27T18:14:01.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.649+0000 7f60e74b4640 1 -- start start 2023-11-27T18:14:01.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.649+0000 7f60e74b4640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f60e006f110 0x7f60e0151190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.649+0000 7f60e74b4640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60e00c26b0 con 0x7f60e00c2b40 2023-11-27T18:14:01.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.649+0000 7f60e74b4640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60e0070220 con 0x7f60e006ed30 2023-11-27T18:14:01.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.649+0000 7f60e74b4640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e0070500 con 0x7f60e006f110 2023-11-27T18:14:01.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.653+0000 7f60e4a4f640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f60e00c2b40 0x7f60e00c84c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:34162/0 (socket says 172.21.15.91:34162) 2023-11-27T18:14:01.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.653+0000 7f60e4a4f640 1 -- 172.21.15.91:0/425432346 learned_addr learned my addr 172.21.15.91:0/425432346 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:14:01.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.653+0000 7f60dffff640 1 -- 172.21.15.91:0/425432346 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4254259178 0 0) 0x7f60e00c26b0 con 0x7f60e00c2b40 2023-11-27T18:14:01.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.653+0000 7f60dffff640 1 -- 172.21.15.91:0/425432346 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60c8003530 con 0x7f60e00c2b40 2023-11-27T18:14:01.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.657+0000 7f60dffff640 1 -- 172.21.15.91:0/425432346 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2490840432 0 0) 0x7f60c8003530 con 0x7f60e00c2b40 2023-11-27T18:14:01.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.657+0000 7f60dffff640 1 -- 172.21.15.91:0/425432346 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f60e006f110 msgr2=0x7f60e0151190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:01.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.657+0000 7f60dffff640 1 --2- 172.21.15.91:0/425432346 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f60e006f110 0x7f60e0151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.657+0000 7f60dffff640 1 -- 172.21.15.91:0/425432346 >> v1:172.21.15.94:6789/0 conn(0x7f60e006ed30 legacy=0x7f60e015b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:01.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.657+0000 7f60dffff640 1 -- 172.21.15.91:0/425432346 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e00c1d80 con 0x7f60e00c2b40 2023-11-27T18:14:01.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.657+0000 7f60dffff640 1 -- 172.21.15.91:0/425432346 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3378743932 0 0) 0x7f60d4001680 con 0x7f60e00c2b40 2023-11-27T18:14:01.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.657+0000 7f60dffff640 1 -- 172.21.15.91:0/425432346 >> v1:172.21.15.91:6789/0 conn(0x7f60e00c2b40 legacy=0x7f60e00c84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.657+0000 7f60dffff640 1 --2- 172.21.15.91:0/425432346 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f60e006f110 0x7f60c80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.657+0000 7f60dffff640 1 --2- 172.21.15.91:0/425432346 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60c80040f0 0x7f60c80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.657+0000 7f60dffff640 1 --2- 172.21.15.91:0/425432346 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f60c8004e30 0x7f60c800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.657+0000 7f60dffff640 1 -- 172.21.15.91:0/425432346 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e0070500 con 0x7f60c80040f0 2023-11-27T18:14:01.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.657+0000 7f60dffff640 1 -- 172.21.15.91:0/425432346 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c80055d0 con 0x7f60c8004e30 2023-11-27T18:14:01.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.657+0000 7f60dffff640 1 -- 172.21.15.91:0/425432346 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60c800bed0 con 0x7f60e006f110 2023-11-27T18:14:01.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.665+0000 7f60e4a4f640 1 --2- 172.21.15.91:0/425432346 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60c80040f0 0x7f60c80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:01.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.665+0000 7f60e4a4f640 1 -- 172.21.15.91:0/425432346 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f60e006f110 msgr2=0x7f60c80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:01.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.665+0000 7f60e4a4f640 1 --2- 172.21.15.91:0/425432346 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f60e006f110 0x7f60c80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.665+0000 7f60e4a4f640 1 -- 172.21.15.91:0/425432346 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f60c8004e30 msgr2=0x7f60c800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:01.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.665+0000 7f60e4a4f640 1 --2- 172.21.15.91:0/425432346 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f60c8004e30 0x7f60c800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.665+0000 7f60e4a4f640 1 -- 172.21.15.91:0/425432346 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c8003530 con 0x7f60c80040f0 2023-11-27T18:14:01.664 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.669+0000 7fa616ffd640 1 -- 172.21.15.91:0/2049377943 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61c005cf0 con 0x7fa618046410 2023-11-27T18:14:01.664 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.669+0000 7fa616ffd640 1 -- 172.21.15.91:0/2049377943 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61c005e50 con 0x7fa618046410 2023-11-27T18:14:01.664 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.669+0000 7fa616ffd640 1 -- 172.21.15.91:0/2049377943 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61c0072d0 con 0x7fa618046410 2023-11-27T18:14:01.664 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.669+0000 7fa6270a6640 1 -- 172.21.15.91:0/2049377943 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa618034e70 con 0x7fa618046410 2023-11-27T18:14:01.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.669+0000 7fa6270a6640 1 -- 172.21.15.91:0/2049377943 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa618035430 con 0x7fa618046410 2023-11-27T18:14:01.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.669+0000 7fa6270a6640 1 -- 172.21.15.91:0/2049377943 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa6180d4b30 con 0x7fa618046410 2023-11-27T18:14:01.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.669+0000 7f60e4a4f640 1 --2- 172.21.15.91:0/425432346 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60c80040f0 0x7f60c80047d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f60d400c160 tx=0x7f60d401cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f61210255f7fa9e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:01.671 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.673+0000 7f60dffff640 1 -- 172.21.15.91:0/425432346 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d4005ae0 con 0x7f60c80040f0 2023-11-27T18:14:01.671 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.673+0000 7f60dffff640 1 -- 172.21.15.91:0/425432346 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d4005c40 con 0x7f60c80040f0 2023-11-27T18:14:01.671 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.673+0000 7f60dffff640 1 -- 172.21.15.91:0/425432346 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d40a5830 con 0x7f60c80040f0 2023-11-27T18:14:01.672 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.673+0000 7f60e74b4640 1 -- 172.21.15.91:0/425432346 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60c80040f0 msgr2=0x7f60c80047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.672 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.673+0000 7f60e74b4640 1 --2- 172.21.15.91:0/425432346 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60c80040f0 0x7f60c80047d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f60d400c160 tx=0x7f60d401cbc0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.672 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.673+0000 7f60e5a51640 1 -- 172.21.15.91:0/425432346 reap_dead start 2023-11-27T18:14:01.672 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.677+0000 7f60e74b4640 1 -- 172.21.15.91:0/425432346 shutdown_connections 2023-11-27T18:14:01.672 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.677+0000 7f60e74b4640 1 -- 172.21.15.91:0/425432346 >> 172.21.15.91:0/425432346 conn(0x7f60e006abb0 msgr2=0x7f60e0070aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:01.672 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.677+0000 7f60e74b4640 1 -- 172.21.15.91:0/425432346 shutdown_connections 2023-11-27T18:14:01.672 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.677+0000 7f60e74b4640 1 -- 172.21.15.91:0/425432346 wait complete. 2023-11-27T18:14:01.673 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.677+0000 7f60e74b4640 1 Processor -- start 2023-11-27T18:14:01.673 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.677+0000 7f60e74b4640 1 -- start start 2023-11-27T18:14:01.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.677+0000 7f60e74b4640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f60c80040f0 0x7f60e00c6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.677+0000 7f60e74b4640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60e0155130 0x7f60e00c6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.677+0000 7f60e74b4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f60e01f0140 0x7f60e01f05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.677+0000 7f60e74b4640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e00c9ef0 con 0x7f60e0155130 2023-11-27T18:14:01.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.677+0000 7f60e74b4640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e00c5200 con 0x7f60e01f0140 2023-11-27T18:14:01.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.677+0000 7f60e74b4640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e00c4dc0 con 0x7f60c80040f0 2023-11-27T18:14:01.676 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.681+0000 7f60e5a51640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f60e01f0140 0x7f60e01f05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:01.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.689+0000 7f60e5a51640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f60e01f0140 0x7f60e01f05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.91:58538/0 (socket says 172.21.15.91:58538) 2023-11-27T18:14:01.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.689+0000 7f60e5a51640 1 -- 172.21.15.91:0/725606654 learned_addr learned my addr 172.21.15.91:0/725606654 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:01.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.689+0000 7f60e4a4f640 1 --2- 172.21.15.91:0/725606654 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60e0155130 0x7f60e00c6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:01.696 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.701+0000 7f60e4a4f640 1 -- 172.21.15.91:0/725606654 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f60c80040f0 msgr2=0x7f60e00c6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.697 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.701+0000 7f60e4a4f640 1 --2- 172.21.15.91:0/725606654 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f60c80040f0 0x7f60e00c6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.697 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.701+0000 7f60e4a4f640 1 -- 172.21.15.91:0/725606654 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f60e01f0140 msgr2=0x7f60e01f05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.697 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.701+0000 7f60e4a4f640 1 --2- 172.21.15.91:0/725606654 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f60e01f0140 0x7f60e01f05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.697 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.701+0000 7f60e4a4f640 1 -- 172.21.15.91:0/725606654 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e00c9c10 con 0x7f60e0155130 2023-11-27T18:14:01.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.701+0000 7f60e4a4f640 1 --2- 172.21.15.91:0/725606654 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60e0155130 0x7f60e00c6980 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f60d4009000 tx=0x7f60c8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:01.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.705+0000 7f4777edc640 1 Processor -- start 2023-11-27T18:14:01.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.705+0000 7f4777edc640 1 -- start start 2023-11-27T18:14:01.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.705+0000 7f4777edc640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4770153750 0x7f477006a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.705+0000 7f4777edc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f477006f840 0x7f477015cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.705+0000 7f4777edc640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47700c75b0 con 0x7f4770066560 2023-11-27T18:14:01.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.705+0000 7f4777edc640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f477015d720 con 0x7f477006f840 2023-11-27T18:14:01.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.705+0000 7f4777edc640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47700720e0 con 0x7f4770153750 2023-11-27T18:14:01.704 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.709+0000 7f60ddffb640 1 -- 172.21.15.91:0/725606654 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d40b4070 con 0x7f60e0155130 2023-11-27T18:14:01.705 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.709+0000 7f60ddffb640 1 -- 172.21.15.91:0/725606654 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d4005a40 con 0x7f60e0155130 2023-11-27T18:14:01.705 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.709+0000 7f60e74b4640 1 -- 172.21.15.91:0/725606654 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60e00c5680 con 0x7f60e0155130 2023-11-27T18:14:01.705 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.709+0000 7f4775477640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f477006f840 0x7f477015cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:01.705 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.709+0000 7f60e74b4640 1 -- 172.21.15.91:0/725606654 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e00c5c40 con 0x7f60e0155130 2023-11-27T18:14:01.705 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.709+0000 7f60ddffb640 1 -- 172.21.15.91:0/725606654 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d40a5ca0 con 0x7f60e0155130 2023-11-27T18:14:01.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.709+0000 7f4775477640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f477006f840 0x7f477015cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44810/0 (socket says 172.21.15.91:44810) 2023-11-27T18:14:01.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.709+0000 7f4775477640 1 -- 172.21.15.91:0/1343534665 learned_addr learned my addr 172.21.15.91:0/1343534665 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:01.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.709+0000 7f60e74b4640 1 -- 172.21.15.91:0/725606654 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60e004e850 con 0x7f60e0155130 2023-11-27T18:14:01.712 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.713+0000 7fb22affd640 1 -- 172.21.15.91:0/958812821 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fb23000f3c0 con 0x7fb23c06adf0 2023-11-27T18:14:01.712 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.717+0000 7fb22affd640 1 --2- 172.21.15.91:0/958812821 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fb21c066840 0x7fb21c068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.712 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.717+0000 7fb239d9b640 1 --2- 172.21.15.91:0/958812821 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fb21c066840 0x7fb21c068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:01.712 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.717+0000 7fb239d9b640 1 --2- 172.21.15.91:0/958812821 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fb21c066840 0x7fb21c068d00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb22c0b2000 tx=0x7fb22c004740 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:01.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.717+0000 7fe6b0ff9640 1 -- 172.21.15.91:0/3469198932 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a8015070 con 0x7fe6ac0379d0 2023-11-27T18:14:01.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.717+0000 7fe6b0ff9640 1 -- 172.21.15.91:0/3469198932 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6a8005980 con 0x7fe6ac0379d0 2023-11-27T18:14:01.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.717+0000 7fe6b0ff9640 1 -- 172.21.15.91:0/3469198932 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a8005d30 con 0x7fe6ac0379d0 2023-11-27T18:14:01.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.717+0000 7fe6b92ed640 1 -- 172.21.15.91:0/3469198932 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6ac04d250 con 0x7fe6ac0379d0 2023-11-27T18:14:01.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.717+0000 7fe6b92ed640 1 -- 172.21.15.91:0/3469198932 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6ac178da0 con 0x7fe6ac0379d0 2023-11-27T18:14:01.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.721+0000 7fe6b92ed640 1 -- 172.21.15.91:0/3469198932 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe6ac0d9600 con 0x7fe6ac0379d0 2023-11-27T18:14:01.721 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.725+0000 7fb22affd640 1 -- 172.21.15.91:0/958812821 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb230055610 con 0x7fb23c06adf0 2023-11-27T18:14:01.721 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.725+0000 7fb22affd640 1 --2- 172.21.15.91:0/958812821 >> [v2:172.21.15.94:6800/1606498064,v1:172.21.15.94:6801/1606498064] conn(0x7fb21c06fd80 0x7fb21c0721c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.721 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.725+0000 7fb22affd640 1 -- 172.21.15.91:0/958812821 --> [v2:172.21.15.94:6800/1606498064,v1:172.21.15.94:6801/1606498064] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb21c072890 con 0x7fb21c06fd80 2023-11-27T18:14:01.722 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.725+0000 7fb22affd640 1 -- 172.21.15.91:0/958812821 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb2300553e0 con 0x7fb23c06adf0 2023-11-27T18:14:01.722 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.725+0000 7fb23ad9d640 1 --2- 172.21.15.91:0/958812821 >> [v2:172.21.15.94:6800/1606498064,v1:172.21.15.94:6801/1606498064] conn(0x7fb21c06fd80 0x7fb21c0721c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:01.722 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.725+0000 7fb23ad9d640 1 --2- 172.21.15.91:0/958812821 >> [v2:172.21.15.94:6800/1606498064,v1:172.21.15.94:6801/1606498064] conn(0x7fb21c06fd80 0x7fb21c0721c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:01.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.729+0000 7fb22affd640 1 -- 172.21.15.91:0/958812821 <== osd.7 v2:172.21.15.94:6800/1606498064 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fb21c072890 con 0x7fb21c06fd80 2023-11-27T18:14:01.726 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.729+0000 7f60ddffb640 1 -- 172.21.15.91:0/725606654 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f60d4007090 con 0x7f60e0155130 2023-11-27T18:14:01.726 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.729+0000 7f60ddffb640 1 --2- 172.21.15.91:0/725606654 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f60cc066820 0x7f60cc068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.726 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.729+0000 7f60e5250640 1 --2- 172.21.15.91:0/725606654 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f60cc066820 0x7f60cc068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:01.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.729+0000 7f60e5250640 1 --2- 172.21.15.91:0/725606654 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f60cc066820 0x7f60cc068ce0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f60d8001c80 tx=0x7f60d8007d20 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:01.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.741+0000 7fb240922640 1 -- 172.21.15.91:0/958812821 --> [v2:172.21.15.94:6800/1606498064,v1:172.21.15.94:6801/1606498064] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb23c0c6f30 con 0x7fb21c06fd80 2023-11-27T18:14:01.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.741+0000 7fb22affd640 1 -- 172.21.15.91:0/958812821 <== osd.7 v2:172.21.15.94:6800/1606498064 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb23c0c6f30 con 0x7fb21c06fd80 2023-11-27T18:14:01.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.745+0000 7fb240922640 1 -- 172.21.15.91:0/958812821 >> [v2:172.21.15.94:6800/1606498064,v1:172.21.15.94:6801/1606498064] conn(0x7fb21c06fd80 msgr2=0x7fb21c0721c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.745+0000 7fb240922640 1 --2- 172.21.15.91:0/958812821 >> [v2:172.21.15.94:6800/1606498064,v1:172.21.15.94:6801/1606498064] conn(0x7fb21c06fd80 0x7fb21c0721c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.745+0000 7fb240922640 1 -- 172.21.15.91:0/958812821 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fb21c066840 msgr2=0x7fb21c068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.745+0000 7fb240922640 1 --2- 172.21.15.91:0/958812821 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fb21c066840 0x7fb21c068d00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb22c0b2000 tx=0x7fb22c004740 comp rx=0 tx=0).stop 2023-11-27T18:14:01.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.745+0000 7fb240922640 1 -- 172.21.15.91:0/958812821 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb23c06adf0 msgr2=0x7fb23c0ca860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.745+0000 7fb240922640 1 --2- 172.21.15.91:0/958812821 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb23c06adf0 0x7fb23c0ca860 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb23000b550 tx=0x7fb23000ba10 comp rx=0 tx=0).stop 2023-11-27T18:14:01.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.745+0000 7fb23ad9d640 1 -- 172.21.15.91:0/958812821 reap_dead start 2023-11-27T18:14:01.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.745+0000 7fb240922640 1 -- 172.21.15.91:0/958812821 shutdown_connections 2023-11-27T18:14:01.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.745+0000 7fb240922640 1 -- 172.21.15.91:0/958812821 >> 172.21.15.91:0/958812821 conn(0x7fb23c06cf80 msgr2=0x7fb23c0c1480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:01.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.745+0000 7fb240922640 1 -- 172.21.15.91:0/958812821 shutdown_connections 2023-11-27T18:14:01.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.745+0000 7fb240922640 1 -- 172.21.15.91:0/958812821 wait complete. 2023-11-27T18:14:01.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.753+0000 7fe3877fe640 1 -- 172.21.15.91:0/2342405923 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fe39801d3b0 con 0x7fe3a015b240 2023-11-27T18:14:01.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.753+0000 7fe3877fe640 1 --2- 172.21.15.91:0/2342405923 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe38c066870 0x7fe38c068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.753+0000 7fe39effd640 1 --2- 172.21.15.91:0/2342405923 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe38c066870 0x7fe38c068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:01.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.753+0000 7fe39effd640 1 --2- 172.21.15.91:0/2342405923 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe38c066870 0x7fe38c068d30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe394000c10 tx=0x7fe394008040 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:01.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.761+0000 7fe3877fe640 1 -- 172.21.15.91:0/2342405923 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe398056040 con 0x7fe3a015b240 2023-11-27T18:14:01.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.761+0000 7fe3877fe640 1 --2- 172.21.15.91:0/2342405923 >> [v2:172.21.15.91:6826/12316911,v1:172.21.15.91:6827/12316911] conn(0x7fe38c06fdb0 0x7fe38c0721f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.761+0000 7fe3877fe640 1 -- 172.21.15.91:0/2342405923 --> [v2:172.21.15.91:6826/12316911,v1:172.21.15.91:6827/12316911] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe38c0728c0 con 0x7fe38c06fdb0 2023-11-27T18:14:01.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.761+0000 7fe39e7fc640 1 --2- 172.21.15.91:0/2342405923 >> [v2:172.21.15.91:6826/12316911,v1:172.21.15.91:6827/12316911] conn(0x7fe38c06fdb0 0x7fe38c0721f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:01.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.761+0000 7fe39e7fc640 1 --2- 172.21.15.91:0/2342405923 >> [v2:172.21.15.91:6826/12316911,v1:172.21.15.91:6827/12316911] conn(0x7fe38c06fdb0 0x7fe38c0721f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:01.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.761+0000 7fe3877fe640 1 -- 172.21.15.91:0/2342405923 <== osd.1 v2:172.21.15.91:6826/12316911 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fe38c0728c0 con 0x7fe38c06fdb0 2023-11-27T18:14:01.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.761+0000 7fa97ccfe640 1 Processor -- start 2023-11-27T18:14:01.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.761+0000 7fa97ccfe640 1 -- start start 2023-11-27T18:14:01.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.761+0000 7fa97ccfe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa97815d6e0 0x7fa9780c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.761+0000 7fa97ccfe640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9780705c0 con 0x7fa9780c8e00 2023-11-27T18:14:01.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.761+0000 7fa97ccfe640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa97815db40 con 0x7fa978153920 2023-11-27T18:14:01.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.761+0000 7fa97ccfe640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa97806f6d0 con 0x7fa97815d6e0 2023-11-27T18:14:01.760 INFO:teuthology.orchestra.run.smithi091.stdout:68719476757 2023-11-27T18:14:01.761 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-27T18:14:01.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.769+0000 7fe3877fe640 1 -- 172.21.15.91:0/2342405923 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe3980097f0 con 0x7fe3a015b240 2023-11-27T18:14:01.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.777+0000 7fe3a55ce640 1 -- 172.21.15.91:0/2342405923 --> [v2:172.21.15.91:6826/12316911,v1:172.21.15.91:6827/12316911] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe3a00c9c10 con 0x7fe38c06fdb0 2023-11-27T18:14:01.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.777+0000 7fe3877fe640 1 -- 172.21.15.91:0/2342405923 <== osd.1 v2:172.21.15.91:6826/12316911 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe39000b980 con 0x7fe38c06fdb0 2023-11-27T18:14:01.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.777+0000 7fe3a55ce640 1 -- 172.21.15.91:0/2342405923 >> [v2:172.21.15.91:6826/12316911,v1:172.21.15.91:6827/12316911] conn(0x7fe38c06fdb0 msgr2=0x7fe38c0721f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.777+0000 7fe3a55ce640 1 --2- 172.21.15.91:0/2342405923 >> [v2:172.21.15.91:6826/12316911,v1:172.21.15.91:6827/12316911] conn(0x7fe38c06fdb0 0x7fe38c0721f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.777+0000 7fe3a55ce640 1 -- 172.21.15.91:0/2342405923 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe38c066870 msgr2=0x7fe38c068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.777+0000 7fe3a55ce640 1 --2- 172.21.15.91:0/2342405923 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe38c066870 0x7fe38c068d30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe394000c10 tx=0x7fe394008040 comp rx=0 tx=0).stop 2023-11-27T18:14:01.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.777+0000 7fe3a55ce640 1 -- 172.21.15.91:0/2342405923 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe3a015b240 msgr2=0x7fe3a00cb1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.777+0000 7fe3a55ce640 1 --2- 172.21.15.91:0/2342405923 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe3a015b240 0x7fe3a00cb1f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe39800be20 tx=0x7fe39800bf10 comp rx=0 tx=0).stop 2023-11-27T18:14:01.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.777+0000 7fe39f7fe640 1 -- 172.21.15.91:0/2342405923 reap_dead start 2023-11-27T18:14:01.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.777+0000 7fe3a55ce640 1 -- 172.21.15.91:0/2342405923 shutdown_connections 2023-11-27T18:14:01.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.777+0000 7fe3a55ce640 1 -- 172.21.15.91:0/2342405923 >> 172.21.15.91:0/2342405923 conn(0x7fe3a006a520 msgr2=0x7fe3a01e2750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:01.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.777+0000 7fe3a55ce640 1 -- 172.21.15.91:0/2342405923 shutdown_connections 2023-11-27T18:14:01.776 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.777+0000 7fe3a55ce640 1 -- 172.21.15.91:0/2342405923 wait complete. 2023-11-27T18:14:01.790 INFO:teuthology.orchestra.run.smithi091.stdout:68719476756 2023-11-27T18:14:01.790 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-27T18:14:01.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.801+0000 7f964ffff640 1 -- 172.21.15.91:0/1705174888 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f96500ba040 con 0x7f965c034770 2023-11-27T18:14:01.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.801+0000 7f964ffff640 1 --2- 172.21.15.91:0/1705174888 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f96480667f0 0x7f9648068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.801+0000 7f9662ffd640 1 --2- 172.21.15.91:0/1705174888 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f96480667f0 0x7f9648068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:01.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.801+0000 7f9662ffd640 1 --2- 172.21.15.91:0/1705174888 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f96480667f0 0x7f9648068cb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f965c16e8e0 tx=0x7f9658009040 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:01.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.805+0000 7f964ffff640 1 -- 172.21.15.91:0/1705174888 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f96500f6090 con 0x7f965c034770 2023-11-27T18:14:01.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.805+0000 7f964ffff640 1 --2- 172.21.15.91:0/1705174888 >> [v2:172.21.15.91:6818/1297704794,v1:172.21.15.91:6819/1297704794] conn(0x7f964806fcb0 0x7f96480720f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.805+0000 7f964ffff640 1 -- 172.21.15.91:0/1705174888 --> [v2:172.21.15.91:6818/1297704794,v1:172.21.15.91:6819/1297704794] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f96480727c0 con 0x7f964806fcb0 2023-11-27T18:14:01.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.805+0000 7f9663fff640 1 --2- 172.21.15.91:0/1705174888 >> [v2:172.21.15.91:6818/1297704794,v1:172.21.15.91:6819/1297704794] conn(0x7f964806fcb0 0x7f96480720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:01.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.805+0000 7f9663fff640 1 --2- 172.21.15.91:0/1705174888 >> [v2:172.21.15.91:6818/1297704794,v1:172.21.15.91:6819/1297704794] conn(0x7f964806fcb0 0x7f96480720f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:01.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.805+0000 7f964ffff640 1 -- 172.21.15.91:0/1705174888 <== osd.3 v2:172.21.15.91:6818/1297704794 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f9664095960 con 0x7f964806fcb0 2023-11-27T18:14:01.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.821+0000 7f966885f640 1 -- 172.21.15.91:0/1705174888 --> [v2:172.21.15.91:6818/1297704794,v1:172.21.15.91:6819/1297704794] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f965c006d50 con 0x7f964806fcb0 2023-11-27T18:14:01.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.821+0000 7f964ffff640 1 -- 172.21.15.91:0/1705174888 <== osd.3 v2:172.21.15.91:6818/1297704794 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f96480727c0 con 0x7f964806fcb0 2023-11-27T18:14:01.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.821+0000 7fe6b0ff9640 1 -- 172.21.15.91:0/3469198932 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fe6a8011630 con 0x7fe6ac0379d0 2023-11-27T18:14:01.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.821+0000 7f966885f640 1 -- 172.21.15.91:0/1705174888 >> [v2:172.21.15.91:6818/1297704794,v1:172.21.15.91:6819/1297704794] conn(0x7f964806fcb0 msgr2=0x7f96480720f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.821+0000 7f966885f640 1 --2- 172.21.15.91:0/1705174888 >> [v2:172.21.15.91:6818/1297704794,v1:172.21.15.91:6819/1297704794] conn(0x7f964806fcb0 0x7f96480720f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.821+0000 7f966885f640 1 -- 172.21.15.91:0/1705174888 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f96480667f0 msgr2=0x7f9648068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.821+0000 7f966885f640 1 --2- 172.21.15.91:0/1705174888 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f96480667f0 0x7f9648068cb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f965c16e8e0 tx=0x7f9658009040 comp rx=0 tx=0).stop 2023-11-27T18:14:01.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.821+0000 7f966885f640 1 -- 172.21.15.91:0/1705174888 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f965c034770 msgr2=0x7f965c04e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.821+0000 7f966885f640 1 --2- 172.21.15.91:0/1705174888 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f965c034770 0x7f965c04e4f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f96500b2000 tx=0x7f965001fa00 comp rx=0 tx=0).stop 2023-11-27T18:14:01.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.821+0000 7f9663fff640 1 -- 172.21.15.91:0/1705174888 reap_dead start 2023-11-27T18:14:01.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.821+0000 7f966885f640 1 -- 172.21.15.91:0/1705174888 shutdown_connections 2023-11-27T18:14:01.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.821+0000 7f966885f640 1 -- 172.21.15.91:0/1705174888 >> 172.21.15.91:0/1705174888 conn(0x7f965c050160 msgr2=0x7f965c0453f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:01.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.821+0000 7f966885f640 1 -- 172.21.15.91:0/1705174888 shutdown_connections 2023-11-27T18:14:01.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.821+0000 7f966885f640 1 -- 172.21.15.91:0/1705174888 wait complete. 2023-11-27T18:14:01.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.821+0000 7fe6b0ff9640 1 --2- 172.21.15.91:0/3469198932 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe698066840 0x7fe698068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.821+0000 7fe6b37fe640 1 --2- 172.21.15.91:0/3469198932 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe698066840 0x7fe698068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:01.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.825+0000 7fe6b37fe640 1 --2- 172.21.15.91:0/3469198932 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe698066840 0x7fe698068d00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe6a001c4f0 tx=0x7fe6a00b5040 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:01.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.825+0000 7fa97659c640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fa978153920 0x7fa9780c6e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.91:58374/0 (socket says 172.21.15.91:58374) 2023-11-27T18:14:01.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.825+0000 7fa97659c640 1 -- 172.21.15.91:0/3678878823 learned_addr learned my addr 172.21.15.91:0/3678878823 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:14:01.823 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.825+0000 7fa616ffd640 1 -- 172.21.15.91:0/2049377943 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fa61c007430 con 0x7fa618046410 2023-11-27T18:14:01.823 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.825+0000 7fa616ffd640 1 --2- 172.21.15.91:0/2049377943 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa604066870 0x7fa604068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.823 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.825+0000 7fa6258a3640 1 --2- 172.21.15.91:0/2049377943 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa604066870 0x7fa604068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:01.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.825+0000 7fe6b0ff9640 1 -- 172.21.15.91:0/3469198932 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe6a80556d0 con 0x7fe6ac0379d0 2023-11-27T18:14:01.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.825+0000 7fe6b0ff9640 1 --2- 172.21.15.91:0/3469198932 >> [v2:172.21.15.91:6802/3776125919,v1:172.21.15.91:6803/3776125919] conn(0x7fe69806fd80 0x7fe6980721c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.825+0000 7fe6b0ff9640 1 -- 172.21.15.91:0/3469198932 --> [v2:172.21.15.91:6802/3776125919,v1:172.21.15.91:6803/3776125919] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe698072890 con 0x7fe69806fd80 2023-11-27T18:14:01.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.825+0000 7fe6b8aec640 1 --2- 172.21.15.91:0/3469198932 >> [v2:172.21.15.91:6802/3776125919,v1:172.21.15.91:6803/3776125919] conn(0x7fe69806fd80 0x7fe6980721c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:01.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.825+0000 7fa6258a3640 1 --2- 172.21.15.91:0/2049377943 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa604066870 0x7fa604068d30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa610007fd0 tx=0x7fa6100079a0 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:01.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.825+0000 7fe6b8aec640 1 --2- 172.21.15.91:0/3469198932 >> [v2:172.21.15.91:6802/3776125919,v1:172.21.15.91:6803/3776125919] conn(0x7fe69806fd80 0x7fe6980721c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:01.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.829+0000 7fe6b0ff9640 1 -- 172.21.15.91:0/3469198932 <== osd.2 v2:172.21.15.91:6802/3776125919 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fe6b4095960 con 0x7fe69806fd80 2023-11-27T18:14:01.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.841+0000 7fa616ffd640 1 -- 172.21.15.91:0/2049377943 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa61c054d90 con 0x7fa618046410 2023-11-27T18:14:01.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.841+0000 7fa616ffd640 1 --2- 172.21.15.91:0/2049377943 >> [v2:172.21.15.91:6810/472303992,v1:172.21.15.91:6811/472303992] conn(0x7fa60406fdb0 0x7fa6040721f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.841+0000 7fa616ffd640 1 -- 172.21.15.91:0/2049377943 --> [v2:172.21.15.91:6810/472303992,v1:172.21.15.91:6811/472303992] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa6040728c0 con 0x7fa60406fdb0 2023-11-27T18:14:01.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.841+0000 7fa6268a5640 1 --2- 172.21.15.91:0/2049377943 >> [v2:172.21.15.91:6810/472303992,v1:172.21.15.91:6811/472303992] conn(0x7fa60406fdb0 0x7fa6040721f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:01.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.841+0000 7fa6268a5640 1 --2- 172.21.15.91:0/2049377943 >> [v2:172.21.15.91:6810/472303992,v1:172.21.15.91:6811/472303992] conn(0x7fa60406fdb0 0x7fa6040721f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:01.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.841+0000 7fa616ffd640 1 -- 172.21.15.91:0/2049377943 <== osd.0 v2:172.21.15.91:6810/472303992 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fa6040728c0 con 0x7fa60406fdb0 2023-11-27T18:14:01.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.845+0000 7fa616ffd640 1 -- 172.21.15.91:0/2049377943 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa61c0510d0 con 0x7fa618046410 2023-11-27T18:14:01.843 INFO:teuthology.orchestra.run.smithi091.stdout:68719476755 2023-11-27T18:14:01.844 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-27T18:14:01.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.849+0000 7fe6b92ed640 1 -- 172.21.15.91:0/3469198932 --> [v2:172.21.15.91:6802/3776125919,v1:172.21.15.91:6803/3776125919] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe6ac0052a0 con 0x7fe69806fd80 2023-11-27T18:14:01.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.853+0000 7fe6b0ff9640 1 -- 172.21.15.91:0/3469198932 <== osd.2 v2:172.21.15.91:6802/3776125919 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe6b408f020 con 0x7fe69806fd80 2023-11-27T18:14:01.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.853+0000 7fe6b92ed640 1 -- 172.21.15.91:0/3469198932 >> [v2:172.21.15.91:6802/3776125919,v1:172.21.15.91:6803/3776125919] conn(0x7fe69806fd80 msgr2=0x7fe6980721c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.853+0000 7fe6b92ed640 1 --2- 172.21.15.91:0/3469198932 >> [v2:172.21.15.91:6802/3776125919,v1:172.21.15.91:6803/3776125919] conn(0x7fe69806fd80 0x7fe6980721c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.853+0000 7fe6b92ed640 1 -- 172.21.15.91:0/3469198932 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe698066840 msgr2=0x7fe698068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.853+0000 7fe6b92ed640 1 --2- 172.21.15.91:0/3469198932 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe698066840 0x7fe698068d00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe6a001c4f0 tx=0x7fe6a00b5040 comp rx=0 tx=0).stop 2023-11-27T18:14:01.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.853+0000 7fe6b92ed640 1 -- 172.21.15.91:0/3469198932 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe6ac0379d0 msgr2=0x7fe6ac04da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.853+0000 7fe6b92ed640 1 --2- 172.21.15.91:0/3469198932 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe6ac0379d0 0x7fe6ac04da50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe6a800b440 tx=0x7fe6a800b900 comp rx=0 tx=0).stop 2023-11-27T18:14:01.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.853+0000 7fe6b8aec640 1 -- 172.21.15.91:0/3469198932 reap_dead start 2023-11-27T18:14:01.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.853+0000 7fe6b92ed640 1 -- 172.21.15.91:0/3469198932 shutdown_connections 2023-11-27T18:14:01.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.853+0000 7fe6b92ed640 1 -- 172.21.15.91:0/3469198932 >> 172.21.15.91:0/3469198932 conn(0x7fe6ac0545f0 msgr2=0x7fe6ac050160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:01.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.853+0000 7fe6b92ed640 1 -- 172.21.15.91:0/3469198932 shutdown_connections 2023-11-27T18:14:01.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.853+0000 7fe6b92ed640 1 -- 172.21.15.91:0/3469198932 wait complete. 2023-11-27T18:14:01.852 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.853+0000 7f4775c78640 1 --2- 172.21.15.91:0/1343534665 >> v2:172.21.15.94:3300/0 conn(0x7f4770153750 0x7f477006a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:01.860 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.861+0000 7f4775c78640 1 -- 172.21.15.91:0/1343534665 >> v2:172.21.15.91:3300/0 conn(0x7f477006f840 msgr2=0x7f477015cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:01.860 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.861+0000 7f4775c78640 1 --2- 172.21.15.91:0/1343534665 >> v2:172.21.15.91:3300/0 conn(0x7f477006f840 0x7f477015cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.860 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.861+0000 7f4775c78640 1 -- 172.21.15.91:0/1343534665 >> v1:172.21.15.94:6789/0 conn(0x7f4770066560 legacy=0x7f477015d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.860 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.865+0000 7f4775c78640 1 -- 172.21.15.91:0/1343534665 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47700c7280 con 0x7f4770153750 2023-11-27T18:14:01.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.869+0000 7fa6270a6640 1 -- 172.21.15.91:0/2049377943 --> [v2:172.21.15.91:6810/472303992,v1:172.21.15.91:6811/472303992] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa618051c20 con 0x7fa60406fdb0 2023-11-27T18:14:01.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.873+0000 7fa616ffd640 1 -- 172.21.15.91:0/2049377943 <== osd.0 v2:172.21.15.91:6810/472303992 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa618051c20 con 0x7fa60406fdb0 2023-11-27T18:14:01.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.873+0000 7f4775c78640 1 --2- 172.21.15.91:0/1343534665 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4770153750 0x7f477006a520 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f47700c7d20 tx=0x7f476c01ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=babe3e6754efcd29 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:01.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.873+0000 7fa6270a6640 1 -- 172.21.15.91:0/2049377943 >> [v2:172.21.15.91:6810/472303992,v1:172.21.15.91:6811/472303992] conn(0x7fa60406fdb0 msgr2=0x7fa6040721f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.873+0000 7fa6270a6640 1 --2- 172.21.15.91:0/2049377943 >> [v2:172.21.15.91:6810/472303992,v1:172.21.15.91:6811/472303992] conn(0x7fa60406fdb0 0x7fa6040721f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.873+0000 7fa6270a6640 1 -- 172.21.15.91:0/2049377943 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa604066870 msgr2=0x7fa604068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.873+0000 7fa6270a6640 1 --2- 172.21.15.91:0/2049377943 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa604066870 0x7fa604068d30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa610007fd0 tx=0x7fa6100079a0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.873+0000 7fa6270a6640 1 -- 172.21.15.91:0/2049377943 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa618046410 msgr2=0x7fa61804f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.873+0000 7fa6270a6640 1 --2- 172.21.15.91:0/2049377943 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa618046410 0x7fa61804f2e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa61c00c450 tx=0x7fa61c00c910 comp rx=0 tx=0).stop 2023-11-27T18:14:01.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.873+0000 7fa6268a5640 1 -- 172.21.15.91:0/2049377943 reap_dead start 2023-11-27T18:14:01.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.873+0000 7fa6270a6640 1 -- 172.21.15.91:0/2049377943 shutdown_connections 2023-11-27T18:14:01.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.873+0000 7fa6270a6640 1 -- 172.21.15.91:0/2049377943 >> 172.21.15.91:0/2049377943 conn(0x7fa618051270 msgr2=0x7fa6180d3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:01.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.873+0000 7fa6270a6640 1 -- 172.21.15.91:0/2049377943 shutdown_connections 2023-11-27T18:14:01.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.873+0000 7fa6270a6640 1 -- 172.21.15.91:0/2049377943 wait complete. 2023-11-27T18:14:01.873 INFO:teuthology.orchestra.run.smithi091.stdout:68719476756 2023-11-27T18:14:01.873 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-27T18:14:01.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.881+0000 7f60ddffb640 1 -- 172.21.15.91:0/725606654 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f60d40ad3c0 con 0x7f60e0155130 2023-11-27T18:14:01.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.881+0000 7f4774c76640 1 -- 172.21.15.91:0/1343534665 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476c0a8950 con 0x7f4770153750 2023-11-27T18:14:01.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.881+0000 7f4774c76640 1 -- 172.21.15.91:0/1343534665 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f476c0a8ab0 con 0x7f4770153750 2023-11-27T18:14:01.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.881+0000 7f4774c76640 1 -- 172.21.15.91:0/1343534665 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476c0a8e40 con 0x7f4770153750 2023-11-27T18:14:01.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.881+0000 7f4777edc640 1 -- 172.21.15.91:0/1343534665 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4770153750 msgr2=0x7f477006a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.881+0000 7f4777edc640 1 --2- 172.21.15.91:0/1343534665 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4770153750 0x7f477006a520 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f47700c7d20 tx=0x7f476c01ec70 comp rx=0 tx=0).stop 2023-11-27T18:14:01.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.881+0000 7f4777edc640 1 -- 172.21.15.91:0/1343534665 shutdown_connections 2023-11-27T18:14:01.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.881+0000 7f4777edc640 1 --2- 172.21.15.91:0/1343534665 >> v2:172.21.15.91:3300/0 conn(0x7f477006f840 0x7f477015cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.881+0000 7f4777edc640 1 --2- 172.21.15.91:0/1343534665 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4770153750 0x7f477006a520 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.881+0000 7f4777edc640 1 -- 172.21.15.91:0/1343534665 >> 172.21.15.91:0/1343534665 conn(0x7f4770071520 msgr2=0x7f4770071930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:01.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.881+0000 7f4777edc640 1 -- 172.21.15.91:0/1343534665 shutdown_connections 2023-11-27T18:14:01.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.881+0000 7f4777edc640 1 -- 172.21.15.91:0/1343534665 wait complete. 2023-11-27T18:14:01.882 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.885+0000 7f4777edc640 1 Processor -- start 2023-11-27T18:14:01.882 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.885+0000 7f4777edc640 1 -- start start 2023-11-27T18:14:01.882 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.885+0000 7f4777edc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4770066560 0x7f47700ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.885+0000 7f4777edc640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f477006f840 0x7f47701f76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.885+0000 7f4777edc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4770153750 0x7f477015b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.885+0000 7f4777edc640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4770157a10 con 0x7f4770066560 2023-11-27T18:14:01.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.885+0000 7f4777edc640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47701f41e0 con 0x7f4770153750 2023-11-27T18:14:01.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.885+0000 7f4777edc640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47701f7c10 con 0x7f477006f840 2023-11-27T18:14:01.884 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.889+0000 7f4775477640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f477006f840 0x7f47701f76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:01.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.889+0000 7f4775477640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f477006f840 0x7f47701f76d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.91:40984/0 (socket says 172.21.15.91:40984) 2023-11-27T18:14:01.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.889+0000 7f4775477640 1 -- 172.21.15.91:0/2243323925 learned_addr learned my addr 172.21.15.91:0/2243323925 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:01.886 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.889+0000 7fbb2569b640 1 Processor -- start 2023-11-27T18:14:01.887 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.889+0000 7f4776479640 1 --2- 172.21.15.91:0/2243323925 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4770153750 0x7f477015b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:01.887 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.889+0000 7fbb2569b640 1 -- start start 2023-11-27T18:14:01.888 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.889+0000 7fbb2569b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fbb20157e20 0x7fbb2006a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.888 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.889+0000 7fbb2569b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fbb20066360 0x7fbb2006aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.888 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.889+0000 7fbb2569b640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb200c6810 con 0x7fbb20072310 2023-11-27T18:14:01.888 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.889+0000 7fbb2569b640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb200c3190 con 0x7fbb20157e20 2023-11-27T18:14:01.888 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.889+0000 7fbb2569b640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb200c64e0 con 0x7fbb20066360 2023-11-27T18:14:01.890 INFO:teuthology.orchestra.run.smithi091.stdout:68719476757 2023-11-27T18:14:01.890 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-27T18:14:01.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.897+0000 7f4776479640 1 -- 172.21.15.91:0/2243323925 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f477006f840 msgr2=0x7f47701f76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.897+0000 7f4776479640 1 --2- 172.21.15.91:0/2243323925 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f477006f840 0x7f47701f76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.897+0000 7f4776479640 1 -- 172.21.15.91:0/2243323925 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4770066560 msgr2=0x7f47700ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.897+0000 7f4776479640 1 --2- 172.21.15.91:0/2243323925 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4770066560 0x7f47700ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.897+0000 7f4776479640 1 -- 172.21.15.91:0/2243323925 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f476c009420 con 0x7f4770153750 2023-11-27T18:14:01.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.909+0000 7f4776479640 1 --2- 172.21.15.91:0/2243323925 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4770153750 0x7f477015b2d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f476800c700 tx=0x7f476800cbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:01.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.909+0000 7fbb17fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fbb20066360 0x7fbb2006aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:01.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.913+0000 7fbb1f7fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fbb20072310 0x7fbb2015db30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.91:58390/0 (socket says 172.21.15.91:58390) 2023-11-27T18:14:01.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.913+0000 7fbb1f7fe640 1 -- 172.21.15.91:0/2831747854 learned_addr learned my addr 172.21.15.91:0/2831747854 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:14:01.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.921+0000 7fbb17fff640 1 -- 172.21.15.91:0/2831747854 >> v2:172.21.15.91:3300/0 conn(0x7fbb20157e20 msgr2=0x7fbb2006a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:01.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.921+0000 7fbb17fff640 1 --2- 172.21.15.91:0/2831747854 >> v2:172.21.15.91:3300/0 conn(0x7fbb20157e20 0x7fbb2006a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.921+0000 7fbb17fff640 1 -- 172.21.15.91:0/2831747854 >> v1:172.21.15.94:6789/0 conn(0x7fbb20072310 legacy=0x7fbb2015db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:01.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.921+0000 7fbb17fff640 1 -- 172.21.15.91:0/2831747854 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb2015e950 con 0x7fbb20066360 2023-11-27T18:14:01.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.921+0000 7f66f24f0640 1 Processor -- start 2023-11-27T18:14:01.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.921+0000 7f66f24f0640 1 -- start start 2023-11-27T18:14:01.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.925+0000 7f66f24f0640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f66ec0c83d0 0x7f66ec0c9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.925+0000 7f66f24f0640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f66ec0c0fc0 0x7f66ec0c1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.925+0000 7f66f24f0640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66ec156d00 con 0x7f66ec150260 2023-11-27T18:14:01.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.925+0000 7f66f24f0640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66ec0c7830 con 0x7f66ec0c83d0 2023-11-27T18:14:01.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.925+0000 7f66f24f0640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec157230 con 0x7f66ec0c0fc0 2023-11-27T18:14:01.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.925+0000 7f66f0a8d640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f66ec0c0fc0 0x7f66ec0c1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:01.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.925+0000 7f66f0a8d640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f66ec0c0fc0 0x7f66ec0c1450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.91:40988/0 (socket says 172.21.15.91:40988) 2023-11-27T18:14:01.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.925+0000 7f66f0a8d640 1 -- 172.21.15.91:0/865051570 learned_addr learned my addr 172.21.15.91:0/865051570 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:01.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.929+0000 7f47667fc640 1 -- 172.21.15.91:0/2243323925 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4768003b80 con 0x7f4770153750 2023-11-27T18:14:01.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.929+0000 7f47667fc640 1 -- 172.21.15.91:0/2243323925 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4768003ce0 con 0x7f4770153750 2023-11-27T18:14:01.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.929+0000 7f4777edc640 1 -- 172.21.15.91:0/2243323925 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47700cacf0 con 0x7f4770153750 2023-11-27T18:14:01.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.929+0000 7f47667fc640 1 -- 172.21.15.91:0/2243323925 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4768005310 con 0x7f4770153750 2023-11-27T18:14:01.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.929+0000 7f4777edc640 1 -- 172.21.15.91:0/2243323925 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47701f38b0 con 0x7f4770153750 2023-11-27T18:14:01.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.929+0000 7f4777edc640 1 -- 172.21.15.91:0/2243323925 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47700c7a20 con 0x7f4770153750 2023-11-27T18:14:01.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.933+0000 7f66f0a8d640 1 -- 172.21.15.91:0/865051570 >> v2:172.21.15.91:3300/0 conn(0x7f66ec0c83d0 msgr2=0x7f66ec0c9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:01.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.933+0000 7f66f0a8d640 1 --2- 172.21.15.91:0/865051570 >> v2:172.21.15.91:3300/0 conn(0x7f66ec0c83d0 0x7f66ec0c9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.933+0000 7f66f0a8d640 1 -- 172.21.15.91:0/865051570 >> v1:172.21.15.94:6789/0 conn(0x7f66ec150260 legacy=0x7f66ec0c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:01.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.933+0000 7f66f0a8d640 1 -- 172.21.15.91:0/865051570 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66ec0c6e60 con 0x7f66ec0c0fc0 2023-11-27T18:14:01.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.937+0000 7fbb17fff640 1 --2- 172.21.15.91:0/2831747854 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbb20066360 0x7fbb2006aa60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbb2006c2c0 tx=0x7fbb1001c390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebdf7161859f6ec4 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:01.936 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.941+0000 7f66f0a8d640 1 --2- 172.21.15.91:0/865051570 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f66ec0c0fc0 0x7f66ec0c1450 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f66e400d150 tx=0x7f66e401eba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fbb44d7a05ce10d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:01.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.949+0000 7f66eaffd640 1 -- 172.21.15.91:0/865051570 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e400b2d0 con 0x7f66ec0c0fc0 2023-11-27T18:14:01.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.949+0000 7f66eaffd640 1 -- 172.21.15.91:0/865051570 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e400b430 con 0x7f66ec0c0fc0 2023-11-27T18:14:01.948 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.949+0000 7f66eaffd640 1 -- 172.21.15.91:0/865051570 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e40a7a60 con 0x7f66ec0c0fc0 2023-11-27T18:14:01.948 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.953+0000 7f66f24f0640 1 -- 172.21.15.91:0/865051570 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f66ec0c0fc0 msgr2=0x7f66ec0c1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.948 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.953+0000 7f66f24f0640 1 --2- 172.21.15.91:0/865051570 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f66ec0c0fc0 0x7f66ec0c1450 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f66e400d150 tx=0x7f66e401eba0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.949 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.953+0000 7f66f24f0640 1 -- 172.21.15.91:0/865051570 shutdown_connections 2023-11-27T18:14:01.949 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.953+0000 7f66f24f0640 1 --2- 172.21.15.91:0/865051570 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f66ec0c0fc0 0x7f66ec0c1450 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.949 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.953+0000 7f66f24f0640 1 --2- 172.21.15.91:0/865051570 >> v2:172.21.15.91:3300/0 conn(0x7f66ec0c83d0 0x7f66ec0c9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.949 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.953+0000 7f66f24f0640 1 -- 172.21.15.91:0/865051570 >> 172.21.15.91:0/865051570 conn(0x7f66ec0c8aa0 msgr2=0x7f66ec0c8e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:01.949 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.953+0000 7f66f24f0640 1 -- 172.21.15.91:0/865051570 shutdown_connections 2023-11-27T18:14:01.949 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.953+0000 7f66f24f0640 1 -- 172.21.15.91:0/865051570 wait complete. 2023-11-27T18:14:01.950 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.953+0000 7f66f24f0640 1 Processor -- start 2023-11-27T18:14:01.950 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.953+0000 7f66f24f0640 1 -- start start 2023-11-27T18:14:01.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.953+0000 7f66f24f0640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f66ec0c0fc0 0x7f66ec1ee1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.953+0000 7f66f24f0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f66ec0c83d0 0x7f66ec1f1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.953+0000 7f66f24f0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f66ec150260 0x7f66ec1e81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.953+0000 7f66f24f0640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec143440 con 0x7f66ec150260 2023-11-27T18:14:01.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.953+0000 7f66f24f0640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec1e7d30 con 0x7f66ec0c83d0 2023-11-27T18:14:01.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.953+0000 7f66f24f0640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec1f2620 con 0x7f66ec0c0fc0 2023-11-27T18:14:01.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.957+0000 7f66ebfff640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f66ec0c0fc0 0x7f66ec1ee1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:01.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.957+0000 7f66ebfff640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f66ec0c0fc0 0x7f66ec1ee1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.91:40998/0 (socket says 172.21.15.91:40998) 2023-11-27T18:14:01.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.957+0000 7f66ebfff640 1 -- 172.21.15.91:0/1690233641 learned_addr learned my addr 172.21.15.91:0/1690233641 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:01.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.965+0000 7f66ebfff640 1 -- 172.21.15.91:0/1690233641 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f66ec0c83d0 msgr2=0x7f66ec1f1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.965+0000 7f66ebfff640 1 --2- 172.21.15.91:0/1690233641 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f66ec0c83d0 0x7f66ec1f1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.965+0000 7f66ebfff640 1 -- 172.21.15.91:0/1690233641 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f66ec150260 msgr2=0x7f66ec1e81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:01.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.965+0000 7f66ebfff640 1 --2- 172.21.15.91:0/1690233641 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f66ec150260 0x7f66ec1e81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:01.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.965+0000 7f66ebfff640 1 -- 172.21.15.91:0/1690233641 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e400bd40 con 0x7f66ec0c0fc0 2023-11-27T18:14:01.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.973+0000 7f66ebfff640 1 --2- 172.21.15.91:0/1690233641 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f66ec0c0fc0 0x7f66ec1ee1d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f66dc00b440 tx=0x7f66dc00b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:01.980 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.985+0000 7f66e8ff9640 1 -- 172.21.15.91:0/1690233641 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66dc011890 con 0x7f66ec0c0fc0 2023-11-27T18:14:01.980 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.985+0000 7f66e8ff9640 1 -- 172.21.15.91:0/1690233641 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66dc011a10 con 0x7f66ec0c0fc0 2023-11-27T18:14:01.980 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.985+0000 7f66f24f0640 1 -- 172.21.15.91:0/1690233641 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66ec1f1d80 con 0x7f66ec0c0fc0 2023-11-27T18:14:01.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.985+0000 7f66e8ff9640 1 -- 172.21.15.91:0/1690233641 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66dc011dc0 con 0x7f66ec0c0fc0 2023-11-27T18:14:01.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.985+0000 7f66f24f0640 1 -- 172.21.15.91:0/1690233641 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66ec1f2340 con 0x7f66ec0c0fc0 2023-11-27T18:14:01.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.985+0000 7f66f24f0640 1 -- 172.21.15.91:0/1690233641 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66ec04e850 con 0x7f66ec0c0fc0 2023-11-27T18:14:01.996 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.997+0000 7f934b222640 1 Processor -- start 2023-11-27T18:14:01.996 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.997+0000 7f934b222640 1 -- start start 2023-11-27T18:14:01.996 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.997+0000 7f934b222640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f934406e6c0 0x7f93440c6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.996 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.997+0000 7f934b222640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f934406d6b0 con 0x7f93441517e0 2023-11-27T18:14:01.996 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.997+0000 7f934b222640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9344151bc0 con 0x7f934406f060 2023-11-27T18:14:01.996 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:01.997+0000 7f934b222640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9344158250 con 0x7f934406e6c0 2023-11-27T18:14:01.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.001+0000 7f3c37fe1640 1 Processor -- start 2023-11-27T18:14:01.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.001+0000 7f3c37fe1640 1 -- start start 2023-11-27T18:14:01.999 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.001+0000 7f3c37fe1640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3c30150420 0x7f3c30072040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.999 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.001+0000 7f3c37fe1640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f3c3006b630 0x7f3c30072580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:01.999 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.001+0000 7f3c37fe1640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c3006bdc0 con 0x7f3c30156360 2023-11-27T18:14:01.999 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.001+0000 7f3c37fe1640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c300c3530 con 0x7f3c3006b630 2023-11-27T18:14:01.999 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.001+0000 7f3c37fe1640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c300663d0 con 0x7f3c30150420 2023-11-27T18:14:02.003 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.005+0000 7faa66645640 1 Processor -- start 2023-11-27T18:14:02.003 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.005+0000 7faa66645640 1 -- start start 2023-11-27T18:14:02.004 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.009+0000 7faa66645640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faa600c54f0 0x7faa600c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:02.004 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.009+0000 7faa66645640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa601572d0 con 0x7faa600c58d0 2023-11-27T18:14:02.004 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.009+0000 7faa66645640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa60157570 con 0x7faa6015ab20 2023-11-27T18:14:02.004 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.009+0000 7faa66645640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa601580d0 con 0x7faa600c54f0 2023-11-27T18:14:02.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.041+0000 7f60ddffb640 1 -- 172.21.15.91:0/725606654 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f60d40eb1f0 con 0x7f60e0155130 2023-11-27T18:14:02.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.121+0000 7f9348fbe640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f93441517e0 0x7f934406a520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:34178/0 (socket says 172.21.15.91:34178) 2023-11-27T18:14:02.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.121+0000 7f9348fbe640 1 -- 172.21.15.91:0/3619981075 learned_addr learned my addr 172.21.15.91:0/3619981075 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:14:02.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.125+0000 7faa57fff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7faa600c58d0 0x7faa600c8f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:34204/0 (socket says 172.21.15.91:34204) 2023-11-27T18:14:02.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.125+0000 7faa57fff640 1 -- 172.21.15.91:0/2732781361 learned_addr learned my addr 172.21.15.91:0/2732781361 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:14:02.125 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.129+0000 7f3c3657e640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f3c30156360 0x7f3c301597d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:34192/0 (socket says 172.21.15.91:34192) 2023-11-27T18:14:02.125 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.129+0000 7f3c3657e640 1 -- 172.21.15.91:0/1918795410 learned_addr learned my addr 172.21.15.91:0/1918795410 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:14:02.126 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.129+0000 7fa975d9b640 1 -- 172.21.15.91:0/3678878823 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 979652461 0 0) 0x7fa9780705c0 con 0x7fa9780c8e00 2023-11-27T18:14:02.126 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.129+0000 7fa975d9b640 1 -- 172.21.15.91:0/3678878823 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa964003530 con 0x7fa9780c8e00 2023-11-27T18:14:02.128 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.133+0000 7fa96ffff640 1 --2- 172.21.15.91:0/3678878823 >> v2:172.21.15.91:3300/0 conn(0x7fa97815d6e0 0x7fa9780c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:02.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.133+0000 7f93437fe640 1 -- 172.21.15.91:0/3619981075 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3938384892 0 0) 0x7f934406d6b0 con 0x7f93441517e0 2023-11-27T18:14:02.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.133+0000 7f93437fe640 1 -- 172.21.15.91:0/3619981075 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9334003530 con 0x7f93441517e0 2023-11-27T18:14:02.139 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.141+0000 7fa96ffff640 1 -- 172.21.15.91:0/3678878823 >> v1:172.21.15.94:6789/0 conn(0x7fa978153920 legacy=0x7fa9780c6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:02.139 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.141+0000 7fa96ffff640 1 -- 172.21.15.91:0/3678878823 >> v1:172.21.15.91:6789/0 conn(0x7fa9780c8e00 legacy=0x7fa97806b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:02.139 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.141+0000 7fa96ffff640 1 -- 172.21.15.91:0/3678878823 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa97806f9b0 con 0x7fa97815d6e0 2023-11-27T18:14:02.146 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.149+0000 7f3c34d7b640 1 -- 172.21.15.91:0/1918795410 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 689817568 0 0) 0x7f3c280014a0 con 0x7f3c30156360 2023-11-27T18:14:02.147 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.149+0000 7f3c34d7b640 1 -- 172.21.15.91:0/1918795410 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c1c003530 con 0x7f3c30156360 2023-11-27T18:14:02.149 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.153+0000 7fa96ffff640 1 --2- 172.21.15.91:0/3678878823 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa97815d6e0 0x7fa9780c88c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa9600097c0 tx=0x7fa96001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df6f1ee4f2f192df server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:02.153 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.157+0000 7f93437fe640 1 -- 172.21.15.91:0/3619981075 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3321062063 0 0) 0x7f9334003530 con 0x7f93441517e0 2023-11-27T18:14:02.153 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.157+0000 7f93437fe640 1 -- 172.21.15.91:0/3619981075 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f934406e6c0 msgr2=0x7f93440c6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:02.153 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.157+0000 7f93437fe640 1 --2- 172.21.15.91:0/3619981075 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f934406e6c0 0x7f93440c6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:02.153 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.157+0000 7f93437fe640 1 -- 172.21.15.91:0/3619981075 >> v1:172.21.15.94:6789/0 conn(0x7f934406f060 legacy=0x7f934415fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:02.153 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.157+0000 7f93437fe640 1 -- 172.21.15.91:0/3619981075 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f934406d900 con 0x7f93441517e0 2023-11-27T18:14:02.153 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.157+0000 7f93437fe640 1 -- 172.21.15.91:0/3619981075 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3378743932 0 0) 0x7f9338001680 con 0x7f93441517e0 2023-11-27T18:14:02.154 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.157+0000 7f93437fe640 1 -- 172.21.15.91:0/3619981075 >> v1:172.21.15.91:6789/0 conn(0x7f93441517e0 legacy=0x7f934406a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:02.154 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.157+0000 7f93437fe640 1 --2- 172.21.15.91:0/3619981075 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f934406e6c0 0x7f93340039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:02.154 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.157+0000 7f93437fe640 1 --2- 172.21.15.91:0/3619981075 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f93340040f0 0x7f93340047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:02.154 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.157+0000 7f93437fe640 1 --2- 172.21.15.91:0/3619981075 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9334004e30 0x7f933400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:02.154 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.157+0000 7f93437fe640 1 -- 172.21.15.91:0/3619981075 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9344158250 con 0x7f93340040f0 2023-11-27T18:14:02.154 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.157+0000 7f93437fe640 1 -- 172.21.15.91:0/3619981075 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9334005540 con 0x7f9334004e30 2023-11-27T18:14:02.154 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.157+0000 7f93437fe640 1 -- 172.21.15.91:0/3619981075 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f933400bed0 con 0x7f934406e6c0 2023-11-27T18:14:02.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.161+0000 7faa5f7fe640 1 -- 172.21.15.91:0/2732781361 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4168194039 0 0) 0x7faa601572d0 con 0x7faa600c58d0 2023-11-27T18:14:02.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.161+0000 7faa5f7fe640 1 -- 172.21.15.91:0/2732781361 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa4c003530 con 0x7faa600c58d0 2023-11-27T18:14:02.170 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.173+0000 7f3c34d7b640 1 -- 172.21.15.91:0/1918795410 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 159785579 0 0) 0x7f3c1c003530 con 0x7f3c30156360 2023-11-27T18:14:02.170 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.173+0000 7f3c34d7b640 1 -- 172.21.15.91:0/1918795410 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3c30150420 msgr2=0x7f3c30072040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:02.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.173+0000 7f3c34d7b640 1 --2- 172.21.15.91:0/1918795410 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3c30150420 0x7f3c30072040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:02.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.173+0000 7f3c34d7b640 1 -- 172.21.15.91:0/1918795410 >> v2:172.21.15.94:3300/0 conn(0x7f3c3006b630 msgr2=0x7f3c30072580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:02.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.173+0000 7f3c34d7b640 1 --2- 172.21.15.91:0/1918795410 >> v2:172.21.15.94:3300/0 conn(0x7f3c3006b630 0x7f3c30072580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:02.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.173+0000 7f3c34d7b640 1 -- 172.21.15.91:0/1918795410 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c3006bb00 con 0x7f3c30156360 2023-11-27T18:14:02.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.173+0000 7f3c34d7b640 1 -- 172.21.15.91:0/1918795410 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3378743932 0 0) 0x7f3c28001b90 con 0x7f3c30156360 2023-11-27T18:14:02.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.173+0000 7f3c34d7b640 1 -- 172.21.15.91:0/1918795410 >> v1:172.21.15.91:6789/0 conn(0x7f3c30156360 legacy=0x7f3c301597d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:02.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.173+0000 7f3c34d7b640 1 --2- 172.21.15.91:0/1918795410 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3c1c003980 0x7f3c1c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:02.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.173+0000 7f3c34d7b640 1 --2- 172.21.15.91:0/1918795410 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3c1c0047d0 0x7f3c1c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:02.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.173+0000 7f3c34d7b640 1 --2- 172.21.15.91:0/1918795410 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3c30150420 0x7f3c1c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:02.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.173+0000 7f3c34d7b640 1 -- 172.21.15.91:0/1918795410 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c300c3530 con 0x7f3c1c003980 2023-11-27T18:14:02.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.173+0000 7f3c34d7b640 1 -- 172.21.15.91:0/1918795410 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c300663d0 con 0x7f3c1c0047d0 2023-11-27T18:14:02.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.173+0000 7f3c34d7b640 1 -- 172.21.15.91:0/1918795410 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1c0055e0 con 0x7f3c30150420 2023-11-27T18:14:02.172 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.173+0000 7faa5f7fe640 1 -- 172.21.15.91:0/2732781361 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1448807282 0 0) 0x7faa4c003530 con 0x7faa600c58d0 2023-11-27T18:14:02.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.173+0000 7faa5f7fe640 1 -- 172.21.15.91:0/2732781361 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faa600c54f0 msgr2=0x7faa600c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:02.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.173+0000 7faa5f7fe640 1 --2- 172.21.15.91:0/2732781361 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faa600c54f0 0x7faa600c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:02.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.173+0000 7faa5f7fe640 1 -- 172.21.15.91:0/2732781361 >> v1:172.21.15.94:6789/0 conn(0x7faa6015ab20 legacy=0x7faa6015af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:02.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.173+0000 7faa5f7fe640 1 -- 172.21.15.91:0/2732781361 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa60157830 con 0x7faa600c58d0 2023-11-27T18:14:02.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.173+0000 7faa5f7fe640 1 -- 172.21.15.91:0/2732781361 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3378743932 0 0) 0x7faa48001680 con 0x7faa600c58d0 2023-11-27T18:14:02.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.173+0000 7faa5f7fe640 1 -- 172.21.15.91:0/2732781361 >> v1:172.21.15.91:6789/0 conn(0x7faa600c58d0 legacy=0x7faa600c8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:02.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.173+0000 7faa5f7fe640 1 --2- 172.21.15.91:0/2732781361 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faa4c0039b0 0x7faa4c003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:02.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.173+0000 7faa5f7fe640 1 --2- 172.21.15.91:0/2732781361 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faa4c0047d0 0x7faa4c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:02.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.173+0000 7faa5f7fe640 1 --2- 172.21.15.91:0/2732781361 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faa600c54f0 0x7faa4c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:02.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.173+0000 7faa5f7fe640 1 -- 172.21.15.91:0/2732781361 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa601580d0 con 0x7faa4c0047d0 2023-11-27T18:14:02.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.173+0000 7faa5f7fe640 1 -- 172.21.15.91:0/2732781361 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c0054f0 con 0x7faa4c0039b0 2023-11-27T18:14:02.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.173+0000 7faa5f7fe640 1 -- 172.21.15.91:0/2732781361 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c00bed0 con 0x7faa600c54f0 2023-11-27T18:14:02.178 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.181+0000 7f3c35d7d640 1 --2- 172.21.15.91:0/1918795410 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3c1c003980 0x7f3c1c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:02.182 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.185+0000 7fa975d9b640 1 -- 172.21.15.91:0/3678878823 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9600ab600 con 0x7fa97815d6e0 2023-11-27T18:14:02.182 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.185+0000 7fa975d9b640 1 -- 172.21.15.91:0/3678878823 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9600a7050 con 0x7fa97815d6e0 2023-11-27T18:14:02.182 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.185+0000 7fa975d9b640 1 -- 172.21.15.91:0/3678878823 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9600ab980 con 0x7fa97815d6e0 2023-11-27T18:14:02.183 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.185+0000 7fa97ccfe640 1 -- 172.21.15.91:0/3678878823 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa97815d6e0 msgr2=0x7fa9780c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:02.183 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.185+0000 7fa97ccfe640 1 --2- 172.21.15.91:0/3678878823 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa97815d6e0 0x7fa9780c88c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa9600097c0 tx=0x7fa96001c3c0 comp rx=0 tx=0).stop 2023-11-27T18:14:02.184 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.185+0000 7fa97ccfe640 1 -- 172.21.15.91:0/3678878823 shutdown_connections 2023-11-27T18:14:02.184 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.185+0000 7fa97ccfe640 1 --2- 172.21.15.91:0/3678878823 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa97815d6e0 0x7fa9780c88c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:02.184 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.185+0000 7fa97ccfe640 1 -- 172.21.15.91:0/3678878823 >> 172.21.15.91:0/3678878823 conn(0x7fa978071ef0 msgr2=0x7fa978072300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:02.184 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.185+0000 7fa97ccfe640 1 -- 172.21.15.91:0/3678878823 shutdown_connections 2023-11-27T18:14:02.184 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.185+0000 7fa97ccfe640 1 -- 172.21.15.91:0/3678878823 wait complete. 2023-11-27T18:14:02.184 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.189+0000 7f9343fff640 1 --2- 172.21.15.91:0/3619981075 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f93340040f0 0x7f93340047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:02.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.189+0000 7faa57fff640 1 --2- 172.21.15.91:0/2732781361 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faa4c0047d0 0x7faa4c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:02.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.189+0000 7fa97ccfe640 1 Processor -- start 2023-11-27T18:14:02.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.189+0000 7fa97ccfe640 1 -- start start 2023-11-27T18:14:02.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.189+0000 7fa97ccfe640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa9780c8e00 0x7fa97815cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:02.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.189+0000 7fa97ccfe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa978153920 0x7fa9781f3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:02.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.189+0000 7fa97ccfe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa97815d6e0 0x7fa9781f3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:02.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.189+0000 7fa97ccfe640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9781465f0 con 0x7fa978153920 2023-11-27T18:14:02.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.189+0000 7fa97ccfe640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa978146d90 con 0x7fa97815d6e0 2023-11-27T18:14:02.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.189+0000 7fa97ccfe640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa978156d50 con 0x7fa9780c8e00 2023-11-27T18:14:02.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.193+0000 7f9343fff640 1 -- 172.21.15.91:0/3619981075 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f934406e6c0 msgr2=0x7f93340039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:02.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.193+0000 7f9343fff640 1 --2- 172.21.15.91:0/3619981075 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f934406e6c0 0x7f93340039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:02.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.193+0000 7f9343fff640 1 -- 172.21.15.91:0/3619981075 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9334004e30 msgr2=0x7f933400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:02.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.193+0000 7f9343fff640 1 --2- 172.21.15.91:0/3619981075 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9334004e30 0x7f933400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:02.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.193+0000 7f9343fff640 1 -- 172.21.15.91:0/3619981075 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9334003530 con 0x7f93340040f0 2023-11-27T18:14:02.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.193+0000 7f3c35d7d640 1 -- 172.21.15.91:0/1918795410 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3c30150420 msgr2=0x7f3c1c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:02.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.193+0000 7f3c35d7d640 1 --2- 172.21.15.91:0/1918795410 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3c30150420 0x7f3c1c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:02.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.193+0000 7f3c35d7d640 1 -- 172.21.15.91:0/1918795410 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3c1c0047d0 msgr2=0x7f3c1c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:02.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.193+0000 7f3c35d7d640 1 --2- 172.21.15.91:0/1918795410 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3c1c0047d0 0x7f3c1c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:02.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.193+0000 7f3c35d7d640 1 -- 172.21.15.91:0/1918795410 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c1c003530 con 0x7f3c1c003980 2023-11-27T18:14:02.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.201+0000 7f60e74b4640 1 -- 172.21.15.91:0/725606654 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f60e014f1b0 con 0x7f60e0155130 2023-11-27T18:14:02.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.201+0000 7faa57fff640 1 -- 172.21.15.91:0/2732781361 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faa600c54f0 msgr2=0x7faa4c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:02.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.201+0000 7faa57fff640 1 --2- 172.21.15.91:0/2732781361 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faa600c54f0 0x7faa4c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:02.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.201+0000 7faa57fff640 1 -- 172.21.15.91:0/2732781361 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faa4c0039b0 msgr2=0x7faa4c003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:02.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.201+0000 7faa57fff640 1 --2- 172.21.15.91:0/2732781361 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faa4c0039b0 0x7faa4c003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:02.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.201+0000 7faa57fff640 1 -- 172.21.15.91:0/2732781361 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa4c003530 con 0x7faa4c0047d0 2023-11-27T18:14:02.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.201+0000 7f9343fff640 1 --2- 172.21.15.91:0/3619981075 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f93340040f0 0x7f93340047d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9330001650 tx=0x7f933001c2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31983400b89bffd0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:02.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.205+0000 7f3c35d7d640 1 --2- 172.21.15.91:0/1918795410 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3c1c003980 0x7f3c1c003da0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c009890 tx=0x7f3c2c01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a71ece9b12a3c26b server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:02.210 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.213+0000 7f93437fe640 1 -- 172.21.15.91:0/3619981075 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9330005270 con 0x7f93340040f0 2023-11-27T18:14:02.210 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.213+0000 7f93437fe640 1 -- 172.21.15.91:0/3619981075 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93300a7070 con 0x7f93340040f0 2023-11-27T18:14:02.210 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.213+0000 7f93437fe640 1 -- 172.21.15.91:0/3619981075 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9330003620 con 0x7f93340040f0 2023-11-27T18:14:02.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.213+0000 7faa57fff640 1 --2- 172.21.15.91:0/2732781361 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faa4c0047d0 0x7faa4c004c50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7faa4800c110 tx=0x7faa4801f2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0cf1b5796df76f0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:02.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.213+0000 7f934b222640 1 -- 172.21.15.91:0/3619981075 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f93340040f0 msgr2=0x7f93340047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:02.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.213+0000 7f934b222640 1 --2- 172.21.15.91:0/3619981075 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f93340040f0 0x7f93340047d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9330001650 tx=0x7f933001c2e0 comp rx=0 tx=0).stop 2023-11-27T18:14:02.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.213+0000 7f93497bf640 1 -- 172.21.15.91:0/3619981075 reap_dead start 2023-11-27T18:14:02.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.213+0000 7f934b222640 1 -- 172.21.15.91:0/3619981075 shutdown_connections 2023-11-27T18:14:02.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.213+0000 7f934b222640 1 -- 172.21.15.91:0/3619981075 >> 172.21.15.91:0/3619981075 conn(0x7f93440c8aa0 msgr2=0x7f93440c8e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:02.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.213+0000 7f934b222640 1 -- 172.21.15.91:0/3619981075 shutdown_connections 2023-11-27T18:14:02.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.213+0000 7f934b222640 1 -- 172.21.15.91:0/3619981075 wait complete. 2023-11-27T18:14:02.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.217+0000 7f934b222640 1 Processor -- start 2023-11-27T18:14:02.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.217+0000 7f934b222640 1 -- start start 2023-11-27T18:14:02.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.217+0000 7f934b222640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f93340040f0 0x7f93440c5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:02.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.217+0000 7f934b222640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9344158650 0x7f9344147840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:02.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.217+0000 7f934b222640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9344151d40 0x7f9344159da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:02.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.217+0000 7f934b222640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93441f0df0 con 0x7f93340040f0 2023-11-27T18:14:02.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.217+0000 7f934b222640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93441f1320 con 0x7f9344151d40 2023-11-27T18:14:02.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.217+0000 7f934b222640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93441ed940 con 0x7f9344158650 2023-11-27T18:14:02.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.221+0000 7f3c34d7b640 1 -- 172.21.15.91:0/1918795410 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c0ab600 con 0x7f3c1c003980 2023-11-27T18:14:02.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.221+0000 7f3c34d7b640 1 -- 172.21.15.91:0/1918795410 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c2c0a7050 con 0x7f3c1c003980 2023-11-27T18:14:02.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.221+0000 7f3c34d7b640 1 -- 172.21.15.91:0/1918795410 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c0aba00 con 0x7f3c1c003980 2023-11-27T18:14:02.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.221+0000 7f3c37fe1640 1 -- 172.21.15.91:0/1918795410 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3c1c003980 msgr2=0x7f3c1c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:02.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.221+0000 7f3c37fe1640 1 --2- 172.21.15.91:0/1918795410 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3c1c003980 0x7f3c1c003da0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c009890 tx=0x7f3c2c01c3a0 comp rx=0 tx=0).stop 2023-11-27T18:14:02.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.221+0000 7f3c3657e640 1 -- 172.21.15.91:0/1918795410 reap_dead start 2023-11-27T18:14:02.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.221+0000 7f3c37fe1640 1 -- 172.21.15.91:0/1918795410 shutdown_connections 2023-11-27T18:14:02.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.221+0000 7f3c37fe1640 1 -- 172.21.15.91:0/1918795410 >> 172.21.15.91:0/1918795410 conn(0x7f3c30071520 msgr2=0x7f3c30071930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:02.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.221+0000 7f3c37fe1640 1 -- 172.21.15.91:0/1918795410 shutdown_connections 2023-11-27T18:14:02.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.221+0000 7f3c37fe1640 1 -- 172.21.15.91:0/1918795410 wait complete. 2023-11-27T18:14:02.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.221+0000 7f3c37fe1640 1 Processor -- start 2023-11-27T18:14:02.220 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.221+0000 7fa96ffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa978153920 0x7fa9781f3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:02.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.221+0000 7f3c37fe1640 1 -- start start 2023-11-27T18:14:02.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.225+0000 7f3c37fe1640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3c1c003980 0x7f3c30141e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:02.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.225+0000 7f3c37fe1640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3c30142340 0x7f3c30159c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:02.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.225+0000 7f3c37fe1640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3c3015a170 0x7f3c301573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:02.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.225+0000 7f3c37fe1640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c30140b50 con 0x7f3c1c003980 2023-11-27T18:14:02.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.225+0000 7f3c37fe1640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3015a5f0 con 0x7f3c30142340 2023-11-27T18:14:02.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.225+0000 7f3c37fe1640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3014deb0 con 0x7f3c3015a170 2023-11-27T18:14:02.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.225+0000 7f60ddffb640 1 -- 172.21.15.91:0/725606654 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f60d40ee810 con 0x7f60e0155130 2023-11-27T18:14:02.224 INFO:teuthology.orchestra.run.smithi091.stdout:68719476756 2023-11-27T18:14:02.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.225+0000 7fa96ffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa978153920 0x7fa9781f3870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44898/0 (socket says 172.21.15.91:44898) 2023-11-27T18:14:02.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.225+0000 7fa96ffff640 1 -- 172.21.15.91:0/3894131730 learned_addr learned my addr 172.21.15.91:0/3894131730 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:02.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.225+0000 7f9348fbe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f93340040f0 0x7f93440c5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:02.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.225+0000 7f9348fbe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f93340040f0 0x7f93440c5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44902/0 (socket says 172.21.15.91:44902) 2023-11-27T18:14:02.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.225+0000 7f9348fbe640 1 -- 172.21.15.91:0/2632944858 learned_addr learned my addr 172.21.15.91:0/2632944858 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:02.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.229+0000 7f60e74b4640 1 -- 172.21.15.91:0/725606654 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f60cc066820 msgr2=0x7f60cc068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:02.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.229+0000 7f60e74b4640 1 --2- 172.21.15.91:0/725606654 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f60cc066820 0x7f60cc068ce0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f60d8001c80 tx=0x7f60d8007d20 comp rx=0 tx=0).stop 2023-11-27T18:14:02.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.229+0000 7f60e74b4640 1 -- 172.21.15.91:0/725606654 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60e0155130 msgr2=0x7f60e00c6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:02.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.229+0000 7f60e74b4640 1 --2- 172.21.15.91:0/725606654 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60e0155130 0x7f60e00c6980 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f60d4009000 tx=0x7f60c8005800 comp rx=0 tx=0).stop 2023-11-27T18:14:02.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.229+0000 7f60e74b4640 1 -- 172.21.15.91:0/725606654 shutdown_connections 2023-11-27T18:14:02.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.229+0000 7f60e74b4640 1 --2- 172.21.15.91:0/725606654 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f60cc066820 0x7f60cc068ce0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:02.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.229+0000 7f60e74b4640 1 --2- 172.21.15.91:0/725606654 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f60e01f0140 0x7f60e01f05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:02.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.229+0000 7f60e74b4640 1 --2- 172.21.15.91:0/725606654 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60e0155130 0x7f60e00c6980 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:02.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.229+0000 7f60e74b4640 1 --2- 172.21.15.91:0/725606654 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f60c80040f0 0x7f60e00c6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:02.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.229+0000 7f60e74b4640 1 -- 172.21.15.91:0/725606654 >> 172.21.15.91:0/725606654 conn(0x7f60e006abb0 msgr2=0x7f60e0070890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:02.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.229+0000 7f60e74b4640 1 -- 172.21.15.91:0/725606654 shutdown_connections 2023-11-27T18:14:02.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.229+0000 7f60e74b4640 1 -- 172.21.15.91:0/725606654 wait complete. 2023-11-27T18:14:02.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.229+0000 7faa5f7fe640 1 -- 172.21.15.91:0/2732781361 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa480058e0 con 0x7faa4c0047d0 2023-11-27T18:14:02.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.229+0000 7faa5f7fe640 1 -- 172.21.15.91:0/2732781361 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa48005a40 con 0x7faa4c0047d0 2023-11-27T18:14:02.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.229+0000 7faa5f7fe640 1 -- 172.21.15.91:0/2732781361 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa48005df0 con 0x7faa4c0047d0 2023-11-27T18:14:02.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.229+0000 7faa66645640 1 -- 172.21.15.91:0/2732781361 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faa4c0047d0 msgr2=0x7faa4c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:02.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.229+0000 7faa66645640 1 --2- 172.21.15.91:0/2732781361 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faa4c0047d0 0x7faa4c004c50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7faa4800c110 tx=0x7faa4801f2d0 comp rx=0 tx=0).stop 2023-11-27T18:14:02.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.229+0000 7faa64be2640 1 -- 172.21.15.91:0/2732781361 reap_dead start 2023-11-27T18:14:02.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.229+0000 7faa66645640 1 -- 172.21.15.91:0/2732781361 shutdown_connections 2023-11-27T18:14:02.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.229+0000 7faa66645640 1 -- 172.21.15.91:0/2732781361 >> 172.21.15.91:0/2732781361 conn(0x7faa60071da0 msgr2=0x7faa600721b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:02.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.229+0000 7faa66645640 1 -- 172.21.15.91:0/2732781361 shutdown_connections 2023-11-27T18:14:02.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.229+0000 7faa66645640 1 -- 172.21.15.91:0/2732781361 wait complete. 2023-11-27T18:14:02.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.229+0000 7faa66645640 1 Processor -- start 2023-11-27T18:14:02.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.229+0000 7faa66645640 1 -- start start 2023-11-27T18:14:02.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.229+0000 7fa96ffff640 1 -- 172.21.15.91:0/3894131730 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa9780c8e00 msgr2=0x7fa97815cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:02.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.229+0000 7fa96ffff640 1 --2- 172.21.15.91:0/3894131730 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa9780c8e00 0x7fa97815cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:02.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.229+0000 7fa96ffff640 1 -- 172.21.15.91:0/3894131730 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa97815d6e0 msgr2=0x7fa9781f3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:02.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.229+0000 7fa96ffff640 1 --2- 172.21.15.91:0/3894131730 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa97815d6e0 0x7fa9781f3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:02.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.229+0000 7fa96ffff640 1 -- 172.21.15.91:0/3894131730 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa960009420 con 0x7fa978153920 2023-11-27T18:14:02.234 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.233+0000 7faa66645640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faa4c0047d0 0x7faa60148510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:02.234 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.233+0000 7faa66645640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faa60143410 0x7faa601588c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:02.234 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.233+0000 7faa66645640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faa60158e00 0x7faa601426e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:02.234 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.233+0000 7faa66645640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa601ed600 con 0x7faa60143410 2023-11-27T18:14:02.234 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.233+0000 7faa66645640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa60159280 con 0x7faa60158e00 2023-11-27T18:14:02.235 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.233+0000 7faa66645640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa601ec980 con 0x7faa4c0047d0 2023-11-27T18:14:02.235 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.237+0000 7f9348fbe640 1 -- 172.21.15.91:0/2632944858 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9344158650 msgr2=0x7f9344147840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:02.235 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.237+0000 7f9348fbe640 1 --2- 172.21.15.91:0/2632944858 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9344158650 0x7f9344147840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:02.235 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.237+0000 7f9348fbe640 1 -- 172.21.15.91:0/2632944858 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9344151d40 msgr2=0x7f9344159da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:02.235 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.237+0000 7f9348fbe640 1 --2- 172.21.15.91:0/2632944858 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9344151d40 0x7f9344159da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:02.235 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.237+0000 7f9348fbe640 1 -- 172.21.15.91:0/2632944858 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9344147d80 con 0x7f93340040f0 2023-11-27T18:14:02.235 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.241+0000 7fa96ffff640 1 --2- 172.21.15.91:0/3894131730 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa978153920 0x7fa9781f3870 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa9600ae040 tx=0x7fa96001ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:02.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.241+0000 7f9348fbe640 1 --2- 172.21.15.91:0/2632944858 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f93340040f0 0x7f93440c5cd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f933800f730 tx=0x7f933800fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:02.242 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476757 got 68719476756 for osd.6 2023-11-27T18:14:02.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.249+0000 7f3c35d7d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3c1c003980 0x7f3c30141e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:02.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.249+0000 7fa96effd640 1 -- 172.21.15.91:0/3894131730 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa960006e20 con 0x7fa978153920 2023-11-27T18:14:02.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.249+0000 7fa96effd640 1 -- 172.21.15.91:0/3894131730 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9600b7450 con 0x7fa978153920 2023-11-27T18:14:02.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.249+0000 7fa96effd640 1 -- 172.21.15.91:0/3894131730 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9600b77e0 con 0x7fa978153920 2023-11-27T18:14:02.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.249+0000 7f3c35d7d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3c1c003980 0x7f3c30141e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44914/0 (socket says 172.21.15.91:44914) 2023-11-27T18:14:02.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.249+0000 7f3c35d7d640 1 -- 172.21.15.91:0/1476915435 learned_addr learned my addr 172.21.15.91:0/1476915435 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:02.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.249+0000 7fa97ccfe640 1 -- 172.21.15.91:0/3894131730 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9781467d0 con 0x7fa978153920 2023-11-27T18:14:02.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.249+0000 7fa97ccfe640 1 -- 172.21.15.91:0/3894131730 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9781569e0 con 0x7fa978153920 2023-11-27T18:14:02.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.249+0000 7f93417fa640 1 -- 172.21.15.91:0/2632944858 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9338007af0 con 0x7f93340040f0 2023-11-27T18:14:02.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.249+0000 7f93417fa640 1 -- 172.21.15.91:0/2632944858 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9338007c90 con 0x7f93340040f0 2023-11-27T18:14:02.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.249+0000 7f934b222640 1 -- 172.21.15.91:0/2632944858 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93441eddd0 con 0x7f93340040f0 2023-11-27T18:14:02.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.249+0000 7f93417fa640 1 -- 172.21.15.91:0/2632944858 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933800a0d0 con 0x7f93340040f0 2023-11-27T18:14:02.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.249+0000 7fa97ccfe640 1 -- 172.21.15.91:0/3894131730 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa97804e850 con 0x7fa978153920 2023-11-27T18:14:02.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.249+0000 7f934b222640 1 -- 172.21.15.91:0/2632944858 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93441ed010 con 0x7f93340040f0 2023-11-27T18:14:02.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.253+0000 7f934b222640 1 -- 172.21.15.91:0/2632944858 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f934404e850 con 0x7f93340040f0 2023-11-27T18:14:02.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.253+0000 7f3c35d7d640 1 -- 172.21.15.91:0/1476915435 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3c3015a170 msgr2=0x7f3c301573c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:02.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.253+0000 7f3c35d7d640 1 --2- 172.21.15.91:0/1476915435 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3c3015a170 0x7f3c301573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:02.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.253+0000 7f3c35d7d640 1 -- 172.21.15.91:0/1476915435 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3c30142340 msgr2=0x7f3c30159c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:02.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.253+0000 7f3c35d7d640 1 --2- 172.21.15.91:0/1476915435 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3c30142340 0x7f3c30159c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:02.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.253+0000 7f3c35d7d640 1 -- 172.21.15.91:0/1476915435 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c30140d60 con 0x7f3c1c003980 2023-11-27T18:14:02.253 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.257+0000 7f47667fc640 1 -- 172.21.15.91:0/2243323925 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f4768005470 con 0x7f4770153750 2023-11-27T18:14:02.253 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.257+0000 7f47667fc640 1 --2- 172.21.15.91:0/2243323925 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f4754066840 0x7f4754068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:02.253 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.257+0000 7f4775c78640 1 --2- 172.21.15.91:0/2243323925 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f4754066840 0x7f4754068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:02.253 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.257+0000 7f4775c78640 1 --2- 172.21.15.91:0/2243323925 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f4754066840 0x7f4754068d00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f476c0b2000 tx=0x7f476c004740 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:02.255 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.257+0000 7f47667fc640 1 -- 172.21.15.91:0/2243323925 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4768055d10 con 0x7f4770153750 2023-11-27T18:14:02.269 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.273+0000 7f47667fc640 1 -- 172.21.15.91:0/2243323925 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f4768051950 con 0x7f4770153750 2023-11-27T18:14:02.309 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.313+0000 7f66e8ff9640 1 -- 172.21.15.91:0/1690233641 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f66dc004020 con 0x7f66ec0c0fc0 2023-11-27T18:14:02.309 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.313+0000 7f66e8ff9640 1 --2- 172.21.15.91:0/1690233641 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f66d8066870 0x7f66d8068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:02.309 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.313+0000 7f66eb7fe640 1 --2- 172.21.15.91:0/1690233641 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f66d8066870 0x7f66d8068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:02.309 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.313+0000 7f66eb7fe640 1 --2- 172.21.15.91:0/1690233641 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f66d8066870 0x7f66d8068d30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f66ec06fd40 tx=0x7f66e0006ca0 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:02.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.349+0000 7faa64be2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faa60158e00 0x7faa601426e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:02.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.349+0000 7faa64be2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faa60158e00 0x7faa601426e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.91:58660/0 (socket says 172.21.15.91:58660) 2023-11-27T18:14:02.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.349+0000 7faa64be2640 1 -- 172.21.15.91:0/2552309879 learned_addr learned my addr 172.21.15.91:0/2552309879 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:02.353 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.357+0000 7faa64be2640 1 -- 172.21.15.91:0/2552309879 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faa4c0047d0 msgr2=0x7faa60148510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:02.353 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.357+0000 7faa64be2640 1 --2- 172.21.15.91:0/2552309879 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faa4c0047d0 0x7faa60148510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:02.353 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.357+0000 7faa64be2640 1 -- 172.21.15.91:0/2552309879 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faa60143410 msgr2=0x7faa601588c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:02.353 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.357+0000 7faa64be2640 1 --2- 172.21.15.91:0/2552309879 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faa60143410 0x7faa601588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:02.353 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.357+0000 7faa64be2640 1 -- 172.21.15.91:0/2552309879 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa601ecc60 con 0x7faa60158e00 2023-11-27T18:14:02.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.365+0000 7faa64be2640 1 --2- 172.21.15.91:0/2552309879 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faa60158e00 0x7faa601426e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7faa600c6170 tx=0x7faa5800c980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:02.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.369+0000 7faa5d7fa640 1 -- 172.21.15.91:0/2552309879 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa58007070 con 0x7faa60158e00 2023-11-27T18:14:02.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.373+0000 7faa5d7fa640 1 -- 172.21.15.91:0/2552309879 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa580071d0 con 0x7faa60158e00 2023-11-27T18:14:02.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.373+0000 7faa66645640 1 -- 172.21.15.91:0/2552309879 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa601ecf40 con 0x7faa60158e00 2023-11-27T18:14:02.369 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.373+0000 7faa5d7fa640 1 -- 172.21.15.91:0/2552309879 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa58007580 con 0x7faa60158e00 2023-11-27T18:14:02.369 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.373+0000 7faa66645640 1 -- 172.21.15.91:0/2552309879 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa60148fc0 con 0x7faa60158e00 2023-11-27T18:14:02.369 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.373+0000 7faa66645640 1 -- 172.21.15.91:0/2552309879 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa601ed740 con 0x7faa60158e00 2023-11-27T18:14:02.370 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.373+0000 7fbb1e7fc640 1 -- 172.21.15.91:0/2831747854 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb100ab600 con 0x7fbb20066360 2023-11-27T18:14:02.370 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.373+0000 7fbb1e7fc640 1 -- 172.21.15.91:0/2831747854 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb100a7050 con 0x7fbb20066360 2023-11-27T18:14:02.370 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.373+0000 7fbb1e7fc640 1 -- 172.21.15.91:0/2831747854 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb100ab980 con 0x7fbb20066360 2023-11-27T18:14:02.370 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.373+0000 7fbb2569b640 1 -- 172.21.15.91:0/2831747854 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbb20066360 msgr2=0x7fbb2006aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:02.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.373+0000 7fbb2569b640 1 --2- 172.21.15.91:0/2831747854 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbb20066360 0x7fbb2006aa60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbb2006c2c0 tx=0x7fbb1001c390 comp rx=0 tx=0).stop 2023-11-27T18:14:02.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.373+0000 7fbb2569b640 1 -- 172.21.15.91:0/2831747854 shutdown_connections 2023-11-27T18:14:02.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.373+0000 7fbb2569b640 1 --2- 172.21.15.91:0/2831747854 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbb20066360 0x7fbb2006aa60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:02.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.373+0000 7fbb2569b640 1 --2- 172.21.15.91:0/2831747854 >> v2:172.21.15.91:3300/0 conn(0x7fbb20157e20 0x7fbb2006a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:02.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.373+0000 7fbb2569b640 1 -- 172.21.15.91:0/2831747854 >> 172.21.15.91:0/2831747854 conn(0x7fbb20071820 msgr2=0x7fbb20071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:02.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.373+0000 7fbb2569b640 1 -- 172.21.15.91:0/2831747854 shutdown_connections 2023-11-27T18:14:02.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.373+0000 7fbb2569b640 1 -- 172.21.15.91:0/2831747854 wait complete. 2023-11-27T18:14:02.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.377+0000 7fbb2569b640 1 Processor -- start 2023-11-27T18:14:02.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.377+0000 7fbb2569b640 1 -- start start 2023-11-27T18:14:02.374 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.377+0000 7fbb2569b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbb20066360 0x7fbb2014e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:02.374 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.377+0000 7fbb2569b640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbb20072310 0x7fbb201616b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:02.374 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.377+0000 7fbb2569b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbb20157e20 0x7fbb20158aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:02.374 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.377+0000 7fbb2569b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2015b200 con 0x7fbb20066360 2023-11-27T18:14:02.374 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.377+0000 7fbb2569b640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2015aa00 con 0x7fbb20157e20 2023-11-27T18:14:02.374 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.377+0000 7fbb2569b640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb20161bf0 con 0x7fbb20072310 2023-11-27T18:14:02.389 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.393+0000 7f66e8ff9640 1 -- 172.21.15.91:0/1690233641 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f66dc055cb0 con 0x7f66ec0c0fc0 2023-11-27T18:14:02.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.425+0000 7f66e8ff9640 1 -- 172.21.15.91:0/1690233641 <== mon.2 v2:172.21.15.94:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f66dc055380 con 0x7f66ec0c0fc0 2023-11-27T18:14:02.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.425+0000 7f4777edc640 1 -- 172.21.15.91:0/2243323925 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f47700c7a20 con 0x7f4770153750 2023-11-27T18:14:02.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.461+0000 7fbb17fff640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbb20072310 0x7fbb201616b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:02.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.461+0000 7fbb17fff640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbb20072310 0x7fbb201616b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.91:41108/0 (socket says 172.21.15.91:41108) 2023-11-27T18:14:02.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.461+0000 7fbb17fff640 1 -- 172.21.15.91:0/2759742770 learned_addr learned my addr 172.21.15.91:0/2759742770 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:02.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.477+0000 7fbb17fff640 1 -- 172.21.15.91:0/2759742770 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbb20157e20 msgr2=0x7fbb20158aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:02.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.477+0000 7fbb17fff640 1 --2- 172.21.15.91:0/2759742770 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbb20157e20 0x7fbb20158aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:02.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.477+0000 7fbb17fff640 1 -- 172.21.15.91:0/2759742770 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbb20066360 msgr2=0x7fbb2014e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:02.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.477+0000 7fbb17fff640 1 --2- 172.21.15.91:0/2759742770 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbb20066360 0x7fbb2014e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:02.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.477+0000 7fbb17fff640 1 -- 172.21.15.91:0/2759742770 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb10009420 con 0x7fbb20072310 2023-11-27T18:14:02.479 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.481+0000 7fbb17fff640 1 --2- 172.21.15.91:0/2759742770 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbb20072310 0x7fbb201616b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbb10018fa0 tx=0x7fbb10019130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:02.489 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.493+0000 7fbb177fe640 1 -- 172.21.15.91:0/2759742770 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb100b4810 con 0x7fbb20072310 2023-11-27T18:14:02.489 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.493+0000 7fbb177fe640 1 -- 172.21.15.91:0/2759742770 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb100b4970 con 0x7fbb20072310 2023-11-27T18:14:02.489 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.493+0000 7fbb177fe640 1 -- 172.21.15.91:0/2759742770 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb100b4d20 con 0x7fbb20072310 2023-11-27T18:14:02.489 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.493+0000 7fbb2569b640 1 -- 172.21.15.91:0/2759742770 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb20159d80 con 0x7fbb20072310 2023-11-27T18:14:02.489 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.493+0000 7fbb2569b640 1 -- 172.21.15.91:0/2759742770 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb2015a340 con 0x7fbb20072310 2023-11-27T18:14:02.489 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.493+0000 7fbb2569b640 1 -- 172.21.15.91:0/2759742770 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb2004e850 con 0x7fbb20072310 2023-11-27T18:14:02.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.513+0000 7fa96effd640 1 -- 172.21.15.91:0/3894131730 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fa9600b7940 con 0x7fa978153920 2023-11-27T18:14:02.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.513+0000 7fa96effd640 1 --2- 172.21.15.91:0/3894131730 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa9580667f0 0x7fa958068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:02.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.513+0000 7fa97659c640 1 --2- 172.21.15.91:0/3894131730 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa9580667f0 0x7fa958068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:02.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.513+0000 7fa97659c640 1 --2- 172.21.15.91:0/3894131730 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa9580667f0 0x7fa958068cb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa968001600 tx=0x7fa968007a50 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:02.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.529+0000 7fa96effd640 1 -- 172.21.15.91:0/3894131730 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa9600b4e40 con 0x7fa978153920 2023-11-27T18:14:02.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.529+0000 7fa96effd640 1 -- 172.21.15.91:0/3894131730 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fa9600ec660 con 0x7fa978153920 2023-11-27T18:14:02.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.537+0000 7fbb177fe640 1 -- 172.21.15.91:0/2759742770 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fbb100b2040 con 0x7fbb20072310 2023-11-27T18:14:02.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.537+0000 7fbb177fe640 1 --2- 172.21.15.91:0/2759742770 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fbb04066870 0x7fbb04068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:02.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.537+0000 7fbb1effd640 1 --2- 172.21.15.91:0/2759742770 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fbb04066870 0x7fbb04068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:02.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.537+0000 7fbb1effd640 1 --2- 172.21.15.91:0/2759742770 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fbb04066870 0x7fbb04068d30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbb08009690 tx=0x7fbb08006c00 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:02.578 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.581+0000 7f66f24f0640 1 -- 172.21.15.91:0/1690233641 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f66ec14dd40 con 0x7f66ec0c0fc0 2023-11-27T18:14:02.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.665+0000 7faa5d7fa640 1 -- 172.21.15.91:0/2552309879 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7faa580076e0 con 0x7faa60158e00 2023-11-27T18:14:02.664 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.665+0000 7faa5d7fa640 1 --2- 172.21.15.91:0/2552309879 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7faa40066870 0x7faa40068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:02.664 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.669+0000 7faa5ffff640 1 --2- 172.21.15.91:0/2552309879 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7faa40066870 0x7faa40068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:02.664 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.669+0000 7faa5ffff640 1 --2- 172.21.15.91:0/2552309879 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7faa40066870 0x7faa40068d30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7faa500096b0 tx=0x7faa50006cb0 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:02.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.669+0000 7faa5d7fa640 1 -- 172.21.15.91:0/2552309879 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7faa58007990 con 0x7faa60158e00 2023-11-27T18:14:02.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.677+0000 7fa97ccfe640 1 -- 172.21.15.91:0/3894131730 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fa978156e90 con 0x7fa978153920 2023-11-27T18:14:02.676 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.681+0000 7faa5d7fa640 1 -- 172.21.15.91:0/2552309879 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7faa58050c10 con 0x7faa60158e00 2023-11-27T18:14:02.711 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.713+0000 7f47667fc640 1 -- 172.21.15.91:0/2243323925 <== mon.1 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f47700c7a20 con 0x7f4770153750 2023-11-27T18:14:02.711 INFO:teuthology.orchestra.run.smithi091.stdout:68719476756 2023-11-27T18:14:02.712 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.717+0000 7f4777edc640 1 -- 172.21.15.91:0/2243323925 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f4754066840 msgr2=0x7f4754068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:02.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.717+0000 7f4777edc640 1 --2- 172.21.15.91:0/2243323925 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f4754066840 0x7f4754068d00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f476c0b2000 tx=0x7f476c004740 comp rx=0 tx=0).stop 2023-11-27T18:14:02.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.717+0000 7f4777edc640 1 -- 172.21.15.91:0/2243323925 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4770153750 msgr2=0x7f477015b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:02.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.717+0000 7f4777edc640 1 --2- 172.21.15.91:0/2243323925 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4770153750 0x7f477015b2d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f476800c700 tx=0x7f476800cbc0 comp rx=0 tx=0).stop 2023-11-27T18:14:02.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.717+0000 7f4777edc640 1 -- 172.21.15.91:0/2243323925 shutdown_connections 2023-11-27T18:14:02.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.717+0000 7f4777edc640 1 --2- 172.21.15.91:0/2243323925 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f4754066840 0x7f4754068d00 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:02.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.717+0000 7f4777edc640 1 --2- 172.21.15.91:0/2243323925 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f477006f840 0x7f47701f76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:02.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.717+0000 7f4777edc640 1 --2- 172.21.15.91:0/2243323925 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4770153750 0x7f477015b2d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:02.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.717+0000 7f4777edc640 1 --2- 172.21.15.91:0/2243323925 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4770066560 0x7f47700ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:02.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.717+0000 7f4777edc640 1 -- 172.21.15.91:0/2243323925 >> 172.21.15.91:0/2243323925 conn(0x7f4770071520 msgr2=0x7f47700c65c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:02.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.717+0000 7f4777edc640 1 -- 172.21.15.91:0/2243323925 shutdown_connections 2023-11-27T18:14:02.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.717+0000 7f4777edc640 1 -- 172.21.15.91:0/2243323925 wait complete. 2023-11-27T18:14:02.730 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476757 got 68719476756 for osd.5 2023-11-27T18:14:02.794 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.797+0000 7f3c35d7d640 1 --2- 172.21.15.91:0/1476915435 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3c1c003980 0x7f3c30141e00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c000c10 tx=0x7f3c1c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:02.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.801+0000 7fbb177fe640 1 -- 172.21.15.91:0/2759742770 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbb100f0410 con 0x7fbb20072310 2023-11-27T18:14:02.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.805+0000 7fa96effd640 1 -- 172.21.15.91:0/3894131730 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa9600b0030 con 0x7fa978153920 2023-11-27T18:14:02.801 INFO:teuthology.orchestra.run.smithi091.stdout:64424509460 2023-11-27T18:14:02.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.809+0000 7fa97ccfe640 1 -- 172.21.15.91:0/3894131730 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa9580667f0 msgr2=0x7fa958068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:02.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.809+0000 7fa97ccfe640 1 --2- 172.21.15.91:0/3894131730 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa9580667f0 0x7fa958068cb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa968001600 tx=0x7fa968007a50 comp rx=0 tx=0).stop 2023-11-27T18:14:02.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.809+0000 7fa97ccfe640 1 -- 172.21.15.91:0/3894131730 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa978153920 msgr2=0x7fa9781f3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:02.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.809+0000 7fa97ccfe640 1 --2- 172.21.15.91:0/3894131730 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa978153920 0x7fa9781f3870 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa9600ae040 tx=0x7fa96001ac00 comp rx=0 tx=0).stop 2023-11-27T18:14:02.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.809+0000 7fa97ccfe640 1 -- 172.21.15.91:0/3894131730 shutdown_connections 2023-11-27T18:14:02.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.809+0000 7fa97ccfe640 1 --2- 172.21.15.91:0/3894131730 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa9580667f0 0x7fa958068cb0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:02.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.809+0000 7fa97ccfe640 1 --2- 172.21.15.91:0/3894131730 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa97815d6e0 0x7fa9781f3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:02.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.809+0000 7fa97ccfe640 1 --2- 172.21.15.91:0/3894131730 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa978153920 0x7fa9781f3870 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:02.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.809+0000 7fa97ccfe640 1 --2- 172.21.15.91:0/3894131730 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa9780c8e00 0x7fa97815cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:02.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.809+0000 7fa97ccfe640 1 -- 172.21.15.91:0/3894131730 >> 172.21.15.91:0/3894131730 conn(0x7fa978071ef0 msgr2=0x7fa9780c2770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:02.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.809+0000 7fa97ccfe640 1 -- 172.21.15.91:0/3894131730 shutdown_connections 2023-11-27T18:14:02.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.809+0000 7fa97ccfe640 1 -- 172.21.15.91:0/3894131730 wait complete. 2023-11-27T18:14:02.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.817+0000 7f93417fa640 1 -- 172.21.15.91:0/2632944858 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f933800a230 con 0x7f93340040f0 2023-11-27T18:14:02.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.821+0000 7f93417fa640 1 --2- 172.21.15.91:0/2632944858 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f9328066870 0x7f9328068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:02.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.821+0000 7f9343fff640 1 --2- 172.21.15.91:0/2632944858 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f9328066870 0x7f9328068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:02.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.821+0000 7f9343fff640 1 --2- 172.21.15.91:0/2632944858 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f9328066870 0x7f9328068d30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f93300aa000 tx=0x7f9330000fc0 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:02.819 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509461 got 64424509460 for osd.4 2023-11-27T18:14:02.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.837+0000 7f93417fa640 1 -- 172.21.15.91:0/2632944858 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9338057f50 con 0x7f93340040f0 2023-11-27T18:14:02.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.837+0000 7f93417fa640 1 -- 172.21.15.91:0/2632944858 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f9338054290 con 0x7f93340040f0 2023-11-27T18:14:02.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.837+0000 7fbb177fe640 1 -- 172.21.15.91:0/2759742770 <== mon.2 v2:172.21.15.94:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fbb100ec050 con 0x7fbb20072310 2023-11-27T18:14:02.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.853+0000 7f66e8ff9640 1 -- 172.21.15.91:0/1690233641 <== mon.2 v2:172.21.15.94:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f66dc015020 con 0x7f66ec0c0fc0 2023-11-27T18:14:02.849 INFO:teuthology.orchestra.run.smithi091.stdout:68719476755 2023-11-27T18:14:02.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.857+0000 7f66f24f0640 1 -- 172.21.15.91:0/1690233641 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f66d8066870 msgr2=0x7f66d8068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:02.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.857+0000 7f66f24f0640 1 --2- 172.21.15.91:0/1690233641 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f66d8066870 0x7f66d8068d30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f66ec06fd40 tx=0x7f66e0006ca0 comp rx=0 tx=0).stop 2023-11-27T18:14:02.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.857+0000 7f66f24f0640 1 -- 172.21.15.91:0/1690233641 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f66ec0c0fc0 msgr2=0x7f66ec1ee1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:02.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.857+0000 7f66f24f0640 1 --2- 172.21.15.91:0/1690233641 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f66ec0c0fc0 0x7f66ec1ee1d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f66dc00b440 tx=0x7f66dc00b900 comp rx=0 tx=0).stop 2023-11-27T18:14:02.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.857+0000 7f66f24f0640 1 -- 172.21.15.91:0/1690233641 shutdown_connections 2023-11-27T18:14:02.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.857+0000 7f66f24f0640 1 --2- 172.21.15.91:0/1690233641 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f66d8066870 0x7f66d8068d30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:02.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.857+0000 7f66f24f0640 1 --2- 172.21.15.91:0/1690233641 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f66ec150260 0x7f66ec1e81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:02.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.857+0000 7f66f24f0640 1 --2- 172.21.15.91:0/1690233641 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f66ec0c83d0 0x7f66ec1f1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:02.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.857+0000 7f66f24f0640 1 --2- 172.21.15.91:0/1690233641 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f66ec0c0fc0 0x7f66ec1ee1d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:02.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.857+0000 7f66f24f0640 1 -- 172.21.15.91:0/1690233641 >> 172.21.15.91:0/1690233641 conn(0x7f66ec0c8aa0 msgr2=0x7f66ec156280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:02.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.857+0000 7f66f24f0640 1 -- 172.21.15.91:0/1690233641 shutdown_connections 2023-11-27T18:14:02.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.857+0000 7f66f24f0640 1 -- 172.21.15.91:0/1690233641 wait complete. 2023-11-27T18:14:02.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.857+0000 7f3c267fc640 1 -- 172.21.15.91:0/1476915435 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c0bd070 con 0x7f3c1c003980 2023-11-27T18:14:02.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.857+0000 7f3c267fc640 1 -- 172.21.15.91:0/1476915435 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c2c0038d0 con 0x7f3c1c003980 2023-11-27T18:14:02.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.857+0000 7f3c267fc640 1 -- 172.21.15.91:0/1476915435 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c003c60 con 0x7f3c1c003980 2023-11-27T18:14:02.855 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.857+0000 7f3c37fe1640 1 -- 172.21.15.91:0/1476915435 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c30141040 con 0x7f3c1c003980 2023-11-27T18:14:02.855 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.857+0000 7f3c37fe1640 1 -- 172.21.15.91:0/1476915435 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c30141600 con 0x7f3c1c003980 2023-11-27T18:14:02.855 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.857+0000 7f3c37fe1640 1 -- 172.21.15.91:0/1476915435 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c3004e850 con 0x7f3c1c003980 2023-11-27T18:14:02.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.861+0000 7faa66645640 1 -- 172.21.15.91:0/2552309879 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7faa601ed740 con 0x7faa60158e00 2023-11-27T18:14:02.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.877+0000 7f3c267fc640 1 -- 172.21.15.91:0/1476915435 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f3c2c0b2050 con 0x7f3c1c003980 2023-11-27T18:14:02.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.877+0000 7f3c267fc640 1 --2- 172.21.15.91:0/1476915435 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f3c14066820 0x7f3c14068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:02.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.877+0000 7f3c3557c640 1 --2- 172.21.15.91:0/1476915435 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f3c14066820 0x7f3c14068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:02.876 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476756 got 68719476755 for osd.1 2023-11-27T18:14:02.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.881+0000 7f3c3557c640 1 --2- 172.21.15.91:0/1476915435 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f3c14066820 0x7f3c14068ce0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3c20006fd0 tx=0x7f3c20006d80 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:02.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.881+0000 7f3c267fc640 1 -- 172.21.15.91:0/1476915435 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3c2c0ef700 con 0x7f3c1c003980 2023-11-27T18:14:02.887 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.889+0000 7faa5d7fa640 1 -- 172.21.15.91:0/2552309879 <== mon.1 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faa601ed740 con 0x7faa60158e00 2023-11-27T18:14:02.887 INFO:teuthology.orchestra.run.smithi091.stdout:68719476756 2023-11-27T18:14:02.889 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.893+0000 7faa66645640 1 -- 172.21.15.91:0/2552309879 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7faa40066870 msgr2=0x7faa40068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:02.889 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.893+0000 7faa66645640 1 --2- 172.21.15.91:0/2552309879 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7faa40066870 0x7faa40068d30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7faa500096b0 tx=0x7faa50006cb0 comp rx=0 tx=0).stop 2023-11-27T18:14:02.889 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.893+0000 7faa66645640 1 -- 172.21.15.91:0/2552309879 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faa60158e00 msgr2=0x7faa601426e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:02.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.893+0000 7faa66645640 1 --2- 172.21.15.91:0/2552309879 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faa60158e00 0x7faa601426e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7faa600c6170 tx=0x7faa5800c980 comp rx=0 tx=0).stop 2023-11-27T18:14:02.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.893+0000 7faa66645640 1 -- 172.21.15.91:0/2552309879 shutdown_connections 2023-11-27T18:14:02.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.893+0000 7faa66645640 1 --2- 172.21.15.91:0/2552309879 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7faa40066870 0x7faa40068d30 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:02.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.893+0000 7faa66645640 1 --2- 172.21.15.91:0/2552309879 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faa60158e00 0x7faa601426e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:02.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.893+0000 7faa66645640 1 --2- 172.21.15.91:0/2552309879 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faa60143410 0x7faa601588c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:02.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.893+0000 7faa66645640 1 --2- 172.21.15.91:0/2552309879 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faa4c0047d0 0x7faa60148510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:02.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.893+0000 7faa66645640 1 -- 172.21.15.91:0/2552309879 >> 172.21.15.91:0/2552309879 conn(0x7faa60071da0 msgr2=0x7faa600721b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:02.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.893+0000 7faa66645640 1 -- 172.21.15.91:0/2552309879 shutdown_connections 2023-11-27T18:14:02.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.893+0000 7faa66645640 1 -- 172.21.15.91:0/2552309879 wait complete. 2023-11-27T18:14:02.910 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476757 got 68719476756 for osd.0 2023-11-27T18:14:02.990 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:02.993+0000 7f934b222640 1 -- 172.21.15.91:0/2632944858 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9344157f00 con 0x7f93340040f0 2023-11-27T18:14:03.000 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.005+0000 7fbb2569b640 1 -- 172.21.15.91:0/2759742770 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fbb200c3b10 con 0x7fbb20072310 2023-11-27T18:14:03.007 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.009+0000 7fbb177fe640 1 -- 172.21.15.91:0/2759742770 <== mon.2 v2:172.21.15.94:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbb100b22f0 con 0x7fbb20072310 2023-11-27T18:14:03.008 INFO:teuthology.orchestra.run.smithi091.stdout:68719476756 2023-11-27T18:14:03.009 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.013+0000 7fbb2569b640 1 -- 172.21.15.91:0/2759742770 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fbb04066870 msgr2=0x7fbb04068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:03.009 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.013+0000 7fbb2569b640 1 --2- 172.21.15.91:0/2759742770 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fbb04066870 0x7fbb04068d30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbb08009690 tx=0x7fbb08006c00 comp rx=0 tx=0).stop 2023-11-27T18:14:03.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.013+0000 7fbb2569b640 1 -- 172.21.15.91:0/2759742770 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbb20072310 msgr2=0x7fbb201616b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:03.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.013+0000 7fbb2569b640 1 --2- 172.21.15.91:0/2759742770 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbb20072310 0x7fbb201616b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbb10018fa0 tx=0x7fbb10019130 comp rx=0 tx=0).stop 2023-11-27T18:14:03.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.013+0000 7fbb2569b640 1 -- 172.21.15.91:0/2759742770 shutdown_connections 2023-11-27T18:14:03.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.013+0000 7fbb2569b640 1 --2- 172.21.15.91:0/2759742770 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fbb04066870 0x7fbb04068d30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:03.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.013+0000 7fbb2569b640 1 --2- 172.21.15.91:0/2759742770 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbb20072310 0x7fbb201616b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:03.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.013+0000 7fbb2569b640 1 --2- 172.21.15.91:0/2759742770 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbb20157e20 0x7fbb20158aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:03.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.013+0000 7fbb2569b640 1 --2- 172.21.15.91:0/2759742770 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbb20066360 0x7fbb2014e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:03.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.013+0000 7fbb2569b640 1 -- 172.21.15.91:0/2759742770 >> 172.21.15.91:0/2759742770 conn(0x7fbb20071820 msgr2=0x7fbb200c48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:03.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.013+0000 7fbb2569b640 1 -- 172.21.15.91:0/2759742770 shutdown_connections 2023-11-27T18:14:03.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.013+0000 7fbb2569b640 1 -- 172.21.15.91:0/2759742770 wait complete. 2023-11-27T18:14:03.024 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476757 got 68719476756 for osd.7 2023-11-27T18:14:03.115 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.117+0000 7f93417fa640 1 -- 172.21.15.91:0/2632944858 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9338025070 con 0x7f93340040f0 2023-11-27T18:14:03.115 INFO:teuthology.orchestra.run.smithi091.stdout:68719476755 2023-11-27T18:14:03.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.121+0000 7f934b222640 1 -- 172.21.15.91:0/2632944858 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f9328066870 msgr2=0x7f9328068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:03.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.121+0000 7f934b222640 1 --2- 172.21.15.91:0/2632944858 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f9328066870 0x7f9328068d30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f93300aa000 tx=0x7f9330000fc0 comp rx=0 tx=0).stop 2023-11-27T18:14:03.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.121+0000 7f934b222640 1 -- 172.21.15.91:0/2632944858 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f93340040f0 msgr2=0x7f93440c5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:03.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.121+0000 7f934b222640 1 --2- 172.21.15.91:0/2632944858 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f93340040f0 0x7f93440c5cd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f933800f730 tx=0x7f933800fbf0 comp rx=0 tx=0).stop 2023-11-27T18:14:03.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.121+0000 7f934b222640 1 -- 172.21.15.91:0/2632944858 shutdown_connections 2023-11-27T18:14:03.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.121+0000 7f934b222640 1 --2- 172.21.15.91:0/2632944858 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f9328066870 0x7f9328068d30 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:03.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.121+0000 7f934b222640 1 --2- 172.21.15.91:0/2632944858 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9344158650 0x7f9344147840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:03.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.121+0000 7f934b222640 1 --2- 172.21.15.91:0/2632944858 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9344151d40 0x7f9344159da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:03.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.121+0000 7f934b222640 1 --2- 172.21.15.91:0/2632944858 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f93340040f0 0x7f93440c5cd0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:03.118 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.121+0000 7f934b222640 1 -- 172.21.15.91:0/2632944858 >> 172.21.15.91:0/2632944858 conn(0x7f93440c8aa0 msgr2=0x7f934414ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:03.118 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.121+0000 7f934b222640 1 -- 172.21.15.91:0/2632944858 shutdown_connections 2023-11-27T18:14:03.118 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.121+0000 7f934b222640 1 -- 172.21.15.91:0/2632944858 wait complete. 2023-11-27T18:14:03.127 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.129+0000 7f3c267fc640 1 -- 172.21.15.91:0/1476915435 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f3c2c0eedd0 con 0x7f3c1c003980 2023-11-27T18:14:03.139 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476756 got 68719476755 for osd.2 2023-11-27T18:14:03.243 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-27T18:14:03.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.301+0000 7f3c37fe1640 1 -- 172.21.15.91:0/1476915435 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3c30140700 con 0x7f3c1c003980 2023-11-27T18:14:03.303 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.305+0000 7f3c267fc640 1 -- 172.21.15.91:0/1476915435 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3c2c0ee960 con 0x7f3c1c003980 2023-11-27T18:14:03.304 INFO:teuthology.orchestra.run.smithi091.stdout:68719476754 2023-11-27T18:14:03.306 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.309+0000 7f3c37fe1640 1 -- 172.21.15.91:0/1476915435 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f3c14066820 msgr2=0x7f3c14068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:03.306 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.309+0000 7f3c37fe1640 1 --2- 172.21.15.91:0/1476915435 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f3c14066820 0x7f3c14068ce0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3c20006fd0 tx=0x7f3c20006d80 comp rx=0 tx=0).stop 2023-11-27T18:14:03.306 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.309+0000 7f3c37fe1640 1 -- 172.21.15.91:0/1476915435 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3c1c003980 msgr2=0x7f3c30141e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:03.306 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.309+0000 7f3c37fe1640 1 --2- 172.21.15.91:0/1476915435 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3c1c003980 0x7f3c30141e00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c000c10 tx=0x7f3c1c005800 comp rx=0 tx=0).stop 2023-11-27T18:14:03.306 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.309+0000 7f3c37fe1640 1 -- 172.21.15.91:0/1476915435 shutdown_connections 2023-11-27T18:14:03.306 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.309+0000 7f3c37fe1640 1 --2- 172.21.15.91:0/1476915435 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f3c14066820 0x7f3c14068ce0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:03.306 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.309+0000 7f3c37fe1640 1 --2- 172.21.15.91:0/1476915435 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3c3015a170 0x7f3c301573c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:03.306 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.309+0000 7f3c37fe1640 1 --2- 172.21.15.91:0/1476915435 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3c30142340 0x7f3c30159c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:03.307 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.309+0000 7f3c37fe1640 1 --2- 172.21.15.91:0/1476915435 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3c1c003980 0x7f3c30141e00 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:03.307 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.309+0000 7f3c37fe1640 1 -- 172.21.15.91:0/1476915435 >> 172.21.15.91:0/1476915435 conn(0x7f3c30071520 msgr2=0x7f3c300c22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:03.307 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.309+0000 7f3c37fe1640 1 -- 172.21.15.91:0/1476915435 shutdown_connections 2023-11-27T18:14:03.307 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.309+0000 7f3c37fe1640 1 -- 172.21.15.91:0/1476915435 wait complete. 2023-11-27T18:14:03.323 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476755 got 68719476754 for osd.3 2023-11-27T18:14:03.350 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.353+0000 7fe0514d2640 1 Processor -- start 2023-11-27T18:14:03.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.353+0000 7fe0514d2640 1 -- start start 2023-11-27T18:14:03.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.353+0000 7fe0514d2640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fe04c0c7c50 0x7fe04c0b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:03.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.353+0000 7fe0514d2640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe04c0c9f80 con 0x7fe04c151730 2023-11-27T18:14:03.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.353+0000 7fe0514d2640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe04c0c9090 con 0x7fe04c0ccbe0 2023-11-27T18:14:03.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.353+0000 7fe0514d2640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe04c0c9370 con 0x7fe04c0c7c50 2023-11-27T18:14:03.352 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.357+0000 7fe04b7fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fe04c0ccbe0 0x7fe04c161bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.91:58416/0 (socket says 172.21.15.91:58416) 2023-11-27T18:14:03.353 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.357+0000 7fe04b7fe640 1 -- 172.21.15.91:0/4259216749 learned_addr learned my addr 172.21.15.91:0/4259216749 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:14:03.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.357+0000 7fe04a7fc640 1 --2- 172.21.15.91:0/4259216749 >> v2:172.21.15.91:3300/0 conn(0x7fe04c0c7c50 0x7fe04c0b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:03.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.361+0000 7fe04a7fc640 1 -- 172.21.15.91:0/4259216749 >> v1:172.21.15.94:6789/0 conn(0x7fe04c0ccbe0 legacy=0x7fe04c161bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:03.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.361+0000 7fe04a7fc640 1 -- 172.21.15.91:0/4259216749 >> v1:172.21.15.91:6789/0 conn(0x7fe04c151730 legacy=0x7fe04c15b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:03.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.361+0000 7fe04a7fc640 1 -- 172.21.15.91:0/4259216749 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe04c0c9650 con 0x7fe04c0c7c50 2023-11-27T18:14:03.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.369+0000 7fe04a7fc640 1 --2- 172.21.15.91:0/4259216749 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe04c0c7c50 0x7fe04c0b0cb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe0400097c0 tx=0x7fe04001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=882d5a5a925ac4e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:03.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.373+0000 7fe049ffb640 1 -- 172.21.15.91:0/4259216749 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0400a8970 con 0x7fe04c0c7c50 2023-11-27T18:14:03.370 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.373+0000 7fe049ffb640 1 -- 172.21.15.91:0/4259216749 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0400a8ad0 con 0x7fe04c0c7c50 2023-11-27T18:14:03.370 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.373+0000 7fe049ffb640 1 -- 172.21.15.91:0/4259216749 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0400a8e60 con 0x7fe04c0c7c50 2023-11-27T18:14:03.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.373+0000 7fe0514d2640 1 -- 172.21.15.91:0/4259216749 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe04c0c7c50 msgr2=0x7fe04c0b0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:03.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.373+0000 7fe0514d2640 1 --2- 172.21.15.91:0/4259216749 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe04c0c7c50 0x7fe04c0b0cb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe0400097c0 tx=0x7fe04001ec70 comp rx=0 tx=0).stop 2023-11-27T18:14:03.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.373+0000 7fe0514d2640 1 -- 172.21.15.91:0/4259216749 shutdown_connections 2023-11-27T18:14:03.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.373+0000 7fe0514d2640 1 --2- 172.21.15.91:0/4259216749 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe04c0c7c50 0x7fe04c0b0cb0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:03.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.373+0000 7fe0514d2640 1 -- 172.21.15.91:0/4259216749 >> 172.21.15.91:0/4259216749 conn(0x7fe04c06a520 msgr2=0x7fe04c06a930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:03.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.373+0000 7fe0514d2640 1 -- 172.21.15.91:0/4259216749 shutdown_connections 2023-11-27T18:14:03.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.373+0000 7fe0514d2640 1 -- 172.21.15.91:0/4259216749 wait complete. 2023-11-27T18:14:03.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.377+0000 7fe0514d2640 1 Processor -- start 2023-11-27T18:14:03.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.377+0000 7fe0514d2640 1 -- start start 2023-11-27T18:14:03.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.377+0000 7fe0514d2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe04c0c7c50 0x7fe04c1f00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:03.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.377+0000 7fe0514d2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe04c0ccbe0 0x7fe04c158660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:03.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.377+0000 7fe0514d2640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe04c151730 0x7fe04c14eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:03.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.377+0000 7fe0514d2640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe04c06d4c0 con 0x7fe04c0c7c50 2023-11-27T18:14:03.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.377+0000 7fe0514d2640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe04c159530 con 0x7fe04c0ccbe0 2023-11-27T18:14:03.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.377+0000 7fe0514d2640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe04c1ef6c0 con 0x7fe04c151730 2023-11-27T18:14:03.374 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.377+0000 7fe04affd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe04c0c7c50 0x7fe04c1f00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:03.374 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.377+0000 7fe04affd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe04c0c7c50 0x7fe04c1f00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44954/0 (socket says 172.21.15.91:44954) 2023-11-27T18:14:03.374 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.377+0000 7fe04affd640 1 -- 172.21.15.91:0/4041101212 learned_addr learned my addr 172.21.15.91:0/4041101212 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:03.374 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.377+0000 7fe04a7fc640 1 --2- 172.21.15.91:0/4041101212 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe04c0ccbe0 0x7fe04c158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:03.374 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.377+0000 7fe04b7fe640 1 --2- 172.21.15.91:0/4041101212 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe04c151730 0x7fe04c14eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:03.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.381+0000 7fe04affd640 1 -- 172.21.15.91:0/4041101212 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe04c151730 msgr2=0x7fe04c14eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:03.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.381+0000 7fe04affd640 1 --2- 172.21.15.91:0/4041101212 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe04c151730 0x7fe04c14eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:03.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.381+0000 7fe04affd640 1 -- 172.21.15.91:0/4041101212 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe04c0ccbe0 msgr2=0x7fe04c158660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:03.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.381+0000 7fe04affd640 1 --2- 172.21.15.91:0/4041101212 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe04c0ccbe0 0x7fe04c158660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:03.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.381+0000 7fe04affd640 1 -- 172.21.15.91:0/4041101212 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe040009420 con 0x7fe04c0c7c50 2023-11-27T18:14:03.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.381+0000 7fe04affd640 1 --2- 172.21.15.91:0/4041101212 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe04c0c7c50 0x7fe04c1f00d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe03c00c420 tx=0x7fe03c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:03.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.385+0000 7fe0337fe640 1 -- 172.21.15.91:0/4041101212 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03c0052d0 con 0x7fe04c0c7c50 2023-11-27T18:14:03.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.385+0000 7fe0514d2640 1 -- 172.21.15.91:0/4041101212 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe04c1f0610 con 0x7fe04c0c7c50 2023-11-27T18:14:03.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.385+0000 7fe0514d2640 1 -- 172.21.15.91:0/4041101212 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe04c150060 con 0x7fe04c0c7c50 2023-11-27T18:14:03.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.385+0000 7fe0514d2640 1 -- 172.21.15.91:0/4041101212 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe04c04e850 con 0x7fe04c0c7c50 2023-11-27T18:14:03.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.385+0000 7fe0337fe640 1 -- 172.21.15.91:0/4041101212 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe03c005430 con 0x7fe04c0c7c50 2023-11-27T18:14:03.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.385+0000 7fe0337fe640 1 -- 172.21.15.91:0/4041101212 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03c007260 con 0x7fe04c0c7c50 2023-11-27T18:14:03.670 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.673+0000 7fe0337fe640 1 -- 172.21.15.91:0/4041101212 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fe03c0073c0 con 0x7fe04c0c7c50 2023-11-27T18:14:03.670 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.673+0000 7fe0337fe640 1 --2- 172.21.15.91:0/4041101212 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe0380667f0 0x7fe038068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:03.671 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.673+0000 7fe04a7fc640 1 --2- 172.21.15.91:0/4041101212 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe0380667f0 0x7fe038068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:03.671 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.673+0000 7fe04a7fc640 1 --2- 172.21.15.91:0/4041101212 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe0380667f0 0x7fe038068cb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe0400b2000 tx=0x7fe0400aa070 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:03.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.709+0000 7fe0337fe640 1 -- 172.21.15.91:0/4041101212 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe03c007670 con 0x7fe04c0c7c50 2023-11-27T18:14:03.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.709+0000 7fe0337fe640 1 -- 172.21.15.91:0/4041101212 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fe03c050d70 con 0x7fe04c0c7c50 2023-11-27T18:14:03.731 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-27T18:14:03.820 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-27T18:14:03.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.861+0000 7fe76c4b5640 1 Processor -- start 2023-11-27T18:14:03.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.861+0000 7fe76c4b5640 1 -- start start 2023-11-27T18:14:03.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.861+0000 7fe76c4b5640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe76414ff60 0x7fe7640c18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:03.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.861+0000 7fe76c4b5640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fe7640cbaf0 0x7fe7640cbf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:03.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.861+0000 7fe76c4b5640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe764156f10 con 0x7fe764150340 2023-11-27T18:14:03.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.861+0000 7fe76c4b5640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe764156080 con 0x7fe7640cbaf0 2023-11-27T18:14:03.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.861+0000 7fe76c4b5640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe764156300 con 0x7fe76414ff60 2023-11-27T18:14:03.860 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.865+0000 7fe76aa52640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fe7640cbaf0 0x7fe7640cbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:03.860 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.865+0000 7fe76aa52640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fe7640cbaf0 0x7fe7640cbf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44964/0 (socket says 172.21.15.91:44964) 2023-11-27T18:14:03.860 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.865+0000 7fe76aa52640 1 -- 172.21.15.91:0/1409211096 learned_addr learned my addr 172.21.15.91:0/1409211096 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:03.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.865+0000 7fe76aa52640 1 -- 172.21.15.91:0/1409211096 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe76414ff60 msgr2=0x7fe7640c18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:03.863 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.865+0000 7fe76aa52640 1 --2- 172.21.15.91:0/1409211096 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe76414ff60 0x7fe7640c18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:03.863 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.865+0000 7fe76aa52640 1 -- 172.21.15.91:0/1409211096 >> v1:172.21.15.94:6789/0 conn(0x7fe764150340 legacy=0x7fe76406fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:03.863 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.865+0000 7fe76aa52640 1 -- 172.21.15.91:0/1409211096 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7641565e0 con 0x7fe7640cbaf0 2023-11-27T18:14:03.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.869+0000 7fe76aa52640 1 --2- 172.21.15.91:0/1409211096 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe7640cbaf0 0x7fe7640cbf60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe75c009e50 tx=0x7fe75c01ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b6bb1c6891b5b40 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:03.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.873+0000 7fe76924f640 1 -- 172.21.15.91:0/1409211096 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c0a57d0 con 0x7fe7640cbaf0 2023-11-27T18:14:03.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.873+0000 7fe0514d2640 1 -- 172.21.15.91:0/4041101212 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fe04c0c3e00 con 0x7fe04c0c7c50 2023-11-27T18:14:03.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.877+0000 7fe76924f640 1 -- 172.21.15.91:0/1409211096 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75c0a5930 con 0x7fe7640cbaf0 2023-11-27T18:14:03.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.877+0000 7fe76924f640 1 -- 172.21.15.91:0/1409211096 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c0a5cc0 con 0x7fe7640cbaf0 2023-11-27T18:14:03.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.877+0000 7fe76c4b5640 1 -- 172.21.15.91:0/1409211096 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe7640cbaf0 msgr2=0x7fe7640cbf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:03.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.877+0000 7fe76c4b5640 1 --2- 172.21.15.91:0/1409211096 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe7640cbaf0 0x7fe7640cbf60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe75c009e50 tx=0x7fe75c01ca10 comp rx=0 tx=0).stop 2023-11-27T18:14:03.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.877+0000 7fe76c4b5640 1 -- 172.21.15.91:0/1409211096 shutdown_connections 2023-11-27T18:14:03.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.877+0000 7fe76c4b5640 1 --2- 172.21.15.91:0/1409211096 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe7640cbaf0 0x7fe7640cbf60 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:03.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.877+0000 7fe76c4b5640 1 --2- 172.21.15.91:0/1409211096 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe76414ff60 0x7fe7640c18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:03.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.877+0000 7fe76c4b5640 1 -- 172.21.15.91:0/1409211096 >> 172.21.15.91:0/1409211096 conn(0x7fe764071da0 msgr2=0x7fe7640721b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:03.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.877+0000 7fe76c4b5640 1 -- 172.21.15.91:0/1409211096 shutdown_connections 2023-11-27T18:14:03.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.877+0000 7fe76c4b5640 1 -- 172.21.15.91:0/1409211096 wait complete. 2023-11-27T18:14:03.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.877+0000 7fe76c4b5640 1 Processor -- start 2023-11-27T18:14:03.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.877+0000 7fe76c4b5640 1 -- start start 2023-11-27T18:14:03.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.877+0000 7fe76c4b5640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe7640cbaf0 0x7fe76406a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:03.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.877+0000 7fe76c4b5640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe76414ff60 0x7fe7640c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:03.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.877+0000 7fe76c4b5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe764150340 0x7fe76414d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:03.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.877+0000 7fe76c4b5640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76415f090 con 0x7fe764150340 2023-11-27T18:14:03.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.877+0000 7fe76c4b5640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76415f2f0 con 0x7fe76414ff60 2023-11-27T18:14:03.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.877+0000 7fe76c4b5640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe76415f5d0 con 0x7fe7640cbaf0 2023-11-27T18:14:03.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.881+0000 7fe76a251640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe7640cbaf0 0x7fe76406a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:03.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.881+0000 7fe0337fe640 1 -- 172.21.15.91:0/4041101212 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe03c020070 con 0x7fe04c0c7c50 2023-11-27T18:14:03.876 INFO:teuthology.orchestra.run.smithi091.stdout:68719476756 2023-11-27T18:14:03.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.881+0000 7fe769a50640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe76414ff60 0x7fe7640c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:03.877 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-27T18:14:03.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.881+0000 7fe76a251640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe7640cbaf0 0x7fe76406a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.91:41122/0 (socket says 172.21.15.91:41122) 2023-11-27T18:14:03.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.881+0000 7fe76a251640 1 -- 172.21.15.91:0/1551954770 learned_addr learned my addr 172.21.15.91:0/1551954770 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:03.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.881+0000 7fe0514d2640 1 -- 172.21.15.91:0/4041101212 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe0380667f0 msgr2=0x7fe038068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:03.879 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.881+0000 7fe0514d2640 1 --2- 172.21.15.91:0/4041101212 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe0380667f0 0x7fe038068cb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe0400b2000 tx=0x7fe0400aa070 comp rx=0 tx=0).stop 2023-11-27T18:14:03.879 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.881+0000 7fe0514d2640 1 -- 172.21.15.91:0/4041101212 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe04c0c7c50 msgr2=0x7fe04c1f00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:03.879 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.881+0000 7fe0514d2640 1 --2- 172.21.15.91:0/4041101212 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe04c0c7c50 0x7fe04c1f00d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe03c00c420 tx=0x7fe03c00c8e0 comp rx=0 tx=0).stop 2023-11-27T18:14:03.879 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.881+0000 7fe0514d2640 1 -- 172.21.15.91:0/4041101212 shutdown_connections 2023-11-27T18:14:03.879 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.881+0000 7fe0514d2640 1 --2- 172.21.15.91:0/4041101212 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe0380667f0 0x7fe038068cb0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:03.879 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.881+0000 7fe0514d2640 1 --2- 172.21.15.91:0/4041101212 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe04c151730 0x7fe04c14eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:03.879 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.881+0000 7fe0514d2640 1 --2- 172.21.15.91:0/4041101212 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe04c0ccbe0 0x7fe04c158660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:03.879 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.881+0000 7fe0514d2640 1 --2- 172.21.15.91:0/4041101212 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe04c0c7c50 0x7fe04c1f00d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:03.879 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.881+0000 7fe0514d2640 1 -- 172.21.15.91:0/4041101212 >> 172.21.15.91:0/4041101212 conn(0x7fe04c06a520 msgr2=0x7fe04c0cbb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:03.879 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.881+0000 7fe0514d2640 1 -- 172.21.15.91:0/4041101212 shutdown_connections 2023-11-27T18:14:03.879 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.881+0000 7fe0514d2640 1 -- 172.21.15.91:0/4041101212 wait complete. 2023-11-27T18:14:03.882 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.885+0000 7fe76aa52640 1 --2- 172.21.15.91:0/1551954770 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe764150340 0x7fe76414d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:03.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.889+0000 7fe76aa52640 1 -- 172.21.15.91:0/1551954770 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe7640cbaf0 msgr2=0x7fe76406a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:03.886 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.889+0000 7fe76aa52640 1 --2- 172.21.15.91:0/1551954770 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe7640cbaf0 0x7fe76406a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:03.886 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.889+0000 7fe76aa52640 1 -- 172.21.15.91:0/1551954770 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe76414ff60 msgr2=0x7fe7640c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:03.886 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.889+0000 7fe76aa52640 1 --2- 172.21.15.91:0/1551954770 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe76414ff60 0x7fe7640c8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:03.886 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.889+0000 7fe76aa52640 1 -- 172.21.15.91:0/1551954770 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe75c009b30 con 0x7fe764150340 2023-11-27T18:14:03.888 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.893+0000 7fe76aa52640 1 --2- 172.21.15.91:0/1551954770 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe764150340 0x7fe76414d940 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe75c0ab000 tx=0x7fe75c0197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:03.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.897+0000 7fe75affd640 1 -- 172.21.15.91:0/1551954770 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c009250 con 0x7fe764150340 2023-11-27T18:14:03.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.897+0000 7fe75affd640 1 -- 172.21.15.91:0/1551954770 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75c0b8680 con 0x7fe764150340 2023-11-27T18:14:03.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.897+0000 7fe76c4b5640 1 -- 172.21.15.91:0/1551954770 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe76415f8b0 con 0x7fe764150340 2023-11-27T18:14:03.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.897+0000 7fe75affd640 1 -- 172.21.15.91:0/1551954770 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c0b8a10 con 0x7fe764150340 2023-11-27T18:14:03.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.897+0000 7fe76c4b5640 1 -- 172.21.15.91:0/1551954770 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe76406acc0 con 0x7fe764150340 2023-11-27T18:14:03.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.897+0000 7fe76c4b5640 1 -- 172.21.15.91:0/1551954770 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe76406f9b0 con 0x7fe764150340 2023-11-27T18:14:03.899 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476757 got 68719476756 for osd.6 2023-11-27T18:14:03.911 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-27T18:14:03.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.917+0000 7fe75affd640 1 -- 172.21.15.91:0/1551954770 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fe75c0b8b70 con 0x7fe764150340 2023-11-27T18:14:03.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.917+0000 7fe75affd640 1 --2- 172.21.15.91:0/1551954770 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe748066820 0x7fe748068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:03.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.917+0000 7fe76a251640 1 --2- 172.21.15.91:0/1551954770 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe748066820 0x7fe748068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:03.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.921+0000 7fe76a251640 1 --2- 172.21.15.91:0/1551954770 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe748066820 0x7fe748068ce0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe760009a50 tx=0x7fe760009210 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:03.937 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.941+0000 7f1169b54640 1 Processor -- start 2023-11-27T18:14:03.937 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.941+0000 7f1169b54640 1 -- start start 2023-11-27T18:14:03.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.941+0000 7f1169b54640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f1164153890 0x7f116406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:03.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.941+0000 7f1169b54640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f116415a130 0x7f116406a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:03.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.941+0000 7f1169b54640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f116415d830 con 0x7f116406aa60 2023-11-27T18:14:03.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.941+0000 7f1169b54640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11640c1cc0 con 0x7f1164153890 2023-11-27T18:14:03.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.941+0000 7f1169b54640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f116406f3d0 con 0x7f116415a130 2023-11-27T18:14:03.940 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.945+0000 7f1162ffd640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f116415a130 0x7f116406a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:03.940 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.945+0000 7f1163fff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f116406aa60 0x7f116406d570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.91:58426/0 (socket says 172.21.15.91:58426) 2023-11-27T18:14:03.940 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.945+0000 7f1163fff640 1 -- 172.21.15.91:0/1367558288 learned_addr learned my addr 172.21.15.91:0/1367558288 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:14:03.946 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.949+0000 7f11627fc640 1 -- 172.21.15.91:0/1367558288 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4232550742 0 0) 0x7f116415d830 con 0x7f116406aa60 2023-11-27T18:14:03.946 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.949+0000 7f11627fc640 1 -- 172.21.15.91:0/1367558288 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f114c003530 con 0x7f116406aa60 2023-11-27T18:14:03.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.949+0000 7f1162ffd640 1 -- 172.21.15.91:0/1367558288 >> v2:172.21.15.91:3300/0 conn(0x7f1164153890 msgr2=0x7f116406edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:03.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.949+0000 7f1162ffd640 1 --2- 172.21.15.91:0/1367558288 >> v2:172.21.15.91:3300/0 conn(0x7f1164153890 0x7f116406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:03.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.949+0000 7f1162ffd640 1 -- 172.21.15.91:0/1367558288 >> v1:172.21.15.94:6789/0 conn(0x7f116406aa60 legacy=0x7f116406d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:03.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.949+0000 7f1162ffd640 1 -- 172.21.15.91:0/1367558288 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f116415cc20 con 0x7f116415a130 2023-11-27T18:14:03.956 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.957+0000 7f1162ffd640 1 --2- 172.21.15.91:0/1367558288 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f116415a130 0x7f116406a520 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f11580097c0 tx=0x7f115801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbb92ec9c67c5643 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:03.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.969+0000 7f11627fc640 1 -- 172.21.15.91:0/1367558288 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11580ab600 con 0x7f116415a130 2023-11-27T18:14:03.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.969+0000 7f11627fc640 1 -- 172.21.15.91:0/1367558288 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11580a7050 con 0x7f116415a130 2023-11-27T18:14:03.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.969+0000 7f11627fc640 1 -- 172.21.15.91:0/1367558288 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11580ab980 con 0x7f116415a130 2023-11-27T18:14:03.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.969+0000 7f1169b54640 1 -- 172.21.15.91:0/1367558288 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f116415a130 msgr2=0x7f116406a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:03.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.969+0000 7f1169b54640 1 --2- 172.21.15.91:0/1367558288 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f116415a130 0x7f116406a520 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f11580097c0 tx=0x7f115801c480 comp rx=0 tx=0).stop 2023-11-27T18:14:03.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.969+0000 7f1169b54640 1 -- 172.21.15.91:0/1367558288 shutdown_connections 2023-11-27T18:14:03.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.969+0000 7f1169b54640 1 --2- 172.21.15.91:0/1367558288 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f116415a130 0x7f116406a520 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:03.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.969+0000 7f1169b54640 1 --2- 172.21.15.91:0/1367558288 >> v2:172.21.15.91:3300/0 conn(0x7f1164153890 0x7f116406edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:03.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.969+0000 7f1169b54640 1 -- 172.21.15.91:0/1367558288 >> 172.21.15.91:0/1367558288 conn(0x7f11640c8aa0 msgr2=0x7f11640c8e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:03.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.969+0000 7f1169b54640 1 -- 172.21.15.91:0/1367558288 shutdown_connections 2023-11-27T18:14:03.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.969+0000 7f1169b54640 1 -- 172.21.15.91:0/1367558288 wait complete. 2023-11-27T18:14:03.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.969+0000 7f1169b54640 1 Processor -- start 2023-11-27T18:14:03.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.969+0000 7f1169b54640 1 -- start start 2023-11-27T18:14:03.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.973+0000 7f1169b54640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f116406aa60 0x7f11640c7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:03.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.973+0000 7f1169b54640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1164153890 0x7f11641493b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:03.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.973+0000 7f1169b54640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f116415a130 0x7f11641498f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:03.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.973+0000 7f1169b54640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1164158800 con 0x7f1164153890 2023-11-27T18:14:03.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.973+0000 7f1169b54640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f116414e730 con 0x7f116406aa60 2023-11-27T18:14:03.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.973+0000 7f1169b54640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11641599f0 con 0x7f116415a130 2023-11-27T18:14:03.970 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.973+0000 7f11637fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f116406aa60 0x7f11640c7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:03.970 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.973+0000 7f1163fff640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f116415a130 0x7f11641498f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:03.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.973+0000 7f11637fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f116406aa60 0x7f11640c7b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.91:58688/0 (socket says 172.21.15.91:58688) 2023-11-27T18:14:03.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.973+0000 7f11637fe640 1 -- 172.21.15.91:0/2247774218 learned_addr learned my addr 172.21.15.91:0/2247774218 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:03.980 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.985+0000 7f11637fe640 1 -- 172.21.15.91:0/2247774218 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f116415a130 msgr2=0x7f11641498f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:03.980 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.985+0000 7f11637fe640 1 --2- 172.21.15.91:0/2247774218 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f116415a130 0x7f11641498f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:03.980 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.985+0000 7f11637fe640 1 -- 172.21.15.91:0/2247774218 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1164153890 msgr2=0x7f11641493b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:03.980 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.985+0000 7f11637fe640 1 --2- 172.21.15.91:0/2247774218 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1164153890 0x7f11641493b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:03.980 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.985+0000 7f11637fe640 1 -- 172.21.15.91:0/2247774218 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1158009420 con 0x7f116406aa60 2023-11-27T18:14:03.987 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.989+0000 7f5fba72f640 1 Processor -- start 2023-11-27T18:14:03.987 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.989+0000 7f5fba72f640 1 -- start start 2023-11-27T18:14:03.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.989+0000 7f11637fe640 1 --2- 172.21.15.91:0/2247774218 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f116406aa60 0x7f11640c7b50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f115400b550 tx=0x7f115400ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:03.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.993+0000 7f5fba72f640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f5fb4153920 0x7f5fb415d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:03.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.993+0000 7f5fba72f640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fb40705c0 con 0x7f5fb40c6e30 2023-11-27T18:14:03.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.993+0000 7f5fba72f640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fb406f6d0 con 0x7f5fb40c7290 2023-11-27T18:14:03.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:03.993+0000 7f5fba72f640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fb40c7720 con 0x7f5fb4153920 2023-11-27T18:14:04.003 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.005+0000 7f5fb3fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f5fb4153920 0x7f5fb415d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:04.003 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.005+0000 7f5fb3fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f5fb4153920 0x7f5fb415d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.91:58694/0 (socket says 172.21.15.91:58694) 2023-11-27T18:14:04.003 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.005+0000 7f5fb3fff640 1 -- 172.21.15.91:0/2567895217 learned_addr learned my addr 172.21.15.91:0/2567895217 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:04.006 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.009+0000 7f114bfff640 1 -- 172.21.15.91:0/2247774218 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1154010870 con 0x7f116406aa60 2023-11-27T18:14:04.006 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.009+0000 7f114bfff640 1 -- 172.21.15.91:0/2247774218 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11540109f0 con 0x7f116406aa60 2023-11-27T18:14:04.006 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.009+0000 7f1169b54640 1 -- 172.21.15.91:0/2247774218 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1164153460 con 0x7f116406aa60 2023-11-27T18:14:04.007 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.009+0000 7f114bfff640 1 -- 172.21.15.91:0/2247774218 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1154010da0 con 0x7f116406aa60 2023-11-27T18:14:04.007 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.009+0000 7f1169b54640 1 -- 172.21.15.91:0/2247774218 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1164158520 con 0x7f116406aa60 2023-11-27T18:14:04.007 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.009+0000 7f1169b54640 1 -- 172.21.15.91:0/2247774218 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1164157fd0 con 0x7f116406aa60 2023-11-27T18:14:04.011 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.013+0000 7f5fb3fff640 1 -- 172.21.15.91:0/2567895217 >> v1:172.21.15.94:6789/0 conn(0x7f5fb40c7290 legacy=0x7f5fb406b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:04.011 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.013+0000 7f5fb3fff640 1 -- 172.21.15.91:0/2567895217 >> v1:172.21.15.91:6789/0 conn(0x7f5fb40c6e30 legacy=0x7f5fb40c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:04.011 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.013+0000 7f5fb3fff640 1 -- 172.21.15.91:0/2567895217 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb406f9b0 con 0x7f5fb4153920 2023-11-27T18:14:04.019 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.021+0000 7f5fb3fff640 1 --2- 172.21.15.91:0/2567895217 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5fb4153920 0x7f5fb415d6e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4009870 tx=0x7f5fa401c400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c21a16b3753be9e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:04.022 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.025+0000 7f31c4527640 1 Processor -- start 2023-11-27T18:14:04.023 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.025+0000 7f31c4527640 1 -- start start 2023-11-27T18:14:04.024 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.029+0000 7f31c4527640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f31bc0c18f0 0x7f31bc157720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:04.024 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.029+0000 7f31c4527640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31bc156f10 con 0x7f31bc14ff60 2023-11-27T18:14:04.024 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.029+0000 7f31c4527640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31bc0c1d00 con 0x7f31bc150340 2023-11-27T18:14:04.024 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.029+0000 7f31c4527640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31bc156080 con 0x7f31bc0c18f0 2023-11-27T18:14:04.024 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-27T18:14:04.138 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.141+0000 7faec8e9e640 1 Processor -- start 2023-11-27T18:14:04.138 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.141+0000 7faec8e9e640 1 -- start start 2023-11-27T18:14:04.138 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.141+0000 7faec8e9e640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faec4153750 0x7faec406a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:04.138 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.141+0000 7faec8e9e640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faec40c75b0 con 0x7faec406f840 2023-11-27T18:14:04.138 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.141+0000 7faec8e9e640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faec40720e0 con 0x7faec4066560 2023-11-27T18:14:04.138 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.141+0000 7faec8e9e640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faec40c7280 con 0x7faec4153750 2023-11-27T18:14:04.139 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.141+0000 7faec259c640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faec4153750 0x7faec406a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:04.139 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.141+0000 7faec259c640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faec4153750 0x7faec406a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.91:41142/0 (socket says 172.21.15.91:41142) 2023-11-27T18:14:04.139 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.141+0000 7faec259c640 1 -- 172.21.15.91:0/3018584168 learned_addr learned my addr 172.21.15.91:0/3018584168 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:04.140 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-27T18:14:04.145 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.149+0000 7faec259c640 1 -- 172.21.15.91:0/3018584168 >> v1:172.21.15.94:6789/0 conn(0x7faec4066560 legacy=0x7faec415d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:04.146 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.149+0000 7faec259c640 1 -- 172.21.15.91:0/3018584168 >> v1:172.21.15.91:6789/0 conn(0x7faec406f840 legacy=0x7faec415cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:04.146 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.149+0000 7faec259c640 1 -- 172.21.15.91:0/3018584168 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec4072380 con 0x7faec4153750 2023-11-27T18:14:04.150 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.153+0000 7faec259c640 1 --2- 172.21.15.91:0/3018584168 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faec4153750 0x7faec406a520 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7faeac0098a0 tx=0x7faeac01ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7998b9684d41cb4 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:04.154 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.157+0000 7fe75affd640 1 -- 172.21.15.91:0/1551954770 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe75c0f0ae0 con 0x7fe764150340 2023-11-27T18:14:04.154 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.157+0000 7fe75affd640 1 -- 172.21.15.91:0/1551954770 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fe75c0ece20 con 0x7fe764150340 2023-11-27T18:14:04.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.165+0000 7faec159a640 1 -- 172.21.15.91:0/3018584168 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeac0a8990 con 0x7faec4153750 2023-11-27T18:14:04.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.165+0000 7faec159a640 1 -- 172.21.15.91:0/3018584168 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeac0a8af0 con 0x7faec4153750 2023-11-27T18:14:04.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.165+0000 7faec159a640 1 -- 172.21.15.91:0/3018584168 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeac0a8e80 con 0x7faec4153750 2023-11-27T18:14:04.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.165+0000 7faec8e9e640 1 -- 172.21.15.91:0/3018584168 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faec4153750 msgr2=0x7faec406a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:04.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.165+0000 7faec8e9e640 1 --2- 172.21.15.91:0/3018584168 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faec4153750 0x7faec406a520 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7faeac0098a0 tx=0x7faeac01ecd0 comp rx=0 tx=0).stop 2023-11-27T18:14:04.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.165+0000 7faec8e9e640 1 -- 172.21.15.91:0/3018584168 shutdown_connections 2023-11-27T18:14:04.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.165+0000 7faec8e9e640 1 --2- 172.21.15.91:0/3018584168 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faec4153750 0x7faec406a520 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:04.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.165+0000 7faec8e9e640 1 -- 172.21.15.91:0/3018584168 >> 172.21.15.91:0/3018584168 conn(0x7faec4071520 msgr2=0x7faec4071930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:04.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.165+0000 7faec8e9e640 1 -- 172.21.15.91:0/3018584168 shutdown_connections 2023-11-27T18:14:04.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.165+0000 7faec8e9e640 1 -- 172.21.15.91:0/3018584168 wait complete. 2023-11-27T18:14:04.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.169+0000 7faec8e9e640 1 Processor -- start 2023-11-27T18:14:04.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.169+0000 7faec8e9e640 1 -- start start 2023-11-27T18:14:04.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.169+0000 7faec8e9e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faec4066560 0x7faec415a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:04.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.169+0000 7faec8e9e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faec406f840 0x7faec4152500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:04.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.169+0000 7faec8e9e640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faec4153750 0x7faec415bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:04.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.169+0000 7faec8e9e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec41e38f0 con 0x7faec406f840 2023-11-27T18:14:04.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.169+0000 7faec8e9e640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec415bb90 con 0x7faec4066560 2023-11-27T18:14:04.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.169+0000 7faec8e9e640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faec4146f90 con 0x7faec4153750 2023-11-27T18:14:04.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.169+0000 7faec2d9d640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faec4153750 0x7faec415bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:04.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.169+0000 7faec2d9d640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faec4153750 0x7faec415bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.91:41150/0 (socket says 172.21.15.91:41150) 2023-11-27T18:14:04.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.169+0000 7faec2d9d640 1 -- 172.21.15.91:0/1122721125 learned_addr learned my addr 172.21.15.91:0/1122721125 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:04.168 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.173+0000 7f31c2ac4640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f31bc0c18f0 0x7f31bc157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:04.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.173+0000 7f31c2ac4640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f31bc0c18f0 0x7f31bc157720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44996/0 (socket says 172.21.15.91:44996) 2023-11-27T18:14:04.170 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.173+0000 7f31c2ac4640 1 -- 172.21.15.91:0/2238663530 learned_addr learned my addr 172.21.15.91:0/2238663530 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:04.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.177+0000 7f31c2ac4640 1 -- 172.21.15.91:0/2238663530 >> v1:172.21.15.94:6789/0 conn(0x7f31bc150340 legacy=0x7f31bc0cbaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:04.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.177+0000 7f31c2ac4640 1 -- 172.21.15.91:0/2238663530 >> v1:172.21.15.91:6789/0 conn(0x7f31bc14ff60 legacy=0x7f31bc06fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:04.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.177+0000 7f31c2ac4640 1 -- 172.21.15.91:0/2238663530 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31bc156300 con 0x7f31bc0c18f0 2023-11-27T18:14:04.177 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.181+0000 7faec2d9d640 1 -- 172.21.15.91:0/1122721125 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faec4066560 msgr2=0x7faec415a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:04.177 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.181+0000 7faec2d9d640 1 --2- 172.21.15.91:0/1122721125 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faec4066560 0x7faec415a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:04.177 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.181+0000 7faec2d9d640 1 -- 172.21.15.91:0/1122721125 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faec406f840 msgr2=0x7faec4152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:04.177 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.181+0000 7faec2d9d640 1 --2- 172.21.15.91:0/1122721125 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faec406f840 0x7faec4152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:04.177 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.181+0000 7faec2d9d640 1 -- 172.21.15.91:0/1122721125 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeac0094d0 con 0x7faec4153750 2023-11-27T18:14:04.182 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.185+0000 7f31c2ac4640 1 --2- 172.21.15.91:0/2238663530 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31bc0c18f0 0x7f31bc157720 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f31b4009e50 tx=0x7f31b401c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eee5cb58a586067 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:04.183 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.185+0000 7faec2d9d640 1 --2- 172.21.15.91:0/1122721125 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faec4153750 0x7faec415bfb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faebc00b9c0 tx=0x7faebc00be80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:04.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.193+0000 7f31c12c1640 1 -- 172.21.15.91:0/2238663530 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b40a5740 con 0x7f31bc0c18f0 2023-11-27T18:14:04.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.193+0000 7f31c12c1640 1 -- 172.21.15.91:0/2238663530 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b40a58a0 con 0x7f31bc0c18f0 2023-11-27T18:14:04.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.193+0000 7f31c12c1640 1 -- 172.21.15.91:0/2238663530 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b40a5c30 con 0x7f31bc0c18f0 2023-11-27T18:14:04.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.193+0000 7f31c4527640 1 -- 172.21.15.91:0/2238663530 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31bc0c18f0 msgr2=0x7f31bc157720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:04.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.193+0000 7f31c4527640 1 --2- 172.21.15.91:0/2238663530 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31bc0c18f0 0x7f31bc157720 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f31b4009e50 tx=0x7f31b401c990 comp rx=0 tx=0).stop 2023-11-27T18:14:04.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.193+0000 7f31c4527640 1 -- 172.21.15.91:0/2238663530 shutdown_connections 2023-11-27T18:14:04.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.193+0000 7f31c4527640 1 --2- 172.21.15.91:0/2238663530 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31bc0c18f0 0x7f31bc157720 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:04.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.193+0000 7f31c4527640 1 -- 172.21.15.91:0/2238663530 >> 172.21.15.91:0/2238663530 conn(0x7f31bc071da0 msgr2=0x7f31bc0721b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:04.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.193+0000 7f31c4527640 1 -- 172.21.15.91:0/2238663530 shutdown_connections 2023-11-27T18:14:04.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.193+0000 7f31c4527640 1 -- 172.21.15.91:0/2238663530 wait complete. 2023-11-27T18:14:04.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.193+0000 7f31c4527640 1 Processor -- start 2023-11-27T18:14:04.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.193+0000 7f31c4527640 1 -- start start 2023-11-27T18:14:04.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.193+0000 7f31c4527640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f31bc0c18f0 0x7f31bc150c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:04.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.193+0000 7f31c4527640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31bc14ff60 0x7f31bc0c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:04.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.193+0000 7f31c4527640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f31bc150340 0x7f31bc0cae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:04.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.193+0000 7f31c4527640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31bc1511a0 con 0x7f31bc14ff60 2023-11-27T18:14:04.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.193+0000 7f31c4527640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31bc15f080 con 0x7f31bc150340 2023-11-27T18:14:04.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.193+0000 7f31c4527640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31bc1f62f0 con 0x7f31bc0c18f0 2023-11-27T18:14:04.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.197+0000 7f31c1ac2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31bc14ff60 0x7f31bc0c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:04.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.197+0000 7f31c1ac2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31bc14ff60 0x7f31bc0c8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:45016/0 (socket says 172.21.15.91:45016) 2023-11-27T18:14:04.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.197+0000 7f31c1ac2640 1 -- 172.21.15.91:0/3398786245 learned_addr learned my addr 172.21.15.91:0/3398786245 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:04.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.197+0000 7f31c1ac2640 1 -- 172.21.15.91:0/3398786245 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f31bc0c18f0 msgr2=0x7f31bc150c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:04.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.197+0000 7f31c1ac2640 1 --2- 172.21.15.91:0/3398786245 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f31bc0c18f0 0x7f31bc150c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:04.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.197+0000 7f31c1ac2640 1 -- 172.21.15.91:0/3398786245 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f31bc150340 msgr2=0x7f31bc0cae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:04.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.197+0000 7f31c1ac2640 1 --2- 172.21.15.91:0/3398786245 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f31bc150340 0x7f31bc0cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:04.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.201+0000 7f31c1ac2640 1 -- 172.21.15.91:0/3398786245 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b4009b30 con 0x7f31bc14ff60 2023-11-27T18:14:04.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.201+0000 7f31c1ac2640 1 --2- 172.21.15.91:0/3398786245 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31bc14ff60 0x7f31bc0c8660 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f31ac00c490 tx=0x7f31ac001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:04.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.205+0000 7faebaffd640 1 -- 172.21.15.91:0/1122721125 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faebc00cba0 con 0x7faec4153750 2023-11-27T18:14:04.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.205+0000 7faebaffd640 1 -- 172.21.15.91:0/1122721125 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faebc00cd00 con 0x7faec4153750 2023-11-27T18:14:04.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.205+0000 7faebaffd640 1 -- 172.21.15.91:0/1122721125 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faebc014680 con 0x7faec4153750 2023-11-27T18:14:04.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.205+0000 7faec8e9e640 1 -- 172.21.15.91:0/1122721125 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faec41e2d70 con 0x7faec4153750 2023-11-27T18:14:04.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.205+0000 7faec8e9e640 1 -- 172.21.15.91:0/1122721125 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faec41e3330 con 0x7faec4153750 2023-11-27T18:14:04.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.205+0000 7faec8e9e640 1 -- 172.21.15.91:0/1122721125 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faec415b8f0 con 0x7faec4153750 2023-11-27T18:14:04.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.205+0000 7f31b2ffd640 1 -- 172.21.15.91:0/3398786245 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ac003600 con 0x7f31bc14ff60 2023-11-27T18:14:04.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.205+0000 7f31b2ffd640 1 -- 172.21.15.91:0/3398786245 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31ac003780 con 0x7f31bc14ff60 2023-11-27T18:14:04.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.205+0000 7f31b2ffd640 1 -- 172.21.15.91:0/3398786245 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ac003b70 con 0x7f31bc14ff60 2023-11-27T18:14:04.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.205+0000 7f31c4527640 1 -- 172.21.15.91:0/3398786245 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31bc15f340 con 0x7f31bc14ff60 2023-11-27T18:14:04.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.205+0000 7f31c4527640 1 -- 172.21.15.91:0/3398786245 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31bc15f900 con 0x7f31bc14ff60 2023-11-27T18:14:04.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.209+0000 7f31c4527640 1 -- 172.21.15.91:0/3398786245 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31bc06f9b0 con 0x7f31bc14ff60 2023-11-27T18:14:04.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.257+0000 7f8ab6614640 1 Processor -- start 2023-11-27T18:14:04.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.257+0000 7f8ab6614640 1 -- start start 2023-11-27T18:14:04.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.257+0000 7f8ab6614640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f8ab006ad20 0x7f8ab00700f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:04.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.257+0000 7f8ab6614640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8ab00c2a80 0x7f8ab00c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:04.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.257+0000 7f8ab6614640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ab00707a0 con 0x7f8ab01539c0 2023-11-27T18:14:04.255 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.257+0000 7f8ab6614640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ab015d7b0 con 0x7f8ab006ad20 2023-11-27T18:14:04.255 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.257+0000 7f8ab6614640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ab00c1790 con 0x7f8ab00c2a80 2023-11-27T18:14:04.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.317+0000 7fe76c4b5640 1 -- 172.21.15.91:0/1551954770 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fe7641600b0 con 0x7fe764150340 2023-11-27T18:14:04.324 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-27T18:14:04.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.345+0000 7f114bfff640 1 -- 172.21.15.91:0/2247774218 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f1154023480 con 0x7f116406aa60 2023-11-27T18:14:04.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.345+0000 7f114bfff640 1 --2- 172.21.15.91:0/2247774218 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f1150066840 0x7f1150068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:04.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.345+0000 7f1162ffd640 1 --2- 172.21.15.91:0/2247774218 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f1150066840 0x7f1150068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:04.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.345+0000 7f1162ffd640 1 --2- 172.21.15.91:0/2247774218 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f1150066840 0x7f1150068d00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f11580ad000 tx=0x7f1158004740 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:04.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.349+0000 7f114bfff640 1 -- 172.21.15.91:0/2247774218 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f11540554b0 con 0x7f116406aa60 2023-11-27T18:14:04.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.369+0000 7f114bfff640 1 -- 172.21.15.91:0/2247774218 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f11540517f0 con 0x7f116406aa60 2023-11-27T18:14:04.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.381+0000 7f5fb2ffd640 1 -- 172.21.15.91:0/2567895217 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa40ab600 con 0x7f5fb4153920 2023-11-27T18:14:04.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.381+0000 7f5fb2ffd640 1 -- 172.21.15.91:0/2567895217 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa40ab760 con 0x7f5fb4153920 2023-11-27T18:14:04.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.381+0000 7f5fb2ffd640 1 -- 172.21.15.91:0/2567895217 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa40abaf0 con 0x7f5fb4153920 2023-11-27T18:14:04.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.381+0000 7f5fba72f640 1 -- 172.21.15.91:0/2567895217 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5fb4153920 msgr2=0x7f5fb415d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:04.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.381+0000 7f5fba72f640 1 --2- 172.21.15.91:0/2567895217 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5fb4153920 0x7f5fb415d6e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4009870 tx=0x7f5fa401c400 comp rx=0 tx=0).stop 2023-11-27T18:14:04.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.381+0000 7f5fba72f640 1 -- 172.21.15.91:0/2567895217 shutdown_connections 2023-11-27T18:14:04.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.381+0000 7f5fba72f640 1 --2- 172.21.15.91:0/2567895217 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5fb4153920 0x7f5fb415d6e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:04.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.381+0000 7f5fba72f640 1 -- 172.21.15.91:0/2567895217 >> 172.21.15.91:0/2567895217 conn(0x7f5fb4071ef0 msgr2=0x7f5fb4072300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:04.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.385+0000 7f5fba72f640 1 -- 172.21.15.91:0/2567895217 shutdown_connections 2023-11-27T18:14:04.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.385+0000 7f5fba72f640 1 -- 172.21.15.91:0/2567895217 wait complete. 2023-11-27T18:14:04.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.385+0000 7f5fba72f640 1 Processor -- start 2023-11-27T18:14:04.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.385+0000 7f5fba72f640 1 -- start start 2023-11-27T18:14:04.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.385+0000 7f5fba72f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5fb40c6e30 0x7f5fb4157d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:04.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.385+0000 7f5fba72f640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5fb40c7290 0x7f5fb40cad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:04.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.385+0000 7f5fba72f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5fb4153920 0x7f5fb40cb280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:04.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.385+0000 7f5fba72f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb4158d10 con 0x7f5fb40c6e30 2023-11-27T18:14:04.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.385+0000 7f5fba72f640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb4158ff0 con 0x7f5fb4153920 2023-11-27T18:14:04.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.385+0000 7f5fba72f640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb40c3a00 con 0x7f5fb40c7290 2023-11-27T18:14:04.387 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.389+0000 7f8aaffff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f8ab01539c0 0x7f8ab00cbb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.91:58446/0 (socket says 172.21.15.91:58446) 2023-11-27T18:14:04.387 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.389+0000 7f8aaffff640 1 -- 172.21.15.91:0/2493011207 learned_addr learned my addr 172.21.15.91:0/2493011207 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:14:04.389 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.393+0000 7f8ab4bb1640 1 --2- 172.21.15.91:0/2493011207 >> v2:172.21.15.94:3300/0 conn(0x7f8ab00c2a80 0x7f8ab00c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:04.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.393+0000 7f5fb8ccc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5fb4153920 0x7f5fb40cb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:04.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.397+0000 7f8ab4bb1640 1 -- 172.21.15.91:0/2493011207 >> v2:172.21.15.91:3300/0 conn(0x7f8ab006ad20 msgr2=0x7f8ab00700f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:04.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.397+0000 7f8ab4bb1640 1 --2- 172.21.15.91:0/2493011207 >> v2:172.21.15.91:3300/0 conn(0x7f8ab006ad20 0x7f8ab00700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:04.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.397+0000 7f8ab4bb1640 1 -- 172.21.15.91:0/2493011207 >> v1:172.21.15.94:6789/0 conn(0x7f8ab01539c0 legacy=0x7f8ab00cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:04.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.397+0000 7f8ab4bb1640 1 -- 172.21.15.91:0/2493011207 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab015cb30 con 0x7f8ab00c2a80 2023-11-27T18:14:04.397 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.401+0000 7f5fb8ccc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5fb4153920 0x7f5fb40cb280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.91:58728/0 (socket says 172.21.15.91:58728) 2023-11-27T18:14:04.397 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.401+0000 7f5fb8ccc640 1 -- 172.21.15.91:0/3778555872 learned_addr learned my addr 172.21.15.91:0/3778555872 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:04.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.417+0000 7f5fb8ccc640 1 -- 172.21.15.91:0/3778555872 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5fb40c7290 msgr2=0x7f5fb40cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:04.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.417+0000 7f5fb8ccc640 1 --2- 172.21.15.91:0/3778555872 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5fb40c7290 0x7f5fb40cad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:04.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.417+0000 7f5fb8ccc640 1 -- 172.21.15.91:0/3778555872 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5fb40c6e30 msgr2=0x7f5fb4157d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:04.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.417+0000 7f5fb8ccc640 1 --2- 172.21.15.91:0/3778555872 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5fb40c6e30 0x7f5fb4157d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:04.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.417+0000 7f5fb8ccc640 1 -- 172.21.15.91:0/3778555872 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa40094d0 con 0x7f5fb4153920 2023-11-27T18:14:04.415 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.417+0000 7f5fb8ccc640 1 --2- 172.21.15.91:0/3778555872 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5fb4153920 0x7f5fb40cb280 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5fac00c780 tx=0x7f5fac00cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:04.420 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:14:04.422 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:14:04.433 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.437+0000 7f2b73bac640 1 Processor -- start 2023-11-27T18:14:04.433 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.437+0000 7f2b73bac640 1 -- start start 2023-11-27T18:14:04.434 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.437+0000 7f8ab4bb1640 1 --2- 172.21.15.91:0/2493011207 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8ab00c2a80 0x7f8ab00c84b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8ab00c9a30 tx=0x7f8aa801c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95db67c81789bd12 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:04.435 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.437+0000 7f2b73bac640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f2b6c156370 0x7f2b6c06fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:04.435 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.437+0000 7f2b73bac640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b6c0c7820 con 0x7f2b6c0c5f80 2023-11-27T18:14:04.437 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.437+0000 7f2b73bac640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b6c0c6ae0 con 0x7f2b6c14ffb0 2023-11-27T18:14:04.437 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.437+0000 7f2b73bac640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b6c156c50 con 0x7f2b6c156370 2023-11-27T18:14:04.441 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.445+0000 7f5fb0ff9640 1 -- 172.21.15.91:0/3778555872 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fac003d90 con 0x7f5fb4153920 2023-11-27T18:14:04.441 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.445+0000 7f5fb0ff9640 1 -- 172.21.15.91:0/3778555872 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fac00ce90 con 0x7f5fb4153920 2023-11-27T18:14:04.441 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.445+0000 7f5fb0ff9640 1 -- 172.21.15.91:0/3778555872 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fac0052b0 con 0x7f5fb4153920 2023-11-27T18:14:04.442 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.445+0000 7f5fba72f640 1 -- 172.21.15.91:0/3778555872 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fb40c3ce0 con 0x7f5fb4153920 2023-11-27T18:14:04.442 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.445+0000 7f5fba72f640 1 -- 172.21.15.91:0/3778555872 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fb4158240 con 0x7f5fb4153920 2023-11-27T18:14:04.443 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.445+0000 7f5fba72f640 1 -- 172.21.15.91:0/3778555872 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fb40c3860 con 0x7f5fb4153920 2023-11-27T18:14:04.444 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.449+0000 7f8aaeffd640 1 -- 172.21.15.91:0/2493011207 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa80a5910 con 0x7f8ab00c2a80 2023-11-27T18:14:04.444 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.449+0000 7f8aaeffd640 1 -- 172.21.15.91:0/2493011207 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa80a5a70 con 0x7f8ab00c2a80 2023-11-27T18:14:04.444 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.449+0000 7f8aaeffd640 1 -- 172.21.15.91:0/2493011207 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa80a5e00 con 0x7f8ab00c2a80 2023-11-27T18:14:04.445 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.449+0000 7f8ab6614640 1 -- 172.21.15.91:0/2493011207 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8ab00c2a80 msgr2=0x7f8ab00c84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:04.445 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.449+0000 7f8ab6614640 1 --2- 172.21.15.91:0/2493011207 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8ab00c2a80 0x7f8ab00c84b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8ab00c9a30 tx=0x7f8aa801c850 comp rx=0 tx=0).stop 2023-11-27T18:14:04.445 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.449+0000 7f8ab6614640 1 -- 172.21.15.91:0/2493011207 shutdown_connections 2023-11-27T18:14:04.445 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.449+0000 7f8ab6614640 1 --2- 172.21.15.91:0/2493011207 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8ab00c2a80 0x7f8ab00c84b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:04.445 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.449+0000 7f8ab6614640 1 --2- 172.21.15.91:0/2493011207 >> v2:172.21.15.91:3300/0 conn(0x7f8ab006ad20 0x7f8ab00700f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:04.445 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.449+0000 7f8ab6614640 1 -- 172.21.15.91:0/2493011207 >> 172.21.15.91:0/2493011207 conn(0x7f8ab0071da0 msgr2=0x7f8ab00721b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:04.445 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.449+0000 7f8ab6614640 1 -- 172.21.15.91:0/2493011207 shutdown_connections 2023-11-27T18:14:04.445 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.449+0000 7f8ab6614640 1 -- 172.21.15.91:0/2493011207 wait complete. 2023-11-27T18:14:04.446 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.449+0000 7f2b71948640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f2b6c14ffb0 0x7f2b6c072310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.91:58450/0 (socket says 172.21.15.91:58450) 2023-11-27T18:14:04.446 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.449+0000 7f2b71948640 1 -- 172.21.15.91:0/1758401973 learned_addr learned my addr 172.21.15.91:0/1758401973 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:14:04.446 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.449+0000 7f8ab6614640 1 Processor -- start 2023-11-27T18:14:04.447 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.449+0000 7f8ab6614640 1 -- start start 2023-11-27T18:14:04.447 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.449+0000 7f8ab6614640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8ab006ad20 0x7f8ab00c5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:04.447 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.449+0000 7f8ab6614640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8ab00c2a80 0x7f8ab01577d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:04.447 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.449+0000 7f8ab6614640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8ab01539c0 0x7f8ab0157d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:04.447 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.449+0000 7f8ab6614640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab0158eb0 con 0x7f8ab006ad20 2023-11-27T18:14:04.447 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.449+0000 7f8ab6614640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab015a310 con 0x7f8ab00c2a80 2023-11-27T18:14:04.447 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.449+0000 7f8ab6614640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab0156760 con 0x7f8ab01539c0 2023-11-27T18:14:04.451 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.453+0000 7f31b2ffd640 1 -- 172.21.15.91:0/3398786245 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f31ac003cd0 con 0x7f31bc14ff60 2023-11-27T18:14:04.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.457+0000 7f31b2ffd640 1 --2- 172.21.15.91:0/3398786245 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f31a0066820 0x7f31a0068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:04.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.457+0000 7f31c22c3640 1 --2- 172.21.15.91:0/3398786245 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f31a0066820 0x7f31a0068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:04.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.457+0000 7f31c22c3640 1 --2- 172.21.15.91:0/3398786245 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f31a0066820 0x7f31a0068ce0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f31b8003cf0 tx=0x7f31b80079c0 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:04.464 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.469+0000 7f31b2ffd640 1 -- 172.21.15.91:0/3398786245 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f31ac054ae0 con 0x7f31bc14ff60 2023-11-27T18:14:04.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.469+0000 7f31b2ffd640 1 -- 172.21.15.91:0/3398786245 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f31ac050720 con 0x7f31bc14ff60 2023-11-27T18:14:04.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.473+0000 7fe75affd640 1 -- 172.21.15.91:0/1551954770 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe7641600b0 con 0x7fe764150340 2023-11-27T18:14:04.470 INFO:teuthology.orchestra.run.smithi091.stdout:68719476756 2023-11-27T18:14:04.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.477+0000 7fe76c4b5640 1 -- 172.21.15.91:0/1551954770 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe748066820 msgr2=0x7fe748068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:04.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.477+0000 7fe76c4b5640 1 --2- 172.21.15.91:0/1551954770 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe748066820 0x7fe748068ce0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe760009a50 tx=0x7fe760009210 comp rx=0 tx=0).stop 2023-11-27T18:14:04.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.477+0000 7fe76c4b5640 1 -- 172.21.15.91:0/1551954770 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe764150340 msgr2=0x7fe76414d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:04.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.477+0000 7fe76c4b5640 1 --2- 172.21.15.91:0/1551954770 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe764150340 0x7fe76414d940 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe75c0ab000 tx=0x7fe75c0197b0 comp rx=0 tx=0).stop 2023-11-27T18:14:04.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.477+0000 7fe76c4b5640 1 -- 172.21.15.91:0/1551954770 shutdown_connections 2023-11-27T18:14:04.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.477+0000 7fe76c4b5640 1 --2- 172.21.15.91:0/1551954770 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe748066820 0x7fe748068ce0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:04.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.477+0000 7fe76c4b5640 1 --2- 172.21.15.91:0/1551954770 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe764150340 0x7fe76414d940 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:04.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.477+0000 7fe76c4b5640 1 --2- 172.21.15.91:0/1551954770 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe76414ff60 0x7fe7640c8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:04.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.477+0000 7fe76c4b5640 1 --2- 172.21.15.91:0/1551954770 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe7640cbaf0 0x7fe76406a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:04.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.477+0000 7fe76c4b5640 1 -- 172.21.15.91:0/1551954770 >> 172.21.15.91:0/1551954770 conn(0x7fe764071da0 msgr2=0x7fe7640cbed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:04.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.477+0000 7fe76c4b5640 1 -- 172.21.15.91:0/1551954770 shutdown_connections 2023-11-27T18:14:04.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.477+0000 7fe76c4b5640 1 -- 172.21.15.91:0/1551954770 wait complete. 2023-11-27T18:14:04.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.477+0000 7f8aaffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8ab006ad20 0x7f8ab00c5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:04.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.477+0000 7f2b72149640 1 --2- 172.21.15.91:0/1758401973 >> v2:172.21.15.91:3300/0 conn(0x7f2b6c156370 0x7f2b6c06fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:04.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.477+0000 7f8aaffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8ab006ad20 0x7f8ab00c5290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:45042/0 (socket says 172.21.15.91:45042) 2023-11-27T18:14:04.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.477+0000 7f8aaffff640 1 -- 172.21.15.91:0/3997748880 learned_addr learned my addr 172.21.15.91:0/3997748880 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:04.479 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.481+0000 7f2b72149640 1 -- 172.21.15.91:0/1758401973 >> v1:172.21.15.94:6789/0 conn(0x7f2b6c14ffb0 legacy=0x7f2b6c072310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:04.479 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.481+0000 7f2b72149640 1 -- 172.21.15.91:0/1758401973 >> v1:172.21.15.91:6789/0 conn(0x7f2b6c0c5f80 legacy=0x7f2b6c155c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:04.480 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.481+0000 7f2b72149640 1 -- 172.21.15.91:0/1758401973 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b6c156990 con 0x7f2b6c156370 2023-11-27T18:14:04.485 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.489+0000 7f8aaffff640 1 -- 172.21.15.91:0/3997748880 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8ab01539c0 msgr2=0x7f8ab0157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:04.485 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.489+0000 7f8aaffff640 1 --2- 172.21.15.91:0/3997748880 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8ab01539c0 0x7f8ab0157d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:04.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.489+0000 7f8aaffff640 1 -- 172.21.15.91:0/3997748880 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8ab00c2a80 msgr2=0x7f8ab01577d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:04.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.489+0000 7f8aaffff640 1 --2- 172.21.15.91:0/3997748880 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8ab00c2a80 0x7f8ab01577d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:04.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.489+0000 7f8aaffff640 1 -- 172.21.15.91:0/3997748880 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa8009a70 con 0x7f8ab006ad20 2023-11-27T18:14:04.487 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.489+0000 7f2b72149640 1 --2- 172.21.15.91:0/1758401973 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2b6c156370 0x7f2b6c06fe60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2b6400aea0 tx=0x7f2b6401d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c38c824f6d4f70e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:04.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.493+0000 7f8aaffff640 1 --2- 172.21.15.91:0/3997748880 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8ab006ad20 0x7f8ab00c5290 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8aa000c400 tx=0x7f8aa000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:04.491 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476757 got 68719476756 for osd.5 2023-11-27T18:14:04.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.497+0000 7f2b70946640 1 -- 172.21.15.91:0/1758401973 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6400a2d0 con 0x7f2b6c156370 2023-11-27T18:14:04.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.497+0000 7f2b70946640 1 -- 172.21.15.91:0/1758401973 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b640a6630 con 0x7f2b6c156370 2023-11-27T18:14:04.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.497+0000 7f2b70946640 1 -- 172.21.15.91:0/1758401973 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b640a69c0 con 0x7f2b6c156370 2023-11-27T18:14:04.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.497+0000 7f2b73bac640 1 -- 172.21.15.91:0/1758401973 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2b6c156370 msgr2=0x7f2b6c06fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:04.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.497+0000 7f2b73bac640 1 --2- 172.21.15.91:0/1758401973 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2b6c156370 0x7f2b6c06fe60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2b6400aea0 tx=0x7f2b6401d9d0 comp rx=0 tx=0).stop 2023-11-27T18:14:04.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.497+0000 7f2b73bac640 1 -- 172.21.15.91:0/1758401973 shutdown_connections 2023-11-27T18:14:04.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.497+0000 7f2b73bac640 1 --2- 172.21.15.91:0/1758401973 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2b6c156370 0x7f2b6c06fe60 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:04.496 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.497+0000 7f2b73bac640 1 -- 172.21.15.91:0/1758401973 >> 172.21.15.91:0/1758401973 conn(0x7f2b6c071820 msgr2=0x7f2b6c071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:04.496 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.497+0000 7f2b73bac640 1 -- 172.21.15.91:0/1758401973 shutdown_connections 2023-11-27T18:14:04.496 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.497+0000 7f2b73bac640 1 -- 172.21.15.91:0/1758401973 wait complete. 2023-11-27T18:14:04.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.501+0000 7f2b73bac640 1 Processor -- start 2023-11-27T18:14:04.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.501+0000 7f2b73bac640 1 -- start start 2023-11-27T18:14:04.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.501+0000 7f2b73bac640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2b6c0c5f80 0x7f2b6c142b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:04.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.501+0000 7f2b73bac640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2b6c14ffb0 0x7f2b6c1f0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:04.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.501+0000 7f2b73bac640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2b6c156370 0x7f2b6c13d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:04.499 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.501+0000 7f2b73bac640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6c140530 con 0x7f2b6c156370 2023-11-27T18:14:04.499 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.501+0000 7f2b73bac640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6c13e2c0 con 0x7f2b6c0c5f80 2023-11-27T18:14:04.499 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.501+0000 7f2b73bac640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6c06f370 con 0x7f2b6c14ffb0 2023-11-27T18:14:04.502 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.505+0000 7f8aacff9640 1 -- 172.21.15.91:0/3997748880 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa0005cf0 con 0x7f8ab006ad20 2023-11-27T18:14:04.502 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.505+0000 7f8aacff9640 1 -- 172.21.15.91:0/3997748880 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa0005e50 con 0x7f8ab006ad20 2023-11-27T18:14:04.502 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.505+0000 7f8ab6614640 1 -- 172.21.15.91:0/3997748880 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ab0159d30 con 0x7f8ab006ad20 2023-11-27T18:14:04.503 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.505+0000 7f8aacff9640 1 -- 172.21.15.91:0/3997748880 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa00072d0 con 0x7f8ab006ad20 2023-11-27T18:14:04.503 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.505+0000 7f8ab6614640 1 -- 172.21.15.91:0/3997748880 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ab0156ca0 con 0x7f8ab006ad20 2023-11-27T18:14:04.503 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.505+0000 7f8ab6614640 1 -- 172.21.15.91:0/3997748880 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ab004e850 con 0x7f8ab006ad20 2023-11-27T18:14:04.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.513+0000 7f2b72149640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2b6c156370 0x7f2b6c13d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:04.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.525+0000 7f8aacff9640 1 -- 172.21.15.91:0/3997748880 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f8aa0007430 con 0x7f8ab006ad20 2023-11-27T18:14:04.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.529+0000 7f8aacff9640 1 --2- 172.21.15.91:0/3997748880 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f8a9c066840 0x7f8a9c068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:04.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.529+0000 7f8aaf7fe640 1 --2- 172.21.15.91:0/3997748880 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f8a9c066840 0x7f8a9c068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:04.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.529+0000 7f8aaf7fe640 1 --2- 172.21.15.91:0/3997748880 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f8a9c066840 0x7f8a9c068d00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8ab015a550 tx=0x7f8aa4006ca0 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:04.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.529+0000 7f2b72149640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2b6c156370 0x7f2b6c13d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:45046/0 (socket says 172.21.15.91:45046) 2023-11-27T18:14:04.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.529+0000 7f2b72149640 1 -- 172.21.15.91:0/2196805517 learned_addr learned my addr 172.21.15.91:0/2196805517 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:04.575 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.577+0000 7faebaffd640 1 -- 172.21.15.91:0/1122721125 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7faebc003980 con 0x7faec4153750 2023-11-27T18:14:04.575 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.577+0000 7faebaffd640 1 --2- 172.21.15.91:0/1122721125 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7faea4066870 0x7faea4068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:04.576 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.581+0000 7faec259c640 1 --2- 172.21.15.91:0/1122721125 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7faea4066870 0x7faea4068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:04.576 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.581+0000 7faec259c640 1 --2- 172.21.15.91:0/1122721125 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7faea4066870 0x7faea4068d30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7faeac0b2000 tx=0x7faeac004740 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:04.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.589+0000 7faebaffd640 1 -- 172.21.15.91:0/1122721125 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7faebc0552d0 con 0x7faec4153750 2023-11-27T18:14:04.611 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.613+0000 7f1169b54640 1 -- 172.21.15.91:0/2247774218 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f116404e850 con 0x7f116406aa60 2023-11-27T18:14:04.617 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.621+0000 7faebaffd640 1 -- 172.21.15.91:0/1122721125 <== mon.2 v2:172.21.15.94:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7faebc050f10 con 0x7faec4153750 2023-11-27T18:14:04.621 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.625+0000 7f2b71147640 1 --2- 172.21.15.91:0/2196805517 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2b6c14ffb0 0x7f2b6c1f0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:04.642 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.645+0000 7f2b71147640 1 -- 172.21.15.91:0/2196805517 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2b6c0c5f80 msgr2=0x7f2b6c142b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:04.642 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.645+0000 7f2b71147640 1 --2- 172.21.15.91:0/2196805517 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2b6c0c5f80 0x7f2b6c142b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:04.642 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.645+0000 7f2b71147640 1 -- 172.21.15.91:0/2196805517 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2b6c156370 msgr2=0x7f2b6c13d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:04.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.645+0000 7f2b71147640 1 --2- 172.21.15.91:0/2196805517 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2b6c156370 0x7f2b6c13d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:04.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.645+0000 7f2b71147640 1 -- 172.21.15.91:0/2196805517 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b6400ab80 con 0x7f2b6c14ffb0 2023-11-27T18:14:04.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.649+0000 7f2b71147640 1 --2- 172.21.15.91:0/2196805517 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2b6c14ffb0 0x7f2b6c1f0e90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c00b440 tx=0x7f2b5c00b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:04.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.661+0000 7f2b627fc640 1 -- 172.21.15.91:0/2196805517 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5c011830 con 0x7f2b6c14ffb0 2023-11-27T18:14:04.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.661+0000 7f2b627fc640 1 -- 172.21.15.91:0/2196805517 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b5c0119b0 con 0x7f2b6c14ffb0 2023-11-27T18:14:04.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.661+0000 7f2b627fc640 1 -- 172.21.15.91:0/2196805517 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5c011d60 con 0x7f2b6c14ffb0 2023-11-27T18:14:04.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.661+0000 7f2b73bac640 1 -- 172.21.15.91:0/2196805517 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b6c13e840 con 0x7f2b6c14ffb0 2023-11-27T18:14:04.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.661+0000 7f2b73bac640 1 -- 172.21.15.91:0/2196805517 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b6c06f5c0 con 0x7f2b6c14ffb0 2023-11-27T18:14:04.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.661+0000 7f2b73bac640 1 -- 172.21.15.91:0/2196805517 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b6c04e850 con 0x7f2b6c14ffb0 2023-11-27T18:14:04.693 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.697+0000 7f31c4527640 1 -- 172.21.15.91:0/3398786245 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f31bc04e850 con 0x7f31bc14ff60 2023-11-27T18:14:04.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.757+0000 7f5fb0ff9640 1 -- 172.21.15.91:0/3778555872 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f5fac005410 con 0x7f5fb4153920 2023-11-27T18:14:04.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.757+0000 7f5fb0ff9640 1 --2- 172.21.15.91:0/3778555872 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f5fa0066840 0x7f5fa0068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:04.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.757+0000 7f5fb3fff640 1 --2- 172.21.15.91:0/3778555872 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f5fa0066840 0x7f5fa0068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:04.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.757+0000 7f5fb3fff640 1 --2- 172.21.15.91:0/3778555872 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f5fa0066840 0x7f5fa0068d00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5fa40af000 tx=0x7f5fa4008040 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:04.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.769+0000 7f5fb0ff9640 1 -- 172.21.15.91:0/3778555872 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5fac0552e0 con 0x7f5fb4153920 2023-11-27T18:14:04.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.785+0000 7f8aacff9640 1 -- 172.21.15.91:0/3997748880 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8aa0054e70 con 0x7f8ab006ad20 2023-11-27T18:14:04.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.785+0000 7f8aacff9640 1 -- 172.21.15.91:0/3997748880 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f8aa00511b0 con 0x7f8ab006ad20 2023-11-27T18:14:04.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.789+0000 7faec8e9e640 1 -- 172.21.15.91:0/1122721125 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7faec40c7a20 con 0x7faec4153750 2023-11-27T18:14:04.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.801+0000 7f5fb0ff9640 1 -- 172.21.15.91:0/3778555872 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f5fac050f20 con 0x7f5fb4153920 2023-11-27T18:14:04.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.813+0000 7f114bfff640 1 -- 172.21.15.91:0/2247774218 <== mon.1 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f115401e020 con 0x7f116406aa60 2023-11-27T18:14:04.811 INFO:teuthology.orchestra.run.smithi091.stdout:64424509460 2023-11-27T18:14:04.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.817+0000 7f1169b54640 1 -- 172.21.15.91:0/2247774218 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f1150066840 msgr2=0x7f1150068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:04.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.817+0000 7f1169b54640 1 --2- 172.21.15.91:0/2247774218 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f1150066840 0x7f1150068d00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f11580ad000 tx=0x7f1158004740 comp rx=0 tx=0).stop 2023-11-27T18:14:04.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.817+0000 7f1169b54640 1 -- 172.21.15.91:0/2247774218 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f116406aa60 msgr2=0x7f11640c7b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:04.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.817+0000 7f1169b54640 1 --2- 172.21.15.91:0/2247774218 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f116406aa60 0x7f11640c7b50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f115400b550 tx=0x7f115400ba10 comp rx=0 tx=0).stop 2023-11-27T18:14:04.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.817+0000 7f1169b54640 1 -- 172.21.15.91:0/2247774218 shutdown_connections 2023-11-27T18:14:04.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.817+0000 7f1169b54640 1 --2- 172.21.15.91:0/2247774218 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f1150066840 0x7f1150068d00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:04.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.817+0000 7f1169b54640 1 --2- 172.21.15.91:0/2247774218 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f116415a130 0x7f11641498f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:04.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.817+0000 7f1169b54640 1 --2- 172.21.15.91:0/2247774218 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1164153890 0x7f11641493b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:04.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.817+0000 7f1169b54640 1 --2- 172.21.15.91:0/2247774218 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f116406aa60 0x7f11640c7b50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:04.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.817+0000 7f1169b54640 1 -- 172.21.15.91:0/2247774218 >> 172.21.15.91:0/2247774218 conn(0x7f11640c8aa0 msgr2=0x7f116406d500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:04.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.817+0000 7f1169b54640 1 -- 172.21.15.91:0/2247774218 shutdown_connections 2023-11-27T18:14:04.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.817+0000 7f1169b54640 1 -- 172.21.15.91:0/2247774218 wait complete. 2023-11-27T18:14:04.836 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509461 got 64424509460 for osd.4 2023-11-27T18:14:04.900 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-27T18:14:04.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.905+0000 7f31b2ffd640 1 -- 172.21.15.91:0/3398786245 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f31ac017070 con 0x7f31bc14ff60 2023-11-27T18:14:04.903 INFO:teuthology.orchestra.run.smithi091.stdout:68719476756 2023-11-27T18:14:04.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.909+0000 7f31c4527640 1 -- 172.21.15.91:0/3398786245 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f31a0066820 msgr2=0x7f31a0068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:04.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.909+0000 7f31c4527640 1 --2- 172.21.15.91:0/3398786245 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f31a0066820 0x7f31a0068ce0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f31b8003cf0 tx=0x7f31b80079c0 comp rx=0 tx=0).stop 2023-11-27T18:14:04.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.909+0000 7f31c4527640 1 -- 172.21.15.91:0/3398786245 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31bc14ff60 msgr2=0x7f31bc0c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:04.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.909+0000 7f31c4527640 1 --2- 172.21.15.91:0/3398786245 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31bc14ff60 0x7f31bc0c8660 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f31ac00c490 tx=0x7f31ac001e80 comp rx=0 tx=0).stop 2023-11-27T18:14:04.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.909+0000 7f31c4527640 1 -- 172.21.15.91:0/3398786245 shutdown_connections 2023-11-27T18:14:04.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.909+0000 7f31c4527640 1 --2- 172.21.15.91:0/3398786245 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f31a0066820 0x7f31a0068ce0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:04.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.909+0000 7f31c4527640 1 --2- 172.21.15.91:0/3398786245 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f31bc150340 0x7f31bc0cae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:04.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.909+0000 7f31c4527640 1 --2- 172.21.15.91:0/3398786245 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31bc14ff60 0x7f31bc0c8660 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:04.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.909+0000 7f31c4527640 1 --2- 172.21.15.91:0/3398786245 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f31bc0c18f0 0x7f31bc150c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:04.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.909+0000 7f31c4527640 1 -- 172.21.15.91:0/3398786245 >> 172.21.15.91:0/3398786245 conn(0x7f31bc071da0 msgr2=0x7f31bc155660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:04.907 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.909+0000 7f31c4527640 1 -- 172.21.15.91:0/3398786245 shutdown_connections 2023-11-27T18:14:04.907 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.909+0000 7f31c4527640 1 -- 172.21.15.91:0/3398786245 wait complete. 2023-11-27T18:14:04.923 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476757 got 68719476756 for osd.0 2023-11-27T18:14:04.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.957+0000 7f8ab6614640 1 -- 172.21.15.91:0/3997748880 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8ab00c7e10 con 0x7f8ab006ad20 2023-11-27T18:14:04.956 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.961+0000 7f8aacff9640 1 -- 172.21.15.91:0/3997748880 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8aa0021020 con 0x7f8ab006ad20 2023-11-27T18:14:04.956 INFO:teuthology.orchestra.run.smithi091.stdout:68719476755 2023-11-27T18:14:04.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.961+0000 7f8ab6614640 1 -- 172.21.15.91:0/3997748880 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f8a9c066840 msgr2=0x7f8a9c068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:04.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.961+0000 7f8ab6614640 1 --2- 172.21.15.91:0/3997748880 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f8a9c066840 0x7f8a9c068d00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8ab015a550 tx=0x7f8aa4006ca0 comp rx=0 tx=0).stop 2023-11-27T18:14:04.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.961+0000 7f8ab6614640 1 -- 172.21.15.91:0/3997748880 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8ab006ad20 msgr2=0x7f8ab00c5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:04.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.961+0000 7f8ab6614640 1 --2- 172.21.15.91:0/3997748880 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8ab006ad20 0x7f8ab00c5290 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8aa000c400 tx=0x7f8aa000c8c0 comp rx=0 tx=0).stop 2023-11-27T18:14:04.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.961+0000 7f8ab6614640 1 -- 172.21.15.91:0/3997748880 shutdown_connections 2023-11-27T18:14:04.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.961+0000 7f8ab6614640 1 --2- 172.21.15.91:0/3997748880 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f8a9c066840 0x7f8a9c068d00 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:04.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.961+0000 7f8ab6614640 1 --2- 172.21.15.91:0/3997748880 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8ab01539c0 0x7f8ab0157d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:04.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.961+0000 7f8ab6614640 1 --2- 172.21.15.91:0/3997748880 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8ab00c2a80 0x7f8ab01577d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:04.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.961+0000 7f8ab6614640 1 --2- 172.21.15.91:0/3997748880 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8ab006ad20 0x7f8ab00c5290 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:04.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.961+0000 7f8ab6614640 1 -- 172.21.15.91:0/3997748880 >> 172.21.15.91:0/3997748880 conn(0x7f8ab0071da0 msgr2=0x7f8ab006b630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:04.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.961+0000 7f8ab6614640 1 -- 172.21.15.91:0/3997748880 shutdown_connections 2023-11-27T18:14:04.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.961+0000 7f8ab6614640 1 -- 172.21.15.91:0/3997748880 wait complete. 2023-11-27T18:14:04.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.965+0000 7f2b627fc640 1 -- 172.21.15.91:0/2196805517 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f2b5c01a400 con 0x7f2b6c14ffb0 2023-11-27T18:14:04.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.965+0000 7f2b627fc640 1 --2- 172.21.15.91:0/2196805517 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f2b500667f0 0x7f2b50068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:04.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.965+0000 7f2b71948640 1 --2- 172.21.15.91:0/2196805517 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f2b500667f0 0x7f2b50068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:04.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.965+0000 7f2b71948640 1 --2- 172.21.15.91:0/2196805517 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f2b500667f0 0x7f2b50068cb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2b680096b0 tx=0x7f2b68006be0 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:04.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.969+0000 7f5fba72f640 1 -- 172.21.15.91:0/3778555872 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5fb40c4200 con 0x7f5fb4153920 2023-11-27T18:14:04.970 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.973+0000 7f2b627fc640 1 -- 172.21.15.91:0/2196805517 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2b5c055d80 con 0x7f2b6c14ffb0 2023-11-27T18:14:04.976 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476756 got 68719476755 for osd.2 2023-11-27T18:14:04.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.981+0000 7f5fb0ff9640 1 -- 172.21.15.91:0/3778555872 <== mon.1 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5fb40c4200 con 0x7f5fb4153920 2023-11-27T18:14:04.977 INFO:teuthology.orchestra.run.smithi091.stdout:68719476755 2023-11-27T18:14:04.979 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.981+0000 7f5fba72f640 1 -- 172.21.15.91:0/3778555872 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f5fa0066840 msgr2=0x7f5fa0068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:04.979 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.981+0000 7f5fba72f640 1 --2- 172.21.15.91:0/3778555872 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f5fa0066840 0x7f5fa0068d00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5fa40af000 tx=0x7f5fa4008040 comp rx=0 tx=0).stop 2023-11-27T18:14:04.979 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.981+0000 7f5fba72f640 1 -- 172.21.15.91:0/3778555872 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5fb4153920 msgr2=0x7f5fb40cb280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:04.979 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.981+0000 7f5fba72f640 1 --2- 172.21.15.91:0/3778555872 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5fb4153920 0x7f5fb40cb280 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5fac00c780 tx=0x7f5fac00cc40 comp rx=0 tx=0).stop 2023-11-27T18:14:04.979 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.981+0000 7f5fba72f640 1 -- 172.21.15.91:0/3778555872 shutdown_connections 2023-11-27T18:14:04.979 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.981+0000 7f5fba72f640 1 --2- 172.21.15.91:0/3778555872 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f5fa0066840 0x7f5fa0068d00 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:04.979 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.981+0000 7f5fba72f640 1 --2- 172.21.15.91:0/3778555872 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5fb40c7290 0x7f5fb40cad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:04.980 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.981+0000 7f5fba72f640 1 --2- 172.21.15.91:0/3778555872 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5fb4153920 0x7f5fb40cb280 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:04.980 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.981+0000 7f5fba72f640 1 --2- 172.21.15.91:0/3778555872 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5fb40c6e30 0x7f5fb4157d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:04.980 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.981+0000 7f5fba72f640 1 -- 172.21.15.91:0/3778555872 >> 172.21.15.91:0/3778555872 conn(0x7f5fb4071ef0 msgr2=0x7f5fb4151580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:04.980 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.981+0000 7f5fba72f640 1 -- 172.21.15.91:0/3778555872 shutdown_connections 2023-11-27T18:14:04.980 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.981+0000 7f5fba72f640 1 -- 172.21.15.91:0/3778555872 wait complete. 2023-11-27T18:14:04.980 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.985+0000 7f2b627fc640 1 -- 172.21.15.91:0/2196805517 <== mon.2 v2:172.21.15.94:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f2b5c0519c0 con 0x7f2b6c14ffb0 2023-11-27T18:14:04.990 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.993+0000 7faebaffd640 1 -- 172.21.15.91:0/1122721125 <== mon.2 v2:172.21.15.94:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faec40c7a20 con 0x7faec4153750 2023-11-27T18:14:04.990 INFO:teuthology.orchestra.run.smithi091.stdout:68719476756 2023-11-27T18:14:04.993 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.997+0000 7faec8e9e640 1 -- 172.21.15.91:0/1122721125 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7faea4066870 msgr2=0x7faea4068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:04.993 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.997+0000 7faec8e9e640 1 --2- 172.21.15.91:0/1122721125 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7faea4066870 0x7faea4068d30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7faeac0b2000 tx=0x7faeac004740 comp rx=0 tx=0).stop 2023-11-27T18:14:04.993 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.997+0000 7faec8e9e640 1 -- 172.21.15.91:0/1122721125 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faec4153750 msgr2=0x7faec415bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:04.993 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.997+0000 7faec8e9e640 1 --2- 172.21.15.91:0/1122721125 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faec4153750 0x7faec415bfb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faebc00b9c0 tx=0x7faebc00be80 comp rx=0 tx=0).stop 2023-11-27T18:14:04.994 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.997+0000 7faec8e9e640 1 -- 172.21.15.91:0/1122721125 shutdown_connections 2023-11-27T18:14:04.994 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.997+0000 7faec8e9e640 1 --2- 172.21.15.91:0/1122721125 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7faea4066870 0x7faea4068d30 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:04.994 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.997+0000 7faec8e9e640 1 --2- 172.21.15.91:0/1122721125 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faec4153750 0x7faec415bfb0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:04.994 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.997+0000 7faec8e9e640 1 --2- 172.21.15.91:0/1122721125 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faec406f840 0x7faec4152500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:04.994 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.997+0000 7faec8e9e640 1 --2- 172.21.15.91:0/1122721125 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faec4066560 0x7faec415a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:04.994 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.997+0000 7faec8e9e640 1 -- 172.21.15.91:0/1122721125 >> 172.21.15.91:0/1122721125 conn(0x7faec4071520 msgr2=0x7faec406b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:04.994 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.997+0000 7faec8e9e640 1 -- 172.21.15.91:0/1122721125 shutdown_connections 2023-11-27T18:14:04.995 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:04.997+0000 7faec8e9e640 1 -- 172.21.15.91:0/1122721125 wait complete. 2023-11-27T18:14:04.996 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476756 got 68719476755 for osd.1 2023-11-27T18:14:05.010 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476757 got 68719476756 for osd.7 2023-11-27T18:14:05.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.029+0000 7fed93abd640 1 Processor -- start 2023-11-27T18:14:05.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.029+0000 7fed93abd640 1 -- start start 2023-11-27T18:14:05.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.029+0000 7fed93abd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fed8c153860 0x7fed8c159f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:05.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.029+0000 7fed93abd640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fed8c153c40 0x7fed8c0ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:05.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.029+0000 7fed93abd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fed8c0cc550 0x7fed8c0ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:05.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.029+0000 7fed93abd640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed8c0cd980 con 0x7fed8c153860 2023-11-27T18:14:05.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.029+0000 7fed93abd640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed8c0c9880 con 0x7fed8c0cc550 2023-11-27T18:14:05.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.029+0000 7fed93abd640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c0cd6c0 con 0x7fed8c153c40 2023-11-27T18:14:05.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.033+0000 7fed91859640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fed8c153860 0x7fed8c159f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:05.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.033+0000 7fed9205a640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fed8c0cc550 0x7fed8c0ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:05.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.033+0000 7fed91859640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fed8c153860 0x7fed8c159f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:45058/0 (socket says 172.21.15.91:45058) 2023-11-27T18:14:05.029 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.033+0000 7fed91859640 1 -- 172.21.15.91:0/4108929483 learned_addr learned my addr 172.21.15.91:0/4108929483 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:05.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.033+0000 7fed91058640 1 --2- 172.21.15.91:0/4108929483 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fed8c153c40 0x7fed8c0ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:05.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.033+0000 7fed91859640 1 -- 172.21.15.91:0/4108929483 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fed8c153c40 msgr2=0x7fed8c0ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:05.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.033+0000 7fed91859640 1 --2- 172.21.15.91:0/4108929483 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fed8c153c40 0x7fed8c0ce0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:05.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.033+0000 7fed91859640 1 -- 172.21.15.91:0/4108929483 >> v2:172.21.15.94:3300/0 conn(0x7fed8c0cc550 msgr2=0x7fed8c0ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:05.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.033+0000 7fed91859640 1 --2- 172.21.15.91:0/4108929483 >> v2:172.21.15.94:3300/0 conn(0x7fed8c0cc550 0x7fed8c0ce620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:05.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.033+0000 7fed91859640 1 -- 172.21.15.91:0/4108929483 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed8c0c9b20 con 0x7fed8c153860 2023-11-27T18:14:05.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.037+0000 7fed91859640 1 --2- 172.21.15.91:0/4108929483 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fed8c153860 0x7fed8c159f40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fed84009870 tx=0x7fed8401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=932fdc9d89bcc08c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:05.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.041+0000 7fed90857640 1 -- 172.21.15.91:0/4108929483 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed840aa620 con 0x7fed8c153860 2023-11-27T18:14:05.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.041+0000 7fed90857640 1 -- 172.21.15.91:0/4108929483 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed840aa780 con 0x7fed8c153860 2023-11-27T18:14:05.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.041+0000 7fed90857640 1 -- 172.21.15.91:0/4108929483 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed840aab10 con 0x7fed8c153860 2023-11-27T18:14:05.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.041+0000 7fed93abd640 1 -- 172.21.15.91:0/4108929483 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fed8c153860 msgr2=0x7fed8c159f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:05.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.041+0000 7fed93abd640 1 --2- 172.21.15.91:0/4108929483 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fed8c153860 0x7fed8c159f40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fed84009870 tx=0x7fed8401c500 comp rx=0 tx=0).stop 2023-11-27T18:14:05.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.041+0000 7fed93abd640 1 -- 172.21.15.91:0/4108929483 shutdown_connections 2023-11-27T18:14:05.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.041+0000 7fed93abd640 1 --2- 172.21.15.91:0/4108929483 >> v2:172.21.15.94:3300/0 conn(0x7fed8c0cc550 0x7fed8c0ce620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:05.040 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.041+0000 7fed93abd640 1 --2- 172.21.15.91:0/4108929483 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fed8c153c40 0x7fed8c0ce0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:05.040 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.041+0000 7fed93abd640 1 --2- 172.21.15.91:0/4108929483 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fed8c153860 0x7fed8c159f40 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:05.040 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.041+0000 7fed93abd640 1 -- 172.21.15.91:0/4108929483 >> 172.21.15.91:0/4108929483 conn(0x7fed8c0b08e0 msgr2=0x7fed8c0b0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:05.040 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.041+0000 7fed93abd640 1 -- 172.21.15.91:0/4108929483 shutdown_connections 2023-11-27T18:14:05.040 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.041+0000 7fed93abd640 1 -- 172.21.15.91:0/4108929483 wait complete. 2023-11-27T18:14:05.041 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.045+0000 7fed93abd640 1 Processor -- start 2023-11-27T18:14:05.041 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.045+0000 7fed93abd640 1 -- start start 2023-11-27T18:14:05.041 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.045+0000 7fed93abd640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fed8c0cc550 0x7fed8c1f2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:05.041 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.045+0000 7fed93abd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fed8c153860 0x7fed8c0b3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:05.041 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.045+0000 7fed93abd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed8c153c40 0x7fed8c0b4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:05.041 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.045+0000 7fed93abd640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c1f3200 con 0x7fed8c153860 2023-11-27T18:14:05.041 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.045+0000 7fed93abd640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c0b38c0 con 0x7fed8c153c40 2023-11-27T18:14:05.041 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.045+0000 7fed93abd640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c1530e0 con 0x7fed8c0cc550 2023-11-27T18:14:05.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.045+0000 7fed91058640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fed8c153860 0x7fed8c0b3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:05.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.045+0000 7fed91058640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fed8c153860 0x7fed8c0b3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:45068/0 (socket says 172.21.15.91:45068) 2023-11-27T18:14:05.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.045+0000 7fed91058640 1 -- 172.21.15.91:0/3842280214 learned_addr learned my addr 172.21.15.91:0/3842280214 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:05.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.045+0000 7fed9205a640 1 --2- 172.21.15.91:0/3842280214 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed8c153c40 0x7fed8c0b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:05.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.049+0000 7fed91058640 1 -- 172.21.15.91:0/3842280214 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fed8c0cc550 msgr2=0x7fed8c1f2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:05.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.049+0000 7fed91058640 1 --2- 172.21.15.91:0/3842280214 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fed8c0cc550 0x7fed8c1f2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:05.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.049+0000 7fed91058640 1 -- 172.21.15.91:0/3842280214 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed8c153c40 msgr2=0x7fed8c0b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:05.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.049+0000 7fed91058640 1 --2- 172.21.15.91:0/3842280214 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed8c153c40 0x7fed8c0b4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:05.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.049+0000 7fed91058640 1 -- 172.21.15.91:0/3842280214 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed840094d0 con 0x7fed8c153860 2023-11-27T18:14:05.047 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.053+0000 7fed91058640 1 --2- 172.21.15.91:0/3842280214 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fed8c153860 0x7fed8c0b3d50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fed8000ce40 tx=0x7fed8000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:05.061 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.053+0000 7fed8a7fc640 1 -- 172.21.15.91:0/3842280214 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed80003ba0 con 0x7fed8c153860 2023-11-27T18:14:05.061 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.053+0000 7fed8a7fc640 1 -- 172.21.15.91:0/3842280214 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed80003d00 con 0x7fed8c153860 2023-11-27T18:14:05.061 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.053+0000 7fed8a7fc640 1 -- 172.21.15.91:0/3842280214 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed80004240 con 0x7fed8c153860 2023-11-27T18:14:05.061 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.053+0000 7fed93abd640 1 -- 172.21.15.91:0/3842280214 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed8c14eff0 con 0x7fed8c153860 2023-11-27T18:14:05.061 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.057+0000 7fed93abd640 1 -- 172.21.15.91:0/3842280214 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed8c14f5a0 con 0x7fed8c153860 2023-11-27T18:14:05.061 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.057+0000 7fed93abd640 1 -- 172.21.15.91:0/3842280214 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed8c074ac0 con 0x7fed8c153860 2023-11-27T18:14:05.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.073+0000 7fed8a7fc640 1 -- 172.21.15.91:0/3842280214 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fed800043a0 con 0x7fed8c153860 2023-11-27T18:14:05.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.073+0000 7fed8a7fc640 1 --2- 172.21.15.91:0/3842280214 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fed78066840 0x7fed78068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:05.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.077+0000 7fed91859640 1 --2- 172.21.15.91:0/3842280214 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fed78066840 0x7fed78068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:05.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.077+0000 7fed91859640 1 --2- 172.21.15.91:0/3842280214 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fed78066840 0x7fed78068d00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fed840ae000 tx=0x7fed84008040 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:05.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.077+0000 7fed8a7fc640 1 -- 172.21.15.91:0/3842280214 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fed80012070 con 0x7fed8c153860 2023-11-27T18:14:05.154 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.157+0000 7f2b73bac640 1 -- 172.21.15.91:0/2196805517 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2b6c1413f0 con 0x7f2b6c14ffb0 2023-11-27T18:14:05.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.161+0000 7f2b627fc640 1 -- 172.21.15.91:0/2196805517 <== mon.2 v2:172.21.15.94:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2b5c015020 con 0x7f2b6c14ffb0 2023-11-27T18:14:05.160 INFO:teuthology.orchestra.run.smithi091.stdout:68719476754 2023-11-27T18:14:05.162 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.165+0000 7f2b73bac640 1 -- 172.21.15.91:0/2196805517 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f2b500667f0 msgr2=0x7f2b50068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:05.162 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.165+0000 7f2b73bac640 1 --2- 172.21.15.91:0/2196805517 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f2b500667f0 0x7f2b50068cb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2b680096b0 tx=0x7f2b68006be0 comp rx=0 tx=0).stop 2023-11-27T18:14:05.162 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.165+0000 7f2b73bac640 1 -- 172.21.15.91:0/2196805517 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2b6c14ffb0 msgr2=0x7f2b6c1f0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:05.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.165+0000 7f2b73bac640 1 --2- 172.21.15.91:0/2196805517 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2b6c14ffb0 0x7f2b6c1f0e90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c00b440 tx=0x7f2b5c00b900 comp rx=0 tx=0).stop 2023-11-27T18:14:05.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.165+0000 7f2b73bac640 1 -- 172.21.15.91:0/2196805517 shutdown_connections 2023-11-27T18:14:05.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.165+0000 7f2b73bac640 1 --2- 172.21.15.91:0/2196805517 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f2b500667f0 0x7f2b50068cb0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:05.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.165+0000 7f2b73bac640 1 --2- 172.21.15.91:0/2196805517 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2b6c14ffb0 0x7f2b6c1f0e90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:05.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.165+0000 7f2b73bac640 1 --2- 172.21.15.91:0/2196805517 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2b6c156370 0x7f2b6c13d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:05.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.165+0000 7f2b73bac640 1 --2- 172.21.15.91:0/2196805517 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2b6c0c5f80 0x7f2b6c142b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:05.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.165+0000 7f2b73bac640 1 -- 172.21.15.91:0/2196805517 >> 172.21.15.91:0/2196805517 conn(0x7f2b6c071820 msgr2=0x7f2b6c0c5490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:05.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.165+0000 7f2b73bac640 1 -- 172.21.15.91:0/2196805517 shutdown_connections 2023-11-27T18:14:05.168 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.165+0000 7f2b73bac640 1 -- 172.21.15.91:0/2196805517 wait complete. 2023-11-27T18:14:05.179 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476755 got 68719476754 for osd.3 2023-11-27T18:14:05.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.325+0000 7fed8a7fc640 1 -- 172.21.15.91:0/3842280214 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fed80052200 con 0x7fed8c153860 2023-11-27T18:14:05.476 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.481+0000 7fed93abd640 1 -- 172.21.15.91:0/3842280214 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fed8c04e850 con 0x7fed8c153860 2023-11-27T18:14:05.489 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.493+0000 7fed8a7fc640 1 -- 172.21.15.91:0/3842280214 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fed80055820 con 0x7fed8c153860 2023-11-27T18:14:05.490 INFO:teuthology.orchestra.run.smithi091.stdout:68719476757 2023-11-27T18:14:05.493 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-27T18:14:05.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.493+0000 7fed93abd640 1 -- 172.21.15.91:0/3842280214 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fed78066840 msgr2=0x7fed78068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:05.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.493+0000 7fed93abd640 1 --2- 172.21.15.91:0/3842280214 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fed78066840 0x7fed78068d00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fed840ae000 tx=0x7fed84008040 comp rx=0 tx=0).stop 2023-11-27T18:14:05.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.493+0000 7fed93abd640 1 -- 172.21.15.91:0/3842280214 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fed8c153860 msgr2=0x7fed8c0b3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:05.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.493+0000 7fed93abd640 1 --2- 172.21.15.91:0/3842280214 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fed8c153860 0x7fed8c0b3d50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fed8000ce40 tx=0x7fed8000a660 comp rx=0 tx=0).stop 2023-11-27T18:14:05.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.497+0000 7fed93abd640 1 -- 172.21.15.91:0/3842280214 shutdown_connections 2023-11-27T18:14:05.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.497+0000 7fed93abd640 1 --2- 172.21.15.91:0/3842280214 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fed78066840 0x7fed78068d00 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:05.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.497+0000 7fed93abd640 1 --2- 172.21.15.91:0/3842280214 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed8c153c40 0x7fed8c0b4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:05.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.497+0000 7fed93abd640 1 --2- 172.21.15.91:0/3842280214 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fed8c153860 0x7fed8c0b3d50 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:05.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.497+0000 7fed93abd640 1 --2- 172.21.15.91:0/3842280214 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fed8c0cc550 0x7fed8c1f2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:05.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.497+0000 7fed93abd640 1 -- 172.21.15.91:0/3842280214 >> 172.21.15.91:0/3842280214 conn(0x7fed8c0b08e0 msgr2=0x7fed8c073720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:05.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.497+0000 7fed93abd640 1 -- 172.21.15.91:0/3842280214 shutdown_connections 2023-11-27T18:14:05.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.497+0000 7fed93abd640 1 -- 172.21.15.91:0/3842280214 wait complete. 2023-11-27T18:14:05.508 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476757 got 68719476757 for osd.6 2023-11-27T18:14:05.508 DEBUG:teuthology.parallel:result is None 2023-11-27T18:14:05.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.617+0000 7fe99f32b640 1 Processor -- start 2023-11-27T18:14:05.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.617+0000 7fe99f32b640 1 -- start start 2023-11-27T18:14:05.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.617+0000 7fe99f32b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe99813d260 0x7fe998066360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:05.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.617+0000 7fe99f32b640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9981580d0 con 0x7fe99806a590 2023-11-27T18:14:05.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.617+0000 7fe99f32b640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9981574c0 con 0x7fe99815b280 2023-11-27T18:14:05.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.617+0000 7fe99f32b640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9981572d0 con 0x7fe99813d260 2023-11-27T18:14:05.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.617+0000 7fe99d0c7640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe99813d260 0x7fe998066360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:05.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.617+0000 7fe99d0c7640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe99813d260 0x7fe998066360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.91:58772/0 (socket says 172.21.15.91:58772) 2023-11-27T18:14:05.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.617+0000 7fe99d0c7640 1 -- 172.21.15.91:0/342145122 learned_addr learned my addr 172.21.15.91:0/342145122 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:05.622 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.625+0000 7fe99d0c7640 1 -- 172.21.15.91:0/342145122 >> v1:172.21.15.94:6789/0 conn(0x7fe99815b280 legacy=0x7fe9980718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:05.622 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.625+0000 7fe99d0c7640 1 -- 172.21.15.91:0/342145122 >> v1:172.21.15.91:6789/0 conn(0x7fe99806a590 legacy=0x7fe9980c4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:05.622 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.625+0000 7fe99d0c7640 1 -- 172.21.15.91:0/342145122 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9981577a0 con 0x7fe99813d260 2023-11-27T18:14:05.635 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.637+0000 7fe99d0c7640 1 --2- 172.21.15.91:0/342145122 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe99813d260 0x7fe998066360 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe98c009870 tx=0x7fe98c01ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94fc928cd002e820 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:05.646 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.649+0000 7fe98bfff640 1 -- 172.21.15.91:0/342145122 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98c0a89b0 con 0x7fe99813d260 2023-11-27T18:14:05.646 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.649+0000 7fe98bfff640 1 -- 172.21.15.91:0/342145122 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe98c0a8b10 con 0x7fe99813d260 2023-11-27T18:14:05.646 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.649+0000 7fe98bfff640 1 -- 172.21.15.91:0/342145122 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98c0a8ea0 con 0x7fe99813d260 2023-11-27T18:14:05.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.649+0000 7fe99f32b640 1 -- 172.21.15.91:0/342145122 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe99813d260 msgr2=0x7fe998066360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:05.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.649+0000 7fe99f32b640 1 --2- 172.21.15.91:0/342145122 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe99813d260 0x7fe998066360 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe98c009870 tx=0x7fe98c01ecb0 comp rx=0 tx=0).stop 2023-11-27T18:14:05.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.649+0000 7fe99f32b640 1 -- 172.21.15.91:0/342145122 shutdown_connections 2023-11-27T18:14:05.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.649+0000 7fe99f32b640 1 --2- 172.21.15.91:0/342145122 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe99813d260 0x7fe998066360 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:05.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.649+0000 7fe99f32b640 1 -- 172.21.15.91:0/342145122 >> 172.21.15.91:0/342145122 conn(0x7fe9980c8080 msgr2=0x7fe9980c8490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:05.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.649+0000 7fe99f32b640 1 -- 172.21.15.91:0/342145122 shutdown_connections 2023-11-27T18:14:05.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.649+0000 7fe99f32b640 1 -- 172.21.15.91:0/342145122 wait complete. 2023-11-27T18:14:05.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.653+0000 7fe99f32b640 1 Processor -- start 2023-11-27T18:14:05.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.653+0000 7fe99f32b640 1 -- start start 2023-11-27T18:14:05.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.653+0000 7fe99f32b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe99806a590 0x7fe998159170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:05.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.653+0000 7fe99f32b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe99813d260 0x7fe998135d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:05.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.653+0000 7fe99f32b640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe99815b280 0x7fe9981362a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:05.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.653+0000 7fe99f32b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe998159af0 con 0x7fe99806a590 2023-11-27T18:14:05.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.653+0000 7fe99f32b640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe998159db0 con 0x7fe99813d260 2023-11-27T18:14:05.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.653+0000 7fe99f32b640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9981525c0 con 0x7fe99815b280 2023-11-27T18:14:05.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.653+0000 7fe99d0c7640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe99806a590 0x7fe998159170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:05.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.653+0000 7fe99d0c7640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe99806a590 0x7fe998159170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:45074/0 (socket says 172.21.15.91:45074) 2023-11-27T18:14:05.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.653+0000 7fe99d0c7640 1 -- 172.21.15.91:0/790794405 learned_addr learned my addr 172.21.15.91:0/790794405 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:05.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.657+0000 7fe99c8c6640 1 --2- 172.21.15.91:0/790794405 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe99813d260 0x7fe998135d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:05.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.657+0000 7fe99d0c7640 1 -- 172.21.15.91:0/790794405 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe99815b280 msgr2=0x7fe9981362a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:05.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.657+0000 7fe99d0c7640 1 --2- 172.21.15.91:0/790794405 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe99815b280 0x7fe9981362a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:05.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.657+0000 7fe99d0c7640 1 -- 172.21.15.91:0/790794405 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe99813d260 msgr2=0x7fe998135d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:05.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.657+0000 7fe99d0c7640 1 --2- 172.21.15.91:0/790794405 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe99813d260 0x7fe998135d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:05.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.657+0000 7fe99d0c7640 1 -- 172.21.15.91:0/790794405 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe98c0094d0 con 0x7fe99806a590 2023-11-27T18:14:05.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.661+0000 7fe99d0c7640 1 --2- 172.21.15.91:0/790794405 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe99806a590 0x7fe998159170 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe98c01b8c0 tx=0x7fe98c01ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:05.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.661+0000 7fe989ffb640 1 -- 172.21.15.91:0/790794405 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98c0b0e60 con 0x7fe99806a590 2023-11-27T18:14:05.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.661+0000 7fe989ffb640 1 -- 172.21.15.91:0/790794405 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe98c0ba440 con 0x7fe99806a590 2023-11-27T18:14:05.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.661+0000 7fe989ffb640 1 -- 172.21.15.91:0/790794405 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98c0ba7f0 con 0x7fe99806a590 2023-11-27T18:14:05.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.661+0000 7fe99f32b640 1 -- 172.21.15.91:0/790794405 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9981528a0 con 0x7fe99806a590 2023-11-27T18:14:05.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.665+0000 7fe99f32b640 1 -- 172.21.15.91:0/790794405 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe998152e60 con 0x7fe99806a590 2023-11-27T18:14:05.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.665+0000 7fe99f32b640 1 -- 172.21.15.91:0/790794405 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe99804e850 con 0x7fe99806a590 2023-11-27T18:14:05.837 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-27T18:14:05.924 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-27T18:14:05.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.937+0000 7fe989ffb640 1 -- 172.21.15.91:0/790794405 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fe98c0ba950 con 0x7fe99806a590 2023-11-27T18:14:05.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.937+0000 7fe989ffb640 1 --2- 172.21.15.91:0/790794405 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe97c066840 0x7fe97c068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:05.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.937+0000 7fe99c8c6640 1 --2- 172.21.15.91:0/790794405 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe97c066840 0x7fe97c068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:05.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.937+0000 7fe99c8c6640 1 --2- 172.21.15.91:0/790794405 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe97c066840 0x7fe97c068d00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe998158c30 tx=0x7fe994009040 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:05.950 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.953+0000 7fe989ffb640 1 -- 172.21.15.91:0/790794405 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe98c0f4170 con 0x7fe99806a590 2023-11-27T18:14:05.950 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.953+0000 7fe989ffb640 1 -- 172.21.15.91:0/790794405 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fe98c0efdb0 con 0x7fe99806a590 2023-11-27T18:14:05.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.965+0000 7f560bf20640 1 Processor -- start 2023-11-27T18:14:05.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.965+0000 7f560bf20640 1 -- start start 2023-11-27T18:14:05.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.965+0000 7f560bf20640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f560415b230 0x7f56040c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:05.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.965+0000 7f560bf20640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56041572d0 con 0x7f56040c58d0 2023-11-27T18:14:05.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.965+0000 7f560bf20640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5604157570 con 0x7f56040c54f0 2023-11-27T18:14:05.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.965+0000 7f560bf20640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56041580d0 con 0x7f560415b230 2023-11-27T18:14:05.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.969+0000 7f56094bb640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f56040c58d0 0x7f560415ab20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:53524/0 (socket says 172.21.15.91:53524) 2023-11-27T18:14:05.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.969+0000 7f56094bb640 1 -- 172.21.15.91:0/304226447 learned_addr learned my addr 172.21.15.91:0/304226447 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:14:05.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.969+0000 7f5608cba640 1 -- 172.21.15.91:0/304226447 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2189976319 0 0) 0x7f56041572d0 con 0x7f56040c58d0 2023-11-27T18:14:05.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.969+0000 7f5608cba640 1 -- 172.21.15.91:0/304226447 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55f0003530 con 0x7f56040c58d0 2023-11-27T18:14:05.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.973+0000 7f5608cba640 1 -- 172.21.15.91:0/304226447 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3366799948 0 0) 0x7f55f0003530 con 0x7f56040c58d0 2023-11-27T18:14:05.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.973+0000 7f5608cba640 1 -- 172.21.15.91:0/304226447 >> v2:172.21.15.94:3300/0 conn(0x7f560415b230 msgr2=0x7f56040c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:05.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.973+0000 7f5608cba640 1 --2- 172.21.15.91:0/304226447 >> v2:172.21.15.94:3300/0 conn(0x7f560415b230 0x7f56040c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:05.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.973+0000 7f5608cba640 1 -- 172.21.15.91:0/304226447 >> v1:172.21.15.94:6789/0 conn(0x7f56040c54f0 legacy=0x7f56040c8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:05.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.973+0000 7f5608cba640 1 -- 172.21.15.91:0/304226447 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5604157830 con 0x7f56040c58d0 2023-11-27T18:14:05.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.973+0000 7f5608cba640 1 -- 172.21.15.91:0/304226447 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3378743932 0 0) 0x7f55f4001680 con 0x7f56040c58d0 2023-11-27T18:14:05.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.973+0000 7f5608cba640 1 -- 172.21.15.91:0/304226447 >> v1:172.21.15.91:6789/0 conn(0x7f56040c58d0 legacy=0x7f560415ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:05.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.973+0000 7f5608cba640 1 --2- 172.21.15.91:0/304226447 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f55f00039d0 0x7f55f0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:05.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.973+0000 7f5608cba640 1 --2- 172.21.15.91:0/304226447 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f55f00047d0 0x7f55f0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:05.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.973+0000 7f5608cba640 1 --2- 172.21.15.91:0/304226447 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f55f00052b0 0x7f55f000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:05.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.973+0000 7f5608cba640 1 -- 172.21.15.91:0/304226447 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56041580d0 con 0x7f55f00052b0 2023-11-27T18:14:05.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.973+0000 7f5608cba640 1 -- 172.21.15.91:0/304226447 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f000c200 con 0x7f55f00039d0 2023-11-27T18:14:05.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.973+0000 7f5608cba640 1 -- 172.21.15.91:0/304226447 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f000c3c0 con 0x7f55f00047d0 2023-11-27T18:14:05.977 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-27T18:14:05.978 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.981+0000 7f560a4bd640 1 --2- 172.21.15.91:0/304226447 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f55f00052b0 0x7f55f000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:05.980 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.985+0000 7f56094bb640 1 --2- 172.21.15.91:0/304226447 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f55f00047d0 0x7f55f0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:05.984 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.989+0000 7f560a4bd640 1 -- 172.21.15.91:0/304226447 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f55f00047d0 msgr2=0x7f55f0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:05.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.989+0000 7f560a4bd640 1 --2- 172.21.15.91:0/304226447 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f55f00047d0 0x7f55f0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:05.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.989+0000 7f560a4bd640 1 -- 172.21.15.91:0/304226447 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f55f00039d0 msgr2=0x7f55f0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:05.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.989+0000 7f560a4bd640 1 --2- 172.21.15.91:0/304226447 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f55f00039d0 0x7f55f0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:05.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.989+0000 7f560a4bd640 1 -- 172.21.15.91:0/304226447 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f0003530 con 0x7f55f00052b0 2023-11-27T18:14:05.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.989+0000 7f560a4bd640 1 -- 172.21.15.91:0/304226447 reap_dead start 2023-11-27T18:14:05.994 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:05.997+0000 7f560a4bd640 1 --2- 172.21.15.91:0/304226447 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f55f00052b0 0x7f55f000b990 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f55fc009c70 tx=0x7f55fc01cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14044e04fd2b72a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:05.996 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-27T18:14:06.011 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-27T18:14:06.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.061+0000 7f6079af2640 1 Processor -- start 2023-11-27T18:14:06.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.061+0000 7f6079af2640 1 -- start start 2023-11-27T18:14:06.059 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.061+0000 7f6079af2640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f60740c7c50 0x7f60740b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:06.059 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.061+0000 7f6079af2640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60740c9f80 con 0x7f6074151730 2023-11-27T18:14:06.059 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.061+0000 7f6079af2640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60740c9090 con 0x7f60740ccbe0 2023-11-27T18:14:06.059 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.061+0000 7f6079af2640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60740c9370 con 0x7f60740c7c50 2023-11-27T18:14:06.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.093+0000 7f3881788640 1 Processor -- start 2023-11-27T18:14:06.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.097+0000 7f3881788640 1 -- start start 2023-11-27T18:14:06.093 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.097+0000 7f3881788640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f387c157570 0x7f387c1579c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:06.093 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.097+0000 7f3881788640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f387c070770 con 0x7f387c06f920 2023-11-27T18:14:06.093 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.097+0000 7f3881788640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f387c157f00 con 0x7f387c0c5fa0 2023-11-27T18:14:06.093 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.097+0000 7f3881788640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f387c0c6380 con 0x7f387c157570 2023-11-27T18:14:06.096 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.101+0000 7f60737fe640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f6074151730 0x7f607415b240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:53540/0 (socket says 172.21.15.91:53540) 2023-11-27T18:14:06.096 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.101+0000 7f60737fe640 1 -- 172.21.15.91:0/4280969681 learned_addr learned my addr 172.21.15.91:0/4280969681 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:14:06.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.117+0000 7f387a7fc640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f387c06f920 0x7f387c0cc2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:53548/0 (socket says 172.21.15.91:53548) 2023-11-27T18:14:06.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.117+0000 7f387a7fc640 1 -- 172.21.15.91:0/3877890453 learned_addr learned my addr 172.21.15.91:0/3877890453 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:14:06.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.121+0000 7fe9ff3bf640 1 Processor -- start 2023-11-27T18:14:06.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.121+0000 7fe9ff3bf640 1 -- start start 2023-11-27T18:14:06.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.121+0000 7fe9ff3bf640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe9f81517e0 0x7fe9f80c6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:06.118 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.121+0000 7fe9ff3bf640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe9f806e6c0 0x7fe9f806ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:06.118 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.121+0000 7fe9ff3bf640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9f806d6b0 con 0x7fe9f806f060 2023-11-27T18:14:06.118 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.121+0000 7fe9ff3bf640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9f806b170 con 0x7fe9f806e6c0 2023-11-27T18:14:06.118 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.121+0000 7fe9ff3bf640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f8151bc0 con 0x7fe9f81517e0 2023-11-27T18:14:06.128 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.133+0000 7f5608cba640 1 -- 172.21.15.91:0/304226447 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55fc003ba0 con 0x7f55f00052b0 2023-11-27T18:14:06.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.133+0000 7f5608cba640 1 -- 172.21.15.91:0/304226447 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55fc003d00 con 0x7f55f00052b0 2023-11-27T18:14:06.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.133+0000 7f5608cba640 1 -- 172.21.15.91:0/304226447 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55fc0a5b80 con 0x7f55f00052b0 2023-11-27T18:14:06.130 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.133+0000 7f560bf20640 1 -- 172.21.15.91:0/304226447 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f55f00052b0 msgr2=0x7f55f000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:06.130 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.133+0000 7f560bf20640 1 --2- 172.21.15.91:0/304226447 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f55f00052b0 0x7f55f000b990 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f55fc009c70 tx=0x7f55fc01cc30 comp rx=0 tx=0).stop 2023-11-27T18:14:06.130 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.133+0000 7f560bf20640 1 -- 172.21.15.91:0/304226447 shutdown_connections 2023-11-27T18:14:06.130 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.133+0000 7f560bf20640 1 --2- 172.21.15.91:0/304226447 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f55f00052b0 0x7f55f000b990 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:06.130 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.133+0000 7f560bf20640 1 -- 172.21.15.91:0/304226447 >> 172.21.15.91:0/304226447 conn(0x7f5604071da0 msgr2=0x7f56040721b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:06.130 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.133+0000 7f560bf20640 1 -- 172.21.15.91:0/304226447 shutdown_connections 2023-11-27T18:14:06.130 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.133+0000 7f560bf20640 1 -- 172.21.15.91:0/304226447 wait complete. 2023-11-27T18:14:06.131 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.133+0000 7f560bf20640 1 Processor -- start 2023-11-27T18:14:06.131 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.133+0000 7f560bf20640 1 -- start start 2023-11-27T18:14:06.131 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.133+0000 7f560bf20640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f55f00052b0 0x7f5604154470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:06.131 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.133+0000 7f560bf20640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56040b1b40 0x7f5604155220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:06.132 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.133+0000 7f560bf20640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f56041528a0 0x7f5604152d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:06.132 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.133+0000 7f560bf20640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5604152410 con 0x7f55f00052b0 2023-11-27T18:14:06.132 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.133+0000 7f560bf20640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5604153260 con 0x7f56040b1b40 2023-11-27T18:14:06.132 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.133+0000 7f560bf20640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56041ed5a0 con 0x7f56041528a0 2023-11-27T18:14:06.132 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.137+0000 7f60727fc640 1 -- 172.21.15.91:0/4280969681 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 465329672 0 0) 0x7f60740c9f80 con 0x7f6074151730 2023-11-27T18:14:06.132 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.137+0000 7f60727fc640 1 -- 172.21.15.91:0/4280969681 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f605c003530 con 0x7f6074151730 2023-11-27T18:14:06.139 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.141+0000 7f3879ffb640 1 -- 172.21.15.91:0/3877890453 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3341038514 0 0) 0x7f387c070770 con 0x7f387c06f920 2023-11-27T18:14:06.139 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.141+0000 7f3879ffb640 1 -- 172.21.15.91:0/3877890453 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3864003530 con 0x7f387c06f920 2023-11-27T18:14:06.140 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.145+0000 7f60727fc640 1 -- 172.21.15.91:0/4280969681 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1091253418 0 0) 0x7f605c003530 con 0x7f6074151730 2023-11-27T18:14:06.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.145+0000 7f60727fc640 1 -- 172.21.15.91:0/4280969681 >> v2:172.21.15.94:3300/0 conn(0x7f60740c7c50 msgr2=0x7f60740b0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:06.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.145+0000 7f60727fc640 1 --2- 172.21.15.91:0/4280969681 >> v2:172.21.15.94:3300/0 conn(0x7f60740c7c50 0x7f60740b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:06.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.145+0000 7f60727fc640 1 -- 172.21.15.91:0/4280969681 >> v1:172.21.15.94:6789/0 conn(0x7f60740ccbe0 legacy=0x7f6074161bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:06.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.145+0000 7f60727fc640 1 -- 172.21.15.91:0/4280969681 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60740c9650 con 0x7f6074151730 2023-11-27T18:14:06.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.145+0000 7f60727fc640 1 -- 172.21.15.91:0/4280969681 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3378743932 0 0) 0x7f6064001680 con 0x7f6074151730 2023-11-27T18:14:06.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.145+0000 7f60727fc640 1 -- 172.21.15.91:0/4280969681 >> v1:172.21.15.91:6789/0 conn(0x7f6074151730 legacy=0x7f607415b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:06.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.145+0000 7f60727fc640 1 --2- 172.21.15.91:0/4280969681 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f605c0039d0 0x7f605c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:06.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.145+0000 7f60727fc640 1 --2- 172.21.15.91:0/4280969681 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f605c0047d0 0x7f605c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:06.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.145+0000 7f60727fc640 1 --2- 172.21.15.91:0/4280969681 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f605c0052b0 0x7f605c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:06.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.145+0000 7f60727fc640 1 -- 172.21.15.91:0/4280969681 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60740c9370 con 0x7f605c0052b0 2023-11-27T18:14:06.142 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.145+0000 7f60727fc640 1 -- 172.21.15.91:0/4280969681 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605c00c1f0 con 0x7f605c0047d0 2023-11-27T18:14:06.142 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.145+0000 7f60727fc640 1 -- 172.21.15.91:0/4280969681 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f605c00c3b0 con 0x7f605c0039d0 2023-11-27T18:14:06.143 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.145+0000 7f5609cbc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f55f00052b0 0x7f5604154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:06.144 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.149+0000 7f3879ffb640 1 -- 172.21.15.91:0/3877890453 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3745793545 0 0) 0x7f3864003530 con 0x7f387c06f920 2023-11-27T18:14:06.144 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.149+0000 7f3879ffb640 1 -- 172.21.15.91:0/3877890453 >> v2:172.21.15.94:3300/0 conn(0x7f387c157570 msgr2=0x7f387c1579c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:06.144 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.149+0000 7f3879ffb640 1 --2- 172.21.15.91:0/3877890453 >> v2:172.21.15.94:3300/0 conn(0x7f387c157570 0x7f387c1579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:06.144 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.149+0000 7f3879ffb640 1 -- 172.21.15.91:0/3877890453 >> v1:172.21.15.94:6789/0 conn(0x7f387c0c5fa0 legacy=0x7f387c0c7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:06.144 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.149+0000 7f3879ffb640 1 -- 172.21.15.91:0/3877890453 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f387c0c8b80 con 0x7f387c06f920 2023-11-27T18:14:06.146 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.149+0000 7f3879ffb640 1 -- 172.21.15.91:0/3877890453 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3378743932 0 0) 0x7f3870001680 con 0x7f387c06f920 2023-11-27T18:14:06.147 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.149+0000 7f3879ffb640 1 -- 172.21.15.91:0/3877890453 >> v1:172.21.15.91:6789/0 conn(0x7f387c06f920 legacy=0x7f387c0cc2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:06.147 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.149+0000 7f3879ffb640 1 --2- 172.21.15.91:0/3877890453 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3864003980 0x7f3864003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:06.147 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.149+0000 7f3879ffb640 1 --2- 172.21.15.91:0/3877890453 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f38640047d0 0x7f3864004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:06.147 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.149+0000 7f3879ffb640 1 --2- 172.21.15.91:0/3877890453 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f38640052b0 0x7f386400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:06.147 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.149+0000 7f3879ffb640 1 -- 172.21.15.91:0/3877890453 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f387c0c6380 con 0x7f3864003980 2023-11-27T18:14:06.147 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.149+0000 7f3879ffb640 1 -- 172.21.15.91:0/3877890453 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f386400c1b0 con 0x7f38640052b0 2023-11-27T18:14:06.147 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.149+0000 7f3879ffb640 1 -- 172.21.15.91:0/3877890453 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f386400c370 con 0x7f38640047d0 2023-11-27T18:14:06.147 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.149+0000 7f5609cbc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f55f00052b0 0x7f5604154470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:55954/0 (socket says 172.21.15.91:55954) 2023-11-27T18:14:06.147 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.149+0000 7f5609cbc640 1 -- 172.21.15.91:0/833733354 learned_addr learned my addr 172.21.15.91:0/833733354 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:06.149 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.153+0000 7fe9fd15b640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe9f81517e0 0x7fe9f80c6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:06.151 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.153+0000 7f5609cbc640 1 -- 172.21.15.91:0/833733354 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f56041528a0 msgr2=0x7f5604152d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:06.151 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.153+0000 7f5609cbc640 1 --2- 172.21.15.91:0/833733354 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f56041528a0 0x7f5604152d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:06.152 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.153+0000 7f5609cbc640 1 -- 172.21.15.91:0/833733354 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56040b1b40 msgr2=0x7f5604155220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:06.152 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.153+0000 7f5609cbc640 1 --2- 172.21.15.91:0/833733354 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56040b1b40 0x7f5604155220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:06.152 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.153+0000 7f5609cbc640 1 -- 172.21.15.91:0/833733354 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56041ed860 con 0x7f55f00052b0 2023-11-27T18:14:06.152 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.157+0000 7f387a7fc640 1 --2- 172.21.15.91:0/3877890453 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f38640047d0 0x7f3864004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:06.154 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.157+0000 7f5609cbc640 1 --2- 172.21.15.91:0/833733354 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f55f00052b0 0x7f5604154470 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f560000c440 tx=0x7f560000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:06.156 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.161+0000 7fe9fd15b640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe9f81517e0 0x7fe9f80c6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.91:54324/0 (socket says 172.21.15.91:54324) 2023-11-27T18:14:06.156 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.161+0000 7fe9fd15b640 1 -- 172.21.15.91:0/3979651122 learned_addr learned my addr 172.21.15.91:0/3979651122 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:06.157 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.161+0000 7f5492757640 1 Processor -- start 2023-11-27T18:14:06.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.161+0000 7f5492757640 1 -- start start 2023-11-27T18:14:06.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.161+0000 7f5492757640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f548c151650 0x7f548c0c1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:06.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.161+0000 7f5492757640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f548c15b550 0x7f548c157230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:06.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.161+0000 7f5492757640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f548c0c8be0 0x7f548c157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:06.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.161+0000 7f5492757640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f548c0b0410 con 0x7f548c0c8be0 2023-11-27T18:14:06.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.161+0000 7f5492757640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f548c15a820 con 0x7f548c15b550 2023-11-27T18:14:06.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.161+0000 7f5492757640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f548c15b0c0 con 0x7f548c151650 2023-11-27T18:14:06.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.165+0000 7f6073fff640 1 --2- 172.21.15.91:0/4280969681 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f605c0052b0 0x7f605c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:06.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.165+0000 7f387affd640 1 --2- 172.21.15.91:0/3877890453 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3864003980 0x7f3864003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:06.162 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.165+0000 7f6073fff640 1 -- 172.21.15.91:0/4280969681 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f605c0039d0 msgr2=0x7f605c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:06.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.165+0000 7f6073fff640 1 --2- 172.21.15.91:0/4280969681 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f605c0039d0 0x7f605c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:06.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.165+0000 7f6073fff640 1 -- 172.21.15.91:0/4280969681 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f605c0047d0 msgr2=0x7f605c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:06.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.165+0000 7f6073fff640 1 --2- 172.21.15.91:0/4280969681 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f605c0047d0 0x7f605c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:06.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.165+0000 7f6073fff640 1 -- 172.21.15.91:0/4280969681 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f605c003530 con 0x7f605c0052b0 2023-11-27T18:14:06.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.165+0000 7f548bfff640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f548c151650 0x7f548c0c1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:06.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.169+0000 7f548bfff640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f548c151650 0x7f548c0c1c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.91:54358/0 (socket says 172.21.15.91:54358) 2023-11-27T18:14:06.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.169+0000 7f548bfff640 1 -- 172.21.15.91:0/462446297 learned_addr learned my addr 172.21.15.91:0/462446297 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:06.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.169+0000 7f6073fff640 1 -- 172.21.15.91:0/4280969681 reap_dead start 2023-11-27T18:14:06.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.169+0000 7f55fa7fc640 1 -- 172.21.15.91:0/833733354 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5600007020 con 0x7f55f00052b0 2023-11-27T18:14:06.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.169+0000 7f55fa7fc640 1 -- 172.21.15.91:0/833733354 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56000071a0 con 0x7f55f00052b0 2023-11-27T18:14:06.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.169+0000 7f55fa7fc640 1 -- 172.21.15.91:0/833733354 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5600007550 con 0x7f55f00052b0 2023-11-27T18:14:06.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.169+0000 7f6073fff640 1 --2- 172.21.15.91:0/4280969681 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f605c0052b0 0x7f605c00b990 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f606c007fd0 tx=0x7f606c01c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e57806d94036c33d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:06.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.169+0000 7f5490cf4640 1 --2- 172.21.15.91:0/462446297 >> v2:172.21.15.91:3300/0 conn(0x7f548c0c8be0 0x7f548c157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:06.168 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.169+0000 7f560bf20640 1 -- 172.21.15.91:0/833733354 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5604151ae0 con 0x7f55f00052b0 2023-11-27T18:14:06.168 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.169+0000 7f560bf20640 1 -- 172.21.15.91:0/833733354 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56041520a0 con 0x7f55f00052b0 2023-11-27T18:14:06.168 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.169+0000 7fe9fd15b640 1 -- 172.21.15.91:0/3979651122 >> v2:172.21.15.94:3300/0 conn(0x7fe9f806e6c0 msgr2=0x7fe9f806ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:06.168 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.169+0000 7fe9fd15b640 1 --2- 172.21.15.91:0/3979651122 >> v2:172.21.15.94:3300/0 conn(0x7fe9f806e6c0 0x7fe9f806ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:06.168 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.169+0000 7fe9fd15b640 1 -- 172.21.15.91:0/3979651122 >> v1:172.21.15.94:6789/0 conn(0x7fe9f806f060 legacy=0x7fe9f806a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:06.168 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.169+0000 7fe9fd15b640 1 -- 172.21.15.91:0/3979651122 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f8158250 con 0x7fe9f81517e0 2023-11-27T18:14:06.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.173+0000 7f560bf20640 1 -- 172.21.15.91:0/833733354 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5604152260 con 0x7f55f00052b0 2023-11-27T18:14:06.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.173+0000 7f387affd640 1 -- 172.21.15.91:0/3877890453 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f38640047d0 msgr2=0x7f3864004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:06.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.173+0000 7f387affd640 1 --2- 172.21.15.91:0/3877890453 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f38640047d0 0x7f3864004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:06.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.173+0000 7f387affd640 1 -- 172.21.15.91:0/3877890453 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f38640052b0 msgr2=0x7f386400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:06.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.173+0000 7f387affd640 1 --2- 172.21.15.91:0/3877890453 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f38640052b0 0x7f386400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:06.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.173+0000 7f387affd640 1 -- 172.21.15.91:0/3877890453 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3864003530 con 0x7f3864003980 2023-11-27T18:14:06.170 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.173+0000 7f387b7fe640 1 -- 172.21.15.91:0/3877890453 reap_dead start 2023-11-27T18:14:06.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.173+0000 7f548b7fe640 1 --2- 172.21.15.91:0/462446297 >> v2:172.21.15.94:3300/0 conn(0x7f548c15b550 0x7f548c157230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:06.172 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.177+0000 7f60727fc640 1 -- 172.21.15.91:0/4280969681 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606c0a6040 con 0x7f605c0052b0 2023-11-27T18:14:06.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.177+0000 7f387affd640 1 --2- 172.21.15.91:0/3877890453 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3864003980 0x7f3864003d80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f386c007fd0 tx=0x7f386c01c290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22252dec653fb08a server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:06.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.177+0000 7f548bfff640 1 -- 172.21.15.91:0/462446297 >> v2:172.21.15.94:3300/0 conn(0x7f548c15b550 msgr2=0x7f548c157230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:06.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.177+0000 7f548bfff640 1 --2- 172.21.15.91:0/462446297 >> v2:172.21.15.94:3300/0 conn(0x7f548c15b550 0x7f548c157230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:06.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.177+0000 7f548bfff640 1 -- 172.21.15.91:0/462446297 >> v2:172.21.15.91:3300/0 conn(0x7f548c0c8be0 msgr2=0x7f548c157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:06.176 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.177+0000 7f548bfff640 1 --2- 172.21.15.91:0/462446297 >> v2:172.21.15.91:3300/0 conn(0x7f548c0c8be0 0x7f548c157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:06.176 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.177+0000 7f548bfff640 1 -- 172.21.15.91:0/462446297 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f548c157d50 con 0x7f548c151650 2023-11-27T18:14:06.176 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.181+0000 7fe99f32b640 1 -- 172.21.15.91:0/790794405 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fe99804e850 con 0x7fe99806a590 2023-11-27T18:14:06.176 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.181+0000 7f60727fc640 1 -- 172.21.15.91:0/4280969681 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f606c003b80 con 0x7f605c0052b0 2023-11-27T18:14:06.177 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.181+0000 7f60727fc640 1 -- 172.21.15.91:0/4280969681 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606c005070 con 0x7f605c0052b0 2023-11-27T18:14:06.178 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.181+0000 7f6079af2640 1 -- 172.21.15.91:0/4280969681 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f605c0052b0 msgr2=0x7f605c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:06.178 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.181+0000 7f6079af2640 1 --2- 172.21.15.91:0/4280969681 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f605c0052b0 0x7f605c00b990 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f606c007fd0 tx=0x7f606c01c640 comp rx=0 tx=0).stop 2023-11-27T18:14:06.178 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.181+0000 7f6079af2640 1 -- 172.21.15.91:0/4280969681 shutdown_connections 2023-11-27T18:14:06.178 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.181+0000 7f6079af2640 1 --2- 172.21.15.91:0/4280969681 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f605c0052b0 0x7f605c00b990 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:06.178 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.181+0000 7f6079af2640 1 -- 172.21.15.91:0/4280969681 >> 172.21.15.91:0/4280969681 conn(0x7f607406a520 msgr2=0x7f607406a930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:06.178 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.181+0000 7f6079af2640 1 -- 172.21.15.91:0/4280969681 shutdown_connections 2023-11-27T18:14:06.178 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.181+0000 7f6079af2640 1 -- 172.21.15.91:0/4280969681 wait complete. 2023-11-27T18:14:06.179 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.181+0000 7f6079af2640 1 Processor -- start 2023-11-27T18:14:06.179 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.181+0000 7f6079af2640 1 -- start start 2023-11-27T18:14:06.179 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-27T18:14:06.180 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.185+0000 7f6079af2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f605c0052b0 0x7f60741438b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:06.180 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.185+0000 7f6079af2640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6074142fa0 0x7f60740cac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:06.180 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.185+0000 7f6079af2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60741433e0 0x7f60740cb160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:06.180 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.185+0000 7f6079af2640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607406c8e0 con 0x7f60741433e0 2023-11-27T18:14:06.181 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.185+0000 7f6079af2640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60741f20c0 con 0x7f605c0052b0 2023-11-27T18:14:06.181 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.185+0000 7f6079af2640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f607406b6d0 con 0x7f6074142fa0 2023-11-27T18:14:06.184 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.189+0000 7f3879ffb640 1 -- 172.21.15.91:0/3877890453 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386c005270 con 0x7f3864003980 2023-11-27T18:14:06.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.189+0000 7f3879ffb640 1 -- 172.21.15.91:0/3877890453 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f386c0a7070 con 0x7f3864003980 2023-11-27T18:14:06.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.189+0000 7f3879ffb640 1 -- 172.21.15.91:0/3877890453 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386c003860 con 0x7f3864003980 2023-11-27T18:14:06.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.189+0000 7f3881788640 1 -- 172.21.15.91:0/3877890453 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3864003980 msgr2=0x7f3864003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:06.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.189+0000 7f3881788640 1 --2- 172.21.15.91:0/3877890453 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3864003980 0x7f3864003d80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f386c007fd0 tx=0x7f386c01c290 comp rx=0 tx=0).stop 2023-11-27T18:14:06.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.189+0000 7f3881788640 1 -- 172.21.15.91:0/3877890453 shutdown_connections 2023-11-27T18:14:06.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.189+0000 7f3881788640 1 --2- 172.21.15.91:0/3877890453 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3864003980 0x7f3864003d80 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:06.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.189+0000 7f3881788640 1 -- 172.21.15.91:0/3877890453 >> 172.21.15.91:0/3877890453 conn(0x7f387c072190 msgr2=0x7f387c0725a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:06.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.189+0000 7f3881788640 1 -- 172.21.15.91:0/3877890453 shutdown_connections 2023-11-27T18:14:06.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.189+0000 7f3881788640 1 -- 172.21.15.91:0/3877890453 wait complete. 2023-11-27T18:14:06.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.189+0000 7f6073fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60741433e0 0x7f60740cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:06.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.189+0000 7fe9fd15b640 1 --2- 172.21.15.91:0/3979651122 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe9f81517e0 0x7fe9f80c6ed0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe9f4009870 tx=0x7fe9f401ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a97d5f6c26149443 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:06.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.189+0000 7f3881788640 1 Processor -- start 2023-11-27T18:14:06.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.189+0000 7f3881788640 1 -- start start 2023-11-27T18:14:06.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.189+0000 7f3881788640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3864003980 0x7f387c155c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:06.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.189+0000 7f3881788640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f387c152e20 0x7f387c1f16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:06.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.189+0000 7f3881788640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f387c151bb0 0x7f387c135570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:06.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.189+0000 7f3881788640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f387c0c2930 con 0x7f3864003980 2023-11-27T18:14:06.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.189+0000 7f3881788640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f387c0c2340 con 0x7f387c152e20 2023-11-27T18:14:06.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.189+0000 7f3881788640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f387c0c5330 con 0x7f387c151bb0 2023-11-27T18:14:06.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.193+0000 7f6073fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60741433e0 0x7f60740cb160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:56002/0 (socket says 172.21.15.91:56002) 2023-11-27T18:14:06.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.193+0000 7f6073fff640 1 -- 172.21.15.91:0/2307108347 learned_addr learned my addr 172.21.15.91:0/2307108347 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:06.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.197+0000 7f387a7fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f387c152e20 0x7f387c1f16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:06.193 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.197+0000 7f60737fe640 1 --2- 172.21.15.91:0/2307108347 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f605c0052b0 0x7f60741438b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:06.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.201+0000 7f387a7fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f387c152e20 0x7f387c1f16c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.91:49870/0 (socket says 172.21.15.91:49870) 2023-11-27T18:14:06.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.201+0000 7f387a7fc640 1 -- 172.21.15.91:0/1379707625 learned_addr learned my addr 172.21.15.91:0/1379707625 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:06.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.201+0000 7f548bfff640 1 --2- 172.21.15.91:0/462446297 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f548c151650 0x7f548c0c1c70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f548c06fa80 tx=0x7f547c01c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e232663b2cfac11 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:06.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.209+0000 7f60737fe640 1 -- 172.21.15.91:0/2307108347 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6074142fa0 msgr2=0x7f60740cac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:06.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.209+0000 7f60737fe640 1 --2- 172.21.15.91:0/2307108347 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6074142fa0 0x7f60740cac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:06.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.209+0000 7f60737fe640 1 -- 172.21.15.91:0/2307108347 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60741433e0 msgr2=0x7f60740cb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:06.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.209+0000 7f60737fe640 1 --2- 172.21.15.91:0/2307108347 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60741433e0 0x7f60740cb160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:06.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.209+0000 7f60737fe640 1 -- 172.21.15.91:0/2307108347 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f607406c4c0 con 0x7f605c0052b0 2023-11-27T18:14:06.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.213+0000 7fe9effff640 1 -- 172.21.15.91:0/3979651122 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f40a89b0 con 0x7fe9f81517e0 2023-11-27T18:14:06.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.213+0000 7fe9effff640 1 -- 172.21.15.91:0/3979651122 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f40a8b10 con 0x7fe9f81517e0 2023-11-27T18:14:06.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.213+0000 7fe9effff640 1 -- 172.21.15.91:0/3979651122 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f40a8ea0 con 0x7fe9f81517e0 2023-11-27T18:14:06.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.213+0000 7fe9ff3bf640 1 -- 172.21.15.91:0/3979651122 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe9f81517e0 msgr2=0x7fe9f80c6ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:06.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.213+0000 7fe9ff3bf640 1 --2- 172.21.15.91:0/3979651122 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe9f81517e0 0x7fe9f80c6ed0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe9f4009870 tx=0x7fe9f401ecf0 comp rx=0 tx=0).stop 2023-11-27T18:14:06.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.217+0000 7fe9ff3bf640 1 -- 172.21.15.91:0/3979651122 shutdown_connections 2023-11-27T18:14:06.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.217+0000 7fe9ff3bf640 1 --2- 172.21.15.91:0/3979651122 >> v2:172.21.15.94:3300/0 conn(0x7fe9f806e6c0 0x7fe9f806ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:06.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.217+0000 7fe9ff3bf640 1 --2- 172.21.15.91:0/3979651122 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe9f81517e0 0x7fe9f80c6ed0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:06.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.217+0000 7fe9ff3bf640 1 -- 172.21.15.91:0/3979651122 >> 172.21.15.91:0/3979651122 conn(0x7fe9f80c8aa0 msgr2=0x7fe9f80c8e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:06.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.217+0000 7fe9ff3bf640 1 -- 172.21.15.91:0/3979651122 shutdown_connections 2023-11-27T18:14:06.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.217+0000 7fe9ff3bf640 1 -- 172.21.15.91:0/3979651122 wait complete. 2023-11-27T18:14:06.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.217+0000 7f387b7fe640 1 --2- 172.21.15.91:0/1379707625 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f387c151bb0 0x7f387c135570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:06.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.217+0000 7fe9ff3bf640 1 Processor -- start 2023-11-27T18:14:06.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.217+0000 7fe9ff3bf640 1 -- start start 2023-11-27T18:14:06.215 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.217+0000 7f387a7fc640 1 -- 172.21.15.91:0/1379707625 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f387c151bb0 msgr2=0x7f387c135570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:06.215 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.217+0000 7f387a7fc640 1 --2- 172.21.15.91:0/1379707625 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f387c151bb0 0x7f387c135570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:06.215 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.217+0000 7f387a7fc640 1 -- 172.21.15.91:0/1379707625 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3864003980 msgr2=0x7f387c155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:06.215 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.217+0000 7f387a7fc640 1 --2- 172.21.15.91:0/1379707625 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3864003980 0x7f387c155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:06.215 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.217+0000 7f387a7fc640 1 -- 172.21.15.91:0/1379707625 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f387c0c5610 con 0x7f387c152e20 2023-11-27T18:14:06.215 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.217+0000 7f548affd640 1 -- 172.21.15.91:0/462446297 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547c0a7070 con 0x7f548c151650 2023-11-27T18:14:06.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.217+0000 7fe9ff3bf640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe9f806e6c0 0x7fe9f80cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:06.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.217+0000 7f548affd640 1 -- 172.21.15.91:0/462446297 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f547c0ab430 con 0x7f548c151650 2023-11-27T18:14:06.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.217+0000 7fe9ff3bf640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe9f806f060 0x7fe9f80c5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:06.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.217+0000 7f548affd640 1 -- 172.21.15.91:0/462446297 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547c0ab7c0 con 0x7f548c151650 2023-11-27T18:14:06.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.217+0000 7fe9ff3bf640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe9f81517e0 0x7fe9f80c9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:06.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.217+0000 7fe9ff3bf640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f8152650 con 0x7fe9f81517e0 2023-11-27T18:14:06.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.217+0000 7fe9ff3bf640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f81ecc90 con 0x7fe9f806f060 2023-11-27T18:14:06.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.217+0000 7fe9ff3bf640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f81edc40 con 0x7fe9f806e6c0 2023-11-27T18:14:06.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.217+0000 7f60737fe640 1 --2- 172.21.15.91:0/2307108347 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f605c0052b0 0x7f60741438b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f606400c760 tx=0x7f606400cc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:06.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.217+0000 7f5492757640 1 -- 172.21.15.91:0/462446297 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f548c151650 msgr2=0x7f548c0c1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:06.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.217+0000 7f5492757640 1 --2- 172.21.15.91:0/462446297 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f548c151650 0x7f548c0c1c70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f548c06fa80 tx=0x7f547c01c470 comp rx=0 tx=0).stop 2023-11-27T18:14:06.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.217+0000 7f5492757640 1 -- 172.21.15.91:0/462446297 shutdown_connections 2023-11-27T18:14:06.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.217+0000 7f5492757640 1 --2- 172.21.15.91:0/462446297 >> v2:172.21.15.91:3300/0 conn(0x7f548c0c8be0 0x7f548c157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:06.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.217+0000 7f5492757640 1 --2- 172.21.15.91:0/462446297 >> v2:172.21.15.94:3300/0 conn(0x7f548c15b550 0x7f548c157230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:06.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.217+0000 7f5492757640 1 --2- 172.21.15.91:0/462446297 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f548c151650 0x7f548c0c1c70 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:06.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.217+0000 7f5492757640 1 -- 172.21.15.91:0/462446297 >> 172.21.15.91:0/462446297 conn(0x7f548c0709f0 msgr2=0x7f548c070e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:06.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.217+0000 7f5492757640 1 -- 172.21.15.91:0/462446297 shutdown_connections 2023-11-27T18:14:06.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.217+0000 7f5492757640 1 -- 172.21.15.91:0/462446297 wait complete. 2023-11-27T18:14:06.220 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.221+0000 7f5492757640 1 Processor -- start 2023-11-27T18:14:06.220 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.221+0000 7f5492757640 1 -- start start 2023-11-27T18:14:06.220 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.221+0000 7f5492757640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f548c0c8be0 0x7f548c0cc760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:06.220 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.221+0000 7f5492757640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f548c151650 0x7f548c0b1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:06.220 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.221+0000 7f5492757640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f548c15b550 0x7f548c0caee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:06.220 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.221+0000 7f5492757640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548c0caac0 con 0x7f548c151650 2023-11-27T18:14:06.220 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.221+0000 7f5492757640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548c0cd1b0 con 0x7f548c0c8be0 2023-11-27T18:14:06.220 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.221+0000 7f5492757640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f548c1f0870 con 0x7f548c15b550 2023-11-27T18:14:06.220 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.225+0000 7fe9fd15b640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe9f806e6c0 0x7fe9f80cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:06.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.229+0000 7f387a7fc640 1 --2- 172.21.15.91:0/1379707625 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f387c152e20 0x7f387c1f16c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3870007310 tx=0x7f38700077d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:06.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.233+0000 7fe9fd15b640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe9f806e6c0 0x7fe9f80cb7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.91:54396/0 (socket says 172.21.15.91:54396) 2023-11-27T18:14:06.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.233+0000 7fe9fd15b640 1 -- 172.21.15.91:0/467706709 learned_addr learned my addr 172.21.15.91:0/467706709 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:06.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.233+0000 7fe9fc95a640 1 --2- 172.21.15.91:0/467706709 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe9f806f060 0x7fe9f80c5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:06.241 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.245+0000 7fe9fd15b640 1 -- 172.21.15.91:0/467706709 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe9f806f060 msgr2=0x7fe9f80c5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:06.241 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.245+0000 7fe9fd15b640 1 --2- 172.21.15.91:0/467706709 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe9f806f060 0x7fe9f80c5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:06.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.245+0000 7fe9fd15b640 1 -- 172.21.15.91:0/467706709 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe9f81517e0 msgr2=0x7fe9f80c9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:06.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.245+0000 7fe9fd15b640 1 --2- 172.21.15.91:0/467706709 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe9f81517e0 0x7fe9f80c9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:06.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.245+0000 7fe9fd15b640 1 -- 172.21.15.91:0/467706709 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f40094d0 con 0x7fe9f806e6c0 2023-11-27T18:14:06.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.249+0000 7f548bfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f548c0c8be0 0x7f548c0cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:06.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.253+0000 7fe9fd15b640 1 --2- 172.21.15.91:0/467706709 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe9f806e6c0 0x7fe9f80cb7e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe9f401d3a0 tx=0x7fe9f401ba90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:06.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.253+0000 7f605bfff640 1 -- 172.21.15.91:0/2307108347 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60640072d0 con 0x7f605c0052b0 2023-11-27T18:14:06.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.253+0000 7f605bfff640 1 -- 172.21.15.91:0/2307108347 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6064007430 con 0x7f605c0052b0 2023-11-27T18:14:06.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.253+0000 7f605bfff640 1 -- 172.21.15.91:0/2307108347 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60640047f0 con 0x7f605c0052b0 2023-11-27T18:14:06.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.253+0000 7f6079af2640 1 -- 172.21.15.91:0/2307108347 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6074143df0 con 0x7f605c0052b0 2023-11-27T18:14:06.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.253+0000 7f6079af2640 1 -- 172.21.15.91:0/2307108347 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f607406bc20 con 0x7f605c0052b0 2023-11-27T18:14:06.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.257+0000 7f6079af2640 1 -- 172.21.15.91:0/2307108347 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60741f2210 con 0x7f605c0052b0 2023-11-27T18:14:06.253 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.257+0000 7f38637fe640 1 -- 172.21.15.91:0/1379707625 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387000f9c0 con 0x7f387c152e20 2023-11-27T18:14:06.253 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.257+0000 7f38637fe640 1 -- 172.21.15.91:0/1379707625 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f387000fb60 con 0x7f387c152e20 2023-11-27T18:14:06.253 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.257+0000 7f38637fe640 1 -- 172.21.15.91:0/1379707625 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38700133f0 con 0x7f387c152e20 2023-11-27T18:14:06.253 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.257+0000 7f3881788640 1 -- 172.21.15.91:0/1379707625 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f387c0c58f0 con 0x7f387c152e20 2023-11-27T18:14:06.253 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.257+0000 7f3881788640 1 -- 172.21.15.91:0/1379707625 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f387c156140 con 0x7f387c152e20 2023-11-27T18:14:06.253 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.257+0000 7f3881788640 1 -- 172.21.15.91:0/1379707625 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f387c0c5ae0 con 0x7f387c152e20 2023-11-27T18:14:06.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.257+0000 7f548bfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f548c0c8be0 0x7f548c0cc760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.91:49890/0 (socket says 172.21.15.91:49890) 2023-11-27T18:14:06.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.257+0000 7f548bfff640 1 -- 172.21.15.91:0/1522465184 learned_addr learned my addr 172.21.15.91:0/1522465184 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:06.257 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.261+0000 7f5490cf4640 1 --2- 172.21.15.91:0/1522465184 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f548c15b550 0x7f548c0caee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:06.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.265+0000 7fe9edffb640 1 -- 172.21.15.91:0/467706709 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f40b0c20 con 0x7fe9f806e6c0 2023-11-27T18:14:06.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.265+0000 7fe9edffb640 1 -- 172.21.15.91:0/467706709 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f40b0da0 con 0x7fe9f806e6c0 2023-11-27T18:14:06.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.265+0000 7fe9edffb640 1 -- 172.21.15.91:0/467706709 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f40c3650 con 0x7fe9f806e6c0 2023-11-27T18:14:06.261 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.265+0000 7fe9ff3bf640 1 -- 172.21.15.91:0/467706709 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9f81ed7b0 con 0x7fe9f806e6c0 2023-11-27T18:14:06.261 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.265+0000 7fe9ff3bf640 1 -- 172.21.15.91:0/467706709 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9f81ece80 con 0x7fe9f806e6c0 2023-11-27T18:14:06.262 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.265+0000 7fe9ff3bf640 1 -- 172.21.15.91:0/467706709 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9f804e850 con 0x7fe9f806e6c0 2023-11-27T18:14:06.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.289+0000 7f5fd28e7640 1 Processor -- start 2023-11-27T18:14:06.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.289+0000 7f5fd28e7640 1 -- start start 2023-11-27T18:14:06.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.293+0000 7f5fd28e7640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f5fcc0c58d0 0x7f5fcc0c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:06.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.293+0000 7f5fd28e7640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f5fcc15ab20 0x7f5fcc15af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:06.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.293+0000 7f5fd28e7640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fcc15b4d0 con 0x7f5fcc0c54f0 2023-11-27T18:14:06.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.293+0000 7f5fd28e7640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fcc1580d0 con 0x7f5fcc15ab20 2023-11-27T18:14:06.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.293+0000 7f5fd28e7640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fcc1572d0 con 0x7f5fcc0c58d0 2023-11-27T18:14:06.431 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.433+0000 7fe989ffb640 1 -- 172.21.15.91:0/790794405 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe98c0b5020 con 0x7fe99806a590 2023-11-27T18:14:06.431 INFO:teuthology.orchestra.run.smithi091.stdout:68719476757 2023-11-27T18:14:06.433 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.437+0000 7fe99f32b640 1 -- 172.21.15.91:0/790794405 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe97c066840 msgr2=0x7fe97c068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:06.433 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.437+0000 7fe99f32b640 1 --2- 172.21.15.91:0/790794405 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe97c066840 0x7fe97c068d00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe998158c30 tx=0x7fe994009040 comp rx=0 tx=0).stop 2023-11-27T18:14:06.433 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.437+0000 7fe99f32b640 1 -- 172.21.15.91:0/790794405 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe99806a590 msgr2=0x7fe998159170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:06.434 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.437+0000 7fe99f32b640 1 --2- 172.21.15.91:0/790794405 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe99806a590 0x7fe998159170 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe98c01b8c0 tx=0x7fe98c01ba50 comp rx=0 tx=0).stop 2023-11-27T18:14:06.434 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.437+0000 7fe99f32b640 1 -- 172.21.15.91:0/790794405 shutdown_connections 2023-11-27T18:14:06.434 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.437+0000 7fe99f32b640 1 --2- 172.21.15.91:0/790794405 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe97c066840 0x7fe97c068d00 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:06.434 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.437+0000 7fe99f32b640 1 --2- 172.21.15.91:0/790794405 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe99815b280 0x7fe9981362a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:06.434 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.437+0000 7fe99f32b640 1 --2- 172.21.15.91:0/790794405 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe99813d260 0x7fe998135d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:06.434 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.437+0000 7fe99f32b640 1 --2- 172.21.15.91:0/790794405 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe99806a590 0x7fe998159170 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:06.434 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.437+0000 7fe99f32b640 1 -- 172.21.15.91:0/790794405 >> 172.21.15.91:0/790794405 conn(0x7fe9980c8080 msgr2=0x7fe9981390c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:06.434 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.437+0000 7fe99f32b640 1 -- 172.21.15.91:0/790794405 shutdown_connections 2023-11-27T18:14:06.434 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.437+0000 7fe99f32b640 1 -- 172.21.15.91:0/790794405 wait complete. 2023-11-27T18:14:06.448 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476757 got 68719476757 for osd.5 2023-11-27T18:14:06.448 DEBUG:teuthology.parallel:result is None 2023-11-27T18:14:06.463 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.465+0000 7f55fa7fc640 1 -- 172.21.15.91:0/833733354 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f56000067a0 con 0x7f55f00052b0 2023-11-27T18:14:06.464 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.469+0000 7f55fa7fc640 1 --2- 172.21.15.91:0/833733354 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f55e8066870 0x7f55e8068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:06.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.469+0000 7f56094bb640 1 --2- 172.21.15.91:0/833733354 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f55e8066870 0x7f55e8068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:06.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.469+0000 7f56094bb640 1 --2- 172.21.15.91:0/833733354 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f55e8066870 0x7f55e8068d30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f55f4001aa0 tx=0x7f55f4001a10 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:06.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.501+0000 7f55fa7fc640 1 -- 172.21.15.91:0/833733354 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f56000551f0 con 0x7f55f00052b0 2023-11-27T18:14:06.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.501+0000 7f55fa7fc640 1 -- 172.21.15.91:0/833733354 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f5600050e30 con 0x7f55f00052b0 2023-11-27T18:14:06.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.513+0000 7f548b7fe640 1 --2- 172.21.15.91:0/1522465184 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f548c151650 0x7f548c0b1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:06.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.513+0000 7f5fd0e84640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f5fcc15ab20 0x7f5fcc15af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:06.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.517+0000 7f548b7fe640 1 -- 172.21.15.91:0/1522465184 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f548c15b550 msgr2=0x7f548c0caee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:06.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.517+0000 7f548b7fe640 1 --2- 172.21.15.91:0/1522465184 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f548c15b550 0x7f548c0caee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:06.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.517+0000 7f548b7fe640 1 -- 172.21.15.91:0/1522465184 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f548c0c8be0 msgr2=0x7f548c0cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:06.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.517+0000 7f548b7fe640 1 --2- 172.21.15.91:0/1522465184 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f548c0c8be0 0x7f548c0cc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:06.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.517+0000 7f548b7fe640 1 -- 172.21.15.91:0/1522465184 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f547c0094d0 con 0x7f548c151650 2023-11-27T18:14:06.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.517+0000 7f5fd0e84640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f5fcc15ab20 0x7f5fcc15af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:56056/0 (socket says 172.21.15.91:56056) 2023-11-27T18:14:06.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.517+0000 7f5fd0e84640 1 -- 172.21.15.91:0/1688438378 learned_addr learned my addr 172.21.15.91:0/1688438378 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:06.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.525+0000 7f548b7fe640 1 --2- 172.21.15.91:0/1522465184 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f548c151650 0x7f548c0b1fa0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f548000d520 tx=0x7f548000d9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:06.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.525+0000 7f5fd0e84640 1 -- 172.21.15.91:0/1688438378 >> v2:172.21.15.94:3300/0 conn(0x7f5fcc0c58d0 msgr2=0x7f5fcc0c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:06.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.525+0000 7f5fd0e84640 1 --2- 172.21.15.91:0/1688438378 >> v2:172.21.15.94:3300/0 conn(0x7f5fcc0c58d0 0x7f5fcc0c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:06.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.525+0000 7f5fd0e84640 1 -- 172.21.15.91:0/1688438378 >> v1:172.21.15.94:6789/0 conn(0x7f5fcc0c54f0 legacy=0x7f5fcc0c8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:06.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.525+0000 7f5fd0e84640 1 -- 172.21.15.91:0/1688438378 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fcc157570 con 0x7f5fcc15ab20 2023-11-27T18:14:06.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.533+0000 7f5488ff9640 1 -- 172.21.15.91:0/1522465184 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5480005bb0 con 0x7f548c151650 2023-11-27T18:14:06.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.533+0000 7f5488ff9640 1 -- 172.21.15.91:0/1522465184 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5480005d10 con 0x7f548c151650 2023-11-27T18:14:06.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.533+0000 7f5488ff9640 1 -- 172.21.15.91:0/1522465184 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5480006290 con 0x7f548c151650 2023-11-27T18:14:06.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.533+0000 7f5492757640 1 -- 172.21.15.91:0/1522465184 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f548c0cd420 con 0x7f548c151650 2023-11-27T18:14:06.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.533+0000 7f5492757640 1 -- 172.21.15.91:0/1522465184 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f548c0cd9e0 con 0x7f548c151650 2023-11-27T18:14:06.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.533+0000 7f5492757640 1 -- 172.21.15.91:0/1522465184 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f548c0cac00 con 0x7f548c151650 2023-11-27T18:14:06.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.537+0000 7f5fd0e84640 1 --2- 172.21.15.91:0/1688438378 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5fcc15ab20 0x7f5fcc15af90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc151710 tx=0x7f5fc401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d2b3f3ecfdf4dd9 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:06.591 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.593+0000 7fe9edffb640 1 -- 172.21.15.91:0/467706709 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fe9f40b7070 con 0x7fe9f806e6c0 2023-11-27T18:14:06.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.597+0000 7fe9edffb640 1 --2- 172.21.15.91:0/467706709 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe9dc066840 0x7fe9dc068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:06.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.597+0000 7fe9fc95a640 1 --2- 172.21.15.91:0/467706709 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe9dc066840 0x7fe9dc068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:06.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.597+0000 7fe9fc95a640 1 --2- 172.21.15.91:0/467706709 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe9dc066840 0x7fe9dc068d00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe9f80cafb0 tx=0x7fe9e8009040 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:06.597 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.601+0000 7fe9edffb640 1 -- 172.21.15.91:0/467706709 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe9f40cb390 con 0x7fe9f806e6c0 2023-11-27T18:14:06.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.641+0000 7fe9edffb640 1 -- 172.21.15.91:0/467706709 <== mon.2 v2:172.21.15.94:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fe9f40ef6f0 con 0x7fe9f806e6c0 2023-11-27T18:14:06.668 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.673+0000 7f560bf20640 1 -- 172.21.15.91:0/833733354 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f56040b20d0 con 0x7f55f00052b0 2023-11-27T18:14:06.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.797+0000 7f55fa7fc640 1 -- 172.21.15.91:0/833733354 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5600020070 con 0x7f55f00052b0 2023-11-27T18:14:06.794 INFO:teuthology.orchestra.run.smithi091.stdout:64424509462 2023-11-27T18:14:06.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.801+0000 7f560bf20640 1 -- 172.21.15.91:0/833733354 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f55e8066870 msgr2=0x7f55e8068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:06.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.801+0000 7f560bf20640 1 --2- 172.21.15.91:0/833733354 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f55e8066870 0x7f55e8068d30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f55f4001aa0 tx=0x7f55f4001a10 comp rx=0 tx=0).stop 2023-11-27T18:14:06.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.801+0000 7f560bf20640 1 -- 172.21.15.91:0/833733354 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f55f00052b0 msgr2=0x7f5604154470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:06.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.801+0000 7f560bf20640 1 --2- 172.21.15.91:0/833733354 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f55f00052b0 0x7f5604154470 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f560000c440 tx=0x7f560000c900 comp rx=0 tx=0).stop 2023-11-27T18:14:06.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.801+0000 7f560bf20640 1 -- 172.21.15.91:0/833733354 shutdown_connections 2023-11-27T18:14:06.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.801+0000 7f560bf20640 1 --2- 172.21.15.91:0/833733354 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f55e8066870 0x7f55e8068d30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:06.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.801+0000 7f560bf20640 1 --2- 172.21.15.91:0/833733354 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f56041528a0 0x7f5604152d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:06.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.801+0000 7f560bf20640 1 --2- 172.21.15.91:0/833733354 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56040b1b40 0x7f5604155220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:06.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.801+0000 7f560bf20640 1 --2- 172.21.15.91:0/833733354 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f55f00052b0 0x7f5604154470 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:06.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.801+0000 7f560bf20640 1 -- 172.21.15.91:0/833733354 >> 172.21.15.91:0/833733354 conn(0x7f5604071da0 msgr2=0x7f5604073720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:06.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.801+0000 7f560bf20640 1 -- 172.21.15.91:0/833733354 shutdown_connections 2023-11-27T18:14:06.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.801+0000 7f560bf20640 1 -- 172.21.15.91:0/833733354 wait complete. 2023-11-27T18:14:06.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.805+0000 7f5fcaffd640 1 -- 172.21.15.91:0/1688438378 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc40a5820 con 0x7f5fcc15ab20 2023-11-27T18:14:06.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.805+0000 7f5fcaffd640 1 -- 172.21.15.91:0/1688438378 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fc40a5980 con 0x7f5fcc15ab20 2023-11-27T18:14:06.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.805+0000 7f5fcaffd640 1 -- 172.21.15.91:0/1688438378 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc40a5d10 con 0x7f5fcc15ab20 2023-11-27T18:14:06.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.805+0000 7f5fd28e7640 1 -- 172.21.15.91:0/1688438378 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5fcc15ab20 msgr2=0x7f5fcc15af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:06.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.805+0000 7f5fd28e7640 1 --2- 172.21.15.91:0/1688438378 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5fcc15ab20 0x7f5fcc15af90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc151710 tx=0x7f5fc401c960 comp rx=0 tx=0).stop 2023-11-27T18:14:06.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.805+0000 7f5fd28e7640 1 -- 172.21.15.91:0/1688438378 shutdown_connections 2023-11-27T18:14:06.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.805+0000 7f5fd28e7640 1 --2- 172.21.15.91:0/1688438378 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5fcc15ab20 0x7f5fcc15af90 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:06.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.805+0000 7f5fd28e7640 1 --2- 172.21.15.91:0/1688438378 >> v2:172.21.15.94:3300/0 conn(0x7f5fcc0c58d0 0x7f5fcc0c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:06.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.805+0000 7f5fd28e7640 1 -- 172.21.15.91:0/1688438378 >> 172.21.15.91:0/1688438378 conn(0x7f5fcc071da0 msgr2=0x7f5fcc0721b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:06.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.805+0000 7f5fd28e7640 1 -- 172.21.15.91:0/1688438378 shutdown_connections 2023-11-27T18:14:06.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.805+0000 7f5fd28e7640 1 -- 172.21.15.91:0/1688438378 wait complete. 2023-11-27T18:14:06.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.809+0000 7f5fd28e7640 1 Processor -- start 2023-11-27T18:14:06.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.809+0000 7f5fd28e7640 1 -- start start 2023-11-27T18:14:06.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.809+0000 7f5fd28e7640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5fcc0c54f0 0x7f5fcc1f1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:06.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.809+0000 7f5fd28e7640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5fcc0c58d0 0x7f5fcc156360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:06.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.809+0000 7f5fd28e7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5fcc15ab20 0x7f5fcc1568a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:06.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.809+0000 7f5fd28e7640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fcc156de0 con 0x7f5fcc0c58d0 2023-11-27T18:14:06.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.809+0000 7f5fd28e7640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fcc06c290 con 0x7f5fcc15ab20 2023-11-27T18:14:06.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.809+0000 7f5fd28e7640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fcc06c4c0 con 0x7f5fcc0c54f0 2023-11-27T18:14:06.807 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.809+0000 7f5fcbfff640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5fcc0c54f0 0x7f5fcc1f1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:06.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.813+0000 7f5fcbfff640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5fcc0c54f0 0x7f5fcc1f1f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.91:54414/0 (socket says 172.21.15.91:54414) 2023-11-27T18:14:06.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.813+0000 7f5fcbfff640 1 -- 172.21.15.91:0/78758524 learned_addr learned my addr 172.21.15.91:0/78758524 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:06.815 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509461 got 64424509462 for osd.4 2023-11-27T18:14:06.815 DEBUG:teuthology.parallel:result is None 2023-11-27T18:14:06.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.821+0000 7f5fcbfff640 1 -- 172.21.15.91:0/78758524 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5fcc15ab20 msgr2=0x7f5fcc1568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:06.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.821+0000 7f5fcbfff640 1 --2- 172.21.15.91:0/78758524 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5fcc15ab20 0x7f5fcc1568a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:06.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.821+0000 7f5fcbfff640 1 -- 172.21.15.91:0/78758524 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5fcc0c58d0 msgr2=0x7f5fcc156360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:06.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.821+0000 7f5fcbfff640 1 --2- 172.21.15.91:0/78758524 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5fcc0c58d0 0x7f5fcc156360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:06.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.821+0000 7f5fcbfff640 1 -- 172.21.15.91:0/78758524 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc4009b30 con 0x7f5fcc0c54f0 2023-11-27T18:14:06.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.825+0000 7fe9ff3bf640 1 -- 172.21.15.91:0/467706709 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe9f806c5f0 con 0x7fe9f806e6c0 2023-11-27T18:14:06.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.825+0000 7f5fcbfff640 1 --2- 172.21.15.91:0/78758524 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5fcc0c54f0 0x7f5fcc1f1f60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5fc000c4c0 tx=0x7f5fc0001e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:06.833 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.837+0000 7f38637fe640 1 -- 172.21.15.91:0/1379707625 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f3870013550 con 0x7f387c152e20 2023-11-27T18:14:06.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.837+0000 7f38637fe640 1 --2- 172.21.15.91:0/1379707625 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f3868066820 0x7f3868068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:06.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.837+0000 7f387affd640 1 --2- 172.21.15.91:0/1379707625 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f3868066820 0x7f3868068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:06.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.837+0000 7f387affd640 1 --2- 172.21.15.91:0/1379707625 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f3868066820 0x7f3868068ce0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f386c0aa000 tx=0x7f386c000fc0 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:06.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.841+0000 7fe9edffb640 1 -- 172.21.15.91:0/467706709 <== mon.2 v2:172.21.15.94:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe9f806c5f0 con 0x7fe9f806e6c0 2023-11-27T18:14:06.837 INFO:teuthology.orchestra.run.smithi091.stdout:68719476756 2023-11-27T18:14:06.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.841+0000 7f5488ff9640 1 -- 172.21.15.91:0/1522465184 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f54800063f0 con 0x7f548c151650 2023-11-27T18:14:06.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.841+0000 7f5488ff9640 1 --2- 172.21.15.91:0/1522465184 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f5478066870 0x7f5478068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:06.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.841+0000 7f548bfff640 1 --2- 172.21.15.91:0/1522465184 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f5478066870 0x7f5478068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:06.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.841+0000 7f548bfff640 1 --2- 172.21.15.91:0/1522465184 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f5478066870 0x7f5478068d30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f547c000c10 tx=0x7f547c008040 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:06.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.841+0000 7fe9ff3bf640 1 -- 172.21.15.91:0/467706709 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe9dc066840 msgr2=0x7fe9dc068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:06.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.841+0000 7fe9ff3bf640 1 --2- 172.21.15.91:0/467706709 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe9dc066840 0x7fe9dc068d00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe9f80cafb0 tx=0x7fe9e8009040 comp rx=0 tx=0).stop 2023-11-27T18:14:06.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.841+0000 7fe9ff3bf640 1 -- 172.21.15.91:0/467706709 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe9f806e6c0 msgr2=0x7fe9f80cb7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:06.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.841+0000 7fe9ff3bf640 1 --2- 172.21.15.91:0/467706709 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe9f806e6c0 0x7fe9f80cb7e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe9f401d3a0 tx=0x7fe9f401ba90 comp rx=0 tx=0).stop 2023-11-27T18:14:06.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.841+0000 7fe9ff3bf640 1 -- 172.21.15.91:0/467706709 shutdown_connections 2023-11-27T18:14:06.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.841+0000 7fe9ff3bf640 1 --2- 172.21.15.91:0/467706709 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe9dc066840 0x7fe9dc068d00 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:06.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.841+0000 7fe9ff3bf640 1 --2- 172.21.15.91:0/467706709 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe9f81517e0 0x7fe9f80c9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:06.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.841+0000 7fe9ff3bf640 1 --2- 172.21.15.91:0/467706709 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe9f806f060 0x7fe9f80c5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:06.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.841+0000 7fe9ff3bf640 1 --2- 172.21.15.91:0/467706709 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe9f806e6c0 0x7fe9f80cb7e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:06.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.841+0000 7fe9ff3bf640 1 -- 172.21.15.91:0/467706709 >> 172.21.15.91:0/467706709 conn(0x7fe9f80c8aa0 msgr2=0x7fe9f80c7a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:06.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.841+0000 7fe9ff3bf640 1 -- 172.21.15.91:0/467706709 shutdown_connections 2023-11-27T18:14:06.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.841+0000 7fe9ff3bf640 1 -- 172.21.15.91:0/467706709 wait complete. 2023-11-27T18:14:06.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.849+0000 7f5fc8ff9640 1 -- 172.21.15.91:0/78758524 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc0005480 con 0x7f5fcc0c54f0 2023-11-27T18:14:06.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.849+0000 7f5fc8ff9640 1 -- 172.21.15.91:0/78758524 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fc0003600 con 0x7f5fcc0c54f0 2023-11-27T18:14:06.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.849+0000 7f5fc8ff9640 1 -- 172.21.15.91:0/78758524 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc0003990 con 0x7f5fcc0c54f0 2023-11-27T18:14:06.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.849+0000 7f5fd28e7640 1 -- 172.21.15.91:0/78758524 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fcc1f5650 con 0x7f5fcc0c54f0 2023-11-27T18:14:06.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.849+0000 7f5fd28e7640 1 -- 172.21.15.91:0/78758524 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fcc155c90 con 0x7f5fcc0c54f0 2023-11-27T18:14:06.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.849+0000 7f5fd28e7640 1 -- 172.21.15.91:0/78758524 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fcc04e850 con 0x7f5fcc0c54f0 2023-11-27T18:14:06.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.857+0000 7f38637fe640 1 -- 172.21.15.91:0/1379707625 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f38700563a0 con 0x7f387c152e20 2023-11-27T18:14:06.855 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476756 got 68719476756 for osd.1 2023-11-27T18:14:06.855 DEBUG:teuthology.parallel:result is None 2023-11-27T18:14:06.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.873+0000 7f5488ff9640 1 -- 172.21.15.91:0/1522465184 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5480005e80 con 0x7f548c151650 2023-11-27T18:14:06.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.873+0000 7f5488ff9640 1 -- 172.21.15.91:0/1522465184 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f5480051de0 con 0x7f548c151650 2023-11-27T18:14:06.884 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.889+0000 7f38637fe640 1 -- 172.21.15.91:0/1379707625 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f3870051fe0 con 0x7f387c152e20 2023-11-27T18:14:06.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.929+0000 7f605bfff640 1 -- 172.21.15.91:0/2307108347 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f606400a640 con 0x7f605c0052b0 2023-11-27T18:14:06.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.929+0000 7f605bfff640 1 --2- 172.21.15.91:0/2307108347 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f6060066840 0x7f6060068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:06.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.929+0000 7f6072ffd640 1 --2- 172.21.15.91:0/2307108347 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f6060066840 0x7f6060068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:06.927 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.929+0000 7f6072ffd640 1 --2- 172.21.15.91:0/2307108347 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f6060066840 0x7f6060068d00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f60740b2e40 tx=0x7f6068006c00 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:06.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.937+0000 7f605bfff640 1 -- 172.21.15.91:0/2307108347 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f60640549e0 con 0x7f605c0052b0 2023-11-27T18:14:06.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:06.965+0000 7f605bfff640 1 -- 172.21.15.91:0/2307108347 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f6064050d20 con 0x7f605c0052b0 2023-11-27T18:14:07.024 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.029+0000 7f5492757640 1 -- 172.21.15.91:0/1522465184 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f548c0cac00 con 0x7f548c151650 2023-11-27T18:14:07.041 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.045+0000 7f3881788640 1 -- 172.21.15.91:0/1379707625 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f387c0c5ae0 con 0x7f387c152e20 2023-11-27T18:14:07.047 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.049+0000 7f38637fe640 1 -- 172.21.15.91:0/1379707625 <== mon.1 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f387c0c5ae0 con 0x7f387c152e20 2023-11-27T18:14:07.047 INFO:teuthology.orchestra.run.smithi091.stdout:68719476756 2023-11-27T18:14:07.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.053+0000 7f3881788640 1 -- 172.21.15.91:0/1379707625 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f3868066820 msgr2=0x7f3868068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:07.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.053+0000 7f3881788640 1 --2- 172.21.15.91:0/1379707625 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f3868066820 0x7f3868068ce0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f386c0aa000 tx=0x7f386c000fc0 comp rx=0 tx=0).stop 2023-11-27T18:14:07.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.053+0000 7f3881788640 1 -- 172.21.15.91:0/1379707625 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f387c152e20 msgr2=0x7f387c1f16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:07.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.053+0000 7f3881788640 1 --2- 172.21.15.91:0/1379707625 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f387c152e20 0x7f387c1f16c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3870007310 tx=0x7f38700077d0 comp rx=0 tx=0).stop 2023-11-27T18:14:07.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.053+0000 7f3881788640 1 -- 172.21.15.91:0/1379707625 shutdown_connections 2023-11-27T18:14:07.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.053+0000 7f3881788640 1 --2- 172.21.15.91:0/1379707625 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f3868066820 0x7f3868068ce0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:07.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.053+0000 7f3881788640 1 --2- 172.21.15.91:0/1379707625 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f387c151bb0 0x7f387c135570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:07.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.053+0000 7f3881788640 1 --2- 172.21.15.91:0/1379707625 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f387c152e20 0x7f387c1f16c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:07.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.053+0000 7f3881788640 1 --2- 172.21.15.91:0/1379707625 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3864003980 0x7f387c155c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:07.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.053+0000 7f3881788640 1 -- 172.21.15.91:0/1379707625 >> 172.21.15.91:0/1379707625 conn(0x7f387c072190 msgr2=0x7f387c072570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:07.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.053+0000 7f3881788640 1 -- 172.21.15.91:0/1379707625 shutdown_connections 2023-11-27T18:14:07.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.053+0000 7f3881788640 1 -- 172.21.15.91:0/1379707625 wait complete. 2023-11-27T18:14:07.065 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476756 got 68719476756 for osd.2 2023-11-27T18:14:07.065 DEBUG:teuthology.parallel:result is None 2023-11-27T18:14:07.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.169+0000 7f6079af2640 1 -- 172.21.15.91:0/2307108347 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f60741f2210 con 0x7f605c0052b0 2023-11-27T18:14:07.182 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.185+0000 7f5488ff9640 1 -- 172.21.15.91:0/1522465184 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f548c0cac00 con 0x7f548c151650 2023-11-27T18:14:07.182 INFO:teuthology.orchestra.run.smithi091.stdout:68719476758 2023-11-27T18:14:07.183 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.189+0000 7f5fc8ff9640 1 -- 172.21.15.91:0/78758524 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f5fc001b3b0 con 0x7f5fcc0c54f0 2023-11-27T18:14:07.184 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.189+0000 7f5fc8ff9640 1 --2- 172.21.15.91:0/78758524 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f5fb8066840 0x7f5fb8068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:07.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.189+0000 7f5492757640 1 -- 172.21.15.91:0/1522465184 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f5478066870 msgr2=0x7f5478068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:07.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.189+0000 7f5492757640 1 --2- 172.21.15.91:0/1522465184 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f5478066870 0x7f5478068d30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f547c000c10 tx=0x7f547c008040 comp rx=0 tx=0).stop 2023-11-27T18:14:07.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.189+0000 7f5492757640 1 -- 172.21.15.91:0/1522465184 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f548c151650 msgr2=0x7f548c0b1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:07.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.189+0000 7f5492757640 1 --2- 172.21.15.91:0/1522465184 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f548c151650 0x7f548c0b1fa0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f548000d520 tx=0x7f548000d9e0 comp rx=0 tx=0).stop 2023-11-27T18:14:07.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.189+0000 7f5492757640 1 -- 172.21.15.91:0/1522465184 shutdown_connections 2023-11-27T18:14:07.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.189+0000 7f5492757640 1 --2- 172.21.15.91:0/1522465184 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f5478066870 0x7f5478068d30 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:07.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.189+0000 7f5492757640 1 --2- 172.21.15.91:0/1522465184 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f548c15b550 0x7f548c0caee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:07.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.189+0000 7f5492757640 1 --2- 172.21.15.91:0/1522465184 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f548c151650 0x7f548c0b1fa0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:07.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.189+0000 7f5fcb7fe640 1 --2- 172.21.15.91:0/78758524 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f5fb8066840 0x7f5fb8068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:07.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.189+0000 7f5492757640 1 --2- 172.21.15.91:0/1522465184 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f548c0c8be0 0x7f548c0cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:07.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.189+0000 7f5492757640 1 -- 172.21.15.91:0/1522465184 >> 172.21.15.91:0/1522465184 conn(0x7f548c0709f0 msgr2=0x7f548c0c33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:07.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.189+0000 7f5492757640 1 -- 172.21.15.91:0/1522465184 shutdown_connections 2023-11-27T18:14:07.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.189+0000 7f5492757640 1 -- 172.21.15.91:0/1522465184 wait complete. 2023-11-27T18:14:07.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.189+0000 7f5fcb7fe640 1 --2- 172.21.15.91:0/78758524 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f5fb8066840 0x7f5fb8068d00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc1efb90 tx=0x7f5fbc006ca0 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:07.201 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476757 got 68719476758 for osd.7 2023-11-27T18:14:07.201 DEBUG:teuthology.parallel:result is None 2023-11-27T18:14:07.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.217+0000 7f605bfff640 1 -- 172.21.15.91:0/2307108347 <== mon.1 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f60741f2210 con 0x7f605c0052b0 2023-11-27T18:14:07.213 INFO:teuthology.orchestra.run.smithi091.stdout:68719476758 2023-11-27T18:14:07.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.217+0000 7f6079af2640 1 -- 172.21.15.91:0/2307108347 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f6060066840 msgr2=0x7f6060068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:07.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.217+0000 7f6079af2640 1 --2- 172.21.15.91:0/2307108347 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f6060066840 0x7f6060068d00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f60740b2e40 tx=0x7f6068006c00 comp rx=0 tx=0).stop 2023-11-27T18:14:07.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.217+0000 7f6079af2640 1 -- 172.21.15.91:0/2307108347 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f605c0052b0 msgr2=0x7f60741438b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:07.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.217+0000 7f6079af2640 1 --2- 172.21.15.91:0/2307108347 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f605c0052b0 0x7f60741438b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f606400c760 tx=0x7f606400cc20 comp rx=0 tx=0).stop 2023-11-27T18:14:07.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.221+0000 7f6079af2640 1 -- 172.21.15.91:0/2307108347 shutdown_connections 2023-11-27T18:14:07.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.221+0000 7f6079af2640 1 --2- 172.21.15.91:0/2307108347 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f6060066840 0x7f6060068d00 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:07.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.221+0000 7f6079af2640 1 --2- 172.21.15.91:0/2307108347 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6074142fa0 0x7f60740cac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:07.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.221+0000 7f6079af2640 1 --2- 172.21.15.91:0/2307108347 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60741433e0 0x7f60740cb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:07.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.221+0000 7f6079af2640 1 --2- 172.21.15.91:0/2307108347 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f605c0052b0 0x7f60741438b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:07.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.221+0000 7f6079af2640 1 -- 172.21.15.91:0/2307108347 >> 172.21.15.91:0/2307108347 conn(0x7f607406a520 msgr2=0x7f60740cc100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:07.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.221+0000 7f6079af2640 1 -- 172.21.15.91:0/2307108347 shutdown_connections 2023-11-27T18:14:07.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.221+0000 7f6079af2640 1 -- 172.21.15.91:0/2307108347 wait complete. 2023-11-27T18:14:07.235 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476757 got 68719476758 for osd.0 2023-11-27T18:14:07.235 DEBUG:teuthology.parallel:result is None 2023-11-27T18:14:07.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.293+0000 7f5fc8ff9640 1 -- 172.21.15.91:0/78758524 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5fc0055180 con 0x7f5fcc0c54f0 2023-11-27T18:14:07.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.333+0000 7f5fc8ff9640 1 -- 172.21.15.91:0/78758524 <== mon.2 v2:172.21.15.94:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f5fc0050dc0 con 0x7f5fcc0c54f0 2023-11-27T18:14:07.500 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.501+0000 7f5fd28e7640 1 -- 172.21.15.91:0/78758524 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5fcc158420 con 0x7f5fcc0c54f0 2023-11-27T18:14:07.556 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.557+0000 7f5fc8ff9640 1 -- 172.21.15.91:0/78758524 <== mon.2 v2:172.21.15.94:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5fc0017020 con 0x7f5fcc0c54f0 2023-11-27T18:14:07.556 INFO:teuthology.orchestra.run.smithi091.stdout:68719476756 2023-11-27T18:14:07.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.561+0000 7f5fd28e7640 1 -- 172.21.15.91:0/78758524 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f5fb8066840 msgr2=0x7f5fb8068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:07.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.561+0000 7f5fd28e7640 1 --2- 172.21.15.91:0/78758524 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f5fb8066840 0x7f5fb8068d00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc1efb90 tx=0x7f5fbc006ca0 comp rx=0 tx=0).stop 2023-11-27T18:14:07.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.561+0000 7f5fd28e7640 1 -- 172.21.15.91:0/78758524 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5fcc0c54f0 msgr2=0x7f5fcc1f1f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:07.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.561+0000 7f5fd28e7640 1 --2- 172.21.15.91:0/78758524 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5fcc0c54f0 0x7f5fcc1f1f60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5fc000c4c0 tx=0x7f5fc0001e80 comp rx=0 tx=0).stop 2023-11-27T18:14:07.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.561+0000 7f5fd28e7640 1 -- 172.21.15.91:0/78758524 shutdown_connections 2023-11-27T18:14:07.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.561+0000 7f5fd28e7640 1 --2- 172.21.15.91:0/78758524 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f5fb8066840 0x7f5fb8068d00 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:07.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.561+0000 7f5fd28e7640 1 --2- 172.21.15.91:0/78758524 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5fcc15ab20 0x7f5fcc1568a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:07.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.561+0000 7f5fd28e7640 1 --2- 172.21.15.91:0/78758524 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5fcc0c58d0 0x7f5fcc156360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:07.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.561+0000 7f5fd28e7640 1 --2- 172.21.15.91:0/78758524 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5fcc0c54f0 0x7f5fcc1f1f60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:07.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.561+0000 7f5fd28e7640 1 -- 172.21.15.91:0/78758524 >> 172.21.15.91:0/78758524 conn(0x7f5fcc071da0 msgr2=0x7f5fcc0c1130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:07.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.565+0000 7f5fd28e7640 1 -- 172.21.15.91:0/78758524 shutdown_connections 2023-11-27T18:14:07.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.565+0000 7f5fd28e7640 1 -- 172.21.15.91:0/78758524 wait complete. 2023-11-27T18:14:07.580 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476755 got 68719476756 for osd.3 2023-11-27T18:14:07.580 DEBUG:teuthology.parallel:result is None 2023-11-27T18:14:07.580 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-27T18:14:07.581 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T18:14:07.699 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.701+0000 7f2388540640 1 Processor -- start 2023-11-27T18:14:07.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.701+0000 7f2388540640 1 -- start start 2023-11-27T18:14:07.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.705+0000 7f2388540640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f23800c5f10 0x7f238006d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:07.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.705+0000 7f2388540640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2380072b70 con 0x7f2380151820 2023-11-27T18:14:07.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.705+0000 7f2388540640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23800c6490 con 0x7f23800c85c0 2023-11-27T18:14:07.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.705+0000 7f2388540640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23800c2d20 con 0x7f23800c5f10 2023-11-27T18:14:07.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.705+0000 7f23862dc640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f2380151820 0x7f2380070e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:53556/0 (socket says 172.21.15.91:53556) 2023-11-27T18:14:07.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.705+0000 7f23862dc640 1 -- 172.21.15.91:0/2901766895 learned_addr learned my addr 172.21.15.91:0/2901766895 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:14:07.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.705+0000 7f2386add640 1 --2- 172.21.15.91:0/2901766895 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f23800c5f10 0x7f238006d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:07.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.709+0000 7f23852da640 1 -- 172.21.15.91:0/2901766895 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2987948675 0 0) 0x7f2380072b70 con 0x7f2380151820 2023-11-27T18:14:07.704 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.709+0000 7f23852da640 1 -- 172.21.15.91:0/2901766895 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f236c003530 con 0x7f2380151820 2023-11-27T18:14:07.708 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.709+0000 7f23852da640 1 -- 172.21.15.91:0/2901766895 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3576576602 0 0) 0x7f236c003530 con 0x7f2380151820 2023-11-27T18:14:07.708 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.709+0000 7f23852da640 1 -- 172.21.15.91:0/2901766895 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f23800c5f10 msgr2=0x7f238006d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:07.708 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.709+0000 7f23852da640 1 --2- 172.21.15.91:0/2901766895 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f23800c5f10 0x7f238006d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:07.708 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.709+0000 7f23852da640 1 -- 172.21.15.91:0/2901766895 >> v1:172.21.15.94:6789/0 conn(0x7f23800c85c0 legacy=0x7f238006cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:07.708 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.709+0000 7f23852da640 1 -- 172.21.15.91:0/2901766895 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2380158160 con 0x7f2380151820 2023-11-27T18:14:07.708 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.709+0000 7f23852da640 1 -- 172.21.15.91:0/2901766895 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3378743932 0 0) 0x7f237c001680 con 0x7f2380151820 2023-11-27T18:14:07.708 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.709+0000 7f23852da640 1 -- 172.21.15.91:0/2901766895 >> v1:172.21.15.91:6789/0 conn(0x7f2380151820 legacy=0x7f2380070e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:07.708 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.709+0000 7f23852da640 1 --2- 172.21.15.91:0/2901766895 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f23800c5f10 0x7f236c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:07.708 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.709+0000 7f23852da640 1 --2- 172.21.15.91:0/2901766895 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f236c003f80 0x7f236c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:07.708 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.709+0000 7f23852da640 1 --2- 172.21.15.91:0/2901766895 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f236c004d10 0x7f236c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:07.708 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.709+0000 7f23852da640 1 -- 172.21.15.91:0/2901766895 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23800c2d20 con 0x7f236c004d10 2023-11-27T18:14:07.709 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.709+0000 7f23852da640 1 -- 172.21.15.91:0/2901766895 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236c00bb60 con 0x7f236c003f80 2023-11-27T18:14:07.709 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.709+0000 7f23852da640 1 -- 172.21.15.91:0/2901766895 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f236c00bd20 con 0x7f23800c5f10 2023-11-27T18:14:07.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.713+0000 7f2386add640 1 --2- 172.21.15.91:0/2901766895 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f236c004d10 0x7f236c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:07.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.717+0000 7f2386add640 1 -- 172.21.15.91:0/2901766895 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f23800c5f10 msgr2=0x7f236c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:07.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.717+0000 7f2386add640 1 --2- 172.21.15.91:0/2901766895 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f23800c5f10 0x7f236c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:07.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.717+0000 7f2386add640 1 -- 172.21.15.91:0/2901766895 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f236c003f80 msgr2=0x7f236c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:07.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.717+0000 7f2386add640 1 --2- 172.21.15.91:0/2901766895 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f236c003f80 0x7f236c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:07.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.717+0000 7f2386add640 1 -- 172.21.15.91:0/2901766895 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f236c003530 con 0x7f236c004d10 2023-11-27T18:14:07.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.721+0000 7f2386add640 1 --2- 172.21.15.91:0/2901766895 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f236c004d10 0x7f236c005190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2378009fc0 tx=0x7f237801cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8bae6888a024e3a server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:07.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.721+0000 7f23852da640 1 -- 172.21.15.91:0/2901766895 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23780a5cb0 con 0x7f236c004d10 2023-11-27T18:14:07.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.721+0000 7f23852da640 1 -- 172.21.15.91:0/2901766895 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f237800f040 con 0x7f236c004d10 2023-11-27T18:14:07.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.721+0000 7f23852da640 1 -- 172.21.15.91:0/2901766895 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23780ad680 con 0x7f236c004d10 2023-11-27T18:14:07.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.725+0000 7f2388540640 1 -- 172.21.15.91:0/2901766895 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f236c004d10 msgr2=0x7f236c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:07.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.725+0000 7f2388540640 1 --2- 172.21.15.91:0/2901766895 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f236c004d10 0x7f236c005190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2378009fc0 tx=0x7f237801cca0 comp rx=0 tx=0).stop 2023-11-27T18:14:07.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.725+0000 7f2386add640 1 -- 172.21.15.91:0/2901766895 reap_dead start 2023-11-27T18:14:07.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.725+0000 7f2388540640 1 -- 172.21.15.91:0/2901766895 shutdown_connections 2023-11-27T18:14:07.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.725+0000 7f2388540640 1 -- 172.21.15.91:0/2901766895 >> 172.21.15.91:0/2901766895 conn(0x7f23800c79b0 msgr2=0x7f23800c7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:07.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.725+0000 7f2388540640 1 -- 172.21.15.91:0/2901766895 shutdown_connections 2023-11-27T18:14:07.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.725+0000 7f2388540640 1 -- 172.21.15.91:0/2901766895 wait complete. 2023-11-27T18:14:07.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.725+0000 7f2388540640 1 Processor -- start 2023-11-27T18:14:07.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.725+0000 7f2388540640 1 -- start start 2023-11-27T18:14:07.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.725+0000 7f2388540640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f23800720c0 0x7f2380155fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:07.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.725+0000 7f2388540640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f23800724a0 0x7f2380143170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:07.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.725+0000 7f2388540640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2380155a90 0x7f23801436b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:07.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.725+0000 7f2388540640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23801f0e90 con 0x7f2380155a90 2023-11-27T18:14:07.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.725+0000 7f2388540640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f238014ef90 con 0x7f23800720c0 2023-11-27T18:14:07.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.725+0000 7f2388540640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23801f0250 con 0x7f23800724a0 2023-11-27T18:14:07.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.725+0000 7f2386add640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2380155a90 0x7f23801436b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:07.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.725+0000 7f2386add640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2380155a90 0x7f23801436b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:56086/0 (socket says 172.21.15.91:56086) 2023-11-27T18:14:07.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.725+0000 7f2386add640 1 -- 172.21.15.91:0/2930327745 learned_addr learned my addr 172.21.15.91:0/2930327745 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:07.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.725+0000 7f2385adb640 1 --2- 172.21.15.91:0/2930327745 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f23800724a0 0x7f2380143170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:07.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.729+0000 7f23862dc640 1 --2- 172.21.15.91:0/2930327745 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f23800720c0 0x7f2380155fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:07.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.729+0000 7f2386add640 1 -- 172.21.15.91:0/2930327745 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f23800724a0 msgr2=0x7f2380143170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:07.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.729+0000 7f2386add640 1 --2- 172.21.15.91:0/2930327745 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f23800724a0 0x7f2380143170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:07.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.729+0000 7f2386add640 1 -- 172.21.15.91:0/2930327745 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f23800720c0 msgr2=0x7f2380155fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:07.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.729+0000 7f2386add640 1 --2- 172.21.15.91:0/2930327745 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f23800720c0 0x7f2380155fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:07.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.729+0000 7f2386add640 1 -- 172.21.15.91:0/2930327745 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23801f04f0 con 0x7f2380155a90 2023-11-27T18:14:07.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.733+0000 7f2386add640 1 --2- 172.21.15.91:0/2930327745 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2380155a90 0x7f23801436b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f23780b0040 tx=0x7f2378009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:07.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.737+0000 7f2376ffd640 1 -- 172.21.15.91:0/2930327745 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23780039a0 con 0x7f2380155a90 2023-11-27T18:14:07.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.737+0000 7f2376ffd640 1 -- 172.21.15.91:0/2930327745 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2378003b00 con 0x7f2380155a90 2023-11-27T18:14:07.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.737+0000 7f2376ffd640 1 -- 172.21.15.91:0/2930327745 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2378003e90 con 0x7f2380155a90 2023-11-27T18:14:07.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.737+0000 7f2388540640 1 -- 172.21.15.91:0/2930327745 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23801f07d0 con 0x7f2380155a90 2023-11-27T18:14:07.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.737+0000 7f2388540640 1 -- 172.21.15.91:0/2930327745 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23800c9f80 con 0x7f2380155a90 2023-11-27T18:14:07.734 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.737+0000 7f2388540640 1 -- 172.21.15.91:0/2930327745 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23801f0fd0 con 0x7f2380155a90 2023-11-27T18:14:07.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.753+0000 7f2376ffd640 1 -- 172.21.15.91:0/2930327745 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f23780b4040 con 0x7f2380155a90 2023-11-27T18:14:07.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.753+0000 7f2376ffd640 1 --2- 172.21.15.91:0/2930327745 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f2364066870 0x7f2364068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:07.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.753+0000 7f23862dc640 1 --2- 172.21.15.91:0/2930327745 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f2364066870 0x7f2364068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:07.752 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:07.757+0000 7f23862dc640 1 --2- 172.21.15.91:0/2930327745 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f2364066870 0x7f2364068d30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f237c000c10 tx=0x7f237c001a70 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:07.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.001+0000 7f2376ffd640 1 -- 172.21.15.91:0/2930327745 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f23780ef370 con 0x7f2380155a90 2023-11-27T18:14:07.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.001+0000 7f2376ffd640 1 -- 172.21.15.91:0/2930327745 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f23780eb6b0 con 0x7f2380155a90 2023-11-27T18:14:08.156 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.161+0000 7f2388540640 1 -- 172.21.15.91:0/2930327745 --> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f23801f0c80 con 0x7f2364066870 2023-11-27T18:14:08.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.169+0000 7f2376ffd640 1 -- 172.21.15.91:0/2930327745 <== mgr.4136 v2:172.21.15.91:6800/2814827118 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368601 (secure 0 0 0) 0x7f237c00f9a0 con 0x7f2364066870 2023-11-27T18:14:08.168 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:14:08.172 INFO:teuthology.orchestra.run.smithi091.stderr:dumped all 2023-11-27T18:14:08.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.173+0000 7f2388540640 1 -- 172.21.15.91:0/2930327745 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f2364066870 msgr2=0x7f2364068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:08.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.173+0000 7f2388540640 1 --2- 172.21.15.91:0/2930327745 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f2364066870 0x7f2364068d30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f237c000c10 tx=0x7f237c001a70 comp rx=0 tx=0).stop 2023-11-27T18:14:08.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.173+0000 7f2388540640 1 -- 172.21.15.91:0/2930327745 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2380155a90 msgr2=0x7f23801436b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:08.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.173+0000 7f2388540640 1 --2- 172.21.15.91:0/2930327745 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2380155a90 0x7f23801436b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f23780b0040 tx=0x7f2378009750 comp rx=0 tx=0).stop 2023-11-27T18:14:08.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.173+0000 7f2388540640 1 -- 172.21.15.91:0/2930327745 shutdown_connections 2023-11-27T18:14:08.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.173+0000 7f2388540640 1 --2- 172.21.15.91:0/2930327745 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f2364066870 0x7f2364068d30 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:08.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.173+0000 7f2388540640 1 --2- 172.21.15.91:0/2930327745 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f23800724a0 0x7f2380143170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:08.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.173+0000 7f2388540640 1 --2- 172.21.15.91:0/2930327745 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2380155a90 0x7f23801436b0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:08.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.173+0000 7f2388540640 1 --2- 172.21.15.91:0/2930327745 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f23800720c0 0x7f2380155fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:08.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.173+0000 7f2388540640 1 -- 172.21.15.91:0/2930327745 >> 172.21.15.91:0/2930327745 conn(0x7f23800c79b0 msgr2=0x7f2380070df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:08.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.177+0000 7f2388540640 1 -- 172.21.15.91:0/2930327745 shutdown_connections 2023-11-27T18:14:08.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.177+0000 7f2388540640 1 -- 172.21.15.91:0/2930327745 wait complete. 2023-11-27T18:14:08.189 INFO:teuthology.orchestra.run.smithi091.stdout:{"pg_ready":true,"pg_map":{"version":71,"stamp":"2023-11-27T18:14:07.112730+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235452,"kb_used_data":2652,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739268,"statfs":{"total":773094113280,"available":772853010432,"internally_reserved":0,"allocated":2715648,"data_stored":2186933,"data_compressed":67010,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004794"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.975533+0000","last_change":"2023-11-27T18:13:12.298503+0000","last_active":"2023-11-27T18:13:21.975533+0000","last_peered":"2023-11-27T18:13:21.975533+0000","last_clean":"2023-11-27T18:13:21.975533+0000","last_became_active":"2023-11-27T18:13:12.298140+0000","last_became_peered":"2023-11-27T18:13:12.298140+0000","last_unstale":"2023-11-27T18:13:21.975533+0000","last_undegraded":"2023-11-27T18:13:21.975533+0000","last_fullsized":"2023-11-27T18:13:21.975533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:04:02.661989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.141448+0000","last_change":"2023-11-27T18:13:14.416681+0000","last_active":"2023-11-27T18:13:22.141448+0000","last_peered":"2023-11-27T18:13:22.141448+0000","last_clean":"2023-11-27T18:13:22.141448+0000","last_became_active":"2023-11-27T18:13:14.416401+0000","last_became_peered":"2023-11-27T18:13:14.416401+0000","last_unstale":"2023-11-27T18:13:22.141448+0000","last_undegraded":"2023-11-27T18:13:22.141448+0000","last_fullsized":"2023-11-27T18:13:22.141448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:02:14.142363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.231066+0000","last_change":"2023-11-27T18:13:20.916435+0000","last_active":"2023-11-27T18:13:23.231066+0000","last_peered":"2023-11-27T18:13:23.231066+0000","last_clean":"2023-11-27T18:13:23.231066+0000","last_became_active":"2023-11-27T18:13:20.915358+0000","last_became_peered":"2023-11-27T18:13:20.915358+0000","last_unstale":"2023-11-27T18:13:23.231066+0000","last_undegraded":"2023-11-27T18:13:23.231066+0000","last_fullsized":"2023-11-27T18:13:23.231066+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:55:46.903556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.141645+0000","last_change":"2023-11-27T18:13:12.305296+0000","last_active":"2023-11-27T18:13:22.141645+0000","last_peered":"2023-11-27T18:13:22.141645+0000","last_clean":"2023-11-27T18:13:22.141645+0000","last_became_active":"2023-11-27T18:13:12.304981+0000","last_became_peered":"2023-11-27T18:13:12.304981+0000","last_unstale":"2023-11-27T18:13:22.141645+0000","last_undegraded":"2023-11-27T18:13:22.141645+0000","last_fullsized":"2023-11-27T18:13:22.141645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:04:30.721243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.142078+0000","last_change":"2023-11-27T18:13:14.366102+0000","last_active":"2023-11-27T18:13:22.142078+0000","last_peered":"2023-11-27T18:13:22.142078+0000","last_clean":"2023-11-27T18:13:22.142078+0000","last_became_active":"2023-11-27T18:13:14.365787+0000","last_became_peered":"2023-11-27T18:13:14.365787+0000","last_unstale":"2023-11-27T18:13:22.142078+0000","last_undegraded":"2023-11-27T18:13:22.142078+0000","last_fullsized":"2023-11-27T18:13:22.142078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:39:34.589545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.674201+0000","last_change":"2023-11-27T18:13:20.915811+0000","last_active":"2023-11-27T18:13:23.674201+0000","last_peered":"2023-11-27T18:13:23.674201+0000","last_clean":"2023-11-27T18:13:23.674201+0000","last_became_active":"2023-11-27T18:13:20.914864+0000","last_became_peered":"2023-11-27T18:13:20.914864+0000","last_unstale":"2023-11-27T18:13:23.674201+0000","last_undegraded":"2023-11-27T18:13:23.674201+0000","last_fullsized":"2023-11-27T18:13:23.674201+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:22:21.572863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140911+0000","last_change":"2023-11-27T18:13:12.272691+0000","last_active":"2023-11-27T18:13:22.140911+0000","last_peered":"2023-11-27T18:13:22.140911+0000","last_clean":"2023-11-27T18:13:22.140911+0000","last_became_active":"2023-11-27T18:13:12.272343+0000","last_became_peered":"2023-11-27T18:13:12.272343+0000","last_unstale":"2023-11-27T18:13:22.140911+0000","last_undegraded":"2023-11-27T18:13:22.140911+0000","last_fullsized":"2023-11-27T18:13:22.140911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:23:55.280753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140650+0000","last_change":"2023-11-27T18:13:15.804199+0000","last_active":"2023-11-27T18:13:22.140650+0000","last_peered":"2023-11-27T18:13:22.140650+0000","last_clean":"2023-11-27T18:13:22.140650+0000","last_became_active":"2023-11-27T18:13:15.803248+0000","last_became_peered":"2023-11-27T18:13:15.803248+0000","last_unstale":"2023-11-27T18:13:22.140650+0000","last_undegraded":"2023-11-27T18:13:22.140650+0000","last_fullsized":"2023-11-27T18:13:22.140650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:39:31.246554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.675082+0000","last_change":"2023-11-27T18:13:20.909371+0000","last_active":"2023-11-27T18:13:23.675082+0000","last_peered":"2023-11-27T18:13:23.675082+0000","last_clean":"2023-11-27T18:13:23.675082+0000","last_became_active":"2023-11-27T18:13:20.908285+0000","last_became_peered":"2023-11-27T18:13:20.908285+0000","last_unstale":"2023-11-27T18:13:23.675082+0000","last_undegraded":"2023-11-27T18:13:23.675082+0000","last_fullsized":"2023-11-27T18:13:23.675082+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:40:20.210205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140612+0000","last_change":"2023-11-27T18:13:12.274531+0000","last_active":"2023-11-27T18:13:22.140612+0000","last_peered":"2023-11-27T18:13:22.140612+0000","last_clean":"2023-11-27T18:13:22.140612+0000","last_became_active":"2023-11-27T18:13:12.274275+0000","last_became_peered":"2023-11-27T18:13:12.274275+0000","last_unstale":"2023-11-27T18:13:22.140612+0000","last_undegraded":"2023-11-27T18:13:22.140612+0000","last_fullsized":"2023-11-27T18:13:22.140612+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:02:12.938184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.143037+0000","last_change":"2023-11-27T18:13:14.422531+0000","last_active":"2023-11-27T18:13:22.143037+0000","last_peered":"2023-11-27T18:13:22.143037+0000","last_clean":"2023-11-27T18:13:22.143037+0000","last_became_active":"2023-11-27T18:13:14.421811+0000","last_became_peered":"2023-11-27T18:13:14.421811+0000","last_unstale":"2023-11-27T18:13:22.143037+0000","last_undegraded":"2023-11-27T18:13:22.143037+0000","last_fullsized":"2023-11-27T18:13:22.143037+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:17:17.491694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.675351+0000","last_change":"2023-11-27T18:13:20.907358+0000","last_active":"2023-11-27T18:13:23.675351+0000","last_peered":"2023-11-27T18:13:23.675351+0000","last_clean":"2023-11-27T18:13:23.675351+0000","last_became_active":"2023-11-27T18:13:20.906418+0000","last_became_peered":"2023-11-27T18:13:20.906418+0000","last_unstale":"2023-11-27T18:13:23.675351+0000","last_undegraded":"2023-11-27T18:13:23.675351+0000","last_fullsized":"2023-11-27T18:13:23.675351+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:26:43.789814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.143078+0000","last_change":"2023-11-27T18:13:14.421453+0000","last_active":"2023-11-27T18:13:22.143078+0000","last_peered":"2023-11-27T18:13:22.143078+0000","last_clean":"2023-11-27T18:13:22.143078+0000","last_became_active":"2023-11-27T18:13:14.418640+0000","last_became_peered":"2023-11-27T18:13:14.418640+0000","last_unstale":"2023-11-27T18:13:22.143078+0000","last_undegraded":"2023-11-27T18:13:22.143078+0000","last_fullsized":"2023-11-27T18:13:22.143078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:38:18.655528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.142971+0000","last_change":"2023-11-27T18:13:12.306690+0000","last_active":"2023-11-27T18:13:22.142971+0000","last_peered":"2023-11-27T18:13:22.142971+0000","last_clean":"2023-11-27T18:13:22.142971+0000","last_became_active":"2023-11-27T18:13:12.306331+0000","last_became_peered":"2023-11-27T18:13:12.306331+0000","last_unstale":"2023-11-27T18:13:22.142971+0000","last_undegraded":"2023-11-27T18:13:22.142971+0000","last_fullsized":"2023-11-27T18:13:22.142971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:39:32.646368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.321605+0000","last_change":"2023-11-27T18:13:20.929179+0000","last_active":"2023-11-27T18:13:23.321605+0000","last_peered":"2023-11-27T18:13:23.321605+0000","last_clean":"2023-11-27T18:13:23.321605+0000","last_became_active":"2023-11-27T18:13:20.927962+0000","last_became_peered":"2023-11-27T18:13:20.927962+0000","last_unstale":"2023-11-27T18:13:23.321605+0000","last_undegraded":"2023-11-27T18:13:23.321605+0000","last_fullsized":"2023-11-27T18:13:23.321605+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:05:49.936547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.927324+0000","last_change":"2023-11-27T18:13:14.368428+0000","last_active":"2023-11-27T18:13:21.927324+0000","last_peered":"2023-11-27T18:13:21.927324+0000","last_clean":"2023-11-27T18:13:21.927324+0000","last_became_active":"2023-11-27T18:13:14.368117+0000","last_became_peered":"2023-11-27T18:13:14.368117+0000","last_unstale":"2023-11-27T18:13:21.927324+0000","last_undegraded":"2023-11-27T18:13:21.927324+0000","last_fullsized":"2023-11-27T18:13:21.927324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:24:45.528760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.139380+0000","last_change":"2023-11-27T18:13:12.306963+0000","last_active":"2023-11-27T18:13:22.139380+0000","last_peered":"2023-11-27T18:13:22.139380+0000","last_clean":"2023-11-27T18:13:22.139380+0000","last_became_active":"2023-11-27T18:13:12.306644+0000","last_became_peered":"2023-11-27T18:13:12.306644+0000","last_unstale":"2023-11-27T18:13:22.139380+0000","last_undegraded":"2023-11-27T18:13:22.139380+0000","last_fullsized":"2023-11-27T18:13:22.139380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:55:43.829654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:24.442496+0000","last_change":"2023-11-27T18:13:20.930173+0000","last_active":"2023-11-27T18:13:24.442496+0000","last_peered":"2023-11-27T18:13:24.442496+0000","last_clean":"2023-11-27T18:13:24.442496+0000","last_became_active":"2023-11-27T18:13:20.928830+0000","last_became_peered":"2023-11-27T18:13:20.928830+0000","last_unstale":"2023-11-27T18:13:24.442496+0000","last_undegraded":"2023-11-27T18:13:24.442496+0000","last_fullsized":"2023-11-27T18:13:24.442496+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:38:26.343953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.974087+0000","last_change":"2023-11-27T18:13:14.378647+0000","last_active":"2023-11-27T18:13:21.974087+0000","last_peered":"2023-11-27T18:13:21.974087+0000","last_clean":"2023-11-27T18:13:21.974087+0000","last_became_active":"2023-11-27T18:13:14.378391+0000","last_became_peered":"2023-11-27T18:13:14.378391+0000","last_unstale":"2023-11-27T18:13:21.974087+0000","last_undegraded":"2023-11-27T18:13:21.974087+0000","last_fullsized":"2023-11-27T18:13:21.974087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:02:22.189845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.975536+0000","last_change":"2023-11-27T18:13:12.270283+0000","last_active":"2023-11-27T18:13:21.975536+0000","last_peered":"2023-11-27T18:13:21.975536+0000","last_clean":"2023-11-27T18:13:21.975536+0000","last_became_active":"2023-11-27T18:13:12.269795+0000","last_became_peered":"2023-11-27T18:13:12.269795+0000","last_unstale":"2023-11-27T18:13:21.975536+0000","last_undegraded":"2023-11-27T18:13:21.975536+0000","last_fullsized":"2023-11-27T18:13:21.975536+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:06:24.103678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.231936+0000","last_change":"2023-11-27T18:13:20.907340+0000","last_active":"2023-11-27T18:13:23.231936+0000","last_peered":"2023-11-27T18:13:23.231936+0000","last_clean":"2023-11-27T18:13:23.231936+0000","last_became_active":"2023-11-27T18:13:20.906609+0000","last_became_peered":"2023-11-27T18:13:20.906609+0000","last_unstale":"2023-11-27T18:13:23.231936+0000","last_undegraded":"2023-11-27T18:13:23.231936+0000","last_fullsized":"2023-11-27T18:13:23.231936+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:19:00.295457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.142648+0000","last_change":"2023-11-27T18:13:14.415177+0000","last_active":"2023-11-27T18:13:22.142648+0000","last_peered":"2023-11-27T18:13:22.142648+0000","last_clean":"2023-11-27T18:13:22.142648+0000","last_became_active":"2023-11-27T18:13:14.414888+0000","last_became_peered":"2023-11-27T18:13:14.414888+0000","last_unstale":"2023-11-27T18:13:22.142648+0000","last_undegraded":"2023-11-27T18:13:22.142648+0000","last_fullsized":"2023-11-27T18:13:22.142648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:41:49.599901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.139916+0000","last_change":"2023-11-27T18:13:12.273724+0000","last_active":"2023-11-27T18:13:22.139916+0000","last_peered":"2023-11-27T18:13:22.139916+0000","last_clean":"2023-11-27T18:13:22.139916+0000","last_became_active":"2023-11-27T18:13:12.273356+0000","last_became_peered":"2023-11-27T18:13:12.273356+0000","last_unstale":"2023-11-27T18:13:22.139916+0000","last_undegraded":"2023-11-27T18:13:22.139916+0000","last_fullsized":"2023-11-27T18:13:22.139916+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:15:14.235633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.675747+0000","last_change":"2023-11-27T18:13:20.935910+0000","last_active":"2023-11-27T18:13:23.675747+0000","last_peered":"2023-11-27T18:13:23.675747+0000","last_clean":"2023-11-27T18:13:23.675747+0000","last_became_active":"2023-11-27T18:13:20.934797+0000","last_became_peered":"2023-11-27T18:13:20.934797+0000","last_unstale":"2023-11-27T18:13:23.675747+0000","last_undegraded":"2023-11-27T18:13:23.675747+0000","last_fullsized":"2023-11-27T18:13:23.675747+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:00:35.425015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.974788+0000","last_change":"2023-11-27T18:13:14.376557+0000","last_active":"2023-11-27T18:13:21.974788+0000","last_peered":"2023-11-27T18:13:21.974788+0000","last_clean":"2023-11-27T18:13:21.974788+0000","last_became_active":"2023-11-27T18:13:14.376304+0000","last_became_peered":"2023-11-27T18:13:14.376304+0000","last_unstale":"2023-11-27T18:13:21.974788+0000","last_undegraded":"2023-11-27T18:13:21.974788+0000","last_fullsized":"2023-11-27T18:13:21.974788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:37:22.787246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.145694+0000","last_change":"2023-11-27T18:13:12.307806+0000","last_active":"2023-11-27T18:13:22.145694+0000","last_peered":"2023-11-27T18:13:22.145694+0000","last_clean":"2023-11-27T18:13:22.145694+0000","last_became_active":"2023-11-27T18:13:12.307492+0000","last_became_peered":"2023-11-27T18:13:12.307492+0000","last_unstale":"2023-11-27T18:13:22.145694+0000","last_undegraded":"2023-11-27T18:13:22.145694+0000","last_fullsized":"2023-11-27T18:13:22.145694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:34:06.981997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.674551+0000","last_change":"2023-11-27T18:13:20.918671+0000","last_active":"2023-11-27T18:13:23.674551+0000","last_peered":"2023-11-27T18:13:23.674551+0000","last_clean":"2023-11-27T18:13:23.674551+0000","last_became_active":"2023-11-27T18:13:20.917507+0000","last_became_peered":"2023-11-27T18:13:20.917507+0000","last_unstale":"2023-11-27T18:13:23.674551+0000","last_undegraded":"2023-11-27T18:13:23.674551+0000","last_fullsized":"2023-11-27T18:13:23.674551+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:00:52.213234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.975274+0000","last_change":"2023-11-27T18:13:14.377644+0000","last_active":"2023-11-27T18:13:21.975274+0000","last_peered":"2023-11-27T18:13:21.975274+0000","last_clean":"2023-11-27T18:13:21.975274+0000","last_became_active":"2023-11-27T18:13:14.377289+0000","last_became_peered":"2023-11-27T18:13:14.377289+0000","last_unstale":"2023-11-27T18:13:21.975274+0000","last_undegraded":"2023-11-27T18:13:21.975274+0000","last_fullsized":"2023-11-27T18:13:21.975274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:55:42.641433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.975026+0000","last_change":"2023-11-27T18:13:12.267960+0000","last_active":"2023-11-27T18:13:21.975026+0000","last_peered":"2023-11-27T18:13:21.975026+0000","last_clean":"2023-11-27T18:13:21.975026+0000","last_became_active":"2023-11-27T18:13:12.267552+0000","last_became_peered":"2023-11-27T18:13:12.267552+0000","last_unstale":"2023-11-27T18:13:21.975026+0000","last_undegraded":"2023-11-27T18:13:21.975026+0000","last_fullsized":"2023-11-27T18:13:21.975026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:26:13.819717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.288385+0000","last_change":"2023-11-27T18:13:20.929780+0000","last_active":"2023-11-27T18:13:23.288385+0000","last_peered":"2023-11-27T18:13:23.288385+0000","last_clean":"2023-11-27T18:13:23.288385+0000","last_became_active":"2023-11-27T18:13:20.929370+0000","last_became_peered":"2023-11-27T18:13:20.929370+0000","last_unstale":"2023-11-27T18:13:23.288385+0000","last_undegraded":"2023-11-27T18:13:23.288385+0000","last_fullsized":"2023-11-27T18:13:23.288385+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:04:33.249483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140988+0000","last_change":"2023-11-27T18:13:14.369764+0000","last_active":"2023-11-27T18:13:22.140988+0000","last_peered":"2023-11-27T18:13:22.140988+0000","last_clean":"2023-11-27T18:13:22.140988+0000","last_became_active":"2023-11-27T18:13:14.369472+0000","last_became_peered":"2023-11-27T18:13:14.369472+0000","last_unstale":"2023-11-27T18:13:22.140988+0000","last_undegraded":"2023-11-27T18:13:22.140988+0000","last_fullsized":"2023-11-27T18:13:22.140988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:35:38.706782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.143297+0000","last_change":"2023-11-27T18:13:12.310761+0000","last_active":"2023-11-27T18:13:22.143297+0000","last_peered":"2023-11-27T18:13:22.143297+0000","last_clean":"2023-11-27T18:13:22.143297+0000","last_became_active":"2023-11-27T18:13:12.310495+0000","last_became_peered":"2023-11-27T18:13:12.310495+0000","last_unstale":"2023-11-27T18:13:22.143297+0000","last_undegraded":"2023-11-27T18:13:22.143297+0000","last_fullsized":"2023-11-27T18:13:22.143297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:48:59.333816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.935576+0000","last_change":"2023-11-27T18:13:20.907638+0000","last_active":"2023-11-27T18:13:23.935576+0000","last_peered":"2023-11-27T18:13:23.935576+0000","last_clean":"2023-11-27T18:13:23.935576+0000","last_became_active":"2023-11-27T18:13:20.907229+0000","last_became_peered":"2023-11-27T18:13:20.907229+0000","last_unstale":"2023-11-27T18:13:23.935576+0000","last_undegraded":"2023-11-27T18:13:23.935576+0000","last_fullsized":"2023-11-27T18:13:23.935576+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:49:08.226420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.071564+0000","last_change":"2023-11-27T18:13:15.851127+0000","last_active":"2023-11-27T18:13:22.071564+0000","last_peered":"2023-11-27T18:13:22.071564+0000","last_clean":"2023-11-27T18:13:22.071564+0000","last_became_active":"2023-11-27T18:13:15.850263+0000","last_became_peered":"2023-11-27T18:13:15.850263+0000","last_unstale":"2023-11-27T18:13:22.071564+0000","last_undegraded":"2023-11-27T18:13:22.071564+0000","last_fullsized":"2023-11-27T18:13:22.071564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:48:39.587974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.139967+0000","last_change":"2023-11-27T18:13:12.310451+0000","last_active":"2023-11-27T18:13:22.139967+0000","last_peered":"2023-11-27T18:13:22.139967+0000","last_clean":"2023-11-27T18:13:22.139967+0000","last_became_active":"2023-11-27T18:13:12.310138+0000","last_became_peered":"2023-11-27T18:13:12.310138+0000","last_unstale":"2023-11-27T18:13:22.139967+0000","last_undegraded":"2023-11-27T18:13:22.139967+0000","last_fullsized":"2023-11-27T18:13:22.139967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:03:09.046171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.934474+0000","last_change":"2023-11-27T18:13:20.896960+0000","last_active":"2023-11-27T18:13:23.934474+0000","last_peered":"2023-11-27T18:13:23.934474+0000","last_clean":"2023-11-27T18:13:23.934474+0000","last_became_active":"2023-11-27T18:13:20.896156+0000","last_became_peered":"2023-11-27T18:13:20.896156+0000","last_unstale":"2023-11-27T18:13:23.934474+0000","last_undegraded":"2023-11-27T18:13:23.934474+0000","last_fullsized":"2023-11-27T18:13:23.934474+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:00:52.213234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140720+0000","last_change":"2023-11-27T18:13:14.421498+0000","last_active":"2023-11-27T18:13:22.140720+0000","last_peered":"2023-11-27T18:13:22.140720+0000","last_clean":"2023-11-27T18:13:22.140720+0000","last_became_active":"2023-11-27T18:13:14.421125+0000","last_became_peered":"2023-11-27T18:13:14.421125+0000","last_unstale":"2023-11-27T18:13:22.140720+0000","last_undegraded":"2023-11-27T18:13:22.140720+0000","last_fullsized":"2023-11-27T18:13:22.140720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:52:30.225572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.143659+0000","last_change":"2023-11-27T18:13:12.301922+0000","last_active":"2023-11-27T18:13:22.143659+0000","last_peered":"2023-11-27T18:13:22.143659+0000","last_clean":"2023-11-27T18:13:22.143659+0000","last_became_active":"2023-11-27T18:13:12.301617+0000","last_became_peered":"2023-11-27T18:13:12.301617+0000","last_unstale":"2023-11-27T18:13:22.143659+0000","last_undegraded":"2023-11-27T18:13:22.143659+0000","last_fullsized":"2023-11-27T18:13:22.143659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:00:43.320630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.935898+0000","last_change":"2023-11-27T18:13:20.905013+0000","last_active":"2023-11-27T18:13:23.935898+0000","last_peered":"2023-11-27T18:13:23.935898+0000","last_clean":"2023-11-27T18:13:23.935898+0000","last_became_active":"2023-11-27T18:13:20.903019+0000","last_became_peered":"2023-11-27T18:13:20.903019+0000","last_unstale":"2023-11-27T18:13:23.935898+0000","last_undegraded":"2023-11-27T18:13:23.935898+0000","last_fullsized":"2023-11-27T18:13:23.935898+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:34:15.874601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.138615+0000","last_change":"2023-11-27T18:13:14.378913+0000","last_active":"2023-11-27T18:13:22.138615+0000","last_peered":"2023-11-27T18:13:22.138615+0000","last_clean":"2023-11-27T18:13:22.138615+0000","last_became_active":"2023-11-27T18:13:14.378644+0000","last_became_peered":"2023-11-27T18:13:14.378644+0000","last_unstale":"2023-11-27T18:13:22.138615+0000","last_undegraded":"2023-11-27T18:13:22.138615+0000","last_fullsized":"2023-11-27T18:13:22.138615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:19:02.523860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.926631+0000","last_change":"2023-11-27T18:13:12.305733+0000","last_active":"2023-11-27T18:13:21.926631+0000","last_peered":"2023-11-27T18:13:21.926631+0000","last_clean":"2023-11-27T18:13:21.926631+0000","last_became_active":"2023-11-27T18:13:12.305380+0000","last_became_peered":"2023-11-27T18:13:12.305380+0000","last_unstale":"2023-11-27T18:13:21.926631+0000","last_undegraded":"2023-11-27T18:13:21.926631+0000","last_fullsized":"2023-11-27T18:13:21.926631+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:34:46.886091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.936019+0000","last_change":"2023-11-27T18:13:20.913672+0000","last_active":"2023-11-27T18:13:23.936019+0000","last_peered":"2023-11-27T18:13:23.936019+0000","last_clean":"2023-11-27T18:13:23.936019+0000","last_became_active":"2023-11-27T18:13:20.913137+0000","last_became_peered":"2023-11-27T18:13:20.913137+0000","last_unstale":"2023-11-27T18:13:23.936019+0000","last_undegraded":"2023-11-27T18:13:23.936019+0000","last_fullsized":"2023-11-27T18:13:23.936019+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:40:20.210205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.138829+0000","last_change":"2023-11-27T18:13:14.413781+0000","last_active":"2023-11-27T18:13:22.138829+0000","last_peered":"2023-11-27T18:13:22.138829+0000","last_clean":"2023-11-27T18:13:22.138829+0000","last_became_active":"2023-11-27T18:13:14.413413+0000","last_became_peered":"2023-11-27T18:13:14.413413+0000","last_unstale":"2023-11-27T18:13:22.138829+0000","last_undegraded":"2023-11-27T18:13:22.138829+0000","last_fullsized":"2023-11-27T18:13:22.138829+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:04:03.068428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.142629+0000","last_change":"2023-11-27T18:13:12.315822+0000","last_active":"2023-11-27T18:13:22.142629+0000","last_peered":"2023-11-27T18:13:22.142629+0000","last_clean":"2023-11-27T18:13:22.142629+0000","last_became_active":"2023-11-27T18:13:12.315610+0000","last_became_peered":"2023-11-27T18:13:12.315610+0000","last_unstale":"2023-11-27T18:13:22.142629+0000","last_undegraded":"2023-11-27T18:13:22.142629+0000","last_fullsized":"2023-11-27T18:13:22.142629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:39:33.385367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:24.439052+0000","last_change":"2023-11-27T18:13:20.912891+0000","last_active":"2023-11-27T18:13:24.439052+0000","last_peered":"2023-11-27T18:13:24.439052+0000","last_clean":"2023-11-27T18:13:24.439052+0000","last_became_active":"2023-11-27T18:13:20.912453+0000","last_became_peered":"2023-11-27T18:13:20.912453+0000","last_unstale":"2023-11-27T18:13:24.439052+0000","last_undegraded":"2023-11-27T18:13:24.439052+0000","last_fullsized":"2023-11-27T18:13:24.439052+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:35:44.943527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.975967+0000","last_change":"2023-11-27T18:13:14.414468+0000","last_active":"2023-11-27T18:13:21.975967+0000","last_peered":"2023-11-27T18:13:21.975967+0000","last_clean":"2023-11-27T18:13:21.975967+0000","last_became_active":"2023-11-27T18:13:14.414156+0000","last_became_peered":"2023-11-27T18:13:14.414156+0000","last_unstale":"2023-11-27T18:13:21.975967+0000","last_undegraded":"2023-11-27T18:13:21.975967+0000","last_fullsized":"2023-11-27T18:13:21.975967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:46:11.500006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.143074+0000","last_change":"2023-11-27T18:13:12.308337+0000","last_active":"2023-11-27T18:13:22.143074+0000","last_peered":"2023-11-27T18:13:22.143074+0000","last_clean":"2023-11-27T18:13:22.143074+0000","last_became_active":"2023-11-27T18:13:12.308050+0000","last_became_peered":"2023-11-27T18:13:12.308050+0000","last_unstale":"2023-11-27T18:13:22.143074+0000","last_undegraded":"2023-11-27T18:13:22.143074+0000","last_fullsized":"2023-11-27T18:13:22.143074+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:14:09.398956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"20'117","reported_seq":170,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140186+0000","last_change":"2023-11-27T18:12:38.371836+0000","last_active":"2023-11-27T18:13:22.140186+0000","last_peered":"2023-11-27T18:13:22.140186+0000","last_clean":"2023-11-27T18:13:22.140186+0000","last_became_active":"2023-11-27T18:12:38.370748+0000","last_became_peered":"2023-11-27T18:12:38.370748+0000","last_unstale":"2023-11-27T18:13:22.140186+0000","last_undegraded":"2023-11-27T18:13:22.140186+0000","last_fullsized":"2023-11-27T18:13:22.140186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:12:36.259476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:12:36.259476+0000","last_clean_scrub_stamp":"2023-11-27T18:12:36.259476+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:25:36.712765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.322281+0000","last_change":"2023-11-27T18:13:20.928359+0000","last_active":"2023-11-27T18:13:23.322281+0000","last_peered":"2023-11-27T18:13:23.322281+0000","last_clean":"2023-11-27T18:13:23.322281+0000","last_became_active":"2023-11-27T18:13:20.926559+0000","last_became_peered":"2023-11-27T18:13:20.926559+0000","last_unstale":"2023-11-27T18:13:23.322281+0000","last_undegraded":"2023-11-27T18:13:23.322281+0000","last_fullsized":"2023-11-27T18:13:23.322281+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:47:06.255647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.143121+0000","last_change":"2023-11-27T18:13:14.422275+0000","last_active":"2023-11-27T18:13:22.143121+0000","last_peered":"2023-11-27T18:13:22.143121+0000","last_clean":"2023-11-27T18:13:22.143121+0000","last_became_active":"2023-11-27T18:13:14.419636+0000","last_became_peered":"2023-11-27T18:13:14.419636+0000","last_unstale":"2023-11-27T18:13:22.143121+0000","last_undegraded":"2023-11-27T18:13:22.143121+0000","last_fullsized":"2023-11-27T18:13:22.143121+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:29:10.027795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.141172+0000","last_change":"2023-11-27T18:13:12.268222+0000","last_active":"2023-11-27T18:13:22.141172+0000","last_peered":"2023-11-27T18:13:22.141172+0000","last_clean":"2023-11-27T18:13:22.141172+0000","last_became_active":"2023-11-27T18:13:12.267764+0000","last_became_peered":"2023-11-27T18:13:12.267764+0000","last_unstale":"2023-11-27T18:13:22.141172+0000","last_undegraded":"2023-11-27T18:13:22.141172+0000","last_fullsized":"2023-11-27T18:13:22.141172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:48:38.383796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.674846+0000","last_change":"2023-11-27T18:13:20.917055+0000","last_active":"2023-11-27T18:13:23.674846+0000","last_peered":"2023-11-27T18:13:23.674846+0000","last_clean":"2023-11-27T18:13:23.674846+0000","last_became_active":"2023-11-27T18:13:20.914157+0000","last_became_peered":"2023-11-27T18:13:20.914157+0000","last_unstale":"2023-11-27T18:13:23.674846+0000","last_undegraded":"2023-11-27T18:13:23.674846+0000","last_fullsized":"2023-11-27T18:13:23.674846+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:34:15.874601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140538+0000","last_change":"2023-11-27T18:13:14.363559+0000","last_active":"2023-11-27T18:13:22.140538+0000","last_peered":"2023-11-27T18:13:22.140538+0000","last_clean":"2023-11-27T18:13:22.140538+0000","last_became_active":"2023-11-27T18:13:14.363285+0000","last_became_peered":"2023-11-27T18:13:14.363285+0000","last_unstale":"2023-11-27T18:13:22.140538+0000","last_undegraded":"2023-11-27T18:13:22.140538+0000","last_fullsized":"2023-11-27T18:13:22.140538+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:00:44.524809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140713+0000","last_change":"2023-11-27T18:13:12.312477+0000","last_active":"2023-11-27T18:13:22.140713+0000","last_peered":"2023-11-27T18:13:22.140713+0000","last_clean":"2023-11-27T18:13:22.140713+0000","last_became_active":"2023-11-27T18:13:12.312038+0000","last_became_peered":"2023-11-27T18:13:12.312038+0000","last_unstale":"2023-11-27T18:13:22.140713+0000","last_undegraded":"2023-11-27T18:13:22.140713+0000","last_fullsized":"2023-11-27T18:13:22.140713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:35:37.502604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:24.439241+0000","last_change":"2023-11-27T18:13:20.913830+0000","last_active":"2023-11-27T18:13:24.439241+0000","last_peered":"2023-11-27T18:13:24.439241+0000","last_clean":"2023-11-27T18:13:24.439241+0000","last_became_active":"2023-11-27T18:13:20.912734+0000","last_became_peered":"2023-11-27T18:13:20.912734+0000","last_unstale":"2023-11-27T18:13:24.439241+0000","last_undegraded":"2023-11-27T18:13:24.439241+0000","last_fullsized":"2023-11-27T18:13:24.439241+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:35:39.280506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.141013+0000","last_change":"2023-11-27T18:13:14.364027+0000","last_active":"2023-11-27T18:13:22.141013+0000","last_peered":"2023-11-27T18:13:22.141013+0000","last_clean":"2023-11-27T18:13:22.141013+0000","last_became_active":"2023-11-27T18:13:14.363772+0000","last_became_peered":"2023-11-27T18:13:14.363772+0000","last_unstale":"2023-11-27T18:13:22.141013+0000","last_undegraded":"2023-11-27T18:13:22.141013+0000","last_fullsized":"2023-11-27T18:13:22.141013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:40:12.521779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.974905+0000","last_change":"2023-11-27T18:13:12.304785+0000","last_active":"2023-11-27T18:13:21.974905+0000","last_peered":"2023-11-27T18:13:21.974905+0000","last_clean":"2023-11-27T18:13:21.974905+0000","last_became_active":"2023-11-27T18:13:12.304400+0000","last_became_peered":"2023-11-27T18:13:12.304400+0000","last_unstale":"2023-11-27T18:13:21.974905+0000","last_undegraded":"2023-11-27T18:13:21.974905+0000","last_fullsized":"2023-11-27T18:13:21.974905+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:37:52.292054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.320761+0000","last_change":"2023-11-27T18:13:20.922959+0000","last_active":"2023-11-27T18:13:23.320761+0000","last_peered":"2023-11-27T18:13:23.320761+0000","last_clean":"2023-11-27T18:13:23.320761+0000","last_became_active":"2023-11-27T18:13:20.918984+0000","last_became_peered":"2023-11-27T18:13:20.918984+0000","last_unstale":"2023-11-27T18:13:23.320761+0000","last_undegraded":"2023-11-27T18:13:23.320761+0000","last_fullsized":"2023-11-27T18:13:23.320761+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:59:33.426999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.071789+0000","last_change":"2023-11-27T18:13:15.852939+0000","last_active":"2023-11-27T18:13:22.071789+0000","last_peered":"2023-11-27T18:13:22.071789+0000","last_clean":"2023-11-27T18:13:22.071789+0000","last_became_active":"2023-11-27T18:13:15.852339+0000","last_became_peered":"2023-11-27T18:13:15.852339+0000","last_unstale":"2023-11-27T18:13:22.071789+0000","last_undegraded":"2023-11-27T18:13:22.071789+0000","last_fullsized":"2023-11-27T18:13:22.071789+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:31:25.796567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140369+0000","last_change":"2023-11-27T18:13:12.311109+0000","last_active":"2023-11-27T18:13:22.140369+0000","last_peered":"2023-11-27T18:13:22.140369+0000","last_clean":"2023-11-27T18:13:22.140369+0000","last_became_active":"2023-11-27T18:13:12.310921+0000","last_became_peered":"2023-11-27T18:13:12.310921+0000","last_unstale":"2023-11-27T18:13:22.140369+0000","last_undegraded":"2023-11-27T18:13:22.140369+0000","last_fullsized":"2023-11-27T18:13:22.140369+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:05:04.546929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.292365+0000","last_change":"2023-11-27T18:13:20.925265+0000","last_active":"2023-11-27T18:13:23.292365+0000","last_peered":"2023-11-27T18:13:23.292365+0000","last_clean":"2023-11-27T18:13:23.292365+0000","last_became_active":"2023-11-27T18:13:20.924209+0000","last_became_peered":"2023-11-27T18:13:20.924209+0000","last_unstale":"2023-11-27T18:13:23.292365+0000","last_undegraded":"2023-11-27T18:13:23.292365+0000","last_fullsized":"2023-11-27T18:13:23.292365+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:31:33.484992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.142532+0000","last_change":"2023-11-27T18:13:14.421768+0000","last_active":"2023-11-27T18:13:22.142532+0000","last_peered":"2023-11-27T18:13:22.142532+0000","last_clean":"2023-11-27T18:13:22.142532+0000","last_became_active":"2023-11-27T18:13:14.421377+0000","last_became_peered":"2023-11-27T18:13:14.421377+0000","last_unstale":"2023-11-27T18:13:22.142532+0000","last_undegraded":"2023-11-27T18:13:22.142532+0000","last_fullsized":"2023-11-27T18:13:22.142532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:00:27.736589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"24'8","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.974338+0000","last_change":"2023-11-27T18:13:12.178547+0000","last_active":"2023-11-27T18:13:21.974338+0000","last_peered":"2023-11-27T18:13:21.974338+0000","last_clean":"2023-11-27T18:13:21.974338+0000","last_became_active":"2023-11-27T18:13:12.177997+0000","last_became_peered":"2023-11-27T18:13:12.177997+0000","last_unstale":"2023-11-27T18:13:21.974338+0000","last_undegraded":"2023-11-27T18:13:21.974338+0000","last_fullsized":"2023-11-27T18:13:21.974338+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:29:10.535816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:24.439272+0000","last_change":"2023-11-27T18:13:20.914541+0000","last_active":"2023-11-27T18:13:24.439272+0000","last_peered":"2023-11-27T18:13:24.439272+0000","last_clean":"2023-11-27T18:13:24.439272+0000","last_became_active":"2023-11-27T18:13:20.914144+0000","last_became_peered":"2023-11-27T18:13:20.914144+0000","last_unstale":"2023-11-27T18:13:24.439272+0000","last_undegraded":"2023-11-27T18:13:24.439272+0000","last_fullsized":"2023-11-27T18:13:24.439272+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:29:17.716220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140030+0000","last_change":"2023-11-27T18:13:15.802553+0000","last_active":"2023-11-27T18:13:22.140030+0000","last_peered":"2023-11-27T18:13:22.140030+0000","last_clean":"2023-11-27T18:13:22.140030+0000","last_became_active":"2023-11-27T18:13:15.801804+0000","last_became_peered":"2023-11-27T18:13:15.801804+0000","last_unstale":"2023-11-27T18:13:22.140030+0000","last_undegraded":"2023-11-27T18:13:22.140030+0000","last_fullsized":"2023-11-27T18:13:22.140030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:50:47.259554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.141046+0000","last_change":"2023-11-27T18:13:12.300863+0000","last_active":"2023-11-27T18:13:22.141046+0000","last_peered":"2023-11-27T18:13:22.141046+0000","last_clean":"2023-11-27T18:13:22.141046+0000","last_became_active":"2023-11-27T18:13:12.300585+0000","last_became_peered":"2023-11-27T18:13:12.300585+0000","last_unstale":"2023-11-27T18:13:22.141046+0000","last_undegraded":"2023-11-27T18:13:22.141046+0000","last_fullsized":"2023-11-27T18:13:22.141046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:27:04.532776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:24.439678+0000","last_change":"2023-11-27T18:13:20.915245+0000","last_active":"2023-11-27T18:13:24.439678+0000","last_peered":"2023-11-27T18:13:24.439678+0000","last_clean":"2023-11-27T18:13:24.439678+0000","last_became_active":"2023-11-27T18:13:20.914216+0000","last_became_peered":"2023-11-27T18:13:20.914216+0000","last_unstale":"2023-11-27T18:13:24.439678+0000","last_undegraded":"2023-11-27T18:13:24.439678+0000","last_fullsized":"2023-11-27T18:13:24.439678+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:56:44.418239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.142871+0000","last_change":"2023-11-27T18:13:14.415225+0000","last_active":"2023-11-27T18:13:22.142871+0000","last_peered":"2023-11-27T18:13:22.142871+0000","last_clean":"2023-11-27T18:13:22.142871+0000","last_became_active":"2023-11-27T18:13:14.414918+0000","last_became_peered":"2023-11-27T18:13:14.414918+0000","last_unstale":"2023-11-27T18:13:22.142871+0000","last_undegraded":"2023-11-27T18:13:22.142871+0000","last_fullsized":"2023-11-27T18:13:22.142871+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:35:31.592080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.143589+0000","last_change":"2023-11-27T18:13:12.305081+0000","last_active":"2023-11-27T18:13:22.143589+0000","last_peered":"2023-11-27T18:13:22.143589+0000","last_clean":"2023-11-27T18:13:22.143589+0000","last_became_active":"2023-11-27T18:13:12.304777+0000","last_became_peered":"2023-11-27T18:13:12.304777+0000","last_unstale":"2023-11-27T18:13:22.143589+0000","last_undegraded":"2023-11-27T18:13:22.143589+0000","last_fullsized":"2023-11-27T18:13:22.143589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:22:12.680259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.936710+0000","last_change":"2023-11-27T18:13:20.904088+0000","last_active":"2023-11-27T18:13:23.936710+0000","last_peered":"2023-11-27T18:13:23.936710+0000","last_clean":"2023-11-27T18:13:23.936710+0000","last_became_active":"2023-11-27T18:13:20.902282+0000","last_became_peered":"2023-11-27T18:13:20.902282+0000","last_unstale":"2023-11-27T18:13:23.936710+0000","last_undegraded":"2023-11-27T18:13:23.936710+0000","last_fullsized":"2023-11-27T18:13:23.936710+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:26:43.789814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140899+0000","last_change":"2023-11-27T18:13:14.415302+0000","last_active":"2023-11-27T18:13:22.140899+0000","last_peered":"2023-11-27T18:13:22.140899+0000","last_clean":"2023-11-27T18:13:22.140899+0000","last_became_active":"2023-11-27T18:13:14.415004+0000","last_became_peered":"2023-11-27T18:13:14.415004+0000","last_unstale":"2023-11-27T18:13:22.140899+0000","last_undegraded":"2023-11-27T18:13:22.140899+0000","last_fullsized":"2023-11-27T18:13:22.140899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:34:11.170873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.927564+0000","last_change":"2023-11-27T18:13:12.268542+0000","last_active":"2023-11-27T18:13:21.927564+0000","last_peered":"2023-11-27T18:13:21.927564+0000","last_clean":"2023-11-27T18:13:21.927564+0000","last_became_active":"2023-11-27T18:13:12.268237+0000","last_became_peered":"2023-11-27T18:13:12.268237+0000","last_unstale":"2023-11-27T18:13:21.927564+0000","last_undegraded":"2023-11-27T18:13:21.927564+0000","last_fullsized":"2023-11-27T18:13:21.927564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:15:07.514381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.321930+0000","last_change":"2023-11-27T18:13:20.900393+0000","last_active":"2023-11-27T18:13:23.321930+0000","last_peered":"2023-11-27T18:13:23.321930+0000","last_clean":"2023-11-27T18:13:23.321930+0000","last_became_active":"2023-11-27T18:13:20.899358+0000","last_became_peered":"2023-11-27T18:13:20.899358+0000","last_unstale":"2023-11-27T18:13:23.321930+0000","last_undegraded":"2023-11-27T18:13:23.321930+0000","last_fullsized":"2023-11-27T18:13:23.321930+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:27:58.837417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140744+0000","last_change":"2023-11-27T18:13:14.371842+0000","last_active":"2023-11-27T18:13:22.140744+0000","last_peered":"2023-11-27T18:13:22.140744+0000","last_clean":"2023-11-27T18:13:22.140744+0000","last_became_active":"2023-11-27T18:13:14.371637+0000","last_became_peered":"2023-11-27T18:13:14.371637+0000","last_unstale":"2023-11-27T18:13:22.140744+0000","last_undegraded":"2023-11-27T18:13:22.140744+0000","last_fullsized":"2023-11-27T18:13:22.140744+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:22:13.884437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"30'10","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:33.656056+0000","last_change":"2023-11-27T18:13:12.248404+0000","last_active":"2023-11-27T18:13:33.656056+0000","last_peered":"2023-11-27T18:13:33.656056+0000","last_clean":"2023-11-27T18:13:33.656056+0000","last_became_active":"2023-11-27T18:13:12.248077+0000","last_became_peered":"2023-11-27T18:13:12.248077+0000","last_unstale":"2023-11-27T18:13:33.656056+0000","last_undegraded":"2023-11-27T18:13:33.656056+0000","last_fullsized":"2023-11-27T18:13:33.656056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:34:21.166265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.288672+0000","last_change":"2023-11-27T18:13:20.919046+0000","last_active":"2023-11-27T18:13:23.288672+0000","last_peered":"2023-11-27T18:13:23.288672+0000","last_clean":"2023-11-27T18:13:23.288672+0000","last_became_active":"2023-11-27T18:13:20.918381+0000","last_became_peered":"2023-11-27T18:13:20.918381+0000","last_unstale":"2023-11-27T18:13:23.288672+0000","last_undegraded":"2023-11-27T18:13:23.288672+0000","last_fullsized":"2023-11-27T18:13:23.288672+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:17:07.092549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.143486+0000","last_change":"2023-11-27T18:13:14.415453+0000","last_active":"2023-11-27T18:13:22.143486+0000","last_peered":"2023-11-27T18:13:22.143486+0000","last_clean":"2023-11-27T18:13:22.143486+0000","last_became_active":"2023-11-27T18:13:14.415026+0000","last_became_peered":"2023-11-27T18:13:14.415026+0000","last_unstale":"2023-11-27T18:13:22.143486+0000","last_undegraded":"2023-11-27T18:13:22.143486+0000","last_fullsized":"2023-11-27T18:13:22.143486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:35:37.255102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.927427+0000","last_change":"2023-11-27T18:13:12.180737+0000","last_active":"2023-11-27T18:13:21.927427+0000","last_peered":"2023-11-27T18:13:21.927427+0000","last_clean":"2023-11-27T18:13:21.927427+0000","last_became_active":"2023-11-27T18:13:12.180112+0000","last_became_peered":"2023-11-27T18:13:12.180112+0000","last_unstale":"2023-11-27T18:13:21.927427+0000","last_undegraded":"2023-11-27T18:13:21.927427+0000","last_fullsized":"2023-11-27T18:13:21.927427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:24:22.455257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.674772+0000","last_change":"2023-11-27T18:13:20.925012+0000","last_active":"2023-11-27T18:13:23.674772+0000","last_peered":"2023-11-27T18:13:23.674772+0000","last_clean":"2023-11-27T18:13:23.674772+0000","last_became_active":"2023-11-27T18:13:20.921675+0000","last_became_peered":"2023-11-27T18:13:20.921675+0000","last_unstale":"2023-11-27T18:13:23.674772+0000","last_undegraded":"2023-11-27T18:13:23.674772+0000","last_fullsized":"2023-11-27T18:13:23.674772+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:49:08.226420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.142147+0000","last_change":"2023-11-27T18:13:14.415432+0000","last_active":"2023-11-27T18:13:22.142147+0000","last_peered":"2023-11-27T18:13:22.142147+0000","last_clean":"2023-11-27T18:13:22.142147+0000","last_became_active":"2023-11-27T18:13:14.415142+0000","last_became_peered":"2023-11-27T18:13:14.415142+0000","last_unstale":"2023-11-27T18:13:22.142147+0000","last_undegraded":"2023-11-27T18:13:22.142147+0000","last_fullsized":"2023-11-27T18:13:22.142147+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:39:33.850547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.142528+0000","last_change":"2023-11-27T18:13:12.273729+0000","last_active":"2023-11-27T18:13:22.142528+0000","last_peered":"2023-11-27T18:13:22.142528+0000","last_clean":"2023-11-27T18:13:22.142528+0000","last_became_active":"2023-11-27T18:13:12.273400+0000","last_became_peered":"2023-11-27T18:13:12.273400+0000","last_unstale":"2023-11-27T18:13:22.142528+0000","last_undegraded":"2023-11-27T18:13:22.142528+0000","last_fullsized":"2023-11-27T18:13:22.142528+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:31:10.508092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.230824+0000","last_change":"2023-11-27T18:13:20.912482+0000","last_active":"2023-11-27T18:13:23.230824+0000","last_peered":"2023-11-27T18:13:23.230824+0000","last_clean":"2023-11-27T18:13:23.230824+0000","last_became_active":"2023-11-27T18:13:20.912063+0000","last_became_peered":"2023-11-27T18:13:20.912063+0000","last_unstale":"2023-11-27T18:13:23.230824+0000","last_undegraded":"2023-11-27T18:13:23.230824+0000","last_fullsized":"2023-11-27T18:13:23.230824+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:11:56.997205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.071693+0000","last_change":"2023-11-27T18:13:15.911622+0000","last_active":"2023-11-27T18:13:22.071693+0000","last_peered":"2023-11-27T18:13:22.071693+0000","last_clean":"2023-11-27T18:13:22.071693+0000","last_became_active":"2023-11-27T18:13:15.911255+0000","last_became_peered":"2023-11-27T18:13:15.911255+0000","last_unstale":"2023-11-27T18:13:22.071693+0000","last_undegraded":"2023-11-27T18:13:22.071693+0000","last_fullsized":"2023-11-27T18:13:22.071693+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:04:03.068428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.141411+0000","last_change":"2023-11-27T18:13:12.168028+0000","last_active":"2023-11-27T18:13:22.141411+0000","last_peered":"2023-11-27T18:13:22.141411+0000","last_clean":"2023-11-27T18:13:22.141411+0000","last_became_active":"2023-11-27T18:13:12.167740+0000","last_became_peered":"2023-11-27T18:13:12.167740+0000","last_unstale":"2023-11-27T18:13:22.141411+0000","last_undegraded":"2023-11-27T18:13:22.141411+0000","last_fullsized":"2023-11-27T18:13:22.141411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:34:21.166265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.289002+0000","last_change":"2023-11-27T18:13:20.915480+0000","last_active":"2023-11-27T18:13:23.289002+0000","last_peered":"2023-11-27T18:13:23.289002+0000","last_clean":"2023-11-27T18:13:23.289002+0000","last_became_active":"2023-11-27T18:13:20.914607+0000","last_became_peered":"2023-11-27T18:13:20.914607+0000","last_unstale":"2023-11-27T18:13:23.289002+0000","last_undegraded":"2023-11-27T18:13:23.289002+0000","last_fullsized":"2023-11-27T18:13:23.289002+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:07:38.034431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.290409+0000","last_change":"2023-11-27T18:13:20.930508+0000","last_active":"2023-11-27T18:13:23.290409+0000","last_peered":"2023-11-27T18:13:23.290409+0000","last_clean":"2023-11-27T18:13:23.290409+0000","last_became_active":"2023-11-27T18:13:20.930060+0000","last_became_peered":"2023-11-27T18:13:20.930060+0000","last_unstale":"2023-11-27T18:13:23.290409+0000","last_undegraded":"2023-11-27T18:13:23.290409+0000","last_fullsized":"2023-11-27T18:13:23.290409+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:43:18.464867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.975017+0000","last_change":"2023-11-27T18:13:14.380263+0000","last_active":"2023-11-27T18:13:21.975017+0000","last_peered":"2023-11-27T18:13:21.975017+0000","last_clean":"2023-11-27T18:13:21.975017+0000","last_became_active":"2023-11-27T18:13:14.379936+0000","last_became_peered":"2023-11-27T18:13:14.379936+0000","last_unstale":"2023-11-27T18:13:21.975017+0000","last_undegraded":"2023-11-27T18:13:21.975017+0000","last_fullsized":"2023-11-27T18:13:21.975017+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:50:34.713768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.142604+0000","last_change":"2023-11-27T18:13:12.300977+0000","last_active":"2023-11-27T18:13:22.142604+0000","last_peered":"2023-11-27T18:13:22.142604+0000","last_clean":"2023-11-27T18:13:22.142604+0000","last_became_active":"2023-11-27T18:13:12.300624+0000","last_became_peered":"2023-11-27T18:13:12.300624+0000","last_unstale":"2023-11-27T18:13:22.142604+0000","last_undegraded":"2023-11-27T18:13:22.142604+0000","last_fullsized":"2023-11-27T18:13:22.142604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:52:29.021393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.322456+0000","last_change":"2023-11-27T18:13:20.919870+0000","last_active":"2023-11-27T18:13:23.322456+0000","last_peered":"2023-11-27T18:13:23.322456+0000","last_clean":"2023-11-27T18:13:23.322456+0000","last_became_active":"2023-11-27T18:13:20.918816+0000","last_became_peered":"2023-11-27T18:13:20.918816+0000","last_unstale":"2023-11-27T18:13:23.322456+0000","last_undegraded":"2023-11-27T18:13:23.322456+0000","last_fullsized":"2023-11-27T18:13:23.322456+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:41:38.778382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.138717+0000","last_change":"2023-11-27T18:13:14.369562+0000","last_active":"2023-11-27T18:13:22.138717+0000","last_peered":"2023-11-27T18:13:22.138717+0000","last_clean":"2023-11-27T18:13:22.138717+0000","last_became_active":"2023-11-27T18:13:14.368880+0000","last_became_peered":"2023-11-27T18:13:14.368880+0000","last_unstale":"2023-11-27T18:13:22.138717+0000","last_undegraded":"2023-11-27T18:13:22.138717+0000","last_fullsized":"2023-11-27T18:13:22.138717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:22:13.884437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.139062+0000","last_change":"2023-11-27T18:13:12.270113+0000","last_active":"2023-11-27T18:13:22.139062+0000","last_peered":"2023-11-27T18:13:22.139062+0000","last_clean":"2023-11-27T18:13:22.139062+0000","last_became_active":"2023-11-27T18:13:12.269755+0000","last_became_peered":"2023-11-27T18:13:12.269755+0000","last_unstale":"2023-11-27T18:13:22.139062+0000","last_undegraded":"2023-11-27T18:13:22.139062+0000","last_fullsized":"2023-11-27T18:13:22.139062+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:51:01.410940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.143492+0000","last_change":"2023-11-27T18:13:12.307568+0000","last_active":"2023-11-27T18:13:22.143492+0000","last_peered":"2023-11-27T18:13:22.143492+0000","last_clean":"2023-11-27T18:13:22.143492+0000","last_became_active":"2023-11-27T18:13:12.307299+0000","last_became_peered":"2023-11-27T18:13:12.307299+0000","last_unstale":"2023-11-27T18:13:22.143492+0000","last_undegraded":"2023-11-27T18:13:22.143492+0000","last_fullsized":"2023-11-27T18:13:22.143492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:19:01.319681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.974648+0000","last_change":"2023-11-27T18:13:14.378937+0000","last_active":"2023-11-27T18:13:21.974648+0000","last_peered":"2023-11-27T18:13:21.974648+0000","last_clean":"2023-11-27T18:13:21.974648+0000","last_became_active":"2023-11-27T18:13:14.378635+0000","last_became_peered":"2023-11-27T18:13:14.378635+0000","last_unstale":"2023-11-27T18:13:21.974648+0000","last_undegraded":"2023-11-27T18:13:21.974648+0000","last_fullsized":"2023-11-27T18:13:21.974648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:06:40.533610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.290577+0000","last_change":"2023-11-27T18:13:20.903249+0000","last_active":"2023-11-27T18:13:23.290577+0000","last_peered":"2023-11-27T18:13:23.290577+0000","last_clean":"2023-11-27T18:13:23.290577+0000","last_became_active":"2023-11-27T18:13:20.902571+0000","last_became_peered":"2023-11-27T18:13:20.902571+0000","last_unstale":"2023-11-27T18:13:23.290577+0000","last_undegraded":"2023-11-27T18:13:23.290577+0000","last_fullsized":"2023-11-27T18:13:23.290577+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:41:48.892641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.139766+0000","last_change":"2023-11-27T18:13:12.304324+0000","last_active":"2023-11-27T18:13:22.139766+0000","last_peered":"2023-11-27T18:13:22.139766+0000","last_clean":"2023-11-27T18:13:22.139766+0000","last_became_active":"2023-11-27T18:13:12.303988+0000","last_became_peered":"2023-11-27T18:13:12.303988+0000","last_unstale":"2023-11-27T18:13:22.139766+0000","last_undegraded":"2023-11-27T18:13:22.139766+0000","last_fullsized":"2023-11-27T18:13:22.139766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:47:59.518332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140188+0000","last_change":"2023-11-27T18:13:15.803183+0000","last_active":"2023-11-27T18:13:22.140188+0000","last_peered":"2023-11-27T18:13:22.140188+0000","last_clean":"2023-11-27T18:13:22.140188+0000","last_became_active":"2023-11-27T18:13:15.802420+0000","last_became_peered":"2023-11-27T18:13:15.802420+0000","last_unstale":"2023-11-27T18:13:22.140188+0000","last_undegraded":"2023-11-27T18:13:22.140188+0000","last_fullsized":"2023-11-27T18:13:22.140188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:51:02.615119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.231473+0000","last_change":"2023-11-27T18:13:20.920758+0000","last_active":"2023-11-27T18:13:23.231473+0000","last_peered":"2023-11-27T18:13:23.231473+0000","last_clean":"2023-11-27T18:13:23.231473+0000","last_became_active":"2023-11-27T18:13:20.920367+0000","last_became_peered":"2023-11-27T18:13:20.920367+0000","last_unstale":"2023-11-27T18:13:23.231473+0000","last_undegraded":"2023-11-27T18:13:23.231473+0000","last_fullsized":"2023-11-27T18:13:23.231473+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:51:50.506446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.070839+0000","last_change":"2023-11-27T18:13:15.849183+0000","last_active":"2023-11-27T18:13:22.070839+0000","last_peered":"2023-11-27T18:13:22.070839+0000","last_clean":"2023-11-27T18:13:22.070839+0000","last_became_active":"2023-11-27T18:13:15.848503+0000","last_became_peered":"2023-11-27T18:13:15.848503+0000","last_unstale":"2023-11-27T18:13:22.070839+0000","last_undegraded":"2023-11-27T18:13:22.070839+0000","last_fullsized":"2023-11-27T18:13:22.070839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:14:48.774302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.926420+0000","last_change":"2023-11-27T18:13:14.336349+0000","last_active":"2023-11-27T18:13:21.926420+0000","last_peered":"2023-11-27T18:13:21.926420+0000","last_clean":"2023-11-27T18:13:21.926420+0000","last_became_active":"2023-11-27T18:13:14.336072+0000","last_became_peered":"2023-11-27T18:13:14.336072+0000","last_unstale":"2023-11-27T18:13:21.926420+0000","last_undegraded":"2023-11-27T18:13:21.926420+0000","last_fullsized":"2023-11-27T18:13:21.926420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:54:58.777656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.142882+0000","last_change":"2023-11-27T18:13:14.421713+0000","last_active":"2023-11-27T18:13:22.142882+0000","last_peered":"2023-11-27T18:13:22.142882+0000","last_clean":"2023-11-27T18:13:22.142882+0000","last_became_active":"2023-11-27T18:13:14.418679+0000","last_became_peered":"2023-11-27T18:13:14.418679+0000","last_unstale":"2023-11-27T18:13:22.142882+0000","last_undegraded":"2023-11-27T18:13:22.142882+0000","last_fullsized":"2023-11-27T18:13:22.142882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:53:03.917430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.139686+0000","last_change":"2023-11-27T18:13:14.376601+0000","last_active":"2023-11-27T18:13:22.139686+0000","last_peered":"2023-11-27T18:13:22.139686+0000","last_clean":"2023-11-27T18:13:22.139686+0000","last_became_active":"2023-11-27T18:13:14.376292+0000","last_became_peered":"2023-11-27T18:13:14.376292+0000","last_unstale":"2023-11-27T18:13:22.139686+0000","last_undegraded":"2023-11-27T18:13:22.139686+0000","last_fullsized":"2023-11-27T18:13:22.139686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:52:30.225572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140984+0000","last_change":"2023-11-27T18:13:14.367285+0000","last_active":"2023-11-27T18:13:22.140984+0000","last_peered":"2023-11-27T18:13:22.140984+0000","last_clean":"2023-11-27T18:13:22.140984+0000","last_became_active":"2023-11-27T18:13:14.366983+0000","last_became_peered":"2023-11-27T18:13:14.366983+0000","last_unstale":"2023-11-27T18:13:22.140984+0000","last_undegraded":"2023-11-27T18:13:22.140984+0000","last_fullsized":"2023-11-27T18:13:22.140984+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:04:31.925421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.141444+0000","last_change":"2023-11-27T18:13:14.375744+0000","last_active":"2023-11-27T18:13:22.141444+0000","last_peered":"2023-11-27T18:13:22.141444+0000","last_clean":"2023-11-27T18:13:22.141444+0000","last_became_active":"2023-11-27T18:13:14.375466+0000","last_became_peered":"2023-11-27T18:13:14.375466+0000","last_unstale":"2023-11-27T18:13:22.141444+0000","last_undegraded":"2023-11-27T18:13:22.141444+0000","last_fullsized":"2023-11-27T18:13:22.141444+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:03:10.250350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.071591+0000","last_change":"2023-11-27T18:13:15.911021+0000","last_active":"2023-11-27T18:13:22.071591+0000","last_peered":"2023-11-27T18:13:22.071591+0000","last_clean":"2023-11-27T18:13:22.071591+0000","last_became_active":"2023-11-27T18:13:15.910418+0000","last_became_peered":"2023-11-27T18:13:15.910418+0000","last_unstale":"2023-11-27T18:13:22.071591+0000","last_undegraded":"2023-11-27T18:13:22.071591+0000","last_fullsized":"2023-11-27T18:13:22.071591+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:55:45.033833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.141861+0000","last_change":"2023-11-27T18:13:14.368483+0000","last_active":"2023-11-27T18:13:22.141861+0000","last_peered":"2023-11-27T18:13:22.141861+0000","last_clean":"2023-11-27T18:13:22.141861+0000","last_became_active":"2023-11-27T18:13:14.366249+0000","last_became_peered":"2023-11-27T18:13:14.366249+0000","last_unstale":"2023-11-27T18:13:22.141861+0000","last_undegraded":"2023-11-27T18:13:22.141861+0000","last_fullsized":"2023-11-27T18:13:22.141861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:52:43.071209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.142531+0000","last_change":"2023-11-27T18:13:14.415379+0000","last_active":"2023-11-27T18:13:22.142531+0000","last_peered":"2023-11-27T18:13:22.142531+0000","last_clean":"2023-11-27T18:13:22.142531+0000","last_became_active":"2023-11-27T18:13:14.414873+0000","last_became_peered":"2023-11-27T18:13:14.414873+0000","last_unstale":"2023-11-27T18:13:22.142531+0000","last_undegraded":"2023-11-27T18:13:22.142531+0000","last_fullsized":"2023-11-27T18:13:22.142531+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:40:12.521779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.138566+0000","last_change":"2023-11-27T18:13:14.416351+0000","last_active":"2023-11-27T18:13:22.138566+0000","last_peered":"2023-11-27T18:13:22.138566+0000","last_clean":"2023-11-27T18:13:22.138566+0000","last_became_active":"2023-11-27T18:13:14.416072+0000","last_became_peered":"2023-11-27T18:13:14.416072+0000","last_unstale":"2023-11-27T18:13:22.138566+0000","last_undegraded":"2023-11-27T18:13:22.138566+0000","last_fullsized":"2023-11-27T18:13:22.138566+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:31:11.712270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140105+0000","last_change":"2023-11-27T18:13:15.801534+0000","last_active":"2023-11-27T18:13:22.140105+0000","last_peered":"2023-11-27T18:13:22.140105+0000","last_clean":"2023-11-27T18:13:22.140105+0000","last_became_active":"2023-11-27T18:13:15.800699+0000","last_became_peered":"2023-11-27T18:13:15.800699+0000","last_unstale":"2023-11-27T18:13:22.140105+0000","last_undegraded":"2023-11-27T18:13:22.140105+0000","last_fullsized":"2023-11-27T18:13:22.140105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:39:39.512202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.974431+0000","last_change":"2023-11-27T18:13:14.413935+0000","last_active":"2023-11-27T18:13:21.974431+0000","last_peered":"2023-11-27T18:13:21.974431+0000","last_clean":"2023-11-27T18:13:21.974431+0000","last_became_active":"2023-11-27T18:13:14.413567+0000","last_became_peered":"2023-11-27T18:13:14.413567+0000","last_unstale":"2023-11-27T18:13:21.974431+0000","last_undegraded":"2023-11-27T18:13:21.974431+0000","last_fullsized":"2023-11-27T18:13:21.974431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:51:07.667299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140494+0000","last_change":"2023-11-27T18:13:14.363105+0000","last_active":"2023-11-27T18:13:22.140494+0000","last_peered":"2023-11-27T18:13:22.140494+0000","last_clean":"2023-11-27T18:13:22.140494+0000","last_became_active":"2023-11-27T18:13:14.362805+0000","last_became_peered":"2023-11-27T18:13:14.362805+0000","last_unstale":"2023-11-27T18:13:22.140494+0000","last_undegraded":"2023-11-27T18:13:22.140494+0000","last_fullsized":"2023-11-27T18:13:22.140494+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:19:02.523860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.143343+0000","last_change":"2023-11-27T18:13:14.416119+0000","last_active":"2023-11-27T18:13:22.143343+0000","last_peered":"2023-11-27T18:13:22.143343+0000","last_clean":"2023-11-27T18:13:22.143343+0000","last_became_active":"2023-11-27T18:13:14.415661+0000","last_became_peered":"2023-11-27T18:13:14.415661+0000","last_unstale":"2023-11-27T18:13:22.143343+0000","last_undegraded":"2023-11-27T18:13:22.143343+0000","last_fullsized":"2023-11-27T18:13:22.143343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:56:36.729814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.927866+0000","last_change":"2023-11-27T18:13:14.413859+0000","last_active":"2023-11-27T18:13:21.927866+0000","last_peered":"2023-11-27T18:13:21.927866+0000","last_clean":"2023-11-27T18:13:21.927866+0000","last_became_active":"2023-11-27T18:13:14.413542+0000","last_became_peered":"2023-11-27T18:13:14.413542+0000","last_unstale":"2023-11-27T18:13:21.927866+0000","last_undegraded":"2023-11-27T18:13:21.927866+0000","last_fullsized":"2023-11-27T18:13:21.927866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:24:16.125984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.145639+0000","last_change":"2023-11-27T18:13:14.417018+0000","last_active":"2023-11-27T18:13:22.145639+0000","last_peered":"2023-11-27T18:13:22.145639+0000","last_clean":"2023-11-27T18:13:22.145639+0000","last_became_active":"2023-11-27T18:13:14.416556+0000","last_became_peered":"2023-11-27T18:13:14.416556+0000","last_unstale":"2023-11-27T18:13:22.145639+0000","last_undegraded":"2023-11-27T18:13:22.145639+0000","last_fullsized":"2023-11-27T18:13:22.145639+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:03:59.054125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.142510+0000","last_change":"2023-11-27T18:13:14.419437+0000","last_active":"2023-11-27T18:13:22.142510+0000","last_peered":"2023-11-27T18:13:22.142510+0000","last_clean":"2023-11-27T18:13:22.142510+0000","last_became_active":"2023-11-27T18:13:14.418823+0000","last_became_peered":"2023-11-27T18:13:14.418823+0000","last_unstale":"2023-11-27T18:13:22.142510+0000","last_undegraded":"2023-11-27T18:13:22.142510+0000","last_fullsized":"2023-11-27T18:13:22.142510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:26:36.101388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.138403+0000","last_change":"2023-11-27T18:13:14.368373+0000","last_active":"2023-11-27T18:13:22.138403+0000","last_peered":"2023-11-27T18:13:22.138403+0000","last_clean":"2023-11-27T18:13:22.138403+0000","last_became_active":"2023-11-27T18:13:14.368100+0000","last_became_peered":"2023-11-27T18:13:14.368100+0000","last_unstale":"2023-11-27T18:13:22.138403+0000","last_undegraded":"2023-11-27T18:13:22.138403+0000","last_fullsized":"2023-11-27T18:13:22.138403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:27:05.736955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.139108+0000","last_change":"2023-11-27T18:13:14.376812+0000","last_active":"2023-11-27T18:13:22.139108+0000","last_peered":"2023-11-27T18:13:22.139108+0000","last_clean":"2023-11-27T18:13:22.139108+0000","last_became_active":"2023-11-27T18:13:14.376559+0000","last_became_peered":"2023-11-27T18:13:14.376559+0000","last_unstale":"2023-11-27T18:13:22.139108+0000","last_undegraded":"2023-11-27T18:13:22.139108+0000","last_fullsized":"2023-11-27T18:13:22.139108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:31:25.796567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140209+0000","last_change":"2023-11-27T18:13:14.367518+0000","last_active":"2023-11-27T18:13:22.140209+0000","last_peered":"2023-11-27T18:13:22.140209+0000","last_clean":"2023-11-27T18:13:22.140209+0000","last_became_active":"2023-11-27T18:13:14.367298+0000","last_became_peered":"2023-11-27T18:13:14.367298+0000","last_unstale":"2023-11-27T18:13:22.140209+0000","last_undegraded":"2023-11-27T18:13:22.140209+0000","last_fullsized":"2023-11-27T18:13:22.140209+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:48:00.722511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140440+0000","last_change":"2023-11-27T18:13:14.364130+0000","last_active":"2023-11-27T18:13:22.140440+0000","last_peered":"2023-11-27T18:13:22.140440+0000","last_clean":"2023-11-27T18:13:22.140440+0000","last_became_active":"2023-11-27T18:13:14.363776+0000","last_became_peered":"2023-11-27T18:13:14.363776+0000","last_unstale":"2023-11-27T18:13:22.140440+0000","last_undegraded":"2023-11-27T18:13:22.140440+0000","last_fullsized":"2023-11-27T18:13:22.140440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:14:10.603135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140667+0000","last_change":"2023-11-27T18:13:14.423459+0000","last_active":"2023-11-27T18:13:22.140667+0000","last_peered":"2023-11-27T18:13:22.140667+0000","last_clean":"2023-11-27T18:13:22.140667+0000","last_became_active":"2023-11-27T18:13:14.423099+0000","last_became_peered":"2023-11-27T18:13:14.423099+0000","last_unstale":"2023-11-27T18:13:22.140667+0000","last_undegraded":"2023-11-27T18:13:22.140667+0000","last_fullsized":"2023-11-27T18:13:22.140667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:39:33.850547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.142197+0000","last_change":"2023-11-27T18:13:14.420348+0000","last_active":"2023-11-27T18:13:22.142197+0000","last_peered":"2023-11-27T18:13:22.142197+0000","last_clean":"2023-11-27T18:13:22.142197+0000","last_became_active":"2023-11-27T18:13:14.419780+0000","last_became_peered":"2023-11-27T18:13:14.419780+0000","last_unstale":"2023-11-27T18:13:22.142197+0000","last_undegraded":"2023-11-27T18:13:22.142197+0000","last_fullsized":"2023-11-27T18:13:22.142197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:49:00.537995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.141371+0000","last_change":"2023-11-27T18:13:15.910347+0000","last_active":"2023-11-27T18:13:22.141371+0000","last_peered":"2023-11-27T18:13:22.141371+0000","last_clean":"2023-11-27T18:13:22.141371+0000","last_became_active":"2023-11-27T18:13:15.909918+0000","last_became_peered":"2023-11-27T18:13:15.909918+0000","last_unstale":"2023-11-27T18:13:22.141371+0000","last_undegraded":"2023-11-27T18:13:22.141371+0000","last_fullsized":"2023-11-27T18:13:22.141371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:14:48.774302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.138428+0000","last_change":"2023-11-27T18:13:14.369974+0000","last_active":"2023-11-27T18:13:22.138428+0000","last_peered":"2023-11-27T18:13:22.138428+0000","last_clean":"2023-11-27T18:13:22.138428+0000","last_became_active":"2023-11-27T18:13:14.369285+0000","last_became_peered":"2023-11-27T18:13:14.369285+0000","last_unstale":"2023-11-27T18:13:22.138428+0000","last_undegraded":"2023-11-27T18:13:22.138428+0000","last_fullsized":"2023-11-27T18:13:22.138428+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:23:56.484932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.141001+0000","last_change":"2023-11-27T18:13:14.385745+0000","last_active":"2023-11-27T18:13:22.141001+0000","last_peered":"2023-11-27T18:13:22.141001+0000","last_clean":"2023-11-27T18:13:22.141001+0000","last_became_active":"2023-11-27T18:13:14.385566+0000","last_became_peered":"2023-11-27T18:13:14.385566+0000","last_unstale":"2023-11-27T18:13:22.141001+0000","last_undegraded":"2023-11-27T18:13:22.141001+0000","last_fullsized":"2023-11-27T18:13:22.141001+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:52:43.071209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.071894+0000","last_change":"2023-11-27T18:13:15.848952+0000","last_active":"2023-11-27T18:13:22.071894+0000","last_peered":"2023-11-27T18:13:22.071894+0000","last_clean":"2023-11-27T18:13:22.071894+0000","last_became_active":"2023-11-27T18:13:15.848237+0000","last_became_peered":"2023-11-27T18:13:15.848237+0000","last_unstale":"2023-11-27T18:13:22.071894+0000","last_undegraded":"2023-11-27T18:13:22.071894+0000","last_fullsized":"2023-11-27T18:13:22.071894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:39:39.512202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140762+0000","last_change":"2023-11-27T18:13:14.373247+0000","last_active":"2023-11-27T18:13:22.140762+0000","last_peered":"2023-11-27T18:13:22.140762+0000","last_clean":"2023-11-27T18:13:22.140762+0000","last_became_active":"2023-11-27T18:13:14.372974+0000","last_became_peered":"2023-11-27T18:13:14.372974+0000","last_unstale":"2023-11-27T18:13:22.140762+0000","last_undegraded":"2023-11-27T18:13:22.140762+0000","last_fullsized":"2023-11-27T18:13:22.140762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:39:34.589545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.071176+0000","last_change":"2023-11-27T18:13:15.851685+0000","last_active":"2023-11-27T18:13:22.071176+0000","last_peered":"2023-11-27T18:13:22.071176+0000","last_clean":"2023-11-27T18:13:22.071176+0000","last_became_active":"2023-11-27T18:13:15.850353+0000","last_became_peered":"2023-11-27T18:13:15.850353+0000","last_unstale":"2023-11-27T18:13:22.071176+0000","last_undegraded":"2023-11-27T18:13:22.071176+0000","last_fullsized":"2023-11-27T18:13:22.071176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:51:02.615119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140426+0000","last_change":"2023-11-27T18:13:14.381126+0000","last_active":"2023-11-27T18:13:22.140426+0000","last_peered":"2023-11-27T18:13:22.140426+0000","last_clean":"2023-11-27T18:13:22.140426+0000","last_became_active":"2023-11-27T18:13:14.380714+0000","last_became_peered":"2023-11-27T18:13:14.380714+0000","last_unstale":"2023-11-27T18:13:22.140426+0000","last_undegraded":"2023-11-27T18:13:22.140426+0000","last_fullsized":"2023-11-27T18:13:22.140426+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:14:10.603135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.141208+0000","last_change":"2023-11-27T18:13:14.368254+0000","last_active":"2023-11-27T18:13:22.141208+0000","last_peered":"2023-11-27T18:13:22.141208+0000","last_clean":"2023-11-27T18:13:22.141208+0000","last_became_active":"2023-11-27T18:13:14.367978+0000","last_became_peered":"2023-11-27T18:13:14.367978+0000","last_unstale":"2023-11-27T18:13:22.141208+0000","last_undegraded":"2023-11-27T18:13:22.141208+0000","last_fullsized":"2023-11-27T18:13:22.141208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:05:05.751108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140257+0000","last_change":"2023-11-27T18:13:14.419332+0000","last_active":"2023-11-27T18:13:22.140257+0000","last_peered":"2023-11-27T18:13:22.140257+0000","last_clean":"2023-11-27T18:13:22.140257+0000","last_became_active":"2023-11-27T18:13:14.418928+0000","last_became_peered":"2023-11-27T18:13:14.418928+0000","last_unstale":"2023-11-27T18:13:22.140257+0000","last_undegraded":"2023-11-27T18:13:22.140257+0000","last_fullsized":"2023-11-27T18:13:22.140257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:34:08.186176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67010,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719476758,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31560,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340280,"statfs":{"total":96636764160,"available":96604446720,"internally_reserved":0,"allocated":385024,"data_stored":714358,"data_compressed":33505,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":17.553999999999998,"5min":17.553999999999998,"15min":17.553999999999998},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.52000000000000002}]},{"osd":1,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":5.4550000000000001,"5min":5.4550000000000001,"15min":5.4550000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":5.3040000000000003,"5min":5.3040000000000003,"15min":5.3040000000000003},"last":0.45200000000000001}]},{"osd":2,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":7.8540000000000001,"5min":7.8540000000000001,"15min":7.8540000000000001},"last":0.68300000000000005}]},{"osd":3,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.60399999999999998}]},{"osd":4,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":7.7759999999999998,"5min":7.7759999999999998,"15min":7.7759999999999998},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":0.85599999999999998}]},{"osd":6,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":7.8200000000000003,"5min":7.8200000000000003,"15min":7.8200000000000003},"last":0.76300000000000001}]},{"osd":7,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.3290000000000002,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":0.82299999999999995},{"interface":"front","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.2690000000000001,"5min":2.2690000000000001,"15min":2.2690000000000001},"last":0.70199999999999996}]}]},{"osd":7,"up_from":16,"seq":68719476758,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":323584,"data_stored":124841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":2.0600000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.54000000000000004}]},{"osd":1,"last update":"Mon Nov 27 18:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":2.1890000000000001,"5min":2.1890000000000001,"15min":2.1890000000000001},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.6190000000000002,"5min":2.6190000000000002,"15min":2.6190000000000002},"last":1.036}]},{"osd":2,"last update":"Mon Nov 27 18:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.5649999999999999,"5min":2.5649999999999999,"15min":2.5649999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.68200000000000005}]},{"osd":3,"last update":"Mon Nov 27 18:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.73799999999999999},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":4.391,"5min":4.391,"15min":4.391},"last":0.95699999999999996}]},{"osd":4,"last update":"Mon Nov 27 18:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.484,"5min":2.484,"15min":2.484},"last":1.097}]},{"osd":5,"last update":"Mon Nov 27 18:13:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":4.8440000000000003,"5min":4.8440000000000003,"15min":4.8440000000000003},"last":1.129},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":0.79000000000000004}]},{"osd":6,"last update":"Mon Nov 27 18:13:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":0.625},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":2.258,"5min":2.258,"15min":2.258},"last":1.24}]}]},{"osd":6,"up_from":16,"seq":68719476758,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":315392,"data_stored":124717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.873},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.82799999999999996}]},{"osd":1,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.54100000000000004}]},{"osd":2,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.995}]},{"osd":3,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":1.1919999999999999}]},{"osd":4,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":1.0229999999999999}]},{"osd":5,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":1.101},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.0580000000000001}]},{"osd":7,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":2.1779999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":1.2609999999999999}]}]},{"osd":3,"up_from":16,"seq":68719476756,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":319488,"data_stored":125299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.442},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.26400000000000001}]},{"osd":1,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.48999999999999999}]},{"osd":2,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.374},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.54900000000000004}]},{"osd":4,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.61399999999999999}]},{"osd":5,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.52000000000000002}]},{"osd":6,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.53500000000000003},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.64800000000000002}]},{"osd":7,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.70099999999999996}]}]},{"osd":2,"up_from":16,"seq":68719476757,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":128559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.8680000000000001,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":0.38900000000000001}]},{"osd":1,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.433},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.47699999999999998}]},{"osd":3,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.499},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.56000000000000005}]},{"osd":4,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.6160000000000001,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":0.873},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.80300000000000005}]},{"osd":5,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.67800000000000005}]},{"osd":6,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.98499999999999999}]},{"osd":7,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.78000000000000003}]}]},{"osd":1,"up_from":16,"seq":68719476757,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":385024,"data_stored":715155,"data_compressed":33505,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:13:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.745},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":0.32300000000000001}]},{"osd":2,"last update":"Mon Nov 27 18:13:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.622},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.39600000000000002}]},{"osd":3,"last update":"Mon Nov 27 18:13:38 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":0.443}]},{"osd":4,"last update":"Mon Nov 27 18:13:38 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.78100000000000003}]},{"osd":5,"last update":"Mon Nov 27 18:13:38 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.72099999999999997}]},{"osd":6,"last update":"Mon Nov 27 18:13:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.48399999999999999}]},{"osd":7,"last update":"Mon Nov 27 18:13:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.8149999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.66600000000000004}]}]},{"osd":0,"up_from":16,"seq":68719476758,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":124773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.63800000000000001}]},{"osd":2,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.872}]},{"osd":3,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.80700000000000005}]},{"osd":4,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.92500000000000004}]},{"osd":5,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.90000000000000002}]},{"osd":6,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":1.091}]},{"osd":7,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":1.1559999999999999},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.351,"5min":1.351,"15min":1.351},"last":0.94199999999999995}]}]},{"osd":4,"up_from":15,"seq":64424509462,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31504,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340336,"statfs":{"total":96636764160,"available":96604504064,"internally_reserved":0,"allocated":335872,"data_stored":129231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":1.2}]},{"osd":1,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.999},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.60499999999999998}]},{"osd":2,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.95899999999999996}]},{"osd":3,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":1.046},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":1.1639999999999999}]},{"osd":5,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.89700000000000002}]},{"osd":6,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":1.077}]},{"osd":7,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":1.127},{"interface":"front","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":1.093}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33505,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33505,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T18:14:08.196 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T18:14:08.352 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.357+0000 7f82d156c640 1 Processor -- start 2023-11-27T18:14:08.352 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.357+0000 7f82d156c640 1 -- start start 2023-11-27T18:14:08.353 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.357+0000 7f82d156c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f82cc0c85c0 0x7f82cc06cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:08.353 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.357+0000 7f82d156c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f82cc0c5f10 0x7f82cc06d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:08.353 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.357+0000 7f82d156c640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82cc072b70 con 0x7f82cc151820 2023-11-27T18:14:08.353 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.357+0000 7f82d156c640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82cc0c2d20 con 0x7f82cc0c5f10 2023-11-27T18:14:08.353 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.357+0000 7f82d156c640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82cc0c6490 con 0x7f82cc0c85c0 2023-11-27T18:14:08.353 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.357+0000 7f82cb7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f82cc0c5f10 0x7f82cc06d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:08.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.357+0000 7f82cb7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f82cc0c5f10 0x7f82cc06d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:56102/0 (socket says 172.21.15.91:56102) 2023-11-27T18:14:08.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.357+0000 7f82cb7fe640 1 -- 172.21.15.91:0/2637357793 learned_addr learned my addr 172.21.15.91:0/2637357793 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:08.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.357+0000 7f82ca7fc640 1 --2- 172.21.15.91:0/2637357793 >> v2:172.21.15.94:3300/0 conn(0x7f82cc0c85c0 0x7f82cc06cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:08.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.361+0000 7f82cb7fe640 1 -- 172.21.15.91:0/2637357793 >> v2:172.21.15.94:3300/0 conn(0x7f82cc0c85c0 msgr2=0x7f82cc06cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:08.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.361+0000 7f82cb7fe640 1 --2- 172.21.15.91:0/2637357793 >> v2:172.21.15.94:3300/0 conn(0x7f82cc0c85c0 0x7f82cc06cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:08.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.361+0000 7f82cb7fe640 1 -- 172.21.15.91:0/2637357793 >> v1:172.21.15.94:6789/0 conn(0x7f82cc151820 legacy=0x7f82cc070e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:08.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.361+0000 7f82cb7fe640 1 -- 172.21.15.91:0/2637357793 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82cc158160 con 0x7f82cc0c5f10 2023-11-27T18:14:08.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.361+0000 7f82cb7fe640 1 --2- 172.21.15.91:0/2637357793 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f82cc0c5f10 0x7f82cc06d0d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f82cc06b3a0 tx=0x7f82c401f180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91d912c2bd5b9684 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:08.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.369+0000 7f82c9ffb640 1 -- 172.21.15.91:0/2637357793 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c40af400 con 0x7f82cc0c5f10 2023-11-27T18:14:08.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.369+0000 7f82c9ffb640 1 -- 172.21.15.91:0/2637357793 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c40ab050 con 0x7f82cc0c5f10 2023-11-27T18:14:08.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.369+0000 7f82c9ffb640 1 -- 172.21.15.91:0/2637357793 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c40af780 con 0x7f82cc0c5f10 2023-11-27T18:14:08.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.369+0000 7f82d156c640 1 -- 172.21.15.91:0/2637357793 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f82cc0c5f10 msgr2=0x7f82cc06d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:08.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.369+0000 7f82d156c640 1 --2- 172.21.15.91:0/2637357793 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f82cc0c5f10 0x7f82cc06d0d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f82cc06b3a0 tx=0x7f82c401f180 comp rx=0 tx=0).stop 2023-11-27T18:14:08.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.369+0000 7f82d156c640 1 -- 172.21.15.91:0/2637357793 shutdown_connections 2023-11-27T18:14:08.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.369+0000 7f82d156c640 1 --2- 172.21.15.91:0/2637357793 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f82cc0c5f10 0x7f82cc06d0d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:08.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.369+0000 7f82d156c640 1 --2- 172.21.15.91:0/2637357793 >> v2:172.21.15.94:3300/0 conn(0x7f82cc0c85c0 0x7f82cc06cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:08.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.369+0000 7f82d156c640 1 -- 172.21.15.91:0/2637357793 >> 172.21.15.91:0/2637357793 conn(0x7f82cc0c79b0 msgr2=0x7f82cc0c7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:08.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.369+0000 7f82d156c640 1 -- 172.21.15.91:0/2637357793 shutdown_connections 2023-11-27T18:14:08.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.369+0000 7f82d156c640 1 -- 172.21.15.91:0/2637357793 wait complete. 2023-11-27T18:14:08.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.369+0000 7f82d156c640 1 Processor -- start 2023-11-27T18:14:08.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.369+0000 7f82d156c640 1 -- start start 2023-11-27T18:14:08.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.369+0000 7f82d156c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f82cc0c5f10 0x7f82cc1ef0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:08.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.369+0000 7f82d156c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f82cc0c85c0 0x7f82cc1e19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:08.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.369+0000 7f82d156c640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f82cc151820 0x7f82cc14a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:08.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.369+0000 7f82d156c640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc157300 con 0x7f82cc0c85c0 2023-11-27T18:14:08.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.369+0000 7f82d156c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc0bfed0 con 0x7f82cc0c5f10 2023-11-27T18:14:08.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.369+0000 7f82d156c640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc1e2260 con 0x7f82cc151820 2023-11-27T18:14:08.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.369+0000 7f82ca7fc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f82cc0c85c0 0x7f82cc1e19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:08.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.373+0000 7f82ca7fc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f82cc0c85c0 0x7f82cc1e19d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:56106/0 (socket says 172.21.15.91:56106) 2023-11-27T18:14:08.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.373+0000 7f82ca7fc640 1 -- 172.21.15.91:0/3412924714 learned_addr learned my addr 172.21.15.91:0/3412924714 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:08.369 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.373+0000 7f82caffd640 1 --2- 172.21.15.91:0/3412924714 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f82cc0c5f10 0x7f82cc1ef0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:08.369 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.373+0000 7f82cb7fe640 1 --2- 172.21.15.91:0/3412924714 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f82cc151820 0x7f82cc14a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:08.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.373+0000 7f82ca7fc640 1 -- 172.21.15.91:0/3412924714 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f82cc151820 msgr2=0x7f82cc14a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:08.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.373+0000 7f82ca7fc640 1 --2- 172.21.15.91:0/3412924714 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f82cc151820 0x7f82cc14a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:08.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.373+0000 7f82ca7fc640 1 -- 172.21.15.91:0/3412924714 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f82cc0c5f10 msgr2=0x7f82cc1ef0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:08.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.373+0000 7f82ca7fc640 1 --2- 172.21.15.91:0/3412924714 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f82cc0c5f10 0x7f82cc1ef0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:08.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.373+0000 7f82ca7fc640 1 -- 172.21.15.91:0/3412924714 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c4009b30 con 0x7f82cc0c85c0 2023-11-27T18:14:08.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.377+0000 7f82ca7fc640 1 --2- 172.21.15.91:0/3412924714 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f82cc0c85c0 0x7f82cc1e19d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f82c000d7d0 tx=0x7f82c000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:08.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.389+0000 7f82b37fe640 1 -- 172.21.15.91:0/3412924714 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c000b6c0 con 0x7f82cc0c85c0 2023-11-27T18:14:08.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.389+0000 7f82b37fe640 1 -- 172.21.15.91:0/3412924714 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c000b820 con 0x7f82cc0c85c0 2023-11-27T18:14:08.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.389+0000 7f82b37fe640 1 -- 172.21.15.91:0/3412924714 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c000bbd0 con 0x7f82cc0c85c0 2023-11-27T18:14:08.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.389+0000 7f82d156c640 1 -- 172.21.15.91:0/3412924714 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82cc1e2540 con 0x7f82cc0c85c0 2023-11-27T18:14:08.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.389+0000 7f82d156c640 1 -- 172.21.15.91:0/3412924714 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82cc1555c0 con 0x7f82cc0c85c0 2023-11-27T18:14:08.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.389+0000 7f82d156c640 1 -- 172.21.15.91:0/3412924714 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82cc067150 con 0x7f82cc0c85c0 2023-11-27T18:14:08.671 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.673+0000 7f82b37fe640 1 -- 172.21.15.91:0/3412924714 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f82c000bd30 con 0x7f82cc0c85c0 2023-11-27T18:14:08.672 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.677+0000 7f82b37fe640 1 --2- 172.21.15.91:0/3412924714 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f82b8066870 0x7f82b8068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:08.672 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.677+0000 7f82caffd640 1 --2- 172.21.15.91:0/3412924714 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f82b8066870 0x7f82b8068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:08.673 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.677+0000 7f82caffd640 1 --2- 172.21.15.91:0/3412924714 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f82b8066870 0x7f82b8068d30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f82bc0098e0 tx=0x7f82bc009060 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:08.711 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.713+0000 7f82b37fe640 1 -- 172.21.15.91:0/3412924714 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f82c0055f90 con 0x7f82cc0c85c0 2023-11-27T18:14:08.712 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.717+0000 7f82b37fe640 1 -- 172.21.15.91:0/3412924714 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f82c00522d0 con 0x7f82cc0c85c0 2023-11-27T18:14:08.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.881+0000 7f82d156c640 1 -- 172.21.15.91:0/3412924714 --> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f82cc0c6cf0 con 0x7f82b8066870 2023-11-27T18:14:08.888 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.893+0000 7f82b37fe640 1 -- 172.21.15.91:0/3412924714 <== mgr.4136 v2:172.21.15.91:6800/2814827118 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368601 (secure 0 0 0) 0x7f82bc009530 con 0x7f82b8066870 2023-11-27T18:14:08.891 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:14:08.894 INFO:teuthology.orchestra.run.smithi091.stderr:dumped all 2023-11-27T18:14:08.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.897+0000 7f82d156c640 1 -- 172.21.15.91:0/3412924714 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f82b8066870 msgr2=0x7f82b8068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:08.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.897+0000 7f82d156c640 1 --2- 172.21.15.91:0/3412924714 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f82b8066870 0x7f82b8068d30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f82bc0098e0 tx=0x7f82bc009060 comp rx=0 tx=0).stop 2023-11-27T18:14:08.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.897+0000 7f82d156c640 1 -- 172.21.15.91:0/3412924714 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f82cc0c85c0 msgr2=0x7f82cc1e19d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:08.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.897+0000 7f82d156c640 1 --2- 172.21.15.91:0/3412924714 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f82cc0c85c0 0x7f82cc1e19d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f82c000d7d0 tx=0x7f82c000dc90 comp rx=0 tx=0).stop 2023-11-27T18:14:08.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.897+0000 7f82d156c640 1 -- 172.21.15.91:0/3412924714 shutdown_connections 2023-11-27T18:14:08.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.897+0000 7f82d156c640 1 --2- 172.21.15.91:0/3412924714 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f82b8066870 0x7f82b8068d30 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:08.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.897+0000 7f82d156c640 1 --2- 172.21.15.91:0/3412924714 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f82cc151820 0x7f82cc14a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:08.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.897+0000 7f82d156c640 1 --2- 172.21.15.91:0/3412924714 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f82cc0c85c0 0x7f82cc1e19d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:08.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.897+0000 7f82d156c640 1 --2- 172.21.15.91:0/3412924714 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f82cc0c5f10 0x7f82cc1ef0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:08.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.897+0000 7f82d156c640 1 -- 172.21.15.91:0/3412924714 >> 172.21.15.91:0/3412924714 conn(0x7f82cc0c79b0 msgr2=0x7f82cc14cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:08.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.897+0000 7f82d156c640 1 -- 172.21.15.91:0/3412924714 shutdown_connections 2023-11-27T18:14:08.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:08.897+0000 7f82d156c640 1 -- 172.21.15.91:0/3412924714 wait complete. 2023-11-27T18:14:08.913 INFO:teuthology.orchestra.run.smithi091.stdout:{"pg_ready":true,"pg_map":{"version":71,"stamp":"2023-11-27T18:14:07.112730+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235452,"kb_used_data":2652,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739268,"statfs":{"total":773094113280,"available":772853010432,"internally_reserved":0,"allocated":2715648,"data_stored":2186933,"data_compressed":67010,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004794"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.975533+0000","last_change":"2023-11-27T18:13:12.298503+0000","last_active":"2023-11-27T18:13:21.975533+0000","last_peered":"2023-11-27T18:13:21.975533+0000","last_clean":"2023-11-27T18:13:21.975533+0000","last_became_active":"2023-11-27T18:13:12.298140+0000","last_became_peered":"2023-11-27T18:13:12.298140+0000","last_unstale":"2023-11-27T18:13:21.975533+0000","last_undegraded":"2023-11-27T18:13:21.975533+0000","last_fullsized":"2023-11-27T18:13:21.975533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:04:02.661989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.141448+0000","last_change":"2023-11-27T18:13:14.416681+0000","last_active":"2023-11-27T18:13:22.141448+0000","last_peered":"2023-11-27T18:13:22.141448+0000","last_clean":"2023-11-27T18:13:22.141448+0000","last_became_active":"2023-11-27T18:13:14.416401+0000","last_became_peered":"2023-11-27T18:13:14.416401+0000","last_unstale":"2023-11-27T18:13:22.141448+0000","last_undegraded":"2023-11-27T18:13:22.141448+0000","last_fullsized":"2023-11-27T18:13:22.141448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:02:14.142363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.231066+0000","last_change":"2023-11-27T18:13:20.916435+0000","last_active":"2023-11-27T18:13:23.231066+0000","last_peered":"2023-11-27T18:13:23.231066+0000","last_clean":"2023-11-27T18:13:23.231066+0000","last_became_active":"2023-11-27T18:13:20.915358+0000","last_became_peered":"2023-11-27T18:13:20.915358+0000","last_unstale":"2023-11-27T18:13:23.231066+0000","last_undegraded":"2023-11-27T18:13:23.231066+0000","last_fullsized":"2023-11-27T18:13:23.231066+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:55:46.903556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.141645+0000","last_change":"2023-11-27T18:13:12.305296+0000","last_active":"2023-11-27T18:13:22.141645+0000","last_peered":"2023-11-27T18:13:22.141645+0000","last_clean":"2023-11-27T18:13:22.141645+0000","last_became_active":"2023-11-27T18:13:12.304981+0000","last_became_peered":"2023-11-27T18:13:12.304981+0000","last_unstale":"2023-11-27T18:13:22.141645+0000","last_undegraded":"2023-11-27T18:13:22.141645+0000","last_fullsized":"2023-11-27T18:13:22.141645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:04:30.721243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.142078+0000","last_change":"2023-11-27T18:13:14.366102+0000","last_active":"2023-11-27T18:13:22.142078+0000","last_peered":"2023-11-27T18:13:22.142078+0000","last_clean":"2023-11-27T18:13:22.142078+0000","last_became_active":"2023-11-27T18:13:14.365787+0000","last_became_peered":"2023-11-27T18:13:14.365787+0000","last_unstale":"2023-11-27T18:13:22.142078+0000","last_undegraded":"2023-11-27T18:13:22.142078+0000","last_fullsized":"2023-11-27T18:13:22.142078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:39:34.589545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.674201+0000","last_change":"2023-11-27T18:13:20.915811+0000","last_active":"2023-11-27T18:13:23.674201+0000","last_peered":"2023-11-27T18:13:23.674201+0000","last_clean":"2023-11-27T18:13:23.674201+0000","last_became_active":"2023-11-27T18:13:20.914864+0000","last_became_peered":"2023-11-27T18:13:20.914864+0000","last_unstale":"2023-11-27T18:13:23.674201+0000","last_undegraded":"2023-11-27T18:13:23.674201+0000","last_fullsized":"2023-11-27T18:13:23.674201+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:22:21.572863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140911+0000","last_change":"2023-11-27T18:13:12.272691+0000","last_active":"2023-11-27T18:13:22.140911+0000","last_peered":"2023-11-27T18:13:22.140911+0000","last_clean":"2023-11-27T18:13:22.140911+0000","last_became_active":"2023-11-27T18:13:12.272343+0000","last_became_peered":"2023-11-27T18:13:12.272343+0000","last_unstale":"2023-11-27T18:13:22.140911+0000","last_undegraded":"2023-11-27T18:13:22.140911+0000","last_fullsized":"2023-11-27T18:13:22.140911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:23:55.280753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140650+0000","last_change":"2023-11-27T18:13:15.804199+0000","last_active":"2023-11-27T18:13:22.140650+0000","last_peered":"2023-11-27T18:13:22.140650+0000","last_clean":"2023-11-27T18:13:22.140650+0000","last_became_active":"2023-11-27T18:13:15.803248+0000","last_became_peered":"2023-11-27T18:13:15.803248+0000","last_unstale":"2023-11-27T18:13:22.140650+0000","last_undegraded":"2023-11-27T18:13:22.140650+0000","last_fullsized":"2023-11-27T18:13:22.140650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:39:31.246554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.675082+0000","last_change":"2023-11-27T18:13:20.909371+0000","last_active":"2023-11-27T18:13:23.675082+0000","last_peered":"2023-11-27T18:13:23.675082+0000","last_clean":"2023-11-27T18:13:23.675082+0000","last_became_active":"2023-11-27T18:13:20.908285+0000","last_became_peered":"2023-11-27T18:13:20.908285+0000","last_unstale":"2023-11-27T18:13:23.675082+0000","last_undegraded":"2023-11-27T18:13:23.675082+0000","last_fullsized":"2023-11-27T18:13:23.675082+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:40:20.210205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140612+0000","last_change":"2023-11-27T18:13:12.274531+0000","last_active":"2023-11-27T18:13:22.140612+0000","last_peered":"2023-11-27T18:13:22.140612+0000","last_clean":"2023-11-27T18:13:22.140612+0000","last_became_active":"2023-11-27T18:13:12.274275+0000","last_became_peered":"2023-11-27T18:13:12.274275+0000","last_unstale":"2023-11-27T18:13:22.140612+0000","last_undegraded":"2023-11-27T18:13:22.140612+0000","last_fullsized":"2023-11-27T18:13:22.140612+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:02:12.938184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.143037+0000","last_change":"2023-11-27T18:13:14.422531+0000","last_active":"2023-11-27T18:13:22.143037+0000","last_peered":"2023-11-27T18:13:22.143037+0000","last_clean":"2023-11-27T18:13:22.143037+0000","last_became_active":"2023-11-27T18:13:14.421811+0000","last_became_peered":"2023-11-27T18:13:14.421811+0000","last_unstale":"2023-11-27T18:13:22.143037+0000","last_undegraded":"2023-11-27T18:13:22.143037+0000","last_fullsized":"2023-11-27T18:13:22.143037+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:17:17.491694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.675351+0000","last_change":"2023-11-27T18:13:20.907358+0000","last_active":"2023-11-27T18:13:23.675351+0000","last_peered":"2023-11-27T18:13:23.675351+0000","last_clean":"2023-11-27T18:13:23.675351+0000","last_became_active":"2023-11-27T18:13:20.906418+0000","last_became_peered":"2023-11-27T18:13:20.906418+0000","last_unstale":"2023-11-27T18:13:23.675351+0000","last_undegraded":"2023-11-27T18:13:23.675351+0000","last_fullsized":"2023-11-27T18:13:23.675351+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:26:43.789814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.143078+0000","last_change":"2023-11-27T18:13:14.421453+0000","last_active":"2023-11-27T18:13:22.143078+0000","last_peered":"2023-11-27T18:13:22.143078+0000","last_clean":"2023-11-27T18:13:22.143078+0000","last_became_active":"2023-11-27T18:13:14.418640+0000","last_became_peered":"2023-11-27T18:13:14.418640+0000","last_unstale":"2023-11-27T18:13:22.143078+0000","last_undegraded":"2023-11-27T18:13:22.143078+0000","last_fullsized":"2023-11-27T18:13:22.143078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:38:18.655528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.142971+0000","last_change":"2023-11-27T18:13:12.306690+0000","last_active":"2023-11-27T18:13:22.142971+0000","last_peered":"2023-11-27T18:13:22.142971+0000","last_clean":"2023-11-27T18:13:22.142971+0000","last_became_active":"2023-11-27T18:13:12.306331+0000","last_became_peered":"2023-11-27T18:13:12.306331+0000","last_unstale":"2023-11-27T18:13:22.142971+0000","last_undegraded":"2023-11-27T18:13:22.142971+0000","last_fullsized":"2023-11-27T18:13:22.142971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:39:32.646368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.321605+0000","last_change":"2023-11-27T18:13:20.929179+0000","last_active":"2023-11-27T18:13:23.321605+0000","last_peered":"2023-11-27T18:13:23.321605+0000","last_clean":"2023-11-27T18:13:23.321605+0000","last_became_active":"2023-11-27T18:13:20.927962+0000","last_became_peered":"2023-11-27T18:13:20.927962+0000","last_unstale":"2023-11-27T18:13:23.321605+0000","last_undegraded":"2023-11-27T18:13:23.321605+0000","last_fullsized":"2023-11-27T18:13:23.321605+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:05:49.936547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.927324+0000","last_change":"2023-11-27T18:13:14.368428+0000","last_active":"2023-11-27T18:13:21.927324+0000","last_peered":"2023-11-27T18:13:21.927324+0000","last_clean":"2023-11-27T18:13:21.927324+0000","last_became_active":"2023-11-27T18:13:14.368117+0000","last_became_peered":"2023-11-27T18:13:14.368117+0000","last_unstale":"2023-11-27T18:13:21.927324+0000","last_undegraded":"2023-11-27T18:13:21.927324+0000","last_fullsized":"2023-11-27T18:13:21.927324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:24:45.528760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.139380+0000","last_change":"2023-11-27T18:13:12.306963+0000","last_active":"2023-11-27T18:13:22.139380+0000","last_peered":"2023-11-27T18:13:22.139380+0000","last_clean":"2023-11-27T18:13:22.139380+0000","last_became_active":"2023-11-27T18:13:12.306644+0000","last_became_peered":"2023-11-27T18:13:12.306644+0000","last_unstale":"2023-11-27T18:13:22.139380+0000","last_undegraded":"2023-11-27T18:13:22.139380+0000","last_fullsized":"2023-11-27T18:13:22.139380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:55:43.829654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:24.442496+0000","last_change":"2023-11-27T18:13:20.930173+0000","last_active":"2023-11-27T18:13:24.442496+0000","last_peered":"2023-11-27T18:13:24.442496+0000","last_clean":"2023-11-27T18:13:24.442496+0000","last_became_active":"2023-11-27T18:13:20.928830+0000","last_became_peered":"2023-11-27T18:13:20.928830+0000","last_unstale":"2023-11-27T18:13:24.442496+0000","last_undegraded":"2023-11-27T18:13:24.442496+0000","last_fullsized":"2023-11-27T18:13:24.442496+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:38:26.343953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.974087+0000","last_change":"2023-11-27T18:13:14.378647+0000","last_active":"2023-11-27T18:13:21.974087+0000","last_peered":"2023-11-27T18:13:21.974087+0000","last_clean":"2023-11-27T18:13:21.974087+0000","last_became_active":"2023-11-27T18:13:14.378391+0000","last_became_peered":"2023-11-27T18:13:14.378391+0000","last_unstale":"2023-11-27T18:13:21.974087+0000","last_undegraded":"2023-11-27T18:13:21.974087+0000","last_fullsized":"2023-11-27T18:13:21.974087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:02:22.189845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.975536+0000","last_change":"2023-11-27T18:13:12.270283+0000","last_active":"2023-11-27T18:13:21.975536+0000","last_peered":"2023-11-27T18:13:21.975536+0000","last_clean":"2023-11-27T18:13:21.975536+0000","last_became_active":"2023-11-27T18:13:12.269795+0000","last_became_peered":"2023-11-27T18:13:12.269795+0000","last_unstale":"2023-11-27T18:13:21.975536+0000","last_undegraded":"2023-11-27T18:13:21.975536+0000","last_fullsized":"2023-11-27T18:13:21.975536+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:06:24.103678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.231936+0000","last_change":"2023-11-27T18:13:20.907340+0000","last_active":"2023-11-27T18:13:23.231936+0000","last_peered":"2023-11-27T18:13:23.231936+0000","last_clean":"2023-11-27T18:13:23.231936+0000","last_became_active":"2023-11-27T18:13:20.906609+0000","last_became_peered":"2023-11-27T18:13:20.906609+0000","last_unstale":"2023-11-27T18:13:23.231936+0000","last_undegraded":"2023-11-27T18:13:23.231936+0000","last_fullsized":"2023-11-27T18:13:23.231936+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:19:00.295457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.142648+0000","last_change":"2023-11-27T18:13:14.415177+0000","last_active":"2023-11-27T18:13:22.142648+0000","last_peered":"2023-11-27T18:13:22.142648+0000","last_clean":"2023-11-27T18:13:22.142648+0000","last_became_active":"2023-11-27T18:13:14.414888+0000","last_became_peered":"2023-11-27T18:13:14.414888+0000","last_unstale":"2023-11-27T18:13:22.142648+0000","last_undegraded":"2023-11-27T18:13:22.142648+0000","last_fullsized":"2023-11-27T18:13:22.142648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:41:49.599901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.139916+0000","last_change":"2023-11-27T18:13:12.273724+0000","last_active":"2023-11-27T18:13:22.139916+0000","last_peered":"2023-11-27T18:13:22.139916+0000","last_clean":"2023-11-27T18:13:22.139916+0000","last_became_active":"2023-11-27T18:13:12.273356+0000","last_became_peered":"2023-11-27T18:13:12.273356+0000","last_unstale":"2023-11-27T18:13:22.139916+0000","last_undegraded":"2023-11-27T18:13:22.139916+0000","last_fullsized":"2023-11-27T18:13:22.139916+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:15:14.235633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.675747+0000","last_change":"2023-11-27T18:13:20.935910+0000","last_active":"2023-11-27T18:13:23.675747+0000","last_peered":"2023-11-27T18:13:23.675747+0000","last_clean":"2023-11-27T18:13:23.675747+0000","last_became_active":"2023-11-27T18:13:20.934797+0000","last_became_peered":"2023-11-27T18:13:20.934797+0000","last_unstale":"2023-11-27T18:13:23.675747+0000","last_undegraded":"2023-11-27T18:13:23.675747+0000","last_fullsized":"2023-11-27T18:13:23.675747+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:00:35.425015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.974788+0000","last_change":"2023-11-27T18:13:14.376557+0000","last_active":"2023-11-27T18:13:21.974788+0000","last_peered":"2023-11-27T18:13:21.974788+0000","last_clean":"2023-11-27T18:13:21.974788+0000","last_became_active":"2023-11-27T18:13:14.376304+0000","last_became_peered":"2023-11-27T18:13:14.376304+0000","last_unstale":"2023-11-27T18:13:21.974788+0000","last_undegraded":"2023-11-27T18:13:21.974788+0000","last_fullsized":"2023-11-27T18:13:21.974788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:37:22.787246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.145694+0000","last_change":"2023-11-27T18:13:12.307806+0000","last_active":"2023-11-27T18:13:22.145694+0000","last_peered":"2023-11-27T18:13:22.145694+0000","last_clean":"2023-11-27T18:13:22.145694+0000","last_became_active":"2023-11-27T18:13:12.307492+0000","last_became_peered":"2023-11-27T18:13:12.307492+0000","last_unstale":"2023-11-27T18:13:22.145694+0000","last_undegraded":"2023-11-27T18:13:22.145694+0000","last_fullsized":"2023-11-27T18:13:22.145694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:34:06.981997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.674551+0000","last_change":"2023-11-27T18:13:20.918671+0000","last_active":"2023-11-27T18:13:23.674551+0000","last_peered":"2023-11-27T18:13:23.674551+0000","last_clean":"2023-11-27T18:13:23.674551+0000","last_became_active":"2023-11-27T18:13:20.917507+0000","last_became_peered":"2023-11-27T18:13:20.917507+0000","last_unstale":"2023-11-27T18:13:23.674551+0000","last_undegraded":"2023-11-27T18:13:23.674551+0000","last_fullsized":"2023-11-27T18:13:23.674551+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:00:52.213234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.975274+0000","last_change":"2023-11-27T18:13:14.377644+0000","last_active":"2023-11-27T18:13:21.975274+0000","last_peered":"2023-11-27T18:13:21.975274+0000","last_clean":"2023-11-27T18:13:21.975274+0000","last_became_active":"2023-11-27T18:13:14.377289+0000","last_became_peered":"2023-11-27T18:13:14.377289+0000","last_unstale":"2023-11-27T18:13:21.975274+0000","last_undegraded":"2023-11-27T18:13:21.975274+0000","last_fullsized":"2023-11-27T18:13:21.975274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:55:42.641433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.975026+0000","last_change":"2023-11-27T18:13:12.267960+0000","last_active":"2023-11-27T18:13:21.975026+0000","last_peered":"2023-11-27T18:13:21.975026+0000","last_clean":"2023-11-27T18:13:21.975026+0000","last_became_active":"2023-11-27T18:13:12.267552+0000","last_became_peered":"2023-11-27T18:13:12.267552+0000","last_unstale":"2023-11-27T18:13:21.975026+0000","last_undegraded":"2023-11-27T18:13:21.975026+0000","last_fullsized":"2023-11-27T18:13:21.975026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:26:13.819717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.288385+0000","last_change":"2023-11-27T18:13:20.929780+0000","last_active":"2023-11-27T18:13:23.288385+0000","last_peered":"2023-11-27T18:13:23.288385+0000","last_clean":"2023-11-27T18:13:23.288385+0000","last_became_active":"2023-11-27T18:13:20.929370+0000","last_became_peered":"2023-11-27T18:13:20.929370+0000","last_unstale":"2023-11-27T18:13:23.288385+0000","last_undegraded":"2023-11-27T18:13:23.288385+0000","last_fullsized":"2023-11-27T18:13:23.288385+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:04:33.249483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140988+0000","last_change":"2023-11-27T18:13:14.369764+0000","last_active":"2023-11-27T18:13:22.140988+0000","last_peered":"2023-11-27T18:13:22.140988+0000","last_clean":"2023-11-27T18:13:22.140988+0000","last_became_active":"2023-11-27T18:13:14.369472+0000","last_became_peered":"2023-11-27T18:13:14.369472+0000","last_unstale":"2023-11-27T18:13:22.140988+0000","last_undegraded":"2023-11-27T18:13:22.140988+0000","last_fullsized":"2023-11-27T18:13:22.140988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:35:38.706782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.143297+0000","last_change":"2023-11-27T18:13:12.310761+0000","last_active":"2023-11-27T18:13:22.143297+0000","last_peered":"2023-11-27T18:13:22.143297+0000","last_clean":"2023-11-27T18:13:22.143297+0000","last_became_active":"2023-11-27T18:13:12.310495+0000","last_became_peered":"2023-11-27T18:13:12.310495+0000","last_unstale":"2023-11-27T18:13:22.143297+0000","last_undegraded":"2023-11-27T18:13:22.143297+0000","last_fullsized":"2023-11-27T18:13:22.143297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:48:59.333816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.935576+0000","last_change":"2023-11-27T18:13:20.907638+0000","last_active":"2023-11-27T18:13:23.935576+0000","last_peered":"2023-11-27T18:13:23.935576+0000","last_clean":"2023-11-27T18:13:23.935576+0000","last_became_active":"2023-11-27T18:13:20.907229+0000","last_became_peered":"2023-11-27T18:13:20.907229+0000","last_unstale":"2023-11-27T18:13:23.935576+0000","last_undegraded":"2023-11-27T18:13:23.935576+0000","last_fullsized":"2023-11-27T18:13:23.935576+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:49:08.226420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.071564+0000","last_change":"2023-11-27T18:13:15.851127+0000","last_active":"2023-11-27T18:13:22.071564+0000","last_peered":"2023-11-27T18:13:22.071564+0000","last_clean":"2023-11-27T18:13:22.071564+0000","last_became_active":"2023-11-27T18:13:15.850263+0000","last_became_peered":"2023-11-27T18:13:15.850263+0000","last_unstale":"2023-11-27T18:13:22.071564+0000","last_undegraded":"2023-11-27T18:13:22.071564+0000","last_fullsized":"2023-11-27T18:13:22.071564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:48:39.587974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.139967+0000","last_change":"2023-11-27T18:13:12.310451+0000","last_active":"2023-11-27T18:13:22.139967+0000","last_peered":"2023-11-27T18:13:22.139967+0000","last_clean":"2023-11-27T18:13:22.139967+0000","last_became_active":"2023-11-27T18:13:12.310138+0000","last_became_peered":"2023-11-27T18:13:12.310138+0000","last_unstale":"2023-11-27T18:13:22.139967+0000","last_undegraded":"2023-11-27T18:13:22.139967+0000","last_fullsized":"2023-11-27T18:13:22.139967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:03:09.046171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.934474+0000","last_change":"2023-11-27T18:13:20.896960+0000","last_active":"2023-11-27T18:13:23.934474+0000","last_peered":"2023-11-27T18:13:23.934474+0000","last_clean":"2023-11-27T18:13:23.934474+0000","last_became_active":"2023-11-27T18:13:20.896156+0000","last_became_peered":"2023-11-27T18:13:20.896156+0000","last_unstale":"2023-11-27T18:13:23.934474+0000","last_undegraded":"2023-11-27T18:13:23.934474+0000","last_fullsized":"2023-11-27T18:13:23.934474+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:00:52.213234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140720+0000","last_change":"2023-11-27T18:13:14.421498+0000","last_active":"2023-11-27T18:13:22.140720+0000","last_peered":"2023-11-27T18:13:22.140720+0000","last_clean":"2023-11-27T18:13:22.140720+0000","last_became_active":"2023-11-27T18:13:14.421125+0000","last_became_peered":"2023-11-27T18:13:14.421125+0000","last_unstale":"2023-11-27T18:13:22.140720+0000","last_undegraded":"2023-11-27T18:13:22.140720+0000","last_fullsized":"2023-11-27T18:13:22.140720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:52:30.225572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.143659+0000","last_change":"2023-11-27T18:13:12.301922+0000","last_active":"2023-11-27T18:13:22.143659+0000","last_peered":"2023-11-27T18:13:22.143659+0000","last_clean":"2023-11-27T18:13:22.143659+0000","last_became_active":"2023-11-27T18:13:12.301617+0000","last_became_peered":"2023-11-27T18:13:12.301617+0000","last_unstale":"2023-11-27T18:13:22.143659+0000","last_undegraded":"2023-11-27T18:13:22.143659+0000","last_fullsized":"2023-11-27T18:13:22.143659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:00:43.320630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.935898+0000","last_change":"2023-11-27T18:13:20.905013+0000","last_active":"2023-11-27T18:13:23.935898+0000","last_peered":"2023-11-27T18:13:23.935898+0000","last_clean":"2023-11-27T18:13:23.935898+0000","last_became_active":"2023-11-27T18:13:20.903019+0000","last_became_peered":"2023-11-27T18:13:20.903019+0000","last_unstale":"2023-11-27T18:13:23.935898+0000","last_undegraded":"2023-11-27T18:13:23.935898+0000","last_fullsized":"2023-11-27T18:13:23.935898+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:34:15.874601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.138615+0000","last_change":"2023-11-27T18:13:14.378913+0000","last_active":"2023-11-27T18:13:22.138615+0000","last_peered":"2023-11-27T18:13:22.138615+0000","last_clean":"2023-11-27T18:13:22.138615+0000","last_became_active":"2023-11-27T18:13:14.378644+0000","last_became_peered":"2023-11-27T18:13:14.378644+0000","last_unstale":"2023-11-27T18:13:22.138615+0000","last_undegraded":"2023-11-27T18:13:22.138615+0000","last_fullsized":"2023-11-27T18:13:22.138615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:19:02.523860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.926631+0000","last_change":"2023-11-27T18:13:12.305733+0000","last_active":"2023-11-27T18:13:21.926631+0000","last_peered":"2023-11-27T18:13:21.926631+0000","last_clean":"2023-11-27T18:13:21.926631+0000","last_became_active":"2023-11-27T18:13:12.305380+0000","last_became_peered":"2023-11-27T18:13:12.305380+0000","last_unstale":"2023-11-27T18:13:21.926631+0000","last_undegraded":"2023-11-27T18:13:21.926631+0000","last_fullsized":"2023-11-27T18:13:21.926631+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:34:46.886091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.936019+0000","last_change":"2023-11-27T18:13:20.913672+0000","last_active":"2023-11-27T18:13:23.936019+0000","last_peered":"2023-11-27T18:13:23.936019+0000","last_clean":"2023-11-27T18:13:23.936019+0000","last_became_active":"2023-11-27T18:13:20.913137+0000","last_became_peered":"2023-11-27T18:13:20.913137+0000","last_unstale":"2023-11-27T18:13:23.936019+0000","last_undegraded":"2023-11-27T18:13:23.936019+0000","last_fullsized":"2023-11-27T18:13:23.936019+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:40:20.210205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.138829+0000","last_change":"2023-11-27T18:13:14.413781+0000","last_active":"2023-11-27T18:13:22.138829+0000","last_peered":"2023-11-27T18:13:22.138829+0000","last_clean":"2023-11-27T18:13:22.138829+0000","last_became_active":"2023-11-27T18:13:14.413413+0000","last_became_peered":"2023-11-27T18:13:14.413413+0000","last_unstale":"2023-11-27T18:13:22.138829+0000","last_undegraded":"2023-11-27T18:13:22.138829+0000","last_fullsized":"2023-11-27T18:13:22.138829+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:04:03.068428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.142629+0000","last_change":"2023-11-27T18:13:12.315822+0000","last_active":"2023-11-27T18:13:22.142629+0000","last_peered":"2023-11-27T18:13:22.142629+0000","last_clean":"2023-11-27T18:13:22.142629+0000","last_became_active":"2023-11-27T18:13:12.315610+0000","last_became_peered":"2023-11-27T18:13:12.315610+0000","last_unstale":"2023-11-27T18:13:22.142629+0000","last_undegraded":"2023-11-27T18:13:22.142629+0000","last_fullsized":"2023-11-27T18:13:22.142629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:39:33.385367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:24.439052+0000","last_change":"2023-11-27T18:13:20.912891+0000","last_active":"2023-11-27T18:13:24.439052+0000","last_peered":"2023-11-27T18:13:24.439052+0000","last_clean":"2023-11-27T18:13:24.439052+0000","last_became_active":"2023-11-27T18:13:20.912453+0000","last_became_peered":"2023-11-27T18:13:20.912453+0000","last_unstale":"2023-11-27T18:13:24.439052+0000","last_undegraded":"2023-11-27T18:13:24.439052+0000","last_fullsized":"2023-11-27T18:13:24.439052+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:35:44.943527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.975967+0000","last_change":"2023-11-27T18:13:14.414468+0000","last_active":"2023-11-27T18:13:21.975967+0000","last_peered":"2023-11-27T18:13:21.975967+0000","last_clean":"2023-11-27T18:13:21.975967+0000","last_became_active":"2023-11-27T18:13:14.414156+0000","last_became_peered":"2023-11-27T18:13:14.414156+0000","last_unstale":"2023-11-27T18:13:21.975967+0000","last_undegraded":"2023-11-27T18:13:21.975967+0000","last_fullsized":"2023-11-27T18:13:21.975967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:46:11.500006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.143074+0000","last_change":"2023-11-27T18:13:12.308337+0000","last_active":"2023-11-27T18:13:22.143074+0000","last_peered":"2023-11-27T18:13:22.143074+0000","last_clean":"2023-11-27T18:13:22.143074+0000","last_became_active":"2023-11-27T18:13:12.308050+0000","last_became_peered":"2023-11-27T18:13:12.308050+0000","last_unstale":"2023-11-27T18:13:22.143074+0000","last_undegraded":"2023-11-27T18:13:22.143074+0000","last_fullsized":"2023-11-27T18:13:22.143074+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:14:09.398956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"20'117","reported_seq":170,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140186+0000","last_change":"2023-11-27T18:12:38.371836+0000","last_active":"2023-11-27T18:13:22.140186+0000","last_peered":"2023-11-27T18:13:22.140186+0000","last_clean":"2023-11-27T18:13:22.140186+0000","last_became_active":"2023-11-27T18:12:38.370748+0000","last_became_peered":"2023-11-27T18:12:38.370748+0000","last_unstale":"2023-11-27T18:13:22.140186+0000","last_undegraded":"2023-11-27T18:13:22.140186+0000","last_fullsized":"2023-11-27T18:13:22.140186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:12:36.259476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:12:36.259476+0000","last_clean_scrub_stamp":"2023-11-27T18:12:36.259476+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:25:36.712765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.322281+0000","last_change":"2023-11-27T18:13:20.928359+0000","last_active":"2023-11-27T18:13:23.322281+0000","last_peered":"2023-11-27T18:13:23.322281+0000","last_clean":"2023-11-27T18:13:23.322281+0000","last_became_active":"2023-11-27T18:13:20.926559+0000","last_became_peered":"2023-11-27T18:13:20.926559+0000","last_unstale":"2023-11-27T18:13:23.322281+0000","last_undegraded":"2023-11-27T18:13:23.322281+0000","last_fullsized":"2023-11-27T18:13:23.322281+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:47:06.255647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.143121+0000","last_change":"2023-11-27T18:13:14.422275+0000","last_active":"2023-11-27T18:13:22.143121+0000","last_peered":"2023-11-27T18:13:22.143121+0000","last_clean":"2023-11-27T18:13:22.143121+0000","last_became_active":"2023-11-27T18:13:14.419636+0000","last_became_peered":"2023-11-27T18:13:14.419636+0000","last_unstale":"2023-11-27T18:13:22.143121+0000","last_undegraded":"2023-11-27T18:13:22.143121+0000","last_fullsized":"2023-11-27T18:13:22.143121+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:29:10.027795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.141172+0000","last_change":"2023-11-27T18:13:12.268222+0000","last_active":"2023-11-27T18:13:22.141172+0000","last_peered":"2023-11-27T18:13:22.141172+0000","last_clean":"2023-11-27T18:13:22.141172+0000","last_became_active":"2023-11-27T18:13:12.267764+0000","last_became_peered":"2023-11-27T18:13:12.267764+0000","last_unstale":"2023-11-27T18:13:22.141172+0000","last_undegraded":"2023-11-27T18:13:22.141172+0000","last_fullsized":"2023-11-27T18:13:22.141172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:48:38.383796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.674846+0000","last_change":"2023-11-27T18:13:20.917055+0000","last_active":"2023-11-27T18:13:23.674846+0000","last_peered":"2023-11-27T18:13:23.674846+0000","last_clean":"2023-11-27T18:13:23.674846+0000","last_became_active":"2023-11-27T18:13:20.914157+0000","last_became_peered":"2023-11-27T18:13:20.914157+0000","last_unstale":"2023-11-27T18:13:23.674846+0000","last_undegraded":"2023-11-27T18:13:23.674846+0000","last_fullsized":"2023-11-27T18:13:23.674846+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:34:15.874601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140538+0000","last_change":"2023-11-27T18:13:14.363559+0000","last_active":"2023-11-27T18:13:22.140538+0000","last_peered":"2023-11-27T18:13:22.140538+0000","last_clean":"2023-11-27T18:13:22.140538+0000","last_became_active":"2023-11-27T18:13:14.363285+0000","last_became_peered":"2023-11-27T18:13:14.363285+0000","last_unstale":"2023-11-27T18:13:22.140538+0000","last_undegraded":"2023-11-27T18:13:22.140538+0000","last_fullsized":"2023-11-27T18:13:22.140538+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:00:44.524809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140713+0000","last_change":"2023-11-27T18:13:12.312477+0000","last_active":"2023-11-27T18:13:22.140713+0000","last_peered":"2023-11-27T18:13:22.140713+0000","last_clean":"2023-11-27T18:13:22.140713+0000","last_became_active":"2023-11-27T18:13:12.312038+0000","last_became_peered":"2023-11-27T18:13:12.312038+0000","last_unstale":"2023-11-27T18:13:22.140713+0000","last_undegraded":"2023-11-27T18:13:22.140713+0000","last_fullsized":"2023-11-27T18:13:22.140713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:35:37.502604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:24.439241+0000","last_change":"2023-11-27T18:13:20.913830+0000","last_active":"2023-11-27T18:13:24.439241+0000","last_peered":"2023-11-27T18:13:24.439241+0000","last_clean":"2023-11-27T18:13:24.439241+0000","last_became_active":"2023-11-27T18:13:20.912734+0000","last_became_peered":"2023-11-27T18:13:20.912734+0000","last_unstale":"2023-11-27T18:13:24.439241+0000","last_undegraded":"2023-11-27T18:13:24.439241+0000","last_fullsized":"2023-11-27T18:13:24.439241+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:35:39.280506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.141013+0000","last_change":"2023-11-27T18:13:14.364027+0000","last_active":"2023-11-27T18:13:22.141013+0000","last_peered":"2023-11-27T18:13:22.141013+0000","last_clean":"2023-11-27T18:13:22.141013+0000","last_became_active":"2023-11-27T18:13:14.363772+0000","last_became_peered":"2023-11-27T18:13:14.363772+0000","last_unstale":"2023-11-27T18:13:22.141013+0000","last_undegraded":"2023-11-27T18:13:22.141013+0000","last_fullsized":"2023-11-27T18:13:22.141013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:40:12.521779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.974905+0000","last_change":"2023-11-27T18:13:12.304785+0000","last_active":"2023-11-27T18:13:21.974905+0000","last_peered":"2023-11-27T18:13:21.974905+0000","last_clean":"2023-11-27T18:13:21.974905+0000","last_became_active":"2023-11-27T18:13:12.304400+0000","last_became_peered":"2023-11-27T18:13:12.304400+0000","last_unstale":"2023-11-27T18:13:21.974905+0000","last_undegraded":"2023-11-27T18:13:21.974905+0000","last_fullsized":"2023-11-27T18:13:21.974905+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:37:52.292054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.320761+0000","last_change":"2023-11-27T18:13:20.922959+0000","last_active":"2023-11-27T18:13:23.320761+0000","last_peered":"2023-11-27T18:13:23.320761+0000","last_clean":"2023-11-27T18:13:23.320761+0000","last_became_active":"2023-11-27T18:13:20.918984+0000","last_became_peered":"2023-11-27T18:13:20.918984+0000","last_unstale":"2023-11-27T18:13:23.320761+0000","last_undegraded":"2023-11-27T18:13:23.320761+0000","last_fullsized":"2023-11-27T18:13:23.320761+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:59:33.426999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.071789+0000","last_change":"2023-11-27T18:13:15.852939+0000","last_active":"2023-11-27T18:13:22.071789+0000","last_peered":"2023-11-27T18:13:22.071789+0000","last_clean":"2023-11-27T18:13:22.071789+0000","last_became_active":"2023-11-27T18:13:15.852339+0000","last_became_peered":"2023-11-27T18:13:15.852339+0000","last_unstale":"2023-11-27T18:13:22.071789+0000","last_undegraded":"2023-11-27T18:13:22.071789+0000","last_fullsized":"2023-11-27T18:13:22.071789+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:31:25.796567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140369+0000","last_change":"2023-11-27T18:13:12.311109+0000","last_active":"2023-11-27T18:13:22.140369+0000","last_peered":"2023-11-27T18:13:22.140369+0000","last_clean":"2023-11-27T18:13:22.140369+0000","last_became_active":"2023-11-27T18:13:12.310921+0000","last_became_peered":"2023-11-27T18:13:12.310921+0000","last_unstale":"2023-11-27T18:13:22.140369+0000","last_undegraded":"2023-11-27T18:13:22.140369+0000","last_fullsized":"2023-11-27T18:13:22.140369+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:05:04.546929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.292365+0000","last_change":"2023-11-27T18:13:20.925265+0000","last_active":"2023-11-27T18:13:23.292365+0000","last_peered":"2023-11-27T18:13:23.292365+0000","last_clean":"2023-11-27T18:13:23.292365+0000","last_became_active":"2023-11-27T18:13:20.924209+0000","last_became_peered":"2023-11-27T18:13:20.924209+0000","last_unstale":"2023-11-27T18:13:23.292365+0000","last_undegraded":"2023-11-27T18:13:23.292365+0000","last_fullsized":"2023-11-27T18:13:23.292365+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:31:33.484992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.142532+0000","last_change":"2023-11-27T18:13:14.421768+0000","last_active":"2023-11-27T18:13:22.142532+0000","last_peered":"2023-11-27T18:13:22.142532+0000","last_clean":"2023-11-27T18:13:22.142532+0000","last_became_active":"2023-11-27T18:13:14.421377+0000","last_became_peered":"2023-11-27T18:13:14.421377+0000","last_unstale":"2023-11-27T18:13:22.142532+0000","last_undegraded":"2023-11-27T18:13:22.142532+0000","last_fullsized":"2023-11-27T18:13:22.142532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:00:27.736589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"24'8","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.974338+0000","last_change":"2023-11-27T18:13:12.178547+0000","last_active":"2023-11-27T18:13:21.974338+0000","last_peered":"2023-11-27T18:13:21.974338+0000","last_clean":"2023-11-27T18:13:21.974338+0000","last_became_active":"2023-11-27T18:13:12.177997+0000","last_became_peered":"2023-11-27T18:13:12.177997+0000","last_unstale":"2023-11-27T18:13:21.974338+0000","last_undegraded":"2023-11-27T18:13:21.974338+0000","last_fullsized":"2023-11-27T18:13:21.974338+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:29:10.535816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:24.439272+0000","last_change":"2023-11-27T18:13:20.914541+0000","last_active":"2023-11-27T18:13:24.439272+0000","last_peered":"2023-11-27T18:13:24.439272+0000","last_clean":"2023-11-27T18:13:24.439272+0000","last_became_active":"2023-11-27T18:13:20.914144+0000","last_became_peered":"2023-11-27T18:13:20.914144+0000","last_unstale":"2023-11-27T18:13:24.439272+0000","last_undegraded":"2023-11-27T18:13:24.439272+0000","last_fullsized":"2023-11-27T18:13:24.439272+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:29:17.716220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140030+0000","last_change":"2023-11-27T18:13:15.802553+0000","last_active":"2023-11-27T18:13:22.140030+0000","last_peered":"2023-11-27T18:13:22.140030+0000","last_clean":"2023-11-27T18:13:22.140030+0000","last_became_active":"2023-11-27T18:13:15.801804+0000","last_became_peered":"2023-11-27T18:13:15.801804+0000","last_unstale":"2023-11-27T18:13:22.140030+0000","last_undegraded":"2023-11-27T18:13:22.140030+0000","last_fullsized":"2023-11-27T18:13:22.140030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:50:47.259554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.141046+0000","last_change":"2023-11-27T18:13:12.300863+0000","last_active":"2023-11-27T18:13:22.141046+0000","last_peered":"2023-11-27T18:13:22.141046+0000","last_clean":"2023-11-27T18:13:22.141046+0000","last_became_active":"2023-11-27T18:13:12.300585+0000","last_became_peered":"2023-11-27T18:13:12.300585+0000","last_unstale":"2023-11-27T18:13:22.141046+0000","last_undegraded":"2023-11-27T18:13:22.141046+0000","last_fullsized":"2023-11-27T18:13:22.141046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:27:04.532776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:24.439678+0000","last_change":"2023-11-27T18:13:20.915245+0000","last_active":"2023-11-27T18:13:24.439678+0000","last_peered":"2023-11-27T18:13:24.439678+0000","last_clean":"2023-11-27T18:13:24.439678+0000","last_became_active":"2023-11-27T18:13:20.914216+0000","last_became_peered":"2023-11-27T18:13:20.914216+0000","last_unstale":"2023-11-27T18:13:24.439678+0000","last_undegraded":"2023-11-27T18:13:24.439678+0000","last_fullsized":"2023-11-27T18:13:24.439678+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:56:44.418239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.142871+0000","last_change":"2023-11-27T18:13:14.415225+0000","last_active":"2023-11-27T18:13:22.142871+0000","last_peered":"2023-11-27T18:13:22.142871+0000","last_clean":"2023-11-27T18:13:22.142871+0000","last_became_active":"2023-11-27T18:13:14.414918+0000","last_became_peered":"2023-11-27T18:13:14.414918+0000","last_unstale":"2023-11-27T18:13:22.142871+0000","last_undegraded":"2023-11-27T18:13:22.142871+0000","last_fullsized":"2023-11-27T18:13:22.142871+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:35:31.592080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.143589+0000","last_change":"2023-11-27T18:13:12.305081+0000","last_active":"2023-11-27T18:13:22.143589+0000","last_peered":"2023-11-27T18:13:22.143589+0000","last_clean":"2023-11-27T18:13:22.143589+0000","last_became_active":"2023-11-27T18:13:12.304777+0000","last_became_peered":"2023-11-27T18:13:12.304777+0000","last_unstale":"2023-11-27T18:13:22.143589+0000","last_undegraded":"2023-11-27T18:13:22.143589+0000","last_fullsized":"2023-11-27T18:13:22.143589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:22:12.680259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.936710+0000","last_change":"2023-11-27T18:13:20.904088+0000","last_active":"2023-11-27T18:13:23.936710+0000","last_peered":"2023-11-27T18:13:23.936710+0000","last_clean":"2023-11-27T18:13:23.936710+0000","last_became_active":"2023-11-27T18:13:20.902282+0000","last_became_peered":"2023-11-27T18:13:20.902282+0000","last_unstale":"2023-11-27T18:13:23.936710+0000","last_undegraded":"2023-11-27T18:13:23.936710+0000","last_fullsized":"2023-11-27T18:13:23.936710+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:26:43.789814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140899+0000","last_change":"2023-11-27T18:13:14.415302+0000","last_active":"2023-11-27T18:13:22.140899+0000","last_peered":"2023-11-27T18:13:22.140899+0000","last_clean":"2023-11-27T18:13:22.140899+0000","last_became_active":"2023-11-27T18:13:14.415004+0000","last_became_peered":"2023-11-27T18:13:14.415004+0000","last_unstale":"2023-11-27T18:13:22.140899+0000","last_undegraded":"2023-11-27T18:13:22.140899+0000","last_fullsized":"2023-11-27T18:13:22.140899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:34:11.170873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.927564+0000","last_change":"2023-11-27T18:13:12.268542+0000","last_active":"2023-11-27T18:13:21.927564+0000","last_peered":"2023-11-27T18:13:21.927564+0000","last_clean":"2023-11-27T18:13:21.927564+0000","last_became_active":"2023-11-27T18:13:12.268237+0000","last_became_peered":"2023-11-27T18:13:12.268237+0000","last_unstale":"2023-11-27T18:13:21.927564+0000","last_undegraded":"2023-11-27T18:13:21.927564+0000","last_fullsized":"2023-11-27T18:13:21.927564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:15:07.514381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.321930+0000","last_change":"2023-11-27T18:13:20.900393+0000","last_active":"2023-11-27T18:13:23.321930+0000","last_peered":"2023-11-27T18:13:23.321930+0000","last_clean":"2023-11-27T18:13:23.321930+0000","last_became_active":"2023-11-27T18:13:20.899358+0000","last_became_peered":"2023-11-27T18:13:20.899358+0000","last_unstale":"2023-11-27T18:13:23.321930+0000","last_undegraded":"2023-11-27T18:13:23.321930+0000","last_fullsized":"2023-11-27T18:13:23.321930+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:27:58.837417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140744+0000","last_change":"2023-11-27T18:13:14.371842+0000","last_active":"2023-11-27T18:13:22.140744+0000","last_peered":"2023-11-27T18:13:22.140744+0000","last_clean":"2023-11-27T18:13:22.140744+0000","last_became_active":"2023-11-27T18:13:14.371637+0000","last_became_peered":"2023-11-27T18:13:14.371637+0000","last_unstale":"2023-11-27T18:13:22.140744+0000","last_undegraded":"2023-11-27T18:13:22.140744+0000","last_fullsized":"2023-11-27T18:13:22.140744+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:22:13.884437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"30'10","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:33.656056+0000","last_change":"2023-11-27T18:13:12.248404+0000","last_active":"2023-11-27T18:13:33.656056+0000","last_peered":"2023-11-27T18:13:33.656056+0000","last_clean":"2023-11-27T18:13:33.656056+0000","last_became_active":"2023-11-27T18:13:12.248077+0000","last_became_peered":"2023-11-27T18:13:12.248077+0000","last_unstale":"2023-11-27T18:13:33.656056+0000","last_undegraded":"2023-11-27T18:13:33.656056+0000","last_fullsized":"2023-11-27T18:13:33.656056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:34:21.166265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.288672+0000","last_change":"2023-11-27T18:13:20.919046+0000","last_active":"2023-11-27T18:13:23.288672+0000","last_peered":"2023-11-27T18:13:23.288672+0000","last_clean":"2023-11-27T18:13:23.288672+0000","last_became_active":"2023-11-27T18:13:20.918381+0000","last_became_peered":"2023-11-27T18:13:20.918381+0000","last_unstale":"2023-11-27T18:13:23.288672+0000","last_undegraded":"2023-11-27T18:13:23.288672+0000","last_fullsized":"2023-11-27T18:13:23.288672+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:17:07.092549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.143486+0000","last_change":"2023-11-27T18:13:14.415453+0000","last_active":"2023-11-27T18:13:22.143486+0000","last_peered":"2023-11-27T18:13:22.143486+0000","last_clean":"2023-11-27T18:13:22.143486+0000","last_became_active":"2023-11-27T18:13:14.415026+0000","last_became_peered":"2023-11-27T18:13:14.415026+0000","last_unstale":"2023-11-27T18:13:22.143486+0000","last_undegraded":"2023-11-27T18:13:22.143486+0000","last_fullsized":"2023-11-27T18:13:22.143486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:35:37.255102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.927427+0000","last_change":"2023-11-27T18:13:12.180737+0000","last_active":"2023-11-27T18:13:21.927427+0000","last_peered":"2023-11-27T18:13:21.927427+0000","last_clean":"2023-11-27T18:13:21.927427+0000","last_became_active":"2023-11-27T18:13:12.180112+0000","last_became_peered":"2023-11-27T18:13:12.180112+0000","last_unstale":"2023-11-27T18:13:21.927427+0000","last_undegraded":"2023-11-27T18:13:21.927427+0000","last_fullsized":"2023-11-27T18:13:21.927427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:24:22.455257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.674772+0000","last_change":"2023-11-27T18:13:20.925012+0000","last_active":"2023-11-27T18:13:23.674772+0000","last_peered":"2023-11-27T18:13:23.674772+0000","last_clean":"2023-11-27T18:13:23.674772+0000","last_became_active":"2023-11-27T18:13:20.921675+0000","last_became_peered":"2023-11-27T18:13:20.921675+0000","last_unstale":"2023-11-27T18:13:23.674772+0000","last_undegraded":"2023-11-27T18:13:23.674772+0000","last_fullsized":"2023-11-27T18:13:23.674772+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:49:08.226420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.142147+0000","last_change":"2023-11-27T18:13:14.415432+0000","last_active":"2023-11-27T18:13:22.142147+0000","last_peered":"2023-11-27T18:13:22.142147+0000","last_clean":"2023-11-27T18:13:22.142147+0000","last_became_active":"2023-11-27T18:13:14.415142+0000","last_became_peered":"2023-11-27T18:13:14.415142+0000","last_unstale":"2023-11-27T18:13:22.142147+0000","last_undegraded":"2023-11-27T18:13:22.142147+0000","last_fullsized":"2023-11-27T18:13:22.142147+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:39:33.850547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.142528+0000","last_change":"2023-11-27T18:13:12.273729+0000","last_active":"2023-11-27T18:13:22.142528+0000","last_peered":"2023-11-27T18:13:22.142528+0000","last_clean":"2023-11-27T18:13:22.142528+0000","last_became_active":"2023-11-27T18:13:12.273400+0000","last_became_peered":"2023-11-27T18:13:12.273400+0000","last_unstale":"2023-11-27T18:13:22.142528+0000","last_undegraded":"2023-11-27T18:13:22.142528+0000","last_fullsized":"2023-11-27T18:13:22.142528+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:31:10.508092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.230824+0000","last_change":"2023-11-27T18:13:20.912482+0000","last_active":"2023-11-27T18:13:23.230824+0000","last_peered":"2023-11-27T18:13:23.230824+0000","last_clean":"2023-11-27T18:13:23.230824+0000","last_became_active":"2023-11-27T18:13:20.912063+0000","last_became_peered":"2023-11-27T18:13:20.912063+0000","last_unstale":"2023-11-27T18:13:23.230824+0000","last_undegraded":"2023-11-27T18:13:23.230824+0000","last_fullsized":"2023-11-27T18:13:23.230824+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:11:56.997205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.071693+0000","last_change":"2023-11-27T18:13:15.911622+0000","last_active":"2023-11-27T18:13:22.071693+0000","last_peered":"2023-11-27T18:13:22.071693+0000","last_clean":"2023-11-27T18:13:22.071693+0000","last_became_active":"2023-11-27T18:13:15.911255+0000","last_became_peered":"2023-11-27T18:13:15.911255+0000","last_unstale":"2023-11-27T18:13:22.071693+0000","last_undegraded":"2023-11-27T18:13:22.071693+0000","last_fullsized":"2023-11-27T18:13:22.071693+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:04:03.068428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.141411+0000","last_change":"2023-11-27T18:13:12.168028+0000","last_active":"2023-11-27T18:13:22.141411+0000","last_peered":"2023-11-27T18:13:22.141411+0000","last_clean":"2023-11-27T18:13:22.141411+0000","last_became_active":"2023-11-27T18:13:12.167740+0000","last_became_peered":"2023-11-27T18:13:12.167740+0000","last_unstale":"2023-11-27T18:13:22.141411+0000","last_undegraded":"2023-11-27T18:13:22.141411+0000","last_fullsized":"2023-11-27T18:13:22.141411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:34:21.166265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.289002+0000","last_change":"2023-11-27T18:13:20.915480+0000","last_active":"2023-11-27T18:13:23.289002+0000","last_peered":"2023-11-27T18:13:23.289002+0000","last_clean":"2023-11-27T18:13:23.289002+0000","last_became_active":"2023-11-27T18:13:20.914607+0000","last_became_peered":"2023-11-27T18:13:20.914607+0000","last_unstale":"2023-11-27T18:13:23.289002+0000","last_undegraded":"2023-11-27T18:13:23.289002+0000","last_fullsized":"2023-11-27T18:13:23.289002+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:07:38.034431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.290409+0000","last_change":"2023-11-27T18:13:20.930508+0000","last_active":"2023-11-27T18:13:23.290409+0000","last_peered":"2023-11-27T18:13:23.290409+0000","last_clean":"2023-11-27T18:13:23.290409+0000","last_became_active":"2023-11-27T18:13:20.930060+0000","last_became_peered":"2023-11-27T18:13:20.930060+0000","last_unstale":"2023-11-27T18:13:23.290409+0000","last_undegraded":"2023-11-27T18:13:23.290409+0000","last_fullsized":"2023-11-27T18:13:23.290409+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:43:18.464867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.975017+0000","last_change":"2023-11-27T18:13:14.380263+0000","last_active":"2023-11-27T18:13:21.975017+0000","last_peered":"2023-11-27T18:13:21.975017+0000","last_clean":"2023-11-27T18:13:21.975017+0000","last_became_active":"2023-11-27T18:13:14.379936+0000","last_became_peered":"2023-11-27T18:13:14.379936+0000","last_unstale":"2023-11-27T18:13:21.975017+0000","last_undegraded":"2023-11-27T18:13:21.975017+0000","last_fullsized":"2023-11-27T18:13:21.975017+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:50:34.713768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.142604+0000","last_change":"2023-11-27T18:13:12.300977+0000","last_active":"2023-11-27T18:13:22.142604+0000","last_peered":"2023-11-27T18:13:22.142604+0000","last_clean":"2023-11-27T18:13:22.142604+0000","last_became_active":"2023-11-27T18:13:12.300624+0000","last_became_peered":"2023-11-27T18:13:12.300624+0000","last_unstale":"2023-11-27T18:13:22.142604+0000","last_undegraded":"2023-11-27T18:13:22.142604+0000","last_fullsized":"2023-11-27T18:13:22.142604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:52:29.021393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.322456+0000","last_change":"2023-11-27T18:13:20.919870+0000","last_active":"2023-11-27T18:13:23.322456+0000","last_peered":"2023-11-27T18:13:23.322456+0000","last_clean":"2023-11-27T18:13:23.322456+0000","last_became_active":"2023-11-27T18:13:20.918816+0000","last_became_peered":"2023-11-27T18:13:20.918816+0000","last_unstale":"2023-11-27T18:13:23.322456+0000","last_undegraded":"2023-11-27T18:13:23.322456+0000","last_fullsized":"2023-11-27T18:13:23.322456+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:41:38.778382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.138717+0000","last_change":"2023-11-27T18:13:14.369562+0000","last_active":"2023-11-27T18:13:22.138717+0000","last_peered":"2023-11-27T18:13:22.138717+0000","last_clean":"2023-11-27T18:13:22.138717+0000","last_became_active":"2023-11-27T18:13:14.368880+0000","last_became_peered":"2023-11-27T18:13:14.368880+0000","last_unstale":"2023-11-27T18:13:22.138717+0000","last_undegraded":"2023-11-27T18:13:22.138717+0000","last_fullsized":"2023-11-27T18:13:22.138717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:22:13.884437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.139062+0000","last_change":"2023-11-27T18:13:12.270113+0000","last_active":"2023-11-27T18:13:22.139062+0000","last_peered":"2023-11-27T18:13:22.139062+0000","last_clean":"2023-11-27T18:13:22.139062+0000","last_became_active":"2023-11-27T18:13:12.269755+0000","last_became_peered":"2023-11-27T18:13:12.269755+0000","last_unstale":"2023-11-27T18:13:22.139062+0000","last_undegraded":"2023-11-27T18:13:22.139062+0000","last_fullsized":"2023-11-27T18:13:22.139062+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:51:01.410940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.143492+0000","last_change":"2023-11-27T18:13:12.307568+0000","last_active":"2023-11-27T18:13:22.143492+0000","last_peered":"2023-11-27T18:13:22.143492+0000","last_clean":"2023-11-27T18:13:22.143492+0000","last_became_active":"2023-11-27T18:13:12.307299+0000","last_became_peered":"2023-11-27T18:13:12.307299+0000","last_unstale":"2023-11-27T18:13:22.143492+0000","last_undegraded":"2023-11-27T18:13:22.143492+0000","last_fullsized":"2023-11-27T18:13:22.143492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:19:01.319681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.974648+0000","last_change":"2023-11-27T18:13:14.378937+0000","last_active":"2023-11-27T18:13:21.974648+0000","last_peered":"2023-11-27T18:13:21.974648+0000","last_clean":"2023-11-27T18:13:21.974648+0000","last_became_active":"2023-11-27T18:13:14.378635+0000","last_became_peered":"2023-11-27T18:13:14.378635+0000","last_unstale":"2023-11-27T18:13:21.974648+0000","last_undegraded":"2023-11-27T18:13:21.974648+0000","last_fullsized":"2023-11-27T18:13:21.974648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:06:40.533610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.290577+0000","last_change":"2023-11-27T18:13:20.903249+0000","last_active":"2023-11-27T18:13:23.290577+0000","last_peered":"2023-11-27T18:13:23.290577+0000","last_clean":"2023-11-27T18:13:23.290577+0000","last_became_active":"2023-11-27T18:13:20.902571+0000","last_became_peered":"2023-11-27T18:13:20.902571+0000","last_unstale":"2023-11-27T18:13:23.290577+0000","last_undegraded":"2023-11-27T18:13:23.290577+0000","last_fullsized":"2023-11-27T18:13:23.290577+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:41:48.892641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.139766+0000","last_change":"2023-11-27T18:13:12.304324+0000","last_active":"2023-11-27T18:13:22.139766+0000","last_peered":"2023-11-27T18:13:22.139766+0000","last_clean":"2023-11-27T18:13:22.139766+0000","last_became_active":"2023-11-27T18:13:12.303988+0000","last_became_peered":"2023-11-27T18:13:12.303988+0000","last_unstale":"2023-11-27T18:13:22.139766+0000","last_undegraded":"2023-11-27T18:13:22.139766+0000","last_fullsized":"2023-11-27T18:13:22.139766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:47:59.518332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140188+0000","last_change":"2023-11-27T18:13:15.803183+0000","last_active":"2023-11-27T18:13:22.140188+0000","last_peered":"2023-11-27T18:13:22.140188+0000","last_clean":"2023-11-27T18:13:22.140188+0000","last_became_active":"2023-11-27T18:13:15.802420+0000","last_became_peered":"2023-11-27T18:13:15.802420+0000","last_unstale":"2023-11-27T18:13:22.140188+0000","last_undegraded":"2023-11-27T18:13:22.140188+0000","last_fullsized":"2023-11-27T18:13:22.140188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:51:02.615119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T18:13:23.231473+0000","last_change":"2023-11-27T18:13:20.920758+0000","last_active":"2023-11-27T18:13:23.231473+0000","last_peered":"2023-11-27T18:13:23.231473+0000","last_clean":"2023-11-27T18:13:23.231473+0000","last_became_active":"2023-11-27T18:13:20.920367+0000","last_became_peered":"2023-11-27T18:13:20.920367+0000","last_unstale":"2023-11-27T18:13:23.231473+0000","last_undegraded":"2023-11-27T18:13:23.231473+0000","last_fullsized":"2023-11-27T18:13:23.231473+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:51:50.506446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.070839+0000","last_change":"2023-11-27T18:13:15.849183+0000","last_active":"2023-11-27T18:13:22.070839+0000","last_peered":"2023-11-27T18:13:22.070839+0000","last_clean":"2023-11-27T18:13:22.070839+0000","last_became_active":"2023-11-27T18:13:15.848503+0000","last_became_peered":"2023-11-27T18:13:15.848503+0000","last_unstale":"2023-11-27T18:13:22.070839+0000","last_undegraded":"2023-11-27T18:13:22.070839+0000","last_fullsized":"2023-11-27T18:13:22.070839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:14:48.774302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.926420+0000","last_change":"2023-11-27T18:13:14.336349+0000","last_active":"2023-11-27T18:13:21.926420+0000","last_peered":"2023-11-27T18:13:21.926420+0000","last_clean":"2023-11-27T18:13:21.926420+0000","last_became_active":"2023-11-27T18:13:14.336072+0000","last_became_peered":"2023-11-27T18:13:14.336072+0000","last_unstale":"2023-11-27T18:13:21.926420+0000","last_undegraded":"2023-11-27T18:13:21.926420+0000","last_fullsized":"2023-11-27T18:13:21.926420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:54:58.777656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.142882+0000","last_change":"2023-11-27T18:13:14.421713+0000","last_active":"2023-11-27T18:13:22.142882+0000","last_peered":"2023-11-27T18:13:22.142882+0000","last_clean":"2023-11-27T18:13:22.142882+0000","last_became_active":"2023-11-27T18:13:14.418679+0000","last_became_peered":"2023-11-27T18:13:14.418679+0000","last_unstale":"2023-11-27T18:13:22.142882+0000","last_undegraded":"2023-11-27T18:13:22.142882+0000","last_fullsized":"2023-11-27T18:13:22.142882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:53:03.917430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.139686+0000","last_change":"2023-11-27T18:13:14.376601+0000","last_active":"2023-11-27T18:13:22.139686+0000","last_peered":"2023-11-27T18:13:22.139686+0000","last_clean":"2023-11-27T18:13:22.139686+0000","last_became_active":"2023-11-27T18:13:14.376292+0000","last_became_peered":"2023-11-27T18:13:14.376292+0000","last_unstale":"2023-11-27T18:13:22.139686+0000","last_undegraded":"2023-11-27T18:13:22.139686+0000","last_fullsized":"2023-11-27T18:13:22.139686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:52:30.225572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140984+0000","last_change":"2023-11-27T18:13:14.367285+0000","last_active":"2023-11-27T18:13:22.140984+0000","last_peered":"2023-11-27T18:13:22.140984+0000","last_clean":"2023-11-27T18:13:22.140984+0000","last_became_active":"2023-11-27T18:13:14.366983+0000","last_became_peered":"2023-11-27T18:13:14.366983+0000","last_unstale":"2023-11-27T18:13:22.140984+0000","last_undegraded":"2023-11-27T18:13:22.140984+0000","last_fullsized":"2023-11-27T18:13:22.140984+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:04:31.925421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.141444+0000","last_change":"2023-11-27T18:13:14.375744+0000","last_active":"2023-11-27T18:13:22.141444+0000","last_peered":"2023-11-27T18:13:22.141444+0000","last_clean":"2023-11-27T18:13:22.141444+0000","last_became_active":"2023-11-27T18:13:14.375466+0000","last_became_peered":"2023-11-27T18:13:14.375466+0000","last_unstale":"2023-11-27T18:13:22.141444+0000","last_undegraded":"2023-11-27T18:13:22.141444+0000","last_fullsized":"2023-11-27T18:13:22.141444+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:03:10.250350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.071591+0000","last_change":"2023-11-27T18:13:15.911021+0000","last_active":"2023-11-27T18:13:22.071591+0000","last_peered":"2023-11-27T18:13:22.071591+0000","last_clean":"2023-11-27T18:13:22.071591+0000","last_became_active":"2023-11-27T18:13:15.910418+0000","last_became_peered":"2023-11-27T18:13:15.910418+0000","last_unstale":"2023-11-27T18:13:22.071591+0000","last_undegraded":"2023-11-27T18:13:22.071591+0000","last_fullsized":"2023-11-27T18:13:22.071591+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:55:45.033833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.141861+0000","last_change":"2023-11-27T18:13:14.368483+0000","last_active":"2023-11-27T18:13:22.141861+0000","last_peered":"2023-11-27T18:13:22.141861+0000","last_clean":"2023-11-27T18:13:22.141861+0000","last_became_active":"2023-11-27T18:13:14.366249+0000","last_became_peered":"2023-11-27T18:13:14.366249+0000","last_unstale":"2023-11-27T18:13:22.141861+0000","last_undegraded":"2023-11-27T18:13:22.141861+0000","last_fullsized":"2023-11-27T18:13:22.141861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:52:43.071209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.142531+0000","last_change":"2023-11-27T18:13:14.415379+0000","last_active":"2023-11-27T18:13:22.142531+0000","last_peered":"2023-11-27T18:13:22.142531+0000","last_clean":"2023-11-27T18:13:22.142531+0000","last_became_active":"2023-11-27T18:13:14.414873+0000","last_became_peered":"2023-11-27T18:13:14.414873+0000","last_unstale":"2023-11-27T18:13:22.142531+0000","last_undegraded":"2023-11-27T18:13:22.142531+0000","last_fullsized":"2023-11-27T18:13:22.142531+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:40:12.521779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.138566+0000","last_change":"2023-11-27T18:13:14.416351+0000","last_active":"2023-11-27T18:13:22.138566+0000","last_peered":"2023-11-27T18:13:22.138566+0000","last_clean":"2023-11-27T18:13:22.138566+0000","last_became_active":"2023-11-27T18:13:14.416072+0000","last_became_peered":"2023-11-27T18:13:14.416072+0000","last_unstale":"2023-11-27T18:13:22.138566+0000","last_undegraded":"2023-11-27T18:13:22.138566+0000","last_fullsized":"2023-11-27T18:13:22.138566+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:31:11.712270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140105+0000","last_change":"2023-11-27T18:13:15.801534+0000","last_active":"2023-11-27T18:13:22.140105+0000","last_peered":"2023-11-27T18:13:22.140105+0000","last_clean":"2023-11-27T18:13:22.140105+0000","last_became_active":"2023-11-27T18:13:15.800699+0000","last_became_peered":"2023-11-27T18:13:15.800699+0000","last_unstale":"2023-11-27T18:13:22.140105+0000","last_undegraded":"2023-11-27T18:13:22.140105+0000","last_fullsized":"2023-11-27T18:13:22.140105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:39:39.512202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.974431+0000","last_change":"2023-11-27T18:13:14.413935+0000","last_active":"2023-11-27T18:13:21.974431+0000","last_peered":"2023-11-27T18:13:21.974431+0000","last_clean":"2023-11-27T18:13:21.974431+0000","last_became_active":"2023-11-27T18:13:14.413567+0000","last_became_peered":"2023-11-27T18:13:14.413567+0000","last_unstale":"2023-11-27T18:13:21.974431+0000","last_undegraded":"2023-11-27T18:13:21.974431+0000","last_fullsized":"2023-11-27T18:13:21.974431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:51:07.667299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140494+0000","last_change":"2023-11-27T18:13:14.363105+0000","last_active":"2023-11-27T18:13:22.140494+0000","last_peered":"2023-11-27T18:13:22.140494+0000","last_clean":"2023-11-27T18:13:22.140494+0000","last_became_active":"2023-11-27T18:13:14.362805+0000","last_became_peered":"2023-11-27T18:13:14.362805+0000","last_unstale":"2023-11-27T18:13:22.140494+0000","last_undegraded":"2023-11-27T18:13:22.140494+0000","last_fullsized":"2023-11-27T18:13:22.140494+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:19:02.523860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.143343+0000","last_change":"2023-11-27T18:13:14.416119+0000","last_active":"2023-11-27T18:13:22.143343+0000","last_peered":"2023-11-27T18:13:22.143343+0000","last_clean":"2023-11-27T18:13:22.143343+0000","last_became_active":"2023-11-27T18:13:14.415661+0000","last_became_peered":"2023-11-27T18:13:14.415661+0000","last_unstale":"2023-11-27T18:13:22.143343+0000","last_undegraded":"2023-11-27T18:13:22.143343+0000","last_fullsized":"2023-11-27T18:13:22.143343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:56:36.729814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:21.927866+0000","last_change":"2023-11-27T18:13:14.413859+0000","last_active":"2023-11-27T18:13:21.927866+0000","last_peered":"2023-11-27T18:13:21.927866+0000","last_clean":"2023-11-27T18:13:21.927866+0000","last_became_active":"2023-11-27T18:13:14.413542+0000","last_became_peered":"2023-11-27T18:13:14.413542+0000","last_unstale":"2023-11-27T18:13:21.927866+0000","last_undegraded":"2023-11-27T18:13:21.927866+0000","last_fullsized":"2023-11-27T18:13:21.927866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:24:16.125984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.145639+0000","last_change":"2023-11-27T18:13:14.417018+0000","last_active":"2023-11-27T18:13:22.145639+0000","last_peered":"2023-11-27T18:13:22.145639+0000","last_clean":"2023-11-27T18:13:22.145639+0000","last_became_active":"2023-11-27T18:13:14.416556+0000","last_became_peered":"2023-11-27T18:13:14.416556+0000","last_unstale":"2023-11-27T18:13:22.145639+0000","last_undegraded":"2023-11-27T18:13:22.145639+0000","last_fullsized":"2023-11-27T18:13:22.145639+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:03:59.054125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.142510+0000","last_change":"2023-11-27T18:13:14.419437+0000","last_active":"2023-11-27T18:13:22.142510+0000","last_peered":"2023-11-27T18:13:22.142510+0000","last_clean":"2023-11-27T18:13:22.142510+0000","last_became_active":"2023-11-27T18:13:14.418823+0000","last_became_peered":"2023-11-27T18:13:14.418823+0000","last_unstale":"2023-11-27T18:13:22.142510+0000","last_undegraded":"2023-11-27T18:13:22.142510+0000","last_fullsized":"2023-11-27T18:13:22.142510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:26:36.101388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.138403+0000","last_change":"2023-11-27T18:13:14.368373+0000","last_active":"2023-11-27T18:13:22.138403+0000","last_peered":"2023-11-27T18:13:22.138403+0000","last_clean":"2023-11-27T18:13:22.138403+0000","last_became_active":"2023-11-27T18:13:14.368100+0000","last_became_peered":"2023-11-27T18:13:14.368100+0000","last_unstale":"2023-11-27T18:13:22.138403+0000","last_undegraded":"2023-11-27T18:13:22.138403+0000","last_fullsized":"2023-11-27T18:13:22.138403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:27:05.736955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.139108+0000","last_change":"2023-11-27T18:13:14.376812+0000","last_active":"2023-11-27T18:13:22.139108+0000","last_peered":"2023-11-27T18:13:22.139108+0000","last_clean":"2023-11-27T18:13:22.139108+0000","last_became_active":"2023-11-27T18:13:14.376559+0000","last_became_peered":"2023-11-27T18:13:14.376559+0000","last_unstale":"2023-11-27T18:13:22.139108+0000","last_undegraded":"2023-11-27T18:13:22.139108+0000","last_fullsized":"2023-11-27T18:13:22.139108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:31:25.796567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140209+0000","last_change":"2023-11-27T18:13:14.367518+0000","last_active":"2023-11-27T18:13:22.140209+0000","last_peered":"2023-11-27T18:13:22.140209+0000","last_clean":"2023-11-27T18:13:22.140209+0000","last_became_active":"2023-11-27T18:13:14.367298+0000","last_became_peered":"2023-11-27T18:13:14.367298+0000","last_unstale":"2023-11-27T18:13:22.140209+0000","last_undegraded":"2023-11-27T18:13:22.140209+0000","last_fullsized":"2023-11-27T18:13:22.140209+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:48:00.722511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140440+0000","last_change":"2023-11-27T18:13:14.364130+0000","last_active":"2023-11-27T18:13:22.140440+0000","last_peered":"2023-11-27T18:13:22.140440+0000","last_clean":"2023-11-27T18:13:22.140440+0000","last_became_active":"2023-11-27T18:13:14.363776+0000","last_became_peered":"2023-11-27T18:13:14.363776+0000","last_unstale":"2023-11-27T18:13:22.140440+0000","last_undegraded":"2023-11-27T18:13:22.140440+0000","last_fullsized":"2023-11-27T18:13:22.140440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:14:10.603135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140667+0000","last_change":"2023-11-27T18:13:14.423459+0000","last_active":"2023-11-27T18:13:22.140667+0000","last_peered":"2023-11-27T18:13:22.140667+0000","last_clean":"2023-11-27T18:13:22.140667+0000","last_became_active":"2023-11-27T18:13:14.423099+0000","last_became_peered":"2023-11-27T18:13:14.423099+0000","last_unstale":"2023-11-27T18:13:22.140667+0000","last_undegraded":"2023-11-27T18:13:22.140667+0000","last_fullsized":"2023-11-27T18:13:22.140667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:39:33.850547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.142197+0000","last_change":"2023-11-27T18:13:14.420348+0000","last_active":"2023-11-27T18:13:22.142197+0000","last_peered":"2023-11-27T18:13:22.142197+0000","last_clean":"2023-11-27T18:13:22.142197+0000","last_became_active":"2023-11-27T18:13:14.419780+0000","last_became_peered":"2023-11-27T18:13:14.419780+0000","last_unstale":"2023-11-27T18:13:22.142197+0000","last_undegraded":"2023-11-27T18:13:22.142197+0000","last_fullsized":"2023-11-27T18:13:22.142197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:49:00.537995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.141371+0000","last_change":"2023-11-27T18:13:15.910347+0000","last_active":"2023-11-27T18:13:22.141371+0000","last_peered":"2023-11-27T18:13:22.141371+0000","last_clean":"2023-11-27T18:13:22.141371+0000","last_became_active":"2023-11-27T18:13:15.909918+0000","last_became_peered":"2023-11-27T18:13:15.909918+0000","last_unstale":"2023-11-27T18:13:22.141371+0000","last_undegraded":"2023-11-27T18:13:22.141371+0000","last_fullsized":"2023-11-27T18:13:22.141371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:14:48.774302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.138428+0000","last_change":"2023-11-27T18:13:14.369974+0000","last_active":"2023-11-27T18:13:22.138428+0000","last_peered":"2023-11-27T18:13:22.138428+0000","last_clean":"2023-11-27T18:13:22.138428+0000","last_became_active":"2023-11-27T18:13:14.369285+0000","last_became_peered":"2023-11-27T18:13:14.369285+0000","last_unstale":"2023-11-27T18:13:22.138428+0000","last_undegraded":"2023-11-27T18:13:22.138428+0000","last_fullsized":"2023-11-27T18:13:22.138428+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:23:56.484932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.141001+0000","last_change":"2023-11-27T18:13:14.385745+0000","last_active":"2023-11-27T18:13:22.141001+0000","last_peered":"2023-11-27T18:13:22.141001+0000","last_clean":"2023-11-27T18:13:22.141001+0000","last_became_active":"2023-11-27T18:13:14.385566+0000","last_became_peered":"2023-11-27T18:13:14.385566+0000","last_unstale":"2023-11-27T18:13:22.141001+0000","last_undegraded":"2023-11-27T18:13:22.141001+0000","last_fullsized":"2023-11-27T18:13:22.141001+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:52:43.071209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.071894+0000","last_change":"2023-11-27T18:13:15.848952+0000","last_active":"2023-11-27T18:13:22.071894+0000","last_peered":"2023-11-27T18:13:22.071894+0000","last_clean":"2023-11-27T18:13:22.071894+0000","last_became_active":"2023-11-27T18:13:15.848237+0000","last_became_peered":"2023-11-27T18:13:15.848237+0000","last_unstale":"2023-11-27T18:13:22.071894+0000","last_undegraded":"2023-11-27T18:13:22.071894+0000","last_fullsized":"2023-11-27T18:13:22.071894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:39:39.512202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140762+0000","last_change":"2023-11-27T18:13:14.373247+0000","last_active":"2023-11-27T18:13:22.140762+0000","last_peered":"2023-11-27T18:13:22.140762+0000","last_clean":"2023-11-27T18:13:22.140762+0000","last_became_active":"2023-11-27T18:13:14.372974+0000","last_became_peered":"2023-11-27T18:13:14.372974+0000","last_unstale":"2023-11-27T18:13:22.140762+0000","last_undegraded":"2023-11-27T18:13:22.140762+0000","last_fullsized":"2023-11-27T18:13:22.140762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:39:34.589545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.071176+0000","last_change":"2023-11-27T18:13:15.851685+0000","last_active":"2023-11-27T18:13:22.071176+0000","last_peered":"2023-11-27T18:13:22.071176+0000","last_clean":"2023-11-27T18:13:22.071176+0000","last_became_active":"2023-11-27T18:13:15.850353+0000","last_became_peered":"2023-11-27T18:13:15.850353+0000","last_unstale":"2023-11-27T18:13:22.071176+0000","last_undegraded":"2023-11-27T18:13:22.071176+0000","last_fullsized":"2023-11-27T18:13:22.071176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:51:02.615119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140426+0000","last_change":"2023-11-27T18:13:14.381126+0000","last_active":"2023-11-27T18:13:22.140426+0000","last_peered":"2023-11-27T18:13:22.140426+0000","last_clean":"2023-11-27T18:13:22.140426+0000","last_became_active":"2023-11-27T18:13:14.380714+0000","last_became_peered":"2023-11-27T18:13:14.380714+0000","last_unstale":"2023-11-27T18:13:22.140426+0000","last_undegraded":"2023-11-27T18:13:22.140426+0000","last_fullsized":"2023-11-27T18:13:22.140426+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:14:10.603135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.141208+0000","last_change":"2023-11-27T18:13:14.368254+0000","last_active":"2023-11-27T18:13:22.141208+0000","last_peered":"2023-11-27T18:13:22.141208+0000","last_clean":"2023-11-27T18:13:22.141208+0000","last_became_active":"2023-11-27T18:13:14.367978+0000","last_became_peered":"2023-11-27T18:13:14.367978+0000","last_unstale":"2023-11-27T18:13:22.141208+0000","last_undegraded":"2023-11-27T18:13:22.141208+0000","last_fullsized":"2023-11-27T18:13:22.141208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:05:05.751108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T18:13:22.140257+0000","last_change":"2023-11-27T18:13:14.419332+0000","last_active":"2023-11-27T18:13:22.140257+0000","last_peered":"2023-11-27T18:13:22.140257+0000","last_clean":"2023-11-27T18:13:22.140257+0000","last_became_active":"2023-11-27T18:13:14.418928+0000","last_became_peered":"2023-11-27T18:13:14.418928+0000","last_unstale":"2023-11-27T18:13:22.140257+0000","last_undegraded":"2023-11-27T18:13:22.140257+0000","last_fullsized":"2023-11-27T18:13:22.140257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:34:08.186176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67010,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719476758,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31560,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340280,"statfs":{"total":96636764160,"available":96604446720,"internally_reserved":0,"allocated":385024,"data_stored":714358,"data_compressed":33505,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":17.553999999999998,"5min":17.553999999999998,"15min":17.553999999999998},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.52000000000000002}]},{"osd":1,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":5.4550000000000001,"5min":5.4550000000000001,"15min":5.4550000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":5.3040000000000003,"5min":5.3040000000000003,"15min":5.3040000000000003},"last":0.45200000000000001}]},{"osd":2,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":7.8540000000000001,"5min":7.8540000000000001,"15min":7.8540000000000001},"last":0.68300000000000005}]},{"osd":3,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.60399999999999998}]},{"osd":4,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":7.7759999999999998,"5min":7.7759999999999998,"15min":7.7759999999999998},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":0.85599999999999998}]},{"osd":6,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":7.8200000000000003,"5min":7.8200000000000003,"15min":7.8200000000000003},"last":0.76300000000000001}]},{"osd":7,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.3290000000000002,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":0.82299999999999995},{"interface":"front","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.2690000000000001,"5min":2.2690000000000001,"15min":2.2690000000000001},"last":0.70199999999999996}]}]},{"osd":7,"up_from":16,"seq":68719476758,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":323584,"data_stored":124841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":2.0600000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.54000000000000004}]},{"osd":1,"last update":"Mon Nov 27 18:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":2.1890000000000001,"5min":2.1890000000000001,"15min":2.1890000000000001},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.6190000000000002,"5min":2.6190000000000002,"15min":2.6190000000000002},"last":1.036}]},{"osd":2,"last update":"Mon Nov 27 18:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.5649999999999999,"5min":2.5649999999999999,"15min":2.5649999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.68200000000000005}]},{"osd":3,"last update":"Mon Nov 27 18:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.73799999999999999},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":4.391,"5min":4.391,"15min":4.391},"last":0.95699999999999996}]},{"osd":4,"last update":"Mon Nov 27 18:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.484,"5min":2.484,"15min":2.484},"last":1.097}]},{"osd":5,"last update":"Mon Nov 27 18:13:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":4.8440000000000003,"5min":4.8440000000000003,"15min":4.8440000000000003},"last":1.129},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":0.79000000000000004}]},{"osd":6,"last update":"Mon Nov 27 18:13:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":0.625},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":2.258,"5min":2.258,"15min":2.258},"last":1.24}]}]},{"osd":6,"up_from":16,"seq":68719476758,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":315392,"data_stored":124717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.873},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.82799999999999996}]},{"osd":1,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.54100000000000004}]},{"osd":2,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.995}]},{"osd":3,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":1.1919999999999999}]},{"osd":4,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":1.0229999999999999}]},{"osd":5,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":1.101},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.0580000000000001}]},{"osd":7,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":2.1779999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":1.2609999999999999}]}]},{"osd":3,"up_from":16,"seq":68719476756,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":319488,"data_stored":125299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.442},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.26400000000000001}]},{"osd":1,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.48999999999999999}]},{"osd":2,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.374},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.54900000000000004}]},{"osd":4,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.61399999999999999}]},{"osd":5,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.52000000000000002}]},{"osd":6,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.53500000000000003},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.64800000000000002}]},{"osd":7,"last update":"Mon Nov 27 18:13:36 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.70099999999999996}]}]},{"osd":2,"up_from":16,"seq":68719476757,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":128559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.8680000000000001,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":0.38900000000000001}]},{"osd":1,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.433},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.47699999999999998}]},{"osd":3,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.499},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.56000000000000005}]},{"osd":4,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.6160000000000001,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":0.873},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.80300000000000005}]},{"osd":5,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.67800000000000005}]},{"osd":6,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.98499999999999999}]},{"osd":7,"last update":"Mon Nov 27 18:13:35 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.78000000000000003}]}]},{"osd":1,"up_from":16,"seq":68719476757,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":385024,"data_stored":715155,"data_compressed":33505,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:13:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.745},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":0.32300000000000001}]},{"osd":2,"last update":"Mon Nov 27 18:13:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.622},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.39600000000000002}]},{"osd":3,"last update":"Mon Nov 27 18:13:38 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":0.443}]},{"osd":4,"last update":"Mon Nov 27 18:13:38 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.78100000000000003}]},{"osd":5,"last update":"Mon Nov 27 18:13:38 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.72099999999999997}]},{"osd":6,"last update":"Mon Nov 27 18:13:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.48399999999999999}]},{"osd":7,"last update":"Mon Nov 27 18:13:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.8149999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.66600000000000004}]}]},{"osd":0,"up_from":16,"seq":68719476758,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":124773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.63800000000000001}]},{"osd":2,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.872}]},{"osd":3,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.80700000000000005}]},{"osd":4,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.92500000000000004}]},{"osd":5,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.90000000000000002}]},{"osd":6,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":1.091}]},{"osd":7,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":1.1559999999999999},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.351,"5min":1.351,"15min":1.351},"last":0.94199999999999995}]}]},{"osd":4,"up_from":15,"seq":64424509462,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31504,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340336,"statfs":{"total":96636764160,"available":96604504064,"internally_reserved":0,"allocated":335872,"data_stored":129231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":1.2}]},{"osd":1,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.999},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.60499999999999998}]},{"osd":2,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.95899999999999996}]},{"osd":3,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":1.046},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":1.1639999999999999}]},{"osd":5,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.89700000000000002}]},{"osd":6,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":1.077}]},{"osd":7,"last update":"Mon Nov 27 18:13:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":1.127},{"interface":"front","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":1.093}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33505,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33505,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T18:14:08.919 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-27T18:14:08.920 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-27T18:14:08.920 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-27T18:14:08.920 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-27T18:14:09.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.081+0000 7f479031a640 1 Processor -- start 2023-11-27T18:14:09.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.081+0000 7f479031a640 1 -- start start 2023-11-27T18:14:09.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.081+0000 7f479031a640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f4788151820 0x7f4788070e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:09.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.081+0000 7f479031a640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f47880c85c0 0x7f478806cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:09.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.081+0000 7f479031a640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f47880c5f10 0x7f478806d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:09.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.081+0000 7f479031a640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47880c2d20 con 0x7f4788151820 2023-11-27T18:14:09.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.081+0000 7f479031a640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4788072b70 con 0x7f47880c85c0 2023-11-27T18:14:09.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.081+0000 7f479031a640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4788071350 con 0x7f47880c5f10 2023-11-27T18:14:09.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.081+0000 7f478e0b6640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f4788151820 0x7f4788070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:09.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.081+0000 7f478e0b6640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f4788151820 0x7f4788070e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:56108/0 (socket says 172.21.15.91:56108) 2023-11-27T18:14:09.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.081+0000 7f478e0b6640 1 -- 172.21.15.91:0/1358838164 learned_addr learned my addr 172.21.15.91:0/1358838164 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:09.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.085+0000 7f478e8b7640 1 --2- 172.21.15.91:0/1358838164 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f47880c5f10 0x7f478806d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:09.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.085+0000 7f478d8b5640 1 --2- 172.21.15.91:0/1358838164 >> v2:172.21.15.94:3300/0 conn(0x7f47880c85c0 0x7f478806cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:09.082 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.085+0000 7f478e0b6640 1 -- 172.21.15.91:0/1358838164 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f47880c5f10 msgr2=0x7f478806d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:09.082 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.085+0000 7f478e0b6640 1 --2- 172.21.15.91:0/1358838164 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f47880c5f10 0x7f478806d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:09.082 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.085+0000 7f478e0b6640 1 -- 172.21.15.91:0/1358838164 >> v2:172.21.15.94:3300/0 conn(0x7f47880c85c0 msgr2=0x7f478806cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:09.082 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.085+0000 7f478e0b6640 1 --2- 172.21.15.91:0/1358838164 >> v2:172.21.15.94:3300/0 conn(0x7f47880c85c0 0x7f478806cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:09.082 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.085+0000 7f478e0b6640 1 -- 172.21.15.91:0/1358838164 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47880c6490 con 0x7f4788151820 2023-11-27T18:14:09.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.089+0000 7f478e0b6640 1 --2- 172.21.15.91:0/1358838164 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4788151820 0x7f4788070e10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f478806b3a0 tx=0x7f478401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c89e0efedf6030fc server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:09.089 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.093+0000 7f478d0b4640 1 -- 172.21.15.91:0/1358838164 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47840a89b0 con 0x7f4788151820 2023-11-27T18:14:09.089 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.093+0000 7f478d0b4640 1 -- 172.21.15.91:0/1358838164 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47840a8b10 con 0x7f4788151820 2023-11-27T18:14:09.089 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.093+0000 7f478d0b4640 1 -- 172.21.15.91:0/1358838164 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47840a8ea0 con 0x7f4788151820 2023-11-27T18:14:09.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.093+0000 7f479031a640 1 -- 172.21.15.91:0/1358838164 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4788151820 msgr2=0x7f4788070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:09.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.093+0000 7f479031a640 1 --2- 172.21.15.91:0/1358838164 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4788151820 0x7f4788070e10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f478806b3a0 tx=0x7f478401ecf0 comp rx=0 tx=0).stop 2023-11-27T18:14:09.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.093+0000 7f479031a640 1 -- 172.21.15.91:0/1358838164 shutdown_connections 2023-11-27T18:14:09.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.093+0000 7f479031a640 1 --2- 172.21.15.91:0/1358838164 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f47880c5f10 0x7f478806d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:09.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.093+0000 7f479031a640 1 --2- 172.21.15.91:0/1358838164 >> v2:172.21.15.94:3300/0 conn(0x7f47880c85c0 0x7f478806cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:09.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.093+0000 7f479031a640 1 --2- 172.21.15.91:0/1358838164 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4788151820 0x7f4788070e10 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:09.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.093+0000 7f479031a640 1 -- 172.21.15.91:0/1358838164 >> 172.21.15.91:0/1358838164 conn(0x7f47880c79b0 msgr2=0x7f47880c7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:09.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.093+0000 7f479031a640 1 -- 172.21.15.91:0/1358838164 shutdown_connections 2023-11-27T18:14:09.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.093+0000 7f479031a640 1 -- 172.21.15.91:0/1358838164 wait complete. 2023-11-27T18:14:09.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.093+0000 7f479031a640 1 Processor -- start 2023-11-27T18:14:09.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.093+0000 7f479031a640 1 -- start start 2023-11-27T18:14:09.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.097+0000 7f479031a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f47880c5f10 0x7f478814e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:09.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.097+0000 7f479031a640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f47880c85c0 0x7f47881ed110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:09.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.097+0000 7f479031a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4788151820 0x7f4788071ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:09.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.097+0000 7f479031a640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4788156fa0 con 0x7f4788151820 2023-11-27T18:14:09.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.097+0000 7f479031a640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4788152150 con 0x7f47880c5f10 2023-11-27T18:14:09.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.097+0000 7f479031a640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47881569e0 con 0x7f47880c85c0 2023-11-27T18:14:09.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.097+0000 7f478e8b7640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4788151820 0x7f4788071ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:09.093 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.097+0000 7f478e8b7640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4788151820 0x7f4788071ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:56124/0 (socket says 172.21.15.91:56124) 2023-11-27T18:14:09.093 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.097+0000 7f478e8b7640 1 -- 172.21.15.91:0/2499830272 learned_addr learned my addr 172.21.15.91:0/2499830272 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:09.093 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.097+0000 7f478e0b6640 1 --2- 172.21.15.91:0/2499830272 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f47880c5f10 0x7f478814e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:09.096 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.101+0000 7f478e8b7640 1 -- 172.21.15.91:0/2499830272 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f47880c85c0 msgr2=0x7f47881ed110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:09.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.101+0000 7f478e8b7640 1 --2- 172.21.15.91:0/2499830272 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f47880c85c0 0x7f47881ed110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:09.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.101+0000 7f478e8b7640 1 -- 172.21.15.91:0/2499830272 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f47880c5f10 msgr2=0x7f478814e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:09.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.101+0000 7f478e8b7640 1 --2- 172.21.15.91:0/2499830272 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f47880c5f10 0x7f478814e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:09.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.101+0000 7f478e8b7640 1 -- 172.21.15.91:0/2499830272 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47840094d0 con 0x7f4788151820 2023-11-27T18:14:09.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.101+0000 7f478e8b7640 1 --2- 172.21.15.91:0/2499830272 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4788151820 0x7f4788071ef0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4780007e60 tx=0x7f478000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:09.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.105+0000 7f477affd640 1 -- 172.21.15.91:0/2499830272 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4780014620 con 0x7f4788151820 2023-11-27T18:14:09.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.105+0000 7f477affd640 1 -- 172.21.15.91:0/2499830272 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478000ee90 con 0x7f4788151820 2023-11-27T18:14:09.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.105+0000 7f477affd640 1 -- 172.21.15.91:0/2499830272 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47800149e0 con 0x7f4788151820 2023-11-27T18:14:09.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.105+0000 7f479031a640 1 -- 172.21.15.91:0/2499830272 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4788156cc0 con 0x7f4788151820 2023-11-27T18:14:09.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.105+0000 7f479031a640 1 -- 172.21.15.91:0/2499830272 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47881f0b00 con 0x7f4788151820 2023-11-27T18:14:09.104 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.105+0000 7f479031a640 1 -- 172.21.15.91:0/2499830272 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47881f0680 con 0x7f4788151820 2023-11-27T18:14:09.124 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.129+0000 7f477affd640 1 -- 172.21.15.91:0/2499830272 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f4780014b40 con 0x7f4788151820 2023-11-27T18:14:09.125 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.129+0000 7f477affd640 1 --2- 172.21.15.91:0/2499830272 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f476c066840 0x7f476c068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:09.125 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.129+0000 7f478e0b6640 1 --2- 172.21.15.91:0/2499830272 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f476c066840 0x7f476c068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:09.125 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.129+0000 7f478e0b6640 1 --2- 172.21.15.91:0/2499830272 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f476c066840 0x7f476c068d00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f47840b2000 tx=0x7f47840aa070 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:09.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.413+0000 7f477affd640 1 -- 172.21.15.91:0/2499830272 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4780056d20 con 0x7f4788151820 2023-11-27T18:14:09.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.413+0000 7f477affd640 1 -- 172.21.15.91:0/2499830272 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f4780052960 con 0x7f4788151820 2023-11-27T18:14:09.608 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.613+0000 7f479031a640 1 -- 172.21.15.91:0/2499830272 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f47881f0680 con 0x7f4788151820 2023-11-27T18:14:09.626 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.629+0000 7f477affd640 1 -- 172.21.15.91:0/2499830272 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f47881f0680 con 0x7f4788151820 2023-11-27T18:14:09.626 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:14:09.627 INFO:teuthology.orchestra.run.smithi091.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-27T18:14:09.629 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.633+0000 7f479031a640 1 -- 172.21.15.91:0/2499830272 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f476c066840 msgr2=0x7f476c068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:09.629 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.633+0000 7f479031a640 1 --2- 172.21.15.91:0/2499830272 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f476c066840 0x7f476c068d00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f47840b2000 tx=0x7f47840aa070 comp rx=0 tx=0).stop 2023-11-27T18:14:09.629 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.633+0000 7f479031a640 1 -- 172.21.15.91:0/2499830272 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4788151820 msgr2=0x7f4788071ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:09.629 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.633+0000 7f479031a640 1 --2- 172.21.15.91:0/2499830272 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4788151820 0x7f4788071ef0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4780007e60 tx=0x7f478000e4b0 comp rx=0 tx=0).stop 2023-11-27T18:14:09.629 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.633+0000 7f479031a640 1 -- 172.21.15.91:0/2499830272 shutdown_connections 2023-11-27T18:14:09.629 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.633+0000 7f479031a640 1 --2- 172.21.15.91:0/2499830272 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f476c066840 0x7f476c068d00 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:09.630 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.633+0000 7f479031a640 1 --2- 172.21.15.91:0/2499830272 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f47880c85c0 0x7f47881ed110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:09.630 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.633+0000 7f479031a640 1 --2- 172.21.15.91:0/2499830272 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4788151820 0x7f4788071ef0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:09.630 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.633+0000 7f479031a640 1 --2- 172.21.15.91:0/2499830272 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f47880c5f10 0x7f478814e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:09.630 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.633+0000 7f479031a640 1 -- 172.21.15.91:0/2499830272 >> 172.21.15.91:0/2499830272 conn(0x7f47880c79b0 msgr2=0x7f47880ca040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:09.630 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.633+0000 7f479031a640 1 -- 172.21.15.91:0/2499830272 shutdown_connections 2023-11-27T18:14:09.630 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.633+0000 7f479031a640 1 -- 172.21.15.91:0/2499830272 wait complete. 2023-11-27T18:14:09.646 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-27T18:14:09.647 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T18:14:09.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.773+0000 7fa9d05e7640 1 Processor -- start 2023-11-27T18:14:09.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.773+0000 7fa9d05e7640 1 -- start start 2023-11-27T18:14:09.769 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.773+0000 7fa9d05e7640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa9c81537b0 0x7fa9c8071a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:09.769 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.773+0000 7fa9d05e7640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa9c80c5bf0 0x7fa9c806cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:09.769 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.773+0000 7fa9d05e7640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9c815d630 con 0x7fa9c80c12d0 2023-11-27T18:14:09.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.773+0000 7fa9d05e7640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9c815d8a0 con 0x7fa9c80c5bf0 2023-11-27T18:14:09.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.773+0000 7fa9d05e7640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9c8070fb0 con 0x7fa9c81537b0 2023-11-27T18:14:09.771 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.773+0000 7fa9ce383640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa9c81537b0 0x7fa9c8071a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:09.771 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.773+0000 7fa9ceb84640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fa9c80c12d0 0x7fa9c80c16e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.91:45256/0 (socket says 172.21.15.91:45256) 2023-11-27T18:14:09.772 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.773+0000 7fa9ceb84640 1 -- 172.21.15.91:0/3233819999 learned_addr learned my addr 172.21.15.91:0/3233819999 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:14:09.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.789+0000 7fa9cdb82640 1 --2- 172.21.15.91:0/3233819999 >> v2:172.21.15.91:3300/0 conn(0x7fa9c80c5bf0 0x7fa9c806cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:09.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.793+0000 7fa9ce383640 1 -- 172.21.15.91:0/3233819999 >> v2:172.21.15.91:3300/0 conn(0x7fa9c80c5bf0 msgr2=0x7fa9c806cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:09.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.793+0000 7fa9ce383640 1 --2- 172.21.15.91:0/3233819999 >> v2:172.21.15.91:3300/0 conn(0x7fa9c80c5bf0 0x7fa9c806cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:09.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.793+0000 7fa9ce383640 1 -- 172.21.15.91:0/3233819999 >> v1:172.21.15.94:6789/0 conn(0x7fa9c80c12d0 legacy=0x7fa9c80c16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:09.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.793+0000 7fa9ce383640 1 -- 172.21.15.91:0/3233819999 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9c8071290 con 0x7fa9c81537b0 2023-11-27T18:14:09.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.829+0000 7fa9ce383640 1 --2- 172.21.15.91:0/3233819999 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa9c81537b0 0x7fa9c8071a90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa9c8070a80 tx=0x7fa9c401f0f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a503fa0b3c1c9ea2 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:09.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.933+0000 7fa9cd381640 1 -- 172.21.15.91:0/3233819999 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c40b0440 con 0x7fa9c81537b0 2023-11-27T18:14:09.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.933+0000 7fa9cd381640 1 -- 172.21.15.91:0/3233819999 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c40b05a0 con 0x7fa9c81537b0 2023-11-27T18:14:09.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.933+0000 7fa9cd381640 1 -- 172.21.15.91:0/3233819999 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c40b0930 con 0x7fa9c81537b0 2023-11-27T18:14:09.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.933+0000 7fa9d05e7640 1 -- 172.21.15.91:0/3233819999 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa9c81537b0 msgr2=0x7fa9c8071a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:09.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.933+0000 7fa9d05e7640 1 --2- 172.21.15.91:0/3233819999 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa9c81537b0 0x7fa9c8071a90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa9c8070a80 tx=0x7fa9c401f0f0 comp rx=0 tx=0).stop 2023-11-27T18:14:09.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.933+0000 7fa9d05e7640 1 -- 172.21.15.91:0/3233819999 shutdown_connections 2023-11-27T18:14:09.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.933+0000 7fa9d05e7640 1 --2- 172.21.15.91:0/3233819999 >> v2:172.21.15.91:3300/0 conn(0x7fa9c80c5bf0 0x7fa9c806cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:09.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.933+0000 7fa9d05e7640 1 --2- 172.21.15.91:0/3233819999 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa9c81537b0 0x7fa9c8071a90 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:09.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.933+0000 7fa9d05e7640 1 -- 172.21.15.91:0/3233819999 >> 172.21.15.91:0/3233819999 conn(0x7fa9c80c79b0 msgr2=0x7fa9c80c7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:09.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.933+0000 7fa9d05e7640 1 -- 172.21.15.91:0/3233819999 shutdown_connections 2023-11-27T18:14:09.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.933+0000 7fa9d05e7640 1 -- 172.21.15.91:0/3233819999 wait complete. 2023-11-27T18:14:09.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.937+0000 7fa9d05e7640 1 Processor -- start 2023-11-27T18:14:09.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.937+0000 7fa9d05e7640 1 -- start start 2023-11-27T18:14:09.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.937+0000 7fa9d05e7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa9c80c12d0 0x7fa9c81550e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:09.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.937+0000 7fa9d05e7640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa9c80c5bf0 0x7fa9c80c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:09.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.937+0000 7fa9d05e7640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa9c81537b0 0x7fa9c81f1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:09.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.937+0000 7fa9d05e7640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c8157d00 con 0x7fa9c80c5bf0 2023-11-27T18:14:09.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.937+0000 7fa9d05e7640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c8157640 con 0x7fa9c80c12d0 2023-11-27T18:14:09.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.937+0000 7fa9d05e7640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c8159d30 con 0x7fa9c81537b0 2023-11-27T18:14:09.936 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.937+0000 7fa9cdb82640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa9c80c5bf0 0x7fa9c80c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:09.936 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.941+0000 7fa9ceb84640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa9c81537b0 0x7fa9c81f1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:09.936 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.941+0000 7fa9cdb82640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa9c80c5bf0 0x7fa9c80c9fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:56146/0 (socket says 172.21.15.91:56146) 2023-11-27T18:14:09.936 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.941+0000 7fa9cdb82640 1 -- 172.21.15.91:0/4146913764 learned_addr learned my addr 172.21.15.91:0/4146913764 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:09.940 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.945+0000 7fa9cdb82640 1 -- 172.21.15.91:0/4146913764 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa9c81537b0 msgr2=0x7fa9c81f1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:09.940 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.945+0000 7fa9cdb82640 1 --2- 172.21.15.91:0/4146913764 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa9c81537b0 0x7fa9c81f1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:09.940 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.945+0000 7fa9cdb82640 1 -- 172.21.15.91:0/4146913764 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa9c80c12d0 msgr2=0x7fa9c81550e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:09.940 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.945+0000 7fa9cdb82640 1 --2- 172.21.15.91:0/4146913764 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa9c80c12d0 0x7fa9c81550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:09.941 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.945+0000 7fa9cdb82640 1 -- 172.21.15.91:0/4146913764 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9c4009a70 con 0x7fa9c80c5bf0 2023-11-27T18:14:09.942 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.945+0000 7fa9cdb82640 1 --2- 172.21.15.91:0/4146913764 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa9c80c5bf0 0x7fa9c80c9fa0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa9b800d800 tx=0x7fa9b800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:09.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.957+0000 7fa9beffd640 1 -- 172.21.15.91:0/4146913764 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b800b6c0 con 0x7fa9c80c5bf0 2023-11-27T18:14:09.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.957+0000 7fa9beffd640 1 -- 172.21.15.91:0/4146913764 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9b800b820 con 0x7fa9c80c5bf0 2023-11-27T18:14:09.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.957+0000 7fa9d05e7640 1 -- 172.21.15.91:0/4146913764 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9c8157a60 con 0x7fa9c80c5bf0 2023-11-27T18:14:09.956 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.957+0000 7fa9beffd640 1 -- 172.21.15.91:0/4146913764 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b800bb90 con 0x7fa9c80c5bf0 2023-11-27T18:14:09.956 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.957+0000 7fa9d05e7640 1 -- 172.21.15.91:0/4146913764 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9c81599c0 con 0x7fa9c80c5bf0 2023-11-27T18:14:09.956 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:09.957+0000 7fa9d05e7640 1 -- 172.21.15.91:0/4146913764 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9c8159820 con 0x7fa9c80c5bf0 2023-11-27T18:14:10.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.361+0000 7fa9beffd640 1 -- 172.21.15.91:0/4146913764 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fa9b800bcf0 con 0x7fa9c80c5bf0 2023-11-27T18:14:10.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.365+0000 7fa9beffd640 1 --2- 172.21.15.91:0/4146913764 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa9ac066840 0x7fa9ac068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:10.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.365+0000 7fa9ce383640 1 --2- 172.21.15.91:0/4146913764 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa9ac066840 0x7fa9ac068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:10.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.365+0000 7fa9ce383640 1 --2- 172.21.15.91:0/4146913764 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa9ac066840 0x7fa9ac068d00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa9c40b2000 tx=0x7fa9c4004ac0 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:10.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.397+0000 7fa9beffd640 1 -- 172.21.15.91:0/4146913764 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa9b8056500 con 0x7fa9c80c5bf0 2023-11-27T18:14:10.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.397+0000 7fa9beffd640 1 -- 172.21.15.91:0/4146913764 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fa9b8052140 con 0x7fa9c80c5bf0 2023-11-27T18:14:10.567 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.569+0000 7fa9d05e7640 1 -- 172.21.15.91:0/4146913764 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9c8159820 con 0x7fa9c80c5bf0 2023-11-27T18:14:10.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.665+0000 7fa9beffd640 1 -- 172.21.15.91:0/4146913764 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+18279 (secure 0 0 0) 0x7fa9c8159820 con 0x7fa9c80c5bf0 2023-11-27T18:14:10.663 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:14:10.664 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":30,"fsid":"08c8ebbf-7936-4c41-a995-d5600de2d072","created":"2023-11-27T18:12:06.484593+0000","modified":"2023-11-27T18:13:22.801287+0000","last_up_change":"2023-11-27T18:12:33.154694+0000","last_in_change":"2023-11-27T18:12:23.622113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T18:12:35.450305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T18:13:09.589619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T18:13:11.439236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-27T18:13:18.514694+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ad53c08-dd19-4ae6-87c5-fa15bea3b4ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6811","nonce":472303992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6813","nonce":472303992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6817","nonce":472303992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6815","nonce":472303992}]},"public_addr":"172.21.15.91:6811/472303992","cluster_addr":"172.21.15.91:6813/472303992","heartbeat_back_addr":"172.21.15.91:6817/472303992","heartbeat_front_addr":"172.21.15.91:6815/472303992","state":["exists","up"]},{"osd":1,"uuid":"f8b5f147-ed29-4329-a787-a12cc34a2569","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6827","nonce":12316911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6829","nonce":12316911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6833","nonce":12316911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6831","nonce":12316911}]},"public_addr":"172.21.15.91:6827/12316911","cluster_addr":"172.21.15.91:6829/12316911","heartbeat_back_addr":"172.21.15.91:6833/12316911","heartbeat_front_addr":"172.21.15.91:6831/12316911","state":["exists","up"]},{"osd":2,"uuid":"c3029f9a-1c48-4f5d-983a-172a614d8795","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6803","nonce":3776125919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6805","nonce":3776125919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6809","nonce":3776125919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6807","nonce":3776125919}]},"public_addr":"172.21.15.91:6803/3776125919","cluster_addr":"172.21.15.91:6805/3776125919","heartbeat_back_addr":"172.21.15.91:6809/3776125919","heartbeat_front_addr":"172.21.15.91:6807/3776125919","state":["exists","up"]},{"osd":3,"uuid":"ab4b6fb2-0126-491b-9224-54a6badc5da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6819","nonce":1297704794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6821","nonce":1297704794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6825","nonce":1297704794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6823","nonce":1297704794}]},"public_addr":"172.21.15.91:6819/1297704794","cluster_addr":"172.21.15.91:6821/1297704794","heartbeat_back_addr":"172.21.15.91:6825/1297704794","heartbeat_front_addr":"172.21.15.91:6823/1297704794","state":["exists","up"]},{"osd":4,"uuid":"695071a8-2de8-4cba-bf20-050021a03bb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6809","nonce":2501531833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6811","nonce":2501531833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6815","nonce":2501531833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6813","nonce":2501531833}]},"public_addr":"172.21.15.94:6809/2501531833","cluster_addr":"172.21.15.94:6811/2501531833","heartbeat_back_addr":"172.21.15.94:6815/2501531833","heartbeat_front_addr":"172.21.15.94:6813/2501531833","state":["exists","up"]},{"osd":5,"uuid":"ca01da14-a700-4845-8db2-f5e3370677e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6817","nonce":2448969592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6819","nonce":2448969592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6823","nonce":2448969592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6821","nonce":2448969592}]},"public_addr":"172.21.15.94:6817/2448969592","cluster_addr":"172.21.15.94:6819/2448969592","heartbeat_back_addr":"172.21.15.94:6823/2448969592","heartbeat_front_addr":"172.21.15.94:6821/2448969592","state":["exists","up"]},{"osd":6,"uuid":"4784bc77-6c33-4e47-abba-d37484982f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6825","nonce":3389553935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6827","nonce":3389553935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6831","nonce":3389553935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6829","nonce":3389553935}]},"public_addr":"172.21.15.94:6825/3389553935","cluster_addr":"172.21.15.94:6827/3389553935","heartbeat_back_addr":"172.21.15.94:6831/3389553935","heartbeat_front_addr":"172.21.15.94:6829/3389553935","state":["exists","up"]},{"osd":7,"uuid":"b954cf3f-4a4f-4a75-9f90-014f72c16d15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6801","nonce":1606498064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6803","nonce":1606498064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6807","nonce":1606498064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6805","nonce":1606498064}]},"public_addr":"172.21.15.94:6801/1606498064","cluster_addr":"172.21.15.94:6803/1606498064","heartbeat_back_addr":"172.21.15.94:6807/1606498064","heartbeat_front_addr":"172.21.15.94:6805/1606498064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.534968+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.506182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.339267+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.532432+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:28.935756+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.471559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.485014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.352978+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T18:14:10.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.669+0000 7fa9d05e7640 1 -- 172.21.15.91:0/4146913764 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa9ac066840 msgr2=0x7fa9ac068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:10.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.669+0000 7fa9d05e7640 1 --2- 172.21.15.91:0/4146913764 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa9ac066840 0x7fa9ac068d00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa9c40b2000 tx=0x7fa9c4004ac0 comp rx=0 tx=0).stop 2023-11-27T18:14:10.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.669+0000 7fa9d05e7640 1 -- 172.21.15.91:0/4146913764 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa9c80c5bf0 msgr2=0x7fa9c80c9fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:10.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.669+0000 7fa9d05e7640 1 --2- 172.21.15.91:0/4146913764 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa9c80c5bf0 0x7fa9c80c9fa0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa9b800d800 tx=0x7fa9b800dcc0 comp rx=0 tx=0).stop 2023-11-27T18:14:10.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.669+0000 7fa9d05e7640 1 -- 172.21.15.91:0/4146913764 shutdown_connections 2023-11-27T18:14:10.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.669+0000 7fa9d05e7640 1 --2- 172.21.15.91:0/4146913764 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa9ac066840 0x7fa9ac068d00 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:10.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.669+0000 7fa9d05e7640 1 --2- 172.21.15.91:0/4146913764 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa9c81537b0 0x7fa9c81f1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:10.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.669+0000 7fa9d05e7640 1 --2- 172.21.15.91:0/4146913764 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa9c80c5bf0 0x7fa9c80c9fa0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:10.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.669+0000 7fa9d05e7640 1 --2- 172.21.15.91:0/4146913764 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa9c80c12d0 0x7fa9c81550e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:10.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.669+0000 7fa9d05e7640 1 -- 172.21.15.91:0/4146913764 >> 172.21.15.91:0/4146913764 conn(0x7fa9c80c79b0 msgr2=0x7fa9c80c8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:10.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.669+0000 7fa9d05e7640 1 -- 172.21.15.91:0/4146913764 shutdown_connections 2023-11-27T18:14:10.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.669+0000 7fa9d05e7640 1 -- 172.21.15.91:0/4146913764 wait complete. 2023-11-27T18:14:10.689 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T18:12:35.450305+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T18:13:09.589619+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T18:13:11.439236+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-27T18:13:18.514694+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-27T18:14:10.689 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T18:14:10.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.821+0000 7fef43548640 1 Processor -- start 2023-11-27T18:14:10.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.821+0000 7fef43548640 1 -- start start 2023-11-27T18:14:10.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.821+0000 7fef43548640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef3c0c40e0 0x7fef3c0c44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:10.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.821+0000 7fef43548640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fef3c1576e0 0x7fef3c157b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:10.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.821+0000 7fef43548640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef3c1580b0 con 0x7fef3c072820 2023-11-27T18:14:10.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.821+0000 7fef43548640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef3c0c7090 con 0x7fef3c0c40e0 2023-11-27T18:14:10.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.821+0000 7fef43548640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef3c0c4a00 con 0x7fef3c1576e0 2023-11-27T18:14:10.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.821+0000 7fef412e4640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef3c0c40e0 0x7fef3c0c44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:10.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.821+0000 7fef412e4640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef3c0c40e0 0x7fef3c0c44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:56158/0 (socket says 172.21.15.91:56158) 2023-11-27T18:14:10.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.821+0000 7fef412e4640 1 -- 172.21.15.91:0/3117453810 learned_addr learned my addr 172.21.15.91:0/3117453810 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:10.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.821+0000 7fef41ae5640 1 --2- 172.21.15.91:0/3117453810 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fef3c1576e0 0x7fef3c157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:10.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.825+0000 7fef412e4640 1 -- 172.21.15.91:0/3117453810 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fef3c1576e0 msgr2=0x7fef3c157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:10.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.825+0000 7fef412e4640 1 --2- 172.21.15.91:0/3117453810 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fef3c1576e0 0x7fef3c157b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:10.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.825+0000 7fef412e4640 1 -- 172.21.15.91:0/3117453810 >> v1:172.21.15.94:6789/0 conn(0x7fef3c072820 legacy=0x7fef3c06ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:10.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.825+0000 7fef412e4640 1 -- 172.21.15.91:0/3117453810 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef3c15aa00 con 0x7fef3c0c40e0 2023-11-27T18:14:10.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.829+0000 7fef412e4640 1 --2- 172.21.15.91:0/3117453810 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef3c0c40e0 0x7fef3c0c44c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fef34009870 tx=0x7fef3401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=840e1366e0016220 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:10.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.833+0000 7fef3bfff640 1 -- 172.21.15.91:0/3117453810 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef340a9400 con 0x7fef3c0c40e0 2023-11-27T18:14:10.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.833+0000 7fef3bfff640 1 -- 172.21.15.91:0/3117453810 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef340a9560 con 0x7fef3c0c40e0 2023-11-27T18:14:10.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.833+0000 7fef3bfff640 1 -- 172.21.15.91:0/3117453810 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef340a98f0 con 0x7fef3c0c40e0 2023-11-27T18:14:10.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.833+0000 7fef43548640 1 -- 172.21.15.91:0/3117453810 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef3c0c40e0 msgr2=0x7fef3c0c44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:10.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.833+0000 7fef43548640 1 --2- 172.21.15.91:0/3117453810 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef3c0c40e0 0x7fef3c0c44c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fef34009870 tx=0x7fef3401c540 comp rx=0 tx=0).stop 2023-11-27T18:14:10.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.833+0000 7fef43548640 1 -- 172.21.15.91:0/3117453810 shutdown_connections 2023-11-27T18:14:10.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.833+0000 7fef43548640 1 --2- 172.21.15.91:0/3117453810 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fef3c1576e0 0x7fef3c157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:10.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.833+0000 7fef43548640 1 --2- 172.21.15.91:0/3117453810 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef3c0c40e0 0x7fef3c0c44c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:10.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.833+0000 7fef43548640 1 -- 172.21.15.91:0/3117453810 >> 172.21.15.91:0/3117453810 conn(0x7fef3c0ca9d0 msgr2=0x7fef3c0cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:10.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.833+0000 7fef43548640 1 -- 172.21.15.91:0/3117453810 shutdown_connections 2023-11-27T18:14:10.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.833+0000 7fef43548640 1 -- 172.21.15.91:0/3117453810 wait complete. 2023-11-27T18:14:10.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.833+0000 7fef43548640 1 Processor -- start 2023-11-27T18:14:10.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.833+0000 7fef43548640 1 -- start start 2023-11-27T18:14:10.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.837+0000 7fef43548640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fef3c072820 0x7fef3c148e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:10.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.837+0000 7fef43548640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef3c0c40e0 0x7fef3c0bf130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:10.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.837+0000 7fef43548640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef3c1576e0 0x7fef3c142fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:10.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.837+0000 7fef43548640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3c14df70 con 0x7fef3c0c40e0 2023-11-27T18:14:10.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.837+0000 7fef43548640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3c0c0a50 con 0x7fef3c1576e0 2023-11-27T18:14:10.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.837+0000 7fef43548640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef3c0c0d30 con 0x7fef3c072820 2023-11-27T18:14:10.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.837+0000 7fef40ae3640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef3c0c40e0 0x7fef3c0bf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:10.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.837+0000 7fef40ae3640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef3c0c40e0 0x7fef3c0bf130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:56162/0 (socket says 172.21.15.91:56162) 2023-11-27T18:14:10.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.837+0000 7fef40ae3640 1 -- 172.21.15.91:0/47187207 learned_addr learned my addr 172.21.15.91:0/47187207 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:10.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.837+0000 7fef412e4640 1 --2- 172.21.15.91:0/47187207 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fef3c072820 0x7fef3c148e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:10.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.837+0000 7fef41ae5640 1 --2- 172.21.15.91:0/47187207 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef3c1576e0 0x7fef3c142fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:10.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.841+0000 7fef40ae3640 1 -- 172.21.15.91:0/47187207 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fef3c072820 msgr2=0x7fef3c148e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:10.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.841+0000 7fef40ae3640 1 --2- 172.21.15.91:0/47187207 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fef3c072820 0x7fef3c148e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:10.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.841+0000 7fef40ae3640 1 -- 172.21.15.91:0/47187207 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef3c1576e0 msgr2=0x7fef3c142fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:10.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.841+0000 7fef40ae3640 1 --2- 172.21.15.91:0/47187207 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef3c1576e0 0x7fef3c142fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:10.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.841+0000 7fef40ae3640 1 -- 172.21.15.91:0/47187207 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef340094d0 con 0x7fef3c0c40e0 2023-11-27T18:14:10.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.841+0000 7fef40ae3640 1 --2- 172.21.15.91:0/47187207 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef3c0c40e0 0x7fef3c0bf130 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fef3000c420 tx=0x7fef3000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:10.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.845+0000 7fef39ffb640 1 -- 172.21.15.91:0/47187207 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef300052d0 con 0x7fef3c0c40e0 2023-11-27T18:14:10.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.845+0000 7fef39ffb640 1 -- 172.21.15.91:0/47187207 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef30005430 con 0x7fef3c0c40e0 2023-11-27T18:14:10.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.845+0000 7fef39ffb640 1 -- 172.21.15.91:0/47187207 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef30007260 con 0x7fef3c0c40e0 2023-11-27T18:14:10.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.845+0000 7fef43548640 1 -- 172.21.15.91:0/47187207 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef3c0bfbb0 con 0x7fef3c0c40e0 2023-11-27T18:14:10.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.845+0000 7fef43548640 1 -- 172.21.15.91:0/47187207 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef3c14a3b0 con 0x7fef3c0c40e0 2023-11-27T18:14:10.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.849+0000 7fef43548640 1 -- 172.21.15.91:0/47187207 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef3c04e850 con 0x7fef3c0c40e0 2023-11-27T18:14:10.863 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.865+0000 7fef39ffb640 1 -- 172.21.15.91:0/47187207 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fef300073c0 con 0x7fef3c0c40e0 2023-11-27T18:14:10.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.869+0000 7fef39ffb640 1 --2- 172.21.15.91:0/47187207 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fef28066840 0x7fef28068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:10.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.869+0000 7fef412e4640 1 --2- 172.21.15.91:0/47187207 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fef28066840 0x7fef28068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:10.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.869+0000 7fef412e4640 1 --2- 172.21.15.91:0/47187207 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fef28066840 0x7fef28068d00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fef340ae000 tx=0x7fef340b3040 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:10.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:10.869+0000 7fef39ffb640 1 -- 172.21.15.91:0/47187207 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fef30007670 con 0x7fef3c0c40e0 2023-11-27T18:14:11.133 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.137+0000 7fef39ffb640 1 -- 172.21.15.91:0/47187207 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fef30051070 con 0x7fef3c0c40e0 2023-11-27T18:14:11.307 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.309+0000 7fef43548640 1 -- 172.21.15.91:0/47187207 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fef3c070e90 con 0x7fef3c0c40e0 2023-11-27T18:14:11.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.433+0000 7fef39ffb640 1 -- 172.21.15.91:0/47187207 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7fef30020070 con 0x7fef3c0c40e0 2023-11-27T18:14:11.430 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 1 2023-11-27T18:14:11.434 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.437+0000 7fef43548640 1 -- 172.21.15.91:0/47187207 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fef28066840 msgr2=0x7fef28068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:11.434 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.437+0000 7fef43548640 1 --2- 172.21.15.91:0/47187207 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fef28066840 0x7fef28068d00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fef340ae000 tx=0x7fef340b3040 comp rx=0 tx=0).stop 2023-11-27T18:14:11.434 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.437+0000 7fef43548640 1 -- 172.21.15.91:0/47187207 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef3c0c40e0 msgr2=0x7fef3c0bf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:11.435 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.437+0000 7fef43548640 1 --2- 172.21.15.91:0/47187207 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef3c0c40e0 0x7fef3c0bf130 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fef3000c420 tx=0x7fef3000c8e0 comp rx=0 tx=0).stop 2023-11-27T18:14:11.435 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.437+0000 7fef43548640 1 -- 172.21.15.91:0/47187207 shutdown_connections 2023-11-27T18:14:11.435 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.437+0000 7fef43548640 1 --2- 172.21.15.91:0/47187207 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fef28066840 0x7fef28068d00 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:11.435 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.437+0000 7fef43548640 1 --2- 172.21.15.91:0/47187207 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef3c1576e0 0x7fef3c142fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:11.435 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.437+0000 7fef43548640 1 --2- 172.21.15.91:0/47187207 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef3c0c40e0 0x7fef3c0bf130 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:11.435 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.437+0000 7fef43548640 1 --2- 172.21.15.91:0/47187207 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fef3c072820 0x7fef3c148e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:11.435 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.437+0000 7fef43548640 1 -- 172.21.15.91:0/47187207 >> 172.21.15.91:0/47187207 conn(0x7fef3c0ca9d0 msgr2=0x7fef3c0cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:11.435 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.437+0000 7fef43548640 1 -- 172.21.15.91:0/47187207 shutdown_connections 2023-11-27T18:14:11.435 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.437+0000 7fef43548640 1 -- 172.21.15.91:0/47187207 wait complete. 2023-11-27T18:14:11.458 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T18:14:11.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.585+0000 7f8698029640 1 Processor -- start 2023-11-27T18:14:11.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.585+0000 7f8698029640 1 -- start start 2023-11-27T18:14:11.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.585+0000 7f8698029640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f869015b550 0x7f8690157230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:11.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.585+0000 7f8698029640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f86900c8be0 0x7f8690157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:11.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.585+0000 7f8698029640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f869015a820 con 0x7f8690151650 2023-11-27T18:14:11.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.585+0000 7f8698029640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86900b0410 con 0x7f869015b550 2023-11-27T18:14:11.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.585+0000 7f8698029640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f869015b0c0 con 0x7f86900c8be0 2023-11-27T18:14:11.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.585+0000 7f8695dc5640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f8690151650 0x7f86900c1c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:53560/0 (socket says 172.21.15.91:53560) 2023-11-27T18:14:11.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.585+0000 7f8695dc5640 1 -- 172.21.15.91:0/3334790157 learned_addr learned my addr 172.21.15.91:0/3334790157 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:14:11.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.589+0000 7f8694dc3640 1 -- 172.21.15.91:0/3334790157 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4166919497 0 0) 0x7f869015a820 con 0x7f8690151650 2023-11-27T18:14:11.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.589+0000 7f8694dc3640 1 -- 172.21.15.91:0/3334790157 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f867c003530 con 0x7f8690151650 2023-11-27T18:14:11.589 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.593+0000 7f8694dc3640 1 -- 172.21.15.91:0/3334790157 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2989249466 0 0) 0x7f867c003530 con 0x7f8690151650 2023-11-27T18:14:11.589 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.593+0000 7f8694dc3640 1 -- 172.21.15.91:0/3334790157 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f86900c8be0 msgr2=0x7f8690157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:11.589 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.593+0000 7f8694dc3640 1 --2- 172.21.15.91:0/3334790157 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f86900c8be0 0x7f8690157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:11.589 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.593+0000 7f8694dc3640 1 -- 172.21.15.91:0/3334790157 >> v2:172.21.15.94:3300/0 conn(0x7f869015b550 msgr2=0x7f8690157230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:11.589 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.593+0000 7f8694dc3640 1 --2- 172.21.15.91:0/3334790157 >> v2:172.21.15.94:3300/0 conn(0x7f869015b550 0x7f8690157230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:11.589 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.593+0000 7f8694dc3640 1 -- 172.21.15.91:0/3334790157 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8690157d50 con 0x7f8690151650 2023-11-27T18:14:11.589 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.593+0000 7f8694dc3640 1 -- 172.21.15.91:0/3334790157 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3378743932 0 0) 0x7f868c001680 con 0x7f8690151650 2023-11-27T18:14:11.589 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.593+0000 7f8694dc3640 1 -- 172.21.15.91:0/3334790157 >> v1:172.21.15.91:6789/0 conn(0x7f8690151650 legacy=0x7f86900c1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:11.590 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.593+0000 7f8694dc3640 1 --2- 172.21.15.91:0/3334790157 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f867c003980 0x7f867c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:11.590 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.593+0000 7f8694dc3640 1 --2- 172.21.15.91:0/3334790157 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f86900c8be0 0x7f867c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:11.590 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.593+0000 7f8694dc3640 1 --2- 172.21.15.91:0/3334790157 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f867c004e30 0x7f867c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:11.590 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.593+0000 7f8694dc3640 1 -- 172.21.15.91:0/3334790157 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f869015b0c0 con 0x7f867c004e30 2023-11-27T18:14:11.590 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.593+0000 7f8694dc3640 1 -- 172.21.15.91:0/3334790157 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867c0055f0 con 0x7f867c003980 2023-11-27T18:14:11.590 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.593+0000 7f8694dc3640 1 -- 172.21.15.91:0/3334790157 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f867c00bed0 con 0x7f86900c8be0 2023-11-27T18:14:11.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.597+0000 7f86965c6640 1 --2- 172.21.15.91:0/3334790157 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f867c004e30 0x7f867c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:11.595 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.597+0000 7f86965c6640 1 -- 172.21.15.91:0/3334790157 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f86900c8be0 msgr2=0x7f867c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:11.595 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.597+0000 7f86965c6640 1 --2- 172.21.15.91:0/3334790157 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f86900c8be0 0x7f867c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:11.595 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.597+0000 7f86965c6640 1 -- 172.21.15.91:0/3334790157 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f867c003980 msgr2=0x7f867c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:11.595 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.597+0000 7f86965c6640 1 --2- 172.21.15.91:0/3334790157 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f867c003980 0x7f867c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:11.595 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.597+0000 7f86965c6640 1 -- 172.21.15.91:0/3334790157 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f867c003530 con 0x7f867c004e30 2023-11-27T18:14:11.598 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.601+0000 7f86965c6640 1 --2- 172.21.15.91:0/3334790157 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f867c004e30 0x7f867c00b990 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8688009ca0 tx=0x7f868801cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f88bfb4d7a2d462 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:11.602 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.605+0000 7f8694dc3640 1 -- 172.21.15.91:0/3334790157 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86880a5c60 con 0x7f867c004e30 2023-11-27T18:14:11.602 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.605+0000 7f8694dc3640 1 -- 172.21.15.91:0/3334790157 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86880a5de0 con 0x7f867c004e30 2023-11-27T18:14:11.602 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.605+0000 7f8694dc3640 1 -- 172.21.15.91:0/3334790157 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86880ad680 con 0x7f867c004e30 2023-11-27T18:14:11.603 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.605+0000 7f8698029640 1 -- 172.21.15.91:0/3334790157 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f867c004e30 msgr2=0x7f867c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:11.603 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.605+0000 7f8698029640 1 --2- 172.21.15.91:0/3334790157 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f867c004e30 0x7f867c00b990 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8688009ca0 tx=0x7f868801cc50 comp rx=0 tx=0).stop 2023-11-27T18:14:11.603 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.605+0000 7f86965c6640 1 -- 172.21.15.91:0/3334790157 reap_dead start 2023-11-27T18:14:11.603 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.605+0000 7f8698029640 1 -- 172.21.15.91:0/3334790157 shutdown_connections 2023-11-27T18:14:11.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.605+0000 7f8698029640 1 -- 172.21.15.91:0/3334790157 >> 172.21.15.91:0/3334790157 conn(0x7f86900709f0 msgr2=0x7f8690070e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:11.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.605+0000 7f8698029640 1 -- 172.21.15.91:0/3334790157 shutdown_connections 2023-11-27T18:14:11.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.605+0000 7f8698029640 1 -- 172.21.15.91:0/3334790157 wait complete. 2023-11-27T18:14:11.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.609+0000 7f8698029640 1 Processor -- start 2023-11-27T18:14:11.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.609+0000 7f8698029640 1 -- start start 2023-11-27T18:14:11.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.609+0000 7f8698029640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f86900c42b0 0x7f86900b2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:11.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.609+0000 7f8698029640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f86900c4690 0x7f86900c50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:11.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.609+0000 7f8698029640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8690148380 0x7f86901f0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:11.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.609+0000 7f8698029640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86901f0710 con 0x7f8690148380 2023-11-27T18:14:11.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.609+0000 7f8698029640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86900c56f0 con 0x7f86900c42b0 2023-11-27T18:14:11.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.609+0000 7f8698029640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f869014aa40 con 0x7f86900c4690 2023-11-27T18:14:11.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.609+0000 7f86965c6640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8690148380 0x7f86901f0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:11.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.609+0000 7f86965c6640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8690148380 0x7f86901f0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:56176/0 (socket says 172.21.15.91:56176) 2023-11-27T18:14:11.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.609+0000 7f86965c6640 1 -- 172.21.15.91:0/1548661910 learned_addr learned my addr 172.21.15.91:0/1548661910 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:11.610 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.613+0000 7f86965c6640 1 -- 172.21.15.91:0/1548661910 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f86900c4690 msgr2=0x7f86900c50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:11.610 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.613+0000 7f86965c6640 1 --2- 172.21.15.91:0/1548661910 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f86900c4690 0x7f86900c50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:11.610 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.613+0000 7f86965c6640 1 -- 172.21.15.91:0/1548661910 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f86900c42b0 msgr2=0x7f86900b2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:11.611 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.613+0000 7f86965c6640 1 --2- 172.21.15.91:0/1548661910 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f86900c42b0 0x7f86900b2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:11.611 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.613+0000 7f86965c6640 1 -- 172.21.15.91:0/1548661910 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f869014ad20 con 0x7f8690148380 2023-11-27T18:14:11.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.617+0000 7f86965c6640 1 --2- 172.21.15.91:0/1548661910 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8690148380 0x7f86901f0b60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f868801d4f0 tx=0x7f867c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:11.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.621+0000 7f86867fc640 1 -- 172.21.15.91:0/1548661910 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86880a5c70 con 0x7f8690148380 2023-11-27T18:14:11.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.621+0000 7f86867fc640 1 -- 172.21.15.91:0/1548661910 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86880ad920 con 0x7f8690148380 2023-11-27T18:14:11.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.621+0000 7f8698029640 1 -- 172.21.15.91:0/1548661910 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f869014b000 con 0x7f8690148380 2023-11-27T18:14:11.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.621+0000 7f86867fc640 1 -- 172.21.15.91:0/1548661910 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86880adc90 con 0x7f8690148380 2023-11-27T18:14:11.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.621+0000 7f8698029640 1 -- 172.21.15.91:0/1548661910 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86901f10a0 con 0x7f8690148380 2023-11-27T18:14:11.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.625+0000 7f8698029640 1 -- 172.21.15.91:0/1548661910 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f869004e850 con 0x7f8690148380 2023-11-27T18:14:11.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.641+0000 7f86867fc640 1 -- 172.21.15.91:0/1548661910 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f86880b8420 con 0x7f8690148380 2023-11-27T18:14:11.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.645+0000 7f86867fc640 1 --2- 172.21.15.91:0/1548661910 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f8674066840 0x7f8674068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:11.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.645+0000 7f8695dc5640 1 --2- 172.21.15.91:0/1548661910 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f8674066840 0x7f8674068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:11.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.645+0000 7f8695dc5640 1 --2- 172.21.15.91:0/1548661910 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f8674066840 0x7f8674068d00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f868c00af20 tx=0x7f868c001560 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:11.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.645+0000 7f86867fc640 1 -- 172.21.15.91:0/1548661910 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f86880ef390 con 0x7f8690148380 2023-11-27T18:14:11.944 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:11.949+0000 7f86867fc640 1 -- 172.21.15.91:0/1548661910 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f86880eb6d0 con 0x7f8690148380 2023-11-27T18:14:12.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.113+0000 7f8698029640 1 -- 172.21.15.91:0/1548661910 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f869014dc40 con 0x7f8690148380 2023-11-27T18:14:12.123 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.125+0000 7f86867fc640 1 -- 172.21.15.91:0/1548661910 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f86880bd020 con 0x7f8690148380 2023-11-27T18:14:12.123 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T18:14:12.126 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.129+0000 7f8698029640 1 -- 172.21.15.91:0/1548661910 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f8674066840 msgr2=0x7f8674068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:12.126 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.129+0000 7f8698029640 1 --2- 172.21.15.91:0/1548661910 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f8674066840 0x7f8674068d00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f868c00af20 tx=0x7f868c001560 comp rx=0 tx=0).stop 2023-11-27T18:14:12.126 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.129+0000 7f8698029640 1 -- 172.21.15.91:0/1548661910 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8690148380 msgr2=0x7f86901f0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:12.127 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.129+0000 7f8698029640 1 --2- 172.21.15.91:0/1548661910 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8690148380 0x7f86901f0b60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f868801d4f0 tx=0x7f867c005800 comp rx=0 tx=0).stop 2023-11-27T18:14:12.127 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.129+0000 7f8698029640 1 -- 172.21.15.91:0/1548661910 shutdown_connections 2023-11-27T18:14:12.127 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.129+0000 7f8698029640 1 --2- 172.21.15.91:0/1548661910 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f8674066840 0x7f8674068d00 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:12.127 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.129+0000 7f8698029640 1 --2- 172.21.15.91:0/1548661910 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f86900c4690 0x7f86900c50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:12.127 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.129+0000 7f8698029640 1 --2- 172.21.15.91:0/1548661910 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8690148380 0x7f86901f0b60 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:12.127 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.129+0000 7f8698029640 1 --2- 172.21.15.91:0/1548661910 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f86900c42b0 0x7f86900b2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:12.127 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.129+0000 7f8698029640 1 -- 172.21.15.91:0/1548661910 >> 172.21.15.91:0/1548661910 conn(0x7f86900709f0 msgr2=0x7f869014c860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:12.128 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.129+0000 7f8698029640 1 -- 172.21.15.91:0/1548661910 shutdown_connections 2023-11-27T18:14:12.128 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.129+0000 7f8698029640 1 -- 172.21.15.91:0/1548661910 wait complete. 2023-11-27T18:14:12.143 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T18:14:12.264 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.269+0000 7fd005e6c640 1 Processor -- start 2023-11-27T18:14:12.264 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.269+0000 7fd005e6c640 1 -- start start 2023-11-27T18:14:12.265 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.269+0000 7fd005e6c640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd000072820 0x7fd0000c44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:12.265 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.269+0000 7fd005e6c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd0001576e0 0x7fd000157b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:12.265 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.269+0000 7fd005e6c640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0001580b0 con 0x7fd0000c40e0 2023-11-27T18:14:12.265 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.269+0000 7fd005e6c640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0000c7090 con 0x7fd0001576e0 2023-11-27T18:14:12.265 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.269+0000 7fd005e6c640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0000c4a00 con 0x7fd000072820 2023-11-27T18:14:12.266 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.269+0000 7fcffffff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd0001576e0 0x7fd000157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:12.266 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.269+0000 7fcffffff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd0001576e0 0x7fd000157b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:56190/0 (socket says 172.21.15.91:56190) 2023-11-27T18:14:12.266 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.269+0000 7fcffffff640 1 -- 172.21.15.91:0/1460407220 learned_addr learned my addr 172.21.15.91:0/1460407220 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:12.266 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.269+0000 7fcff6ffd640 1 --2- 172.21.15.91:0/1460407220 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd000072820 0x7fd0000c44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:12.268 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.273+0000 7fcffffff640 1 -- 172.21.15.91:0/1460407220 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd000072820 msgr2=0x7fd0000c44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:12.269 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.273+0000 7fcffffff640 1 --2- 172.21.15.91:0/1460407220 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd000072820 0x7fd0000c44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:12.269 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.273+0000 7fcffffff640 1 -- 172.21.15.91:0/1460407220 >> v1:172.21.15.94:6789/0 conn(0x7fd0000c40e0 legacy=0x7fd00006ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:12.269 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.273+0000 7fcffffff640 1 -- 172.21.15.91:0/1460407220 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd00015aa00 con 0x7fd0001576e0 2023-11-27T18:14:12.269 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.273+0000 7fcff6ffd640 1 --2- 172.21.15.91:0/1460407220 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd000072820 0x7fd0000c44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T18:14:12.272 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.277+0000 7fcffffff640 1 --2- 172.21.15.91:0/1460407220 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd0001576e0 0x7fd000157b70 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fcff8009e50 tx=0x7fcff801ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e91d21634a8510de server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:12.278 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.281+0000 7fcffeffd640 1 -- 172.21.15.91:0/1460407220 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff80a58e0 con 0x7fd0001576e0 2023-11-27T18:14:12.279 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.281+0000 7fcffeffd640 1 -- 172.21.15.91:0/1460407220 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff80a5a40 con 0x7fd0001576e0 2023-11-27T18:14:12.279 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.281+0000 7fcffeffd640 1 -- 172.21.15.91:0/1460407220 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff80a5dd0 con 0x7fd0001576e0 2023-11-27T18:14:12.279 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.281+0000 7fd005e6c640 1 -- 172.21.15.91:0/1460407220 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd0001576e0 msgr2=0x7fd000157b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:12.279 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.281+0000 7fd005e6c640 1 --2- 172.21.15.91:0/1460407220 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd0001576e0 0x7fd000157b70 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fcff8009e50 tx=0x7fcff801ca10 comp rx=0 tx=0).stop 2023-11-27T18:14:12.279 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.281+0000 7fd005e6c640 1 -- 172.21.15.91:0/1460407220 shutdown_connections 2023-11-27T18:14:12.279 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.281+0000 7fd005e6c640 1 --2- 172.21.15.91:0/1460407220 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd0001576e0 0x7fd000157b70 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:12.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.281+0000 7fd005e6c640 1 --2- 172.21.15.91:0/1460407220 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd000072820 0x7fd0000c44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:12.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.281+0000 7fd005e6c640 1 -- 172.21.15.91:0/1460407220 >> 172.21.15.91:0/1460407220 conn(0x7fd0000ca9d0 msgr2=0x7fd0000cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:12.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.281+0000 7fd005e6c640 1 -- 172.21.15.91:0/1460407220 shutdown_connections 2023-11-27T18:14:12.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.281+0000 7fd005e6c640 1 -- 172.21.15.91:0/1460407220 wait complete. 2023-11-27T18:14:12.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.281+0000 7fd005e6c640 1 Processor -- start 2023-11-27T18:14:12.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.281+0000 7fd005e6c640 1 -- start start 2023-11-27T18:14:12.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.285+0000 7fd005e6c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd000072820 0x7fd0000c1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:12.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.285+0000 7fd005e6c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd0000c40e0 0x7fd000160d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:12.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.285+0000 7fd005e6c640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd0001576e0 0x7fd00014f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:12.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.285+0000 7fd005e6c640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0000c2410 con 0x7fd000072820 2023-11-27T18:14:12.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.285+0000 7fd005e6c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0000c3a20 con 0x7fd0000c40e0 2023-11-27T18:14:12.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.285+0000 7fd005e6c640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0000c3d00 con 0x7fd0001576e0 2023-11-27T18:14:12.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.285+0000 7fcfff7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd000072820 0x7fd0000c1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:12.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.285+0000 7fcfff7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd000072820 0x7fd0000c1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:56194/0 (socket says 172.21.15.91:56194) 2023-11-27T18:14:12.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.285+0000 7fcfff7fe640 1 -- 172.21.15.91:0/913922372 learned_addr learned my addr 172.21.15.91:0/913922372 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:12.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.285+0000 7fcff6ffd640 1 --2- 172.21.15.91:0/913922372 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd0000c40e0 0x7fd000160d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:12.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.285+0000 7fcffffff640 1 --2- 172.21.15.91:0/913922372 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd0001576e0 0x7fd00014f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:12.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.293+0000 7fcfff7fe640 1 -- 172.21.15.91:0/913922372 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd0001576e0 msgr2=0x7fd00014f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:12.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.293+0000 7fcfff7fe640 1 --2- 172.21.15.91:0/913922372 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd0001576e0 0x7fd00014f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:12.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.293+0000 7fcfff7fe640 1 -- 172.21.15.91:0/913922372 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd0000c40e0 msgr2=0x7fd000160d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:12.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.293+0000 7fcfff7fe640 1 --2- 172.21.15.91:0/913922372 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd0000c40e0 0x7fd000160d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:12.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.293+0000 7fcfff7fe640 1 -- 172.21.15.91:0/913922372 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff8009b30 con 0x7fd000072820 2023-11-27T18:14:12.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.297+0000 7fcfff7fe640 1 --2- 172.21.15.91:0/913922372 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd000072820 0x7fd0000c1ed0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fcfe800c420 tx=0x7fcfe800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:12.297 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.301+0000 7fcffcff9640 1 -- 172.21.15.91:0/913922372 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe80052d0 con 0x7fd000072820 2023-11-27T18:14:12.297 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.301+0000 7fcffcff9640 1 -- 172.21.15.91:0/913922372 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe8005430 con 0x7fd000072820 2023-11-27T18:14:12.297 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.301+0000 7fcffcff9640 1 -- 172.21.15.91:0/913922372 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe8007260 con 0x7fd000072820 2023-11-27T18:14:12.298 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.301+0000 7fd005e6c640 1 -- 172.21.15.91:0/913922372 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0000c8ee0 con 0x7fd000072820 2023-11-27T18:14:12.298 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.301+0000 7fd005e6c640 1 -- 172.21.15.91:0/913922372 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0000c94a0 con 0x7fd000072820 2023-11-27T18:14:12.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.301+0000 7fd005e6c640 1 -- 172.21.15.91:0/913922372 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd00004e850 con 0x7fd000072820 2023-11-27T18:14:12.318 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.321+0000 7fcffcff9640 1 -- 172.21.15.91:0/913922372 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fcfe80073c0 con 0x7fd000072820 2023-11-27T18:14:12.318 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.321+0000 7fcffcff9640 1 --2- 172.21.15.91:0/913922372 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fcfe00667f0 0x7fcfe0068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:12.318 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.321+0000 7fcff6ffd640 1 --2- 172.21.15.91:0/913922372 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fcfe00667f0 0x7fcfe0068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:12.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.321+0000 7fcff6ffd640 1 --2- 172.21.15.91:0/913922372 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fcfe00667f0 0x7fcfe0068cb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd0001558a0 tx=0x7fcff0008040 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:12.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.325+0000 7fcffcff9640 1 -- 172.21.15.91:0/913922372 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcfe8007670 con 0x7fd000072820 2023-11-27T18:14:12.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.641+0000 7fcffcff9640 1 -- 172.21.15.91:0/913922372 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fcfe8051030 con 0x7fd000072820 2023-11-27T18:14:12.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.809+0000 7fd005e6c640 1 -- 172.21.15.91:0/913922372 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd000070e90 con 0x7fd000072820 2023-11-27T18:14:12.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.825+0000 7fcffcff9640 1 -- 172.21.15.91:0/913922372 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcfe8020020 con 0x7fd000072820 2023-11-27T18:14:12.821 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-11-27T18:14:12.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.829+0000 7fd005e6c640 1 -- 172.21.15.91:0/913922372 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fcfe00667f0 msgr2=0x7fcfe0068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:12.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.829+0000 7fd005e6c640 1 --2- 172.21.15.91:0/913922372 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fcfe00667f0 0x7fcfe0068cb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd0001558a0 tx=0x7fcff0008040 comp rx=0 tx=0).stop 2023-11-27T18:14:12.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.829+0000 7fd005e6c640 1 -- 172.21.15.91:0/913922372 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd000072820 msgr2=0x7fd0000c1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:12.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.829+0000 7fd005e6c640 1 --2- 172.21.15.91:0/913922372 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd000072820 0x7fd0000c1ed0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fcfe800c420 tx=0x7fcfe800c8e0 comp rx=0 tx=0).stop 2023-11-27T18:14:12.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.829+0000 7fd005e6c640 1 -- 172.21.15.91:0/913922372 shutdown_connections 2023-11-27T18:14:12.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.829+0000 7fd005e6c640 1 --2- 172.21.15.91:0/913922372 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fcfe00667f0 0x7fcfe0068cb0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:12.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.829+0000 7fd005e6c640 1 --2- 172.21.15.91:0/913922372 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd0001576e0 0x7fd00014f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:12.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.829+0000 7fd005e6c640 1 --2- 172.21.15.91:0/913922372 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd0000c40e0 0x7fd000160d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:12.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.829+0000 7fd005e6c640 1 --2- 172.21.15.91:0/913922372 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd000072820 0x7fd0000c1ed0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:12.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.829+0000 7fd005e6c640 1 -- 172.21.15.91:0/913922372 >> 172.21.15.91:0/913922372 conn(0x7fd0000ca9d0 msgr2=0x7fd00006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:12.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.829+0000 7fd005e6c640 1 -- 172.21.15.91:0/913922372 shutdown_connections 2023-11-27T18:14:12.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.829+0000 7fd005e6c640 1 -- 172.21.15.91:0/913922372 wait complete. 2023-11-27T18:14:12.842 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-27T18:14:12.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.973+0000 7fa879fa4640 1 Processor -- start 2023-11-27T18:14:12.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.973+0000 7fa879fa4640 1 -- start start 2023-11-27T18:14:12.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.977+0000 7fa879fa4640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa8741598e0 0x7fa874156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:12.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.977+0000 7fa879fa4640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa874157010 0x7fa87406a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:12.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.977+0000 7fa879fa4640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa874072b90 con 0x7fa87413f640 2023-11-27T18:14:12.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.977+0000 7fa879fa4640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa874156640 con 0x7fa874157010 2023-11-27T18:14:12.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.977+0000 7fa879fa4640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa874070ce0 con 0x7fa8741598e0 2023-11-27T18:14:12.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.977+0000 7fa873fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa874157010 0x7fa87406a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:12.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.977+0000 7fa8737fe640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fa87413f640 0x7fa874072480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:53570/0 (socket says 172.21.15.91:53570) 2023-11-27T18:14:12.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.977+0000 7fa8737fe640 1 -- 172.21.15.91:0/1014822040 learned_addr learned my addr 172.21.15.91:0/1014822040 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:14:12.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.977+0000 7fa872ffd640 1 --2- 172.21.15.91:0/1014822040 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa8741598e0 0x7fa874156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:12.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.981+0000 7fa873fff640 1 -- 172.21.15.91:0/1014822040 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa8741598e0 msgr2=0x7fa874156ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:12.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.981+0000 7fa873fff640 1 --2- 172.21.15.91:0/1014822040 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa8741598e0 0x7fa874156ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:12.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.981+0000 7fa873fff640 1 -- 172.21.15.91:0/1014822040 >> v1:172.21.15.91:6789/0 conn(0x7fa87413f640 legacy=0x7fa874072480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:12.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.981+0000 7fa873fff640 1 -- 172.21.15.91:0/1014822040 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8741562f0 con 0x7fa874157010 2023-11-27T18:14:12.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.985+0000 7fa873fff640 1 --2- 172.21.15.91:0/1014822040 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa874157010 0x7fa87406a520 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa86c009d90 tx=0x7fa86c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b620ada6de516f48 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:12.984 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.989+0000 7fa8727fc640 1 -- 172.21.15.91:0/1014822040 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86c0a5770 con 0x7fa874157010 2023-11-27T18:14:12.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.989+0000 7fa8727fc640 1 -- 172.21.15.91:0/1014822040 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa86c0a58d0 con 0x7fa874157010 2023-11-27T18:14:12.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.989+0000 7fa8727fc640 1 -- 172.21.15.91:0/1014822040 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86c0a5c60 con 0x7fa874157010 2023-11-27T18:14:12.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.989+0000 7fa879fa4640 1 -- 172.21.15.91:0/1014822040 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa874157010 msgr2=0x7fa87406a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:12.986 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.989+0000 7fa879fa4640 1 --2- 172.21.15.91:0/1014822040 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa874157010 0x7fa87406a520 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa86c009d90 tx=0x7fa86c01c8e0 comp rx=0 tx=0).stop 2023-11-27T18:14:12.986 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.989+0000 7fa879fa4640 1 -- 172.21.15.91:0/1014822040 shutdown_connections 2023-11-27T18:14:12.986 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.989+0000 7fa879fa4640 1 --2- 172.21.15.91:0/1014822040 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa874157010 0x7fa87406a520 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:12.986 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.989+0000 7fa879fa4640 1 --2- 172.21.15.91:0/1014822040 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa8741598e0 0x7fa874156ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:12.986 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.989+0000 7fa879fa4640 1 -- 172.21.15.91:0/1014822040 >> 172.21.15.91:0/1014822040 conn(0x7fa8740ca9d0 msgr2=0x7fa8740cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:12.986 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.989+0000 7fa879fa4640 1 -- 172.21.15.91:0/1014822040 shutdown_connections 2023-11-27T18:14:12.986 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.989+0000 7fa879fa4640 1 -- 172.21.15.91:0/1014822040 wait complete. 2023-11-27T18:14:12.987 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.989+0000 7fa879fa4640 1 Processor -- start 2023-11-27T18:14:12.987 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.989+0000 7fa879fa4640 1 -- start start 2023-11-27T18:14:12.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.993+0000 7fa879fa4640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa87413f640 0x7fa874153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:12.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.993+0000 7fa879fa4640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa874157010 0x7fa8740be8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:12.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.993+0000 7fa879fa4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8741598e0 0x7fa8741589c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:12.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.993+0000 7fa879fa4640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa874157520 con 0x7fa874157010 2023-11-27T18:14:12.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.993+0000 7fa879fa4640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8740c8870 con 0x7fa8741598e0 2023-11-27T18:14:12.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.993+0000 7fa879fa4640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8740c8b50 con 0x7fa87413f640 2023-11-27T18:14:12.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.993+0000 7fa872ffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa874157010 0x7fa8740be8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:12.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.993+0000 7fa872ffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa874157010 0x7fa8740be8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:56212/0 (socket says 172.21.15.91:56212) 2023-11-27T18:14:12.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.993+0000 7fa872ffd640 1 -- 172.21.15.91:0/3756411859 learned_addr learned my addr 172.21.15.91:0/3756411859 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:12.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.993+0000 7fa873fff640 1 --2- 172.21.15.91:0/3756411859 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8741598e0 0x7fa8741589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:12.990 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.993+0000 7fa8737fe640 1 --2- 172.21.15.91:0/3756411859 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa87413f640 0x7fa874153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:12.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.997+0000 7fa872ffd640 1 -- 172.21.15.91:0/3756411859 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa87413f640 msgr2=0x7fa874153520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:12.993 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.997+0000 7fa872ffd640 1 --2- 172.21.15.91:0/3756411859 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa87413f640 0x7fa874153520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:12.993 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.997+0000 7fa872ffd640 1 -- 172.21.15.91:0/3756411859 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8741598e0 msgr2=0x7fa8741589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:12.993 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.997+0000 7fa872ffd640 1 --2- 172.21.15.91:0/3756411859 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8741598e0 0x7fa8741589c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:12.993 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.997+0000 7fa872ffd640 1 -- 172.21.15.91:0/3756411859 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa86c009a70 con 0x7fa874157010 2023-11-27T18:14:12.995 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:12.997+0000 7fa872ffd640 1 --2- 172.21.15.91:0/3756411859 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa874157010 0x7fa8740be8d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa86800e840 tx=0x7fa86800ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:12.999 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.001+0000 7fa85bfff640 1 -- 172.21.15.91:0/3756411859 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa868009510 con 0x7fa874157010 2023-11-27T18:14:13.000 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.001+0000 7fa85bfff640 1 -- 172.21.15.91:0/3756411859 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa86800ee90 con 0x7fa874157010 2023-11-27T18:14:13.000 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.001+0000 7fa85bfff640 1 -- 172.21.15.91:0/3756411859 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86800cb60 con 0x7fa874157010 2023-11-27T18:14:13.000 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.001+0000 7fa879fa4640 1 -- 172.21.15.91:0/3756411859 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8740c8e30 con 0x7fa874157010 2023-11-27T18:14:13.000 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.001+0000 7fa879fa4640 1 -- 172.21.15.91:0/3756411859 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8740c93f0 con 0x7fa874157010 2023-11-27T18:14:13.000 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.005+0000 7fa879fa4640 1 -- 172.21.15.91:0/3756411859 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa87404e850 con 0x7fa874157010 2023-11-27T18:14:13.020 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.021+0000 7fa85bfff640 1 -- 172.21.15.91:0/3756411859 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fa86800ccc0 con 0x7fa874157010 2023-11-27T18:14:13.020 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.025+0000 7fa85bfff640 1 --2- 172.21.15.91:0/3756411859 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa860066870 0x7fa860068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:13.020 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.025+0000 7fa8737fe640 1 --2- 172.21.15.91:0/3756411859 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa860066870 0x7fa860068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:13.020 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.025+0000 7fa8737fe640 1 --2- 172.21.15.91:0/3756411859 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa860066870 0x7fa860068d30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa864007ca0 tx=0x7fa864007bf0 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:13.023 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.025+0000 7fa85bfff640 1 -- 172.21.15.91:0/3756411859 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa868055880 con 0x7fa874157010 2023-11-27T18:14:13.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.345+0000 7fa85bfff640 1 -- 172.21.15.91:0/3756411859 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fa868051bc0 con 0x7fa874157010 2023-11-27T18:14:13.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.512+0000 7fa879fa4640 1 -- 172.21.15.91:0/3756411859 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa8741352e0 con 0x7fa874157010 2023-11-27T18:14:13.518 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.520+0000 7fa85bfff640 1 -- 172.21.15.91:0/3756411859 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa868021020 con 0x7fa874157010 2023-11-27T18:14:13.519 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T18:14:13.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.524+0000 7fa879fa4640 1 -- 172.21.15.91:0/3756411859 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa860066870 msgr2=0x7fa860068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:13.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.524+0000 7fa879fa4640 1 --2- 172.21.15.91:0/3756411859 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa860066870 0x7fa860068d30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa864007ca0 tx=0x7fa864007bf0 comp rx=0 tx=0).stop 2023-11-27T18:14:13.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.524+0000 7fa879fa4640 1 -- 172.21.15.91:0/3756411859 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa874157010 msgr2=0x7fa8740be8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:13.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.524+0000 7fa879fa4640 1 --2- 172.21.15.91:0/3756411859 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa874157010 0x7fa8740be8d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa86800e840 tx=0x7fa86800ec40 comp rx=0 tx=0).stop 2023-11-27T18:14:13.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.524+0000 7fa879fa4640 1 -- 172.21.15.91:0/3756411859 shutdown_connections 2023-11-27T18:14:13.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.524+0000 7fa879fa4640 1 --2- 172.21.15.91:0/3756411859 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa860066870 0x7fa860068d30 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:13.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.524+0000 7fa879fa4640 1 --2- 172.21.15.91:0/3756411859 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8741598e0 0x7fa8741589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:13.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.524+0000 7fa879fa4640 1 --2- 172.21.15.91:0/3756411859 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa874157010 0x7fa8740be8d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:13.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.524+0000 7fa879fa4640 1 --2- 172.21.15.91:0/3756411859 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa87413f640 0x7fa874153520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:13.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.524+0000 7fa879fa4640 1 -- 172.21.15.91:0/3756411859 >> 172.21.15.91:0/3756411859 conn(0x7fa8740ca9d0 msgr2=0x7fa87413e550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:13.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.524+0000 7fa879fa4640 1 -- 172.21.15.91:0/3756411859 shutdown_connections 2023-11-27T18:14:13.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.524+0000 7fa879fa4640 1 -- 172.21.15.91:0/3756411859 wait complete. 2023-11-27T18:14:13.539 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T18:14:13.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.664+0000 7f539bf65640 1 Processor -- start 2023-11-27T18:14:13.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.664+0000 7f539bf65640 1 -- start start 2023-11-27T18:14:13.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.664+0000 7f539bf65640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f53940c6c50 0x7f53940c2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:13.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.664+0000 7f539bf65640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f53940c82f0 0x7f5394159810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:13.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.664+0000 7f539bf65640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53940c73e0 con 0x7f5394153a20 2023-11-27T18:14:13.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.664+0000 7f539bf65640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53940701f0 con 0x7f53940c6c50 2023-11-27T18:14:13.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.664+0000 7f539bf65640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53940c7120 con 0x7f53940c82f0 2023-11-27T18:14:13.662 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.664+0000 7f539a502640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f53940c82f0 0x7f5394159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:13.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.664+0000 7f539a502640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f53940c82f0 0x7f5394159810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.91:50064/0 (socket says 172.21.15.91:50064) 2023-11-27T18:14:13.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.664+0000 7f539a502640 1 -- 172.21.15.91:0/961136278 learned_addr learned my addr 172.21.15.91:0/961136278 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:13.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.672+0000 7f539a502640 1 -- 172.21.15.91:0/961136278 >> v2:172.21.15.91:3300/0 conn(0x7f53940c6c50 msgr2=0x7f53940c2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:13.670 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.672+0000 7f539a502640 1 --2- 172.21.15.91:0/961136278 >> v2:172.21.15.91:3300/0 conn(0x7f53940c6c50 0x7f53940c2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:13.670 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.672+0000 7f539a502640 1 -- 172.21.15.91:0/961136278 >> v1:172.21.15.91:6789/0 conn(0x7f5394153a20 legacy=0x7f53940c1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:13.670 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.672+0000 7f539a502640 1 -- 172.21.15.91:0/961136278 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f539406f8c0 con 0x7f53940c82f0 2023-11-27T18:14:13.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.676+0000 7f539a502640 1 --2- 172.21.15.91:0/961136278 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f53940c82f0 0x7f5394159810 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f539406f3f0 tx=0x7f538c01c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8139949ad1b25441 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:13.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.688+0000 7f5398cff640 1 -- 172.21.15.91:0/961136278 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538c0a5740 con 0x7f53940c82f0 2023-11-27T18:14:13.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.688+0000 7f5398cff640 1 -- 172.21.15.91:0/961136278 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f538c0a58a0 con 0x7f53940c82f0 2023-11-27T18:14:13.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.688+0000 7f5398cff640 1 -- 172.21.15.91:0/961136278 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538c0a5c30 con 0x7f53940c82f0 2023-11-27T18:14:13.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.688+0000 7f539bf65640 1 -- 172.21.15.91:0/961136278 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f53940c82f0 msgr2=0x7f5394159810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:13.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.688+0000 7f539bf65640 1 --2- 172.21.15.91:0/961136278 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f53940c82f0 0x7f5394159810 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f539406f3f0 tx=0x7f538c01c990 comp rx=0 tx=0).stop 2023-11-27T18:14:13.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.688+0000 7f539bf65640 1 -- 172.21.15.91:0/961136278 shutdown_connections 2023-11-27T18:14:13.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.688+0000 7f539bf65640 1 --2- 172.21.15.91:0/961136278 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f53940c82f0 0x7f5394159810 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:13.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.688+0000 7f539bf65640 1 --2- 172.21.15.91:0/961136278 >> v2:172.21.15.91:3300/0 conn(0x7f53940c6c50 0x7f53940c2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:13.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.688+0000 7f539bf65640 1 -- 172.21.15.91:0/961136278 >> 172.21.15.91:0/961136278 conn(0x7f53940cbec0 msgr2=0x7f53940cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:13.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.688+0000 7f539bf65640 1 -- 172.21.15.91:0/961136278 shutdown_connections 2023-11-27T18:14:13.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.688+0000 7f539bf65640 1 -- 172.21.15.91:0/961136278 wait complete. 2023-11-27T18:14:13.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.688+0000 7f539bf65640 1 Processor -- start 2023-11-27T18:14:13.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.688+0000 7f539bf65640 1 -- start start 2023-11-27T18:14:13.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.692+0000 7f539bf65640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f53940c6c50 0x7f5394146240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:13.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.692+0000 7f539bf65640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f53940c82f0 0x7f5394144d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:13.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.692+0000 7f539bf65640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5394153a20 0x7f539414e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:13.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.692+0000 7f539bf65640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53941571c0 con 0x7f53940c82f0 2023-11-27T18:14:13.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.692+0000 7f539bf65640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53941588c0 con 0x7f53940c6c50 2023-11-27T18:14:13.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.692+0000 7f539bf65640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f539414fbb0 con 0x7f5394153a20 2023-11-27T18:14:13.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.692+0000 7f539a502640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5394153a20 0x7f539414e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:13.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.692+0000 7f5399d01640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f53940c6c50 0x7f5394146240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:13.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.692+0000 7f539a502640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5394153a20 0x7f539414e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.91:54534/0 (socket says 172.21.15.91:54534) 2023-11-27T18:14:13.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.692+0000 7f539a502640 1 -- 172.21.15.91:0/2648917686 learned_addr learned my addr 172.21.15.91:0/2648917686 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:13.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.704+0000 7f539a502640 1 -- 172.21.15.91:0/2648917686 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f53940c6c50 msgr2=0x7f5394146240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:13.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.704+0000 7f539a502640 1 --2- 172.21.15.91:0/2648917686 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f53940c6c50 0x7f5394146240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:13.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.704+0000 7f539a502640 1 -- 172.21.15.91:0/2648917686 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f53940c82f0 msgr2=0x7f5394144d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:13.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.704+0000 7f539a502640 1 --2- 172.21.15.91:0/2648917686 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f53940c82f0 0x7f5394144d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:13.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.704+0000 7f539a502640 1 -- 172.21.15.91:0/2648917686 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f538c009b30 con 0x7f5394153a20 2023-11-27T18:14:13.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.708+0000 7f539a502640 1 --2- 172.21.15.91:0/2648917686 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5394153a20 0x7f539414e0b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f538c0af040 tx=0x7f538c019730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:13.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.844+0000 7f538a7fc640 1 -- 172.21.15.91:0/2648917686 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538c0b8670 con 0x7f5394153a20 2023-11-27T18:14:13.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.844+0000 7f538a7fc640 1 -- 172.21.15.91:0/2648917686 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f538c0b87d0 con 0x7f5394153a20 2023-11-27T18:14:13.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.844+0000 7f538a7fc640 1 -- 172.21.15.91:0/2648917686 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538c0b8b80 con 0x7f5394153a20 2023-11-27T18:14:13.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.844+0000 7f539bf65640 1 -- 172.21.15.91:0/2648917686 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5394158b60 con 0x7f5394153a20 2023-11-27T18:14:13.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.844+0000 7f539bf65640 1 -- 172.21.15.91:0/2648917686 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5394159120 con 0x7f5394153a20 2023-11-27T18:14:13.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:13.844+0000 7f539bf65640 1 -- 172.21.15.91:0/2648917686 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5394067810 con 0x7f5394153a20 2023-11-27T18:14:14.144 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:14.148+0000 7f538a7fc640 1 -- 172.21.15.91:0/2648917686 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f538c0b8ce0 con 0x7f5394153a20 2023-11-27T18:14:20.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:14.148+0000 7f538a7fc640 1 --2- 172.21.15.91:0/2648917686 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f5378066840 0x7f5378068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:20.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:14.148+0000 7f5399d01640 1 --2- 172.21.15.91:0/2648917686 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f5378066840 0x7f5378068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:20.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:14.148+0000 7f5399d01640 1 --2- 172.21.15.91:0/2648917686 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f5378066840 0x7f5378068d00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f53900098e0 tx=0x7f5390009060 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:20.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:14.160+0000 7f538a7fc640 1 -- 172.21.15.91:0/2648917686 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f538c0f1a60 con 0x7f5394153a20 2023-11-27T18:14:20.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:14.196+0000 7f538a7fc640 1 -- 172.21.15.91:0/2648917686 <== mon.2 v2:172.21.15.94:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f538c0ed6a0 con 0x7f5394153a20 2023-11-27T18:14:20.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:14.416+0000 7f539bf65640 1 -- 172.21.15.91:0/2648917686 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5394067810 con 0x7f5394153a20 2023-11-27T18:14:20.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:14.432+0000 7f538a7fc640 1 -- 172.21.15.91:0/2648917686 <== mon.2 v2:172.21.15.94:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6491 (secure 0 0 0) 0x7f538c0f0cc0 con 0x7f5394153a20 2023-11-27T18:14:20.868 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:14:20.868 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1156758494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1156758494},{"type":"v1","addr":"172.21.15.91:6835","nonce":1156758494}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4227,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/2636117364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2636117364},{"type":"v1","addr":"172.21.15.91:6837","nonce":2636117364}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6839/1813662020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6838","nonce":1813662020},{"type":"v1","addr":"172.21.15.91:6839","nonce":1813662020}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4243,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3605337236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3605337236},{"type":"v1","addr":"172.21.15.94:6833","nonce":3605337236}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4246,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/1691562292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1691562292},{"type":"v1","addr":"172.21.15.94:6835","nonce":1691562292}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T18:13:13.083833+0000","modified":"2023-11-27T18:13:54.891064+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":10,"addr":"172.21.15.94:6837/3938864244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":3938864244},{"type":"v1","addr":"172.21.15.94:6837","nonce":3938864244}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-27T18:14:20.870 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 9 2023-11-27T18:14:20.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:14.436+0000 7f539bf65640 1 -- 172.21.15.91:0/2648917686 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f5378066840 msgr2=0x7f5378068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:20.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:14.436+0000 7f539bf65640 1 --2- 172.21.15.91:0/2648917686 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f5378066840 0x7f5378068d00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f53900098e0 tx=0x7f5390009060 comp rx=0 tx=0).stop 2023-11-27T18:14:20.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:14.436+0000 7f539bf65640 1 -- 172.21.15.91:0/2648917686 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5394153a20 msgr2=0x7f539414e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:20.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:14.436+0000 7f539bf65640 1 --2- 172.21.15.91:0/2648917686 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5394153a20 0x7f539414e0b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f538c0af040 tx=0x7f538c019730 comp rx=0 tx=0).stop 2023-11-27T18:14:20.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:14.436+0000 7f539bf65640 1 -- 172.21.15.91:0/2648917686 shutdown_connections 2023-11-27T18:14:20.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:14.436+0000 7f539bf65640 1 --2- 172.21.15.91:0/2648917686 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f5378066840 0x7f5378068d00 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:20.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:14.436+0000 7f539bf65640 1 --2- 172.21.15.91:0/2648917686 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5394153a20 0x7f539414e0b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:20.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:14.436+0000 7f539bf65640 1 --2- 172.21.15.91:0/2648917686 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f53940c82f0 0x7f5394144d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:20.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:14.436+0000 7f539bf65640 1 --2- 172.21.15.91:0/2648917686 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f53940c6c50 0x7f5394146240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:20.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:14.436+0000 7f539bf65640 1 -- 172.21.15.91:0/2648917686 >> 172.21.15.91:0/2648917686 conn(0x7f53940cbec0 msgr2=0x7f53941472b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:20.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:14.436+0000 7f539bf65640 1 -- 172.21.15.91:0/2648917686 shutdown_connections 2023-11-27T18:14:20.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:14.436+0000 7f539bf65640 1 -- 172.21.15.91:0/2648917686 wait complete. 2023-11-27T18:14:20.872 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T18:14:20.999 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.000+0000 7f6c1ab33640 1 Processor -- start 2023-11-27T18:14:21.000 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.000+0000 7f6c1ab33640 1 -- start start 2023-11-27T18:14:21.000 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.004+0000 7f6c1ab33640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6c140c1f80 0x7f6c14157f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:21.000 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.004+0000 7f6c1ab33640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c141584b0 con 0x7f6c141516f0 2023-11-27T18:14:21.001 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.004+0000 7f6c1ab33640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c140c2fe0 con 0x7f6c140c8ff0 2023-11-27T18:14:21.001 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.004+0000 7f6c1ab33640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c140c85a0 con 0x7f6c140c1f80 2023-11-27T18:14:21.002 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.004+0000 7f6c13fff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f6c140c8ff0 0x7f6c140cccc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.91:35942/0 (socket says 172.21.15.91:35942) 2023-11-27T18:14:21.002 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.004+0000 7f6c13fff640 1 -- 172.21.15.91:0/696510372 learned_addr learned my addr 172.21.15.91:0/696510372 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:14:21.002 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.004+0000 7f6c190d0640 1 --2- 172.21.15.91:0/696510372 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6c140c1f80 0x7f6c14157f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:21.005 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.008+0000 7f6c137fe640 1 -- 172.21.15.91:0/696510372 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3726437553 0 0) 0x7f6c140c2fe0 con 0x7f6c140c8ff0 2023-11-27T18:14:21.005 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.008+0000 7f6c137fe640 1 -- 172.21.15.91:0/696510372 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c04003530 con 0x7f6c140c8ff0 2023-11-27T18:14:21.009 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.012+0000 7f6c137fe640 1 -- 172.21.15.91:0/696510372 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3218610965 0 0) 0x7f6c08001120 con 0x7f6c141516f0 2023-11-27T18:14:21.009 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.012+0000 7f6c137fe640 1 -- 172.21.15.91:0/696510372 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c140c2fe0 con 0x7f6c141516f0 2023-11-27T18:14:21.011 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.012+0000 7f6c137fe640 1 -- 172.21.15.91:0/696510372 <== mon.1 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3446224901 0 0) 0x7f6c04003530 con 0x7f6c140c8ff0 2023-11-27T18:14:21.011 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.012+0000 7f6c137fe640 1 -- 172.21.15.91:0/696510372 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6c140c1f80 msgr2=0x7f6c14157f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:21.011 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.012+0000 7f6c137fe640 1 --2- 172.21.15.91:0/696510372 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6c140c1f80 0x7f6c14157f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:21.011 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.012+0000 7f6c137fe640 1 -- 172.21.15.91:0/696510372 >> v1:172.21.15.91:6789/0 conn(0x7f6c141516f0 legacy=0x7f6c140c3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:21.012 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.012+0000 7f6c137fe640 1 -- 172.21.15.91:0/696510372 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c140c7f00 con 0x7f6c140c8ff0 2023-11-27T18:14:21.012 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.012+0000 7f6c137fe640 1 -- 172.21.15.91:0/696510372 <== mon.1 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3378743932 0 0) 0x7f6c00001680 con 0x7f6c140c8ff0 2023-11-27T18:14:21.012 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.012+0000 7f6c137fe640 1 -- 172.21.15.91:0/696510372 >> v1:172.21.15.94:6789/0 conn(0x7f6c140c8ff0 legacy=0x7f6c140cccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:21.012 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.012+0000 7f6c137fe640 1 --2- 172.21.15.91:0/696510372 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6c140c1f80 0x7f6c04003b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:21.012 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.012+0000 7f6c137fe640 1 --2- 172.21.15.91:0/696510372 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6c040040c0 0x7f6c040047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:21.012 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.012+0000 7f6c137fe640 1 --2- 172.21.15.91:0/696510372 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c04004d10 0x7f6c04005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:21.012 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.012+0000 7f6c137fe640 1 -- 172.21.15.91:0/696510372 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c140c85a0 con 0x7f6c040040c0 2023-11-27T18:14:21.012 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.012+0000 7f6c137fe640 1 -- 172.21.15.91:0/696510372 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0400ba70 con 0x7f6c04004d10 2023-11-27T18:14:21.012 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.012+0000 7f6c137fe640 1 -- 172.21.15.91:0/696510372 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0400bc30 con 0x7f6c140c1f80 2023-11-27T18:14:21.013 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.016+0000 7f6c13fff640 1 --2- 172.21.15.91:0/696510372 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6c040040c0 0x7f6c040047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:21.014 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.016+0000 7f6c190d0640 1 --2- 172.21.15.91:0/696510372 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c04004d10 0x7f6c04005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:21.018 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.020+0000 7f6c190d0640 1 -- 172.21.15.91:0/696510372 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6c140c1f80 msgr2=0x7f6c04003b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:21.018 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.020+0000 7f6c190d0640 1 --2- 172.21.15.91:0/696510372 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6c140c1f80 0x7f6c04003b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:21.018 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.020+0000 7f6c190d0640 1 -- 172.21.15.91:0/696510372 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6c040040c0 msgr2=0x7f6c040047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:21.018 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.020+0000 7f6c190d0640 1 --2- 172.21.15.91:0/696510372 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6c040040c0 0x7f6c040047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:21.018 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.020+0000 7f6c190d0640 1 -- 172.21.15.91:0/696510372 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c04003530 con 0x7f6c04004d10 2023-11-27T18:14:21.021 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.024+0000 7f6c190d0640 1 --2- 172.21.15.91:0/696510372 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c04004d10 0x7f6c04005190 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c009fc0 tx=0x7f6c0c01cca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4946e88e77817674 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:21.029 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.032+0000 7f6c137fe640 1 -- 172.21.15.91:0/696510372 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c0a5cb0 con 0x7f6c04004d10 2023-11-27T18:14:21.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.032+0000 7f6c137fe640 1 -- 172.21.15.91:0/696510372 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c0c00f040 con 0x7f6c04004d10 2023-11-27T18:14:21.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.032+0000 7f6c137fe640 1 -- 172.21.15.91:0/696510372 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c0ad680 con 0x7f6c04004d10 2023-11-27T18:14:21.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.032+0000 7f6c1ab33640 1 -- 172.21.15.91:0/696510372 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c04004d10 msgr2=0x7f6c04005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:21.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.032+0000 7f6c1ab33640 1 --2- 172.21.15.91:0/696510372 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c04004d10 0x7f6c04005190 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c009fc0 tx=0x7f6c0c01cca0 comp rx=0 tx=0).stop 2023-11-27T18:14:21.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.032+0000 7f6c190d0640 1 -- 172.21.15.91:0/696510372 reap_dead start 2023-11-27T18:14:21.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.032+0000 7f6c1ab33640 1 -- 172.21.15.91:0/696510372 shutdown_connections 2023-11-27T18:14:21.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.032+0000 7f6c1ab33640 1 -- 172.21.15.91:0/696510372 >> 172.21.15.91:0/696510372 conn(0x7f6c1406a520 msgr2=0x7f6c1406a930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:21.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.032+0000 7f6c1ab33640 1 -- 172.21.15.91:0/696510372 shutdown_connections 2023-11-27T18:14:21.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.032+0000 7f6c1ab33640 1 -- 172.21.15.91:0/696510372 wait complete. 2023-11-27T18:14:21.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.036+0000 7f6c1ab33640 1 Processor -- start 2023-11-27T18:14:21.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.036+0000 7f6c1ab33640 1 -- start start 2023-11-27T18:14:21.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.036+0000 7f6c1ab33640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6c141553b0 0x7f6c141f3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:21.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.036+0000 7f6c1ab33640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6c1406bca0 0x7f6c141ef9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:21.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.036+0000 7f6c1ab33640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c14155790 0x7f6c14144810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:21.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.036+0000 7f6c1ab33640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c141ef2a0 con 0x7f6c141553b0 2023-11-27T18:14:21.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.036+0000 7f6c1ab33640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c14155de0 con 0x7f6c14155790 2023-11-27T18:14:21.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.036+0000 7f6c1ab33640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c141f3760 con 0x7f6c1406bca0 2023-11-27T18:14:21.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.036+0000 7f6c188cf640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6c141553b0 0x7f6c141f3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:21.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.036+0000 7f6c188cf640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6c141553b0 0x7f6c141f3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:46084/0 (socket says 172.21.15.91:46084) 2023-11-27T18:14:21.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.036+0000 7f6c188cf640 1 -- 172.21.15.91:0/3298603189 learned_addr learned my addr 172.21.15.91:0/3298603189 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:21.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.036+0000 7f6c13fff640 1 --2- 172.21.15.91:0/3298603189 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6c1406bca0 0x7f6c141ef9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:21.035 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.036+0000 7f6c190d0640 1 --2- 172.21.15.91:0/3298603189 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c14155790 0x7f6c14144810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:21.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.040+0000 7f6c188cf640 1 -- 172.21.15.91:0/3298603189 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6c1406bca0 msgr2=0x7f6c141ef9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:21.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.040+0000 7f6c188cf640 1 --2- 172.21.15.91:0/3298603189 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6c1406bca0 0x7f6c141ef9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:21.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.040+0000 7f6c188cf640 1 -- 172.21.15.91:0/3298603189 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c14155790 msgr2=0x7f6c14144810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:21.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.040+0000 7f6c188cf640 1 --2- 172.21.15.91:0/3298603189 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c14155790 0x7f6c14144810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:21.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.040+0000 7f6c188cf640 1 -- 172.21.15.91:0/3298603189 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c141ef520 con 0x7f6c141553b0 2023-11-27T18:14:21.040 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.044+0000 7f6c188cf640 1 --2- 172.21.15.91:0/3298603189 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6c141553b0 0x7f6c141f3220 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6c0800c650 tx=0x7f6c0800cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:21.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.048+0000 7f6c117fa640 1 -- 172.21.15.91:0/3298603189 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c080052d0 con 0x7f6c141553b0 2023-11-27T18:14:21.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.048+0000 7f6c117fa640 1 -- 172.21.15.91:0/3298603189 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c08005430 con 0x7f6c141553b0 2023-11-27T18:14:21.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.048+0000 7f6c117fa640 1 -- 172.21.15.91:0/3298603189 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c08003800 con 0x7f6c141553b0 2023-11-27T18:14:21.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.048+0000 7f6c1ab33640 1 -- 172.21.15.91:0/3298603189 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c14146a60 con 0x7f6c141553b0 2023-11-27T18:14:21.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.048+0000 7f6c1ab33640 1 -- 172.21.15.91:0/3298603189 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c14146d00 con 0x7f6c141553b0 2023-11-27T18:14:21.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.048+0000 7f6c1ab33640 1 -- 172.21.15.91:0/3298603189 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c1404e930 con 0x7f6c141553b0 2023-11-27T18:14:21.370 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.372+0000 7f6c117fa640 1 -- 172.21.15.91:0/3298603189 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f6c08003960 con 0x7f6c141553b0 2023-11-27T18:14:21.370 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.372+0000 7f6c117fa640 1 --2- 172.21.15.91:0/3298603189 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f6bf80667f0 0x7f6bf8068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:21.370 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.372+0000 7f6c13fff640 1 --2- 172.21.15.91:0/3298603189 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f6bf80667f0 0x7f6bf8068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:21.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.372+0000 7f6c13fff640 1 --2- 172.21.15.91:0/3298603189 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f6bf80667f0 0x7f6bf8068cb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6c1406c080 tx=0x7f6c00000ee0 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:21.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.412+0000 7f6c117fa640 1 -- 172.21.15.91:0/3298603189 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6c08055620 con 0x7f6c141553b0 2023-11-27T18:14:21.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.460+0000 7f6c117fa640 1 -- 172.21.15.91:0/3298603189 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f6c08051960 con 0x7f6c141553b0 2023-11-27T18:14:21.622 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.624+0000 7f6c1ab33640 1 -- 172.21.15.91:0/3298603189 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6c141584b0 con 0x7f6c141553b0 2023-11-27T18:14:21.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.720+0000 7f6c117fa640 1 -- 172.21.15.91:0/3298603189 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+18421 (secure 0 0 0) 0x7f6c141584b0 con 0x7f6c141553b0 2023-11-27T18:14:21.720 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:14:21.720 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":31,"fsid":"08c8ebbf-7936-4c41-a995-d5600de2d072","created":"2023-11-27T18:12:06.484593+0000","modified":"2023-11-27T18:14:20.376217+0000","last_up_change":"2023-11-27T18:12:33.154694+0000","last_in_change":"2023-11-27T18:12:23.622113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T18:12:35.450305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T18:13:09.589619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T18:13:11.439236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-27T18:13:18.514694+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ad53c08-dd19-4ae6-87c5-fa15bea3b4ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6811","nonce":472303992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6813","nonce":472303992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6817","nonce":472303992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6815","nonce":472303992}]},"public_addr":"172.21.15.91:6811/472303992","cluster_addr":"172.21.15.91:6813/472303992","heartbeat_back_addr":"172.21.15.91:6817/472303992","heartbeat_front_addr":"172.21.15.91:6815/472303992","state":["exists","up"]},{"osd":1,"uuid":"f8b5f147-ed29-4329-a787-a12cc34a2569","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6827","nonce":12316911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6829","nonce":12316911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6833","nonce":12316911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6831","nonce":12316911}]},"public_addr":"172.21.15.91:6827/12316911","cluster_addr":"172.21.15.91:6829/12316911","heartbeat_back_addr":"172.21.15.91:6833/12316911","heartbeat_front_addr":"172.21.15.91:6831/12316911","state":["exists","up"]},{"osd":2,"uuid":"c3029f9a-1c48-4f5d-983a-172a614d8795","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6803","nonce":3776125919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6805","nonce":3776125919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6809","nonce":3776125919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6807","nonce":3776125919}]},"public_addr":"172.21.15.91:6803/3776125919","cluster_addr":"172.21.15.91:6805/3776125919","heartbeat_back_addr":"172.21.15.91:6809/3776125919","heartbeat_front_addr":"172.21.15.91:6807/3776125919","state":["exists","up"]},{"osd":3,"uuid":"ab4b6fb2-0126-491b-9224-54a6badc5da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6819","nonce":1297704794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6821","nonce":1297704794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6825","nonce":1297704794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6823","nonce":1297704794}]},"public_addr":"172.21.15.91:6819/1297704794","cluster_addr":"172.21.15.91:6821/1297704794","heartbeat_back_addr":"172.21.15.91:6825/1297704794","heartbeat_front_addr":"172.21.15.91:6823/1297704794","state":["exists","up"]},{"osd":4,"uuid":"695071a8-2de8-4cba-bf20-050021a03bb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6809","nonce":2501531833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6811","nonce":2501531833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6815","nonce":2501531833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6813","nonce":2501531833}]},"public_addr":"172.21.15.94:6809/2501531833","cluster_addr":"172.21.15.94:6811/2501531833","heartbeat_back_addr":"172.21.15.94:6815/2501531833","heartbeat_front_addr":"172.21.15.94:6813/2501531833","state":["exists","up"]},{"osd":5,"uuid":"ca01da14-a700-4845-8db2-f5e3370677e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6817","nonce":2448969592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6819","nonce":2448969592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6823","nonce":2448969592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6821","nonce":2448969592}]},"public_addr":"172.21.15.94:6817/2448969592","cluster_addr":"172.21.15.94:6819/2448969592","heartbeat_back_addr":"172.21.15.94:6823/2448969592","heartbeat_front_addr":"172.21.15.94:6821/2448969592","state":["exists","up"]},{"osd":6,"uuid":"4784bc77-6c33-4e47-abba-d37484982f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6825","nonce":3389553935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6827","nonce":3389553935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6831","nonce":3389553935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6829","nonce":3389553935}]},"public_addr":"172.21.15.94:6825/3389553935","cluster_addr":"172.21.15.94:6827/3389553935","heartbeat_back_addr":"172.21.15.94:6831/3389553935","heartbeat_front_addr":"172.21.15.94:6829/3389553935","state":["exists","up"]},{"osd":7,"uuid":"b954cf3f-4a4f-4a75-9f90-014f72c16d15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6801","nonce":1606498064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6803","nonce":1606498064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6807","nonce":1606498064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6805","nonce":1606498064}]},"public_addr":"172.21.15.94:6801/1606498064","cluster_addr":"172.21.15.94:6803/1606498064","heartbeat_back_addr":"172.21.15.94:6807/1606498064","heartbeat_front_addr":"172.21.15.94:6805/1606498064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.534968+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.506182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.339267+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.532432+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:28.935756+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.471559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.485014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.352978+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":0,"to":7}]},{"pgid":"4.d","mappings":[{"from":3,"to":0}]},{"pgid":"4.1d","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T18:14:21.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.724+0000 7f6c1ab33640 1 -- 172.21.15.91:0/3298603189 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f6bf80667f0 msgr2=0x7f6bf8068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:21.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.724+0000 7f6c1ab33640 1 --2- 172.21.15.91:0/3298603189 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f6bf80667f0 0x7f6bf8068cb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6c1406c080 tx=0x7f6c00000ee0 comp rx=0 tx=0).stop 2023-11-27T18:14:21.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.724+0000 7f6c1ab33640 1 -- 172.21.15.91:0/3298603189 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6c141553b0 msgr2=0x7f6c141f3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:21.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.724+0000 7f6c1ab33640 1 --2- 172.21.15.91:0/3298603189 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6c141553b0 0x7f6c141f3220 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6c0800c650 tx=0x7f6c0800cb10 comp rx=0 tx=0).stop 2023-11-27T18:14:21.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.728+0000 7f6c1ab33640 1 -- 172.21.15.91:0/3298603189 shutdown_connections 2023-11-27T18:14:21.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.728+0000 7f6c1ab33640 1 --2- 172.21.15.91:0/3298603189 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f6bf80667f0 0x7f6bf8068cb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:21.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.728+0000 7f6c1ab33640 1 --2- 172.21.15.91:0/3298603189 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6c1406bca0 0x7f6c141ef9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:21.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.728+0000 7f6c1ab33640 1 --2- 172.21.15.91:0/3298603189 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c14155790 0x7f6c14144810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:21.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.728+0000 7f6c1ab33640 1 --2- 172.21.15.91:0/3298603189 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6c141553b0 0x7f6c141f3220 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:21.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.728+0000 7f6c1ab33640 1 -- 172.21.15.91:0/3298603189 >> 172.21.15.91:0/3298603189 conn(0x7f6c1406a520 msgr2=0x7f6c14157d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:21.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.728+0000 7f6c1ab33640 1 -- 172.21.15.91:0/3298603189 shutdown_connections 2023-11-27T18:14:21.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.728+0000 7f6c1ab33640 1 -- 172.21.15.91:0/3298603189 wait complete. 2023-11-27T18:14:21.747 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T18:12:35.450305+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T18:13:09.589619+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T18:13:11.439236+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-27T18:13:18.514694+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-27T18:14:21.747 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T18:14:21.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.880+0000 7fc810561640 1 Processor -- start 2023-11-27T18:14:21.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.880+0000 7fc810561640 1 -- start start 2023-11-27T18:14:21.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.880+0000 7fc810561640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc8080c54f0 0x7fc8080c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:21.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.880+0000 7fc810561640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc80815a870 con 0x7fc80815ad00 2023-11-27T18:14:21.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.880+0000 7fc810561640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc808157150 con 0x7fc8080c58d0 2023-11-27T18:14:21.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.880+0000 7fc810561640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc808157410 con 0x7fc8080c54f0 2023-11-27T18:14:21.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.884+0000 7fc80e2fd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc8080c54f0 0x7fc8080c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:21.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.884+0000 7fc80e2fd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc8080c54f0 0x7fc8080c82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.91:58994/0 (socket says 172.21.15.91:58994) 2023-11-27T18:14:21.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.884+0000 7fc80e2fd640 1 -- 172.21.15.91:0/93090060 learned_addr learned my addr 172.21.15.91:0/93090060 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:21.888 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.892+0000 7fc80e2fd640 1 -- 172.21.15.91:0/93090060 >> v1:172.21.15.94:6789/0 conn(0x7fc8080c58d0 legacy=0x7fc8080c8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:21.888 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.892+0000 7fc80e2fd640 1 -- 172.21.15.91:0/93090060 >> v1:172.21.15.91:6789/0 conn(0x7fc80815ad00 legacy=0x7fc80814d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:21.888 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.892+0000 7fc80e2fd640 1 -- 172.21.15.91:0/93090060 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8081576f0 con 0x7fc8080c54f0 2023-11-27T18:14:21.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.896+0000 7fc80e2fd640 1 --2- 172.21.15.91:0/93090060 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8080c54f0 0x7fc8080c82a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc7f8009870 tx=0x7fc7f801ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b030989f4c287e86 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:21.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.916+0000 7fc80d2fb640 1 -- 172.21.15.91:0/93090060 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f80a89b0 con 0x7fc8080c54f0 2023-11-27T18:14:21.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.916+0000 7fc80d2fb640 1 -- 172.21.15.91:0/93090060 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f80a8b10 con 0x7fc8080c54f0 2023-11-27T18:14:21.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.916+0000 7fc80d2fb640 1 -- 172.21.15.91:0/93090060 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f80a8ea0 con 0x7fc8080c54f0 2023-11-27T18:14:21.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.916+0000 7fc810561640 1 -- 172.21.15.91:0/93090060 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8080c54f0 msgr2=0x7fc8080c82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:21.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.916+0000 7fc810561640 1 --2- 172.21.15.91:0/93090060 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8080c54f0 0x7fc8080c82a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc7f8009870 tx=0x7fc7f801ecb0 comp rx=0 tx=0).stop 2023-11-27T18:14:21.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.916+0000 7fc810561640 1 -- 172.21.15.91:0/93090060 shutdown_connections 2023-11-27T18:14:21.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.916+0000 7fc810561640 1 --2- 172.21.15.91:0/93090060 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8080c54f0 0x7fc8080c82a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:21.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.916+0000 7fc810561640 1 -- 172.21.15.91:0/93090060 >> 172.21.15.91:0/93090060 conn(0x7fc808071da0 msgr2=0x7fc8080721b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:21.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.916+0000 7fc810561640 1 -- 172.21.15.91:0/93090060 shutdown_connections 2023-11-27T18:14:21.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.916+0000 7fc810561640 1 -- 172.21.15.91:0/93090060 wait complete. 2023-11-27T18:14:21.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.920+0000 7fc810561640 1 Processor -- start 2023-11-27T18:14:21.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.920+0000 7fc810561640 1 -- start start 2023-11-27T18:14:21.917 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.920+0000 7fc810561640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc8080c54f0 0x7fc8080c9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:21.917 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.920+0000 7fc810561640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8080c58d0 0x7fc80813a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:21.917 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.920+0000 7fc810561640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc80815ad00 0x7fc8081ed740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:21.917 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.920+0000 7fc810561640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8080ca550 con 0x7fc80815ad00 2023-11-27T18:14:21.917 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.920+0000 7fc810561640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc808141960 con 0x7fc8080c58d0 2023-11-27T18:14:21.917 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.920+0000 7fc810561640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8080cb980 con 0x7fc8080c54f0 2023-11-27T18:14:21.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.920+0000 7fc80e2fd640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc8080c54f0 0x7fc8080c9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:21.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.920+0000 7fc80dafc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8080c58d0 0x7fc80813a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:21.919 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.920+0000 7fc80e2fd640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc8080c54f0 0x7fc8080c9980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.91:58612/0 (socket says 172.21.15.91:58612) 2023-11-27T18:14:21.919 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.920+0000 7fc80e2fd640 1 -- 172.21.15.91:0/2102401699 learned_addr learned my addr 172.21.15.91:0/2102401699 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:21.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.932+0000 7fc80e2fd640 1 -- 172.21.15.91:0/2102401699 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8080c58d0 msgr2=0x7fc80813a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:21.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.932+0000 7fc80e2fd640 1 --2- 172.21.15.91:0/2102401699 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8080c58d0 0x7fc80813a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:21.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.932+0000 7fc80e2fd640 1 -- 172.21.15.91:0/2102401699 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc80815ad00 msgr2=0x7fc8081ed740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:21.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.932+0000 7fc80e2fd640 1 --2- 172.21.15.91:0/2102401699 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc80815ad00 0x7fc8081ed740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:21.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.932+0000 7fc80e2fd640 1 -- 172.21.15.91:0/2102401699 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f80094d0 con 0x7fc8080c54f0 2023-11-27T18:14:21.936 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.940+0000 7fc80e2fd640 1 --2- 172.21.15.91:0/2102401699 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc8080c54f0 0x7fc8080c9980 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc7f801b8c0 tx=0x7fc7f801ba50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:21.948 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.948+0000 7fc7feffd640 1 -- 172.21.15.91:0/2102401699 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f80b0e60 con 0x7fc8080c54f0 2023-11-27T18:14:21.948 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.948+0000 7fc7feffd640 1 -- 172.21.15.91:0/2102401699 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f80ba440 con 0x7fc8080c54f0 2023-11-27T18:14:21.948 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.948+0000 7fc7feffd640 1 -- 172.21.15.91:0/2102401699 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f80ba7f0 con 0x7fc8080c54f0 2023-11-27T18:14:21.948 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.948+0000 7fc810561640 1 -- 172.21.15.91:0/2102401699 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8080cb3c0 con 0x7fc8080c54f0 2023-11-27T18:14:21.948 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.948+0000 7fc810561640 1 -- 172.21.15.91:0/2102401699 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc80813ec70 con 0x7fc8080c54f0 2023-11-27T18:14:21.948 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:21.952+0000 7fc810561640 1 -- 172.21.15.91:0/2102401699 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc80813ec70 con 0x7fc8080c54f0 2023-11-27T18:14:22.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:22.388+0000 7fc7feffd640 1 -- 172.21.15.91:0/2102401699 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fc7f80ba950 con 0x7fc8080c54f0 2023-11-27T18:14:22.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:22.388+0000 7fc7feffd640 1 --2- 172.21.15.91:0/2102401699 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fc7ec066840 0x7fc7ec068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:22.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:22.388+0000 7fc80dafc640 1 --2- 172.21.15.91:0/2102401699 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fc7ec066840 0x7fc7ec068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:22.387 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:22.392+0000 7fc80dafc640 1 --2- 172.21.15.91:0/2102401699 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fc7ec066840 0x7fc7ec068d00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc808158430 tx=0x7fc804007e40 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:22.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:22.396+0000 7fc7feffd640 1 -- 172.21.15.91:0/2102401699 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc7f80f4210 con 0x7fc8080c54f0 2023-11-27T18:14:22.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:22.428+0000 7fc7feffd640 1 -- 172.21.15.91:0/2102401699 <== mon.2 v2:172.21.15.94:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fc7f80efe50 con 0x7fc8080c54f0 2023-11-27T18:14:22.620 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:22.624+0000 7fc810561640 1 -- 172.21.15.91:0/2102401699 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc80813ec70 con 0x7fc8080c54f0 2023-11-27T18:14:22.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:22.880+0000 7fc7feffd640 1 -- 172.21.15.91:0/2102401699 <== mon.2 v2:172.21.15.94:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc7f80b5030 con 0x7fc8080c54f0 2023-11-27T18:14:22.877 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 1 2023-11-27T18:14:22.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:22.880+0000 7fc810561640 1 -- 172.21.15.91:0/2102401699 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fc7ec066840 msgr2=0x7fc7ec068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:22.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:22.880+0000 7fc810561640 1 --2- 172.21.15.91:0/2102401699 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fc7ec066840 0x7fc7ec068d00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc808158430 tx=0x7fc804007e40 comp rx=0 tx=0).stop 2023-11-27T18:14:22.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:22.880+0000 7fc810561640 1 -- 172.21.15.91:0/2102401699 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc8080c54f0 msgr2=0x7fc8080c9980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:22.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:22.880+0000 7fc810561640 1 --2- 172.21.15.91:0/2102401699 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc8080c54f0 0x7fc8080c9980 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc7f801b8c0 tx=0x7fc7f801ba50 comp rx=0 tx=0).stop 2023-11-27T18:14:22.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:22.884+0000 7fc810561640 1 -- 172.21.15.91:0/2102401699 shutdown_connections 2023-11-27T18:14:22.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:22.884+0000 7fc810561640 1 --2- 172.21.15.91:0/2102401699 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fc7ec066840 0x7fc7ec068d00 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:22.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:22.884+0000 7fc810561640 1 --2- 172.21.15.91:0/2102401699 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc80815ad00 0x7fc8081ed740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:22.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:22.884+0000 7fc810561640 1 --2- 172.21.15.91:0/2102401699 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8080c58d0 0x7fc80813a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:22.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:22.884+0000 7fc810561640 1 --2- 172.21.15.91:0/2102401699 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc8080c54f0 0x7fc8080c9980 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:22.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:22.884+0000 7fc810561640 1 -- 172.21.15.91:0/2102401699 >> 172.21.15.91:0/2102401699 conn(0x7fc808071da0 msgr2=0x7fc80806fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:22.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:22.884+0000 7fc810561640 1 -- 172.21.15.91:0/2102401699 shutdown_connections 2023-11-27T18:14:22.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:22.884+0000 7fc810561640 1 -- 172.21.15.91:0/2102401699 wait complete. 2023-11-27T18:14:22.900 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T18:14:23.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.028+0000 7fc1b6fe1640 1 Processor -- start 2023-11-27T18:14:23.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.028+0000 7fc1b6fe1640 1 -- start start 2023-11-27T18:14:23.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.032+0000 7fc1b6fe1640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc1b0070ce0 0x7fc1b0156d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:23.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.032+0000 7fc1b6fe1640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1b0156890 con 0x7fc1b00723f0 2023-11-27T18:14:23.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.032+0000 7fc1b6fe1640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1b0157260 con 0x7fc1b0071a60 2023-11-27T18:14:23.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.032+0000 7fc1b6fe1640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1b0156260 con 0x7fc1b0070ce0 2023-11-27T18:14:23.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.032+0000 7fc1b557e640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fc1b00723f0 0x7fc1b006a520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:53600/0 (socket says 172.21.15.91:53600) 2023-11-27T18:14:23.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.032+0000 7fc1b557e640 1 -- 172.21.15.91:0/2742226754 learned_addr learned my addr 172.21.15.91:0/2742226754 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:14:23.029 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.032+0000 7fc1affff640 1 --2- 172.21.15.91:0/2742226754 >> v2:172.21.15.94:3300/0 conn(0x7fc1b0070ce0 0x7fc1b0156d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:23.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.036+0000 7fc1af7fe640 1 -- 172.21.15.91:0/2742226754 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3775869303 0 0) 0x7fc1b0156890 con 0x7fc1b00723f0 2023-11-27T18:14:23.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.036+0000 7fc1af7fe640 1 -- 172.21.15.91:0/2742226754 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc198003530 con 0x7fc1b00723f0 2023-11-27T18:14:23.036 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.040+0000 7fc1af7fe640 1 -- 172.21.15.91:0/2742226754 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4031399063 0 0) 0x7fc198003530 con 0x7fc1b00723f0 2023-11-27T18:14:23.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.040+0000 7fc1af7fe640 1 -- 172.21.15.91:0/2742226754 >> v2:172.21.15.94:3300/0 conn(0x7fc1b0070ce0 msgr2=0x7fc1b0156d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:23.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.040+0000 7fc1af7fe640 1 --2- 172.21.15.91:0/2742226754 >> v2:172.21.15.94:3300/0 conn(0x7fc1b0070ce0 0x7fc1b0156d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:23.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.040+0000 7fc1af7fe640 1 -- 172.21.15.91:0/2742226754 >> v1:172.21.15.94:6789/0 conn(0x7fc1b0071a60 legacy=0x7fc1b0159850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:23.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.040+0000 7fc1af7fe640 1 -- 172.21.15.91:0/2742226754 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b0071e40 con 0x7fc1b00723f0 2023-11-27T18:14:23.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.040+0000 7fc1af7fe640 1 -- 172.21.15.91:0/2742226754 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3378743932 0 0) 0x7fc1a8001a00 con 0x7fc1b00723f0 2023-11-27T18:14:23.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.040+0000 7fc1af7fe640 1 -- 172.21.15.91:0/2742226754 >> v1:172.21.15.91:6789/0 conn(0x7fc1b00723f0 legacy=0x7fc1b006a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:23.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.040+0000 7fc1af7fe640 1 --2- 172.21.15.91:0/2742226754 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1980039d0 0x7fc198003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:23.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.040+0000 7fc1af7fe640 1 --2- 172.21.15.91:0/2742226754 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc1980047d0 0x7fc198004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:23.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.040+0000 7fc1af7fe640 1 --2- 172.21.15.91:0/2742226754 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc198005190 0x7fc19800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:23.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.040+0000 7fc1af7fe640 1 -- 172.21.15.91:0/2742226754 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b0156260 con 0x7fc1980047d0 2023-11-27T18:14:23.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.040+0000 7fc1af7fe640 1 -- 172.21.15.91:0/2742226754 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc19800c090 con 0x7fc1980039d0 2023-11-27T18:14:23.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.040+0000 7fc1af7fe640 1 -- 172.21.15.91:0/2742226754 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc19800c250 con 0x7fc198005190 2023-11-27T18:14:23.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.040+0000 7fc1b557e640 1 --2- 172.21.15.91:0/2742226754 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc198005190 0x7fc19800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:23.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.040+0000 7fc1affff640 1 --2- 172.21.15.91:0/2742226754 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc1980047d0 0x7fc198004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:23.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.044+0000 7fc1affff640 1 -- 172.21.15.91:0/2742226754 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc198005190 msgr2=0x7fc19800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:23.043 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.044+0000 7fc1affff640 1 --2- 172.21.15.91:0/2742226754 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc198005190 0x7fc19800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:23.043 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.044+0000 7fc1affff640 1 -- 172.21.15.91:0/2742226754 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1980039d0 msgr2=0x7fc198003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:23.043 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.044+0000 7fc1affff640 1 --2- 172.21.15.91:0/2742226754 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1980039d0 0x7fc198003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:23.043 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.044+0000 7fc1affff640 1 -- 172.21.15.91:0/2742226754 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc198003530 con 0x7fc1980047d0 2023-11-27T18:14:23.043 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.044+0000 7fc1b557e640 1 -- 172.21.15.91:0/2742226754 reap_dead start 2023-11-27T18:14:23.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.048+0000 7fc1affff640 1 --2- 172.21.15.91:0/2742226754 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc1980047d0 0x7fc198004c50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4009ae0 tx=0x7fc1a401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51ab85d8e1141619 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:23.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.052+0000 7fc1af7fe640 1 -- 172.21.15.91:0/2742226754 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a40a5640 con 0x7fc1980047d0 2023-11-27T18:14:23.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.052+0000 7fc1af7fe640 1 -- 172.21.15.91:0/2742226754 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a40a57a0 con 0x7fc1980047d0 2023-11-27T18:14:23.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.052+0000 7fc1af7fe640 1 -- 172.21.15.91:0/2742226754 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a40a5b50 con 0x7fc1980047d0 2023-11-27T18:14:23.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.052+0000 7fc1b6fe1640 1 -- 172.21.15.91:0/2742226754 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc1980047d0 msgr2=0x7fc198004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:23.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.052+0000 7fc1b6fe1640 1 --2- 172.21.15.91:0/2742226754 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc1980047d0 0x7fc198004c50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4009ae0 tx=0x7fc1a401ca50 comp rx=0 tx=0).stop 2023-11-27T18:14:23.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.052+0000 7fc1b6fe1640 1 -- 172.21.15.91:0/2742226754 shutdown_connections 2023-11-27T18:14:23.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.052+0000 7fc1b6fe1640 1 --2- 172.21.15.91:0/2742226754 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc1980047d0 0x7fc198004c50 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:23.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.052+0000 7fc1b6fe1640 1 -- 172.21.15.91:0/2742226754 >> 172.21.15.91:0/2742226754 conn(0x7fc1b00ca9d0 msgr2=0x7fc1b00cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:23.052 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.052+0000 7fc1b6fe1640 1 -- 172.21.15.91:0/2742226754 shutdown_connections 2023-11-27T18:14:23.052 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.052+0000 7fc1b6fe1640 1 -- 172.21.15.91:0/2742226754 wait complete. 2023-11-27T18:14:23.052 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.056+0000 7fc1b6fe1640 1 Processor -- start 2023-11-27T18:14:23.052 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.056+0000 7fc1b6fe1640 1 -- start start 2023-11-27T18:14:23.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.056+0000 7fc1b6fe1640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc1980047d0 0x7fc1b01eeff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:23.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.056+0000 7fc1b6fe1640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1b0157420 0x7fc1b01f0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:23.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.056+0000 7fc1b6fe1640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc1b0159730 0x7fc1b014ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:23.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.056+0000 7fc1b6fe1640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b01588e0 con 0x7fc1b0159730 2023-11-27T18:14:23.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.056+0000 7fc1b6fe1640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b01579f0 con 0x7fc1b0157420 2023-11-27T18:14:23.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.056+0000 7fc1b6fe1640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b0157cd0 con 0x7fc1980047d0 2023-11-27T18:14:23.054 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.056+0000 7fc1b557e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc1b0159730 0x7fc1b014ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:23.054 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.056+0000 7fc1b557e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc1b0159730 0x7fc1b014ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:46110/0 (socket says 172.21.15.91:46110) 2023-11-27T18:14:23.054 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.056+0000 7fc1b557e640 1 -- 172.21.15.91:0/485074802 learned_addr learned my addr 172.21.15.91:0/485074802 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:23.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.056+0000 7fc1b4d7d640 1 --2- 172.21.15.91:0/485074802 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc1980047d0 0x7fc1b01eeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:23.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.056+0000 7fc1affff640 1 --2- 172.21.15.91:0/485074802 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1b0157420 0x7fc1b01f0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:23.058 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.060+0000 7fc1b557e640 1 -- 172.21.15.91:0/485074802 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc1980047d0 msgr2=0x7fc1b01eeff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:23.058 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.060+0000 7fc1b557e640 1 --2- 172.21.15.91:0/485074802 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc1980047d0 0x7fc1b01eeff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:23.058 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.060+0000 7fc1b557e640 1 -- 172.21.15.91:0/485074802 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1b0157420 msgr2=0x7fc1b01f0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:23.058 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.060+0000 7fc1b557e640 1 --2- 172.21.15.91:0/485074802 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1b0157420 0x7fc1b01f0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:23.058 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.060+0000 7fc1b557e640 1 -- 172.21.15.91:0/485074802 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b0157fb0 con 0x7fc1b0159730 2023-11-27T18:14:23.061 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.064+0000 7fc1b557e640 1 --2- 172.21.15.91:0/485074802 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc1b0159730 0x7fc1b014ee00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc1b00c1da0 tx=0x7fc1a8007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:23.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.068+0000 7fc1ad7fa640 1 -- 172.21.15.91:0/485074802 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a8015610 con 0x7fc1b0159730 2023-11-27T18:14:23.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.068+0000 7fc1ad7fa640 1 -- 172.21.15.91:0/485074802 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a8015770 con 0x7fc1b0159730 2023-11-27T18:14:23.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.068+0000 7fc1b6fe1640 1 -- 172.21.15.91:0/485074802 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1b0158290 con 0x7fc1b0159730 2023-11-27T18:14:23.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.068+0000 7fc1ad7fa640 1 -- 172.21.15.91:0/485074802 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a8015b00 con 0x7fc1b0159730 2023-11-27T18:14:23.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.068+0000 7fc1b6fe1640 1 -- 172.21.15.91:0/485074802 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1b0150820 con 0x7fc1b0159730 2023-11-27T18:14:23.066 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.068+0000 7fc1b6fe1640 1 -- 172.21.15.91:0/485074802 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1b004e850 con 0x7fc1b0159730 2023-11-27T18:14:23.086 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.088+0000 7fc1ad7fa640 1 -- 172.21.15.91:0/485074802 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fc1a8015c60 con 0x7fc1b0159730 2023-11-27T18:14:23.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.088+0000 7fc1ad7fa640 1 --2- 172.21.15.91:0/485074802 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fc19c066840 0x7fc19c068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:23.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.088+0000 7fc1b4d7d640 1 --2- 172.21.15.91:0/485074802 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fc19c066840 0x7fc19c068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:23.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.088+0000 7fc1b4d7d640 1 --2- 172.21.15.91:0/485074802 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fc19c066840 0x7fc19c068d00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0001170 tx=0x7fc1a0009040 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:23.089 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.092+0000 7fc1ad7fa640 1 -- 172.21.15.91:0/485074802 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc1a80591e0 con 0x7fc1b0159730 2023-11-27T18:14:23.439 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.440+0000 7fc1ad7fa640 1 -- 172.21.15.91:0/485074802 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fc1a8054e20 con 0x7fc1b0159730 2023-11-27T18:14:23.610 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.612+0000 7fc1b6fe1640 1 -- 172.21.15.91:0/485074802 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc1b00c55b0 con 0x7fc1b0159730 2023-11-27T18:14:23.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.668+0000 7fc1ad7fa640 1 -- 172.21.15.91:0/485074802 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v32) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc1a8058440 con 0x7fc1b0159730 2023-11-27T18:14:23.666 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T18:14:23.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.672+0000 7fc1b6fe1640 1 -- 172.21.15.91:0/485074802 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fc19c066840 msgr2=0x7fc19c068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:23.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.672+0000 7fc1b6fe1640 1 --2- 172.21.15.91:0/485074802 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fc19c066840 0x7fc19c068d00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0001170 tx=0x7fc1a0009040 comp rx=0 tx=0).stop 2023-11-27T18:14:23.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.672+0000 7fc1b6fe1640 1 -- 172.21.15.91:0/485074802 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc1b0159730 msgr2=0x7fc1b014ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:23.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.672+0000 7fc1b6fe1640 1 --2- 172.21.15.91:0/485074802 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc1b0159730 0x7fc1b014ee00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc1b00c1da0 tx=0x7fc1a8007700 comp rx=0 tx=0).stop 2023-11-27T18:14:23.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.672+0000 7fc1b6fe1640 1 -- 172.21.15.91:0/485074802 shutdown_connections 2023-11-27T18:14:23.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.672+0000 7fc1b6fe1640 1 --2- 172.21.15.91:0/485074802 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fc19c066840 0x7fc19c068d00 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:23.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.672+0000 7fc1b6fe1640 1 --2- 172.21.15.91:0/485074802 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc1b0159730 0x7fc1b014ee00 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:23.670 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.672+0000 7fc1b6fe1640 1 --2- 172.21.15.91:0/485074802 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1b0157420 0x7fc1b01f0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:23.670 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.672+0000 7fc1b6fe1640 1 --2- 172.21.15.91:0/485074802 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc1980047d0 0x7fc1b01eeff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:23.670 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.672+0000 7fc1b6fe1640 1 -- 172.21.15.91:0/485074802 >> 172.21.15.91:0/485074802 conn(0x7fc1b00ca9d0 msgr2=0x7fc1b0154760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:23.670 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.672+0000 7fc1b6fe1640 1 -- 172.21.15.91:0/485074802 shutdown_connections 2023-11-27T18:14:23.670 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.672+0000 7fc1b6fe1640 1 -- 172.21.15.91:0/485074802 wait complete. 2023-11-27T18:14:23.688 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T18:14:23.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.820+0000 7fe35f0bc640 1 Processor -- start 2023-11-27T18:14:23.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.820+0000 7fe35f0bc640 1 -- start start 2023-11-27T18:14:23.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.820+0000 7fe35f0bc640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe358153c40 0x7fe3580ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:23.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.820+0000 7fe35f0bc640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe3580cc550 0x7fe3580ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:23.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.820+0000 7fe35f0bc640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3580cd980 con 0x7fe358153860 2023-11-27T18:14:23.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.820+0000 7fe35f0bc640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe35815a650 con 0x7fe3580cc550 2023-11-27T18:14:23.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.820+0000 7fe35f0bc640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3580c9880 con 0x7fe358153c40 2023-11-27T18:14:23.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.820+0000 7fe35ce58640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fe358153860 0x7fe358159f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:53616/0 (socket says 172.21.15.91:53616) 2023-11-27T18:14:23.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.820+0000 7fe35ce58640 1 -- 172.21.15.91:0/3263040275 learned_addr learned my addr 172.21.15.91:0/3263040275 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:14:23.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.824+0000 7fe3577fe640 1 -- 172.21.15.91:0/3263040275 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2278795729 0 0) 0x7fe3580cd980 con 0x7fe358153860 2023-11-27T18:14:23.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.824+0000 7fe3577fe640 1 -- 172.21.15.91:0/3263040275 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe340003530 con 0x7fe358153860 2023-11-27T18:14:23.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.828+0000 7fe3577fe640 1 -- 172.21.15.91:0/3263040275 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 347814851 0 0) 0x7fe340003530 con 0x7fe358153860 2023-11-27T18:14:23.827 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.828+0000 7fe3577fe640 1 -- 172.21.15.91:0/3263040275 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe358153c40 msgr2=0x7fe3580ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:23.827 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.828+0000 7fe3577fe640 1 --2- 172.21.15.91:0/3263040275 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe358153c40 0x7fe3580ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:23.827 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.828+0000 7fe3577fe640 1 -- 172.21.15.91:0/3263040275 >> v2:172.21.15.94:3300/0 conn(0x7fe3580cc550 msgr2=0x7fe3580ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:23.827 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.828+0000 7fe3577fe640 1 --2- 172.21.15.91:0/3263040275 >> v2:172.21.15.94:3300/0 conn(0x7fe3580cc550 0x7fe3580ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:23.828 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.828+0000 7fe3577fe640 1 -- 172.21.15.91:0/3263040275 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3580cd6c0 con 0x7fe358153860 2023-11-27T18:14:23.828 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.828+0000 7fe3577fe640 1 -- 172.21.15.91:0/3263040275 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3378743932 0 0) 0x7fe348001680 con 0x7fe358153860 2023-11-27T18:14:23.828 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.828+0000 7fe3577fe640 1 -- 172.21.15.91:0/3263040275 >> v1:172.21.15.91:6789/0 conn(0x7fe358153860 legacy=0x7fe358159f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:23.828 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.828+0000 7fe3577fe640 1 --2- 172.21.15.91:0/3263040275 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe340003980 0x7fe340003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:23.828 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.828+0000 7fe3577fe640 1 --2- 172.21.15.91:0/3263040275 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe358153c40 0x7fe3400047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:23.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.828+0000 7fe3577fe640 1 --2- 172.21.15.91:0/3263040275 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe340004e30 0x7fe34000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:23.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.828+0000 7fe3577fe640 1 -- 172.21.15.91:0/3263040275 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe35815a650 con 0x7fe340004e30 2023-11-27T18:14:23.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.828+0000 7fe3577fe640 1 -- 172.21.15.91:0/3263040275 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3580c9880 con 0x7fe340003980 2023-11-27T18:14:23.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.828+0000 7fe3577fe640 1 -- 172.21.15.91:0/3263040275 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe340005560 con 0x7fe358153c40 2023-11-27T18:14:23.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.832+0000 7fe35d659640 1 --2- 172.21.15.91:0/3263040275 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe340004e30 0x7fe34000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:23.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.832+0000 7fe35d659640 1 -- 172.21.15.91:0/3263040275 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe358153c40 msgr2=0x7fe3400047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:23.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.832+0000 7fe35d659640 1 --2- 172.21.15.91:0/3263040275 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe358153c40 0x7fe3400047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:23.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.832+0000 7fe35d659640 1 -- 172.21.15.91:0/3263040275 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe340003980 msgr2=0x7fe340003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:23.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.832+0000 7fe35d659640 1 --2- 172.21.15.91:0/3263040275 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe340003980 0x7fe340003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:23.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.832+0000 7fe35d659640 1 -- 172.21.15.91:0/3263040275 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe340003530 con 0x7fe340004e30 2023-11-27T18:14:23.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.836+0000 7fe35d659640 1 --2- 172.21.15.91:0/3263040275 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe340004e30 0x7fe34000b990 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe35806aff0 tx=0x7fe35001cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f6ecde469642581 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:23.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.840+0000 7fe3577fe640 1 -- 172.21.15.91:0/3263040275 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3500a5c00 con 0x7fe340004e30 2023-11-27T18:14:23.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.840+0000 7fe3577fe640 1 -- 172.21.15.91:0/3263040275 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3500a5d80 con 0x7fe340004e30 2023-11-27T18:14:23.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.840+0000 7fe3577fe640 1 -- 172.21.15.91:0/3263040275 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3500ad680 con 0x7fe340004e30 2023-11-27T18:14:23.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.840+0000 7fe35f0bc640 1 -- 172.21.15.91:0/3263040275 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe340004e30 msgr2=0x7fe34000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:23.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.840+0000 7fe35f0bc640 1 --2- 172.21.15.91:0/3263040275 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe340004e30 0x7fe34000b990 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe35806aff0 tx=0x7fe35001cbf0 comp rx=0 tx=0).stop 2023-11-27T18:14:23.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.840+0000 7fe35d659640 1 -- 172.21.15.91:0/3263040275 reap_dead start 2023-11-27T18:14:23.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.840+0000 7fe35f0bc640 1 -- 172.21.15.91:0/3263040275 shutdown_connections 2023-11-27T18:14:23.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.840+0000 7fe35f0bc640 1 -- 172.21.15.91:0/3263040275 >> 172.21.15.91:0/3263040275 conn(0x7fe3580b08e0 msgr2=0x7fe3580b0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:23.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.840+0000 7fe35f0bc640 1 -- 172.21.15.91:0/3263040275 shutdown_connections 2023-11-27T18:14:23.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.840+0000 7fe35f0bc640 1 -- 172.21.15.91:0/3263040275 wait complete. 2023-11-27T18:14:23.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.844+0000 7fe35f0bc640 1 Processor -- start 2023-11-27T18:14:23.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.844+0000 7fe35f0bc640 1 -- start start 2023-11-27T18:14:23.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.844+0000 7fe35f0bc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe3581ef650 0x7fe3581efa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:23.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.844+0000 7fe35f0bc640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe3581f2b50 0x7fe3581f2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:23.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.844+0000 7fe35f0bc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe35806cba0 0x7fe35806d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:23.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.844+0000 7fe35f0bc640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe35814d1d0 con 0x7fe35806cba0 2023-11-27T18:14:23.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.844+0000 7fe35f0bc640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe35814b2d0 con 0x7fe3581ef650 2023-11-27T18:14:23.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.844+0000 7fe35f0bc640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3581eef20 con 0x7fe3581f2b50 2023-11-27T18:14:23.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.844+0000 7fe35d659640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe35806cba0 0x7fe35806d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:23.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.844+0000 7fe35d659640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe35806cba0 0x7fe35806d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:46128/0 (socket says 172.21.15.91:46128) 2023-11-27T18:14:23.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.844+0000 7fe35d659640 1 -- 172.21.15.91:0/2744684316 learned_addr learned my addr 172.21.15.91:0/2744684316 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:23.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.848+0000 7fe35d659640 1 -- 172.21.15.91:0/2744684316 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe3581f2b50 msgr2=0x7fe3581f2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:23.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.848+0000 7fe35d659640 1 --2- 172.21.15.91:0/2744684316 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe3581f2b50 0x7fe3581f2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:23.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.848+0000 7fe35d659640 1 -- 172.21.15.91:0/2744684316 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe3581ef650 msgr2=0x7fe3581efa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:23.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.848+0000 7fe35d659640 1 --2- 172.21.15.91:0/2744684316 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe3581ef650 0x7fe3581efa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:23.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.848+0000 7fe35d659640 1 -- 172.21.15.91:0/2744684316 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3580b3fb0 con 0x7fe35806cba0 2023-11-27T18:14:23.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.852+0000 7fe35d659640 1 --2- 172.21.15.91:0/2744684316 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe35806cba0 0x7fe35806d020 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe35001c660 tx=0x7fe340005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:23.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.856+0000 7fe3557fa640 1 -- 172.21.15.91:0/2744684316 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe350004270 con 0x7fe35806cba0 2023-11-27T18:14:23.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.856+0000 7fe3557fa640 1 -- 172.21.15.91:0/2744684316 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3500043f0 con 0x7fe35806cba0 2023-11-27T18:14:23.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.856+0000 7fe3557fa640 1 -- 172.21.15.91:0/2744684316 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3500047a0 con 0x7fe35806cba0 2023-11-27T18:14:23.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.856+0000 7fe35f0bc640 1 -- 172.21.15.91:0/2744684316 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe35814cef0 con 0x7fe35806cba0 2023-11-27T18:14:23.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.856+0000 7fe35f0bc640 1 -- 172.21.15.91:0/2744684316 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3580b47e0 con 0x7fe35806cba0 2023-11-27T18:14:23.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.856+0000 7fe35f0bc640 1 -- 172.21.15.91:0/2744684316 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe358074ac0 con 0x7fe35806cba0 2023-11-27T18:14:23.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.880+0000 7fe3557fa640 1 -- 172.21.15.91:0/2744684316 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fe3500c3460 con 0x7fe35806cba0 2023-11-27T18:14:23.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.880+0000 7fe3557fa640 1 --2- 172.21.15.91:0/2744684316 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe344066870 0x7fe344068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:23.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.880+0000 7fe35ce58640 1 --2- 172.21.15.91:0/2744684316 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe344066870 0x7fe344068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:23.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.880+0000 7fe35ce58640 1 --2- 172.21.15.91:0/2744684316 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe344066870 0x7fe344068d30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe3480079a0 tx=0x7fe3480015b0 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:23.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:23.884+0000 7fe3557fa640 1 -- 172.21.15.91:0/2744684316 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe3500f13b0 con 0x7fe35806cba0 2023-11-27T18:14:24.151 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.152+0000 7fe3557fa640 1 -- 172.21.15.91:0/2744684316 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fe3500ecff0 con 0x7fe35806cba0 2023-11-27T18:14:24.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.324+0000 7fe35f0bc640 1 -- 172.21.15.91:0/2744684316 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe3580b49d0 con 0x7fe35806cba0 2023-11-27T18:14:24.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.332+0000 7fe3557fa640 1 -- 172.21.15.91:0/2744684316 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v32) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe3500b20a0 con 0x7fe35806cba0 2023-11-27T18:14:24.330 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-11-27T18:14:24.333 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.336+0000 7fe35f0bc640 1 -- 172.21.15.91:0/2744684316 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe344066870 msgr2=0x7fe344068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:24.333 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.336+0000 7fe35f0bc640 1 --2- 172.21.15.91:0/2744684316 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe344066870 0x7fe344068d30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe3480079a0 tx=0x7fe3480015b0 comp rx=0 tx=0).stop 2023-11-27T18:14:24.333 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.336+0000 7fe35f0bc640 1 -- 172.21.15.91:0/2744684316 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe35806cba0 msgr2=0x7fe35806d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:24.333 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.336+0000 7fe35f0bc640 1 --2- 172.21.15.91:0/2744684316 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe35806cba0 0x7fe35806d020 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe35001c660 tx=0x7fe340005800 comp rx=0 tx=0).stop 2023-11-27T18:14:24.333 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.336+0000 7fe35f0bc640 1 -- 172.21.15.91:0/2744684316 shutdown_connections 2023-11-27T18:14:24.334 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.336+0000 7fe35f0bc640 1 --2- 172.21.15.91:0/2744684316 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe344066870 0x7fe344068d30 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:24.334 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.336+0000 7fe35f0bc640 1 --2- 172.21.15.91:0/2744684316 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe3581f2b50 0x7fe3581f2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:24.334 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.336+0000 7fe35f0bc640 1 --2- 172.21.15.91:0/2744684316 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe35806cba0 0x7fe35806d020 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:24.334 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.336+0000 7fe35f0bc640 1 --2- 172.21.15.91:0/2744684316 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe3581ef650 0x7fe3581efa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:24.334 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.336+0000 7fe35f0bc640 1 -- 172.21.15.91:0/2744684316 >> 172.21.15.91:0/2744684316 conn(0x7fe3580b08e0 msgr2=0x7fe35814e750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:24.335 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.336+0000 7fe35f0bc640 1 -- 172.21.15.91:0/2744684316 shutdown_connections 2023-11-27T18:14:24.335 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.336+0000 7fe35f0bc640 1 -- 172.21.15.91:0/2744684316 wait complete. 2023-11-27T18:14:24.350 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-27T18:14:24.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.476+0000 7fe563e1f640 1 Processor -- start 2023-11-27T18:14:24.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.476+0000 7fe563e1f640 1 -- start start 2023-11-27T18:14:24.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.476+0000 7fe563e1f640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe55c1598e0 0x7fe55c156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:24.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.476+0000 7fe563e1f640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe55c157010 0x7fe55c06a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:24.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.476+0000 7fe563e1f640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe55c072b90 con 0x7fe55c13f640 2023-11-27T18:14:24.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.476+0000 7fe563e1f640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe55c156640 con 0x7fe55c157010 2023-11-27T18:14:24.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.476+0000 7fe563e1f640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe55c070ce0 con 0x7fe55c1598e0 2023-11-27T18:14:24.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.476+0000 7fe5623bc640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe55c157010 0x7fe55c06a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:24.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.476+0000 7fe5613ba640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe55c1598e0 0x7fe55c156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:24.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.480+0000 7fe5623bc640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe55c157010 0x7fe55c06a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.91:59054/0 (socket says 172.21.15.91:59054) 2023-11-27T18:14:24.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.480+0000 7fe5623bc640 1 -- 172.21.15.91:0/2345631953 learned_addr learned my addr 172.21.15.91:0/2345631953 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:24.482 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.484+0000 7fe5613ba640 1 -- 172.21.15.91:0/2345631953 >> v2:172.21.15.94:3300/0 conn(0x7fe55c157010 msgr2=0x7fe55c06a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:24.482 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.484+0000 7fe5613ba640 1 --2- 172.21.15.91:0/2345631953 >> v2:172.21.15.94:3300/0 conn(0x7fe55c157010 0x7fe55c06a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:24.482 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.484+0000 7fe5613ba640 1 -- 172.21.15.91:0/2345631953 >> v1:172.21.15.94:6789/0 conn(0x7fe55c13f640 legacy=0x7fe55c072480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:24.482 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.484+0000 7fe5613ba640 1 -- 172.21.15.91:0/2345631953 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe55c1562f0 con 0x7fe55c1598e0 2023-11-27T18:14:24.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.488+0000 7fe5613ba640 1 --2- 172.21.15.91:0/2345631953 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe55c1598e0 0x7fe55c156ad0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe54c0097c0 tx=0x7fe54c01c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=679f779e8e5061da server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:24.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.500+0000 7fe560bb9640 1 -- 172.21.15.91:0/2345631953 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54c0ab600 con 0x7fe55c1598e0 2023-11-27T18:14:24.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.500+0000 7fe560bb9640 1 -- 172.21.15.91:0/2345631953 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe54c0a7050 con 0x7fe55c1598e0 2023-11-27T18:14:24.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.500+0000 7fe560bb9640 1 -- 172.21.15.91:0/2345631953 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54c0ab980 con 0x7fe55c1598e0 2023-11-27T18:14:24.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.500+0000 7fe563e1f640 1 -- 172.21.15.91:0/2345631953 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe55c1598e0 msgr2=0x7fe55c156ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:24.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.500+0000 7fe563e1f640 1 --2- 172.21.15.91:0/2345631953 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe55c1598e0 0x7fe55c156ad0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe54c0097c0 tx=0x7fe54c01c410 comp rx=0 tx=0).stop 2023-11-27T18:14:24.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.500+0000 7fe563e1f640 1 -- 172.21.15.91:0/2345631953 shutdown_connections 2023-11-27T18:14:24.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.500+0000 7fe563e1f640 1 --2- 172.21.15.91:0/2345631953 >> v2:172.21.15.94:3300/0 conn(0x7fe55c157010 0x7fe55c06a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:24.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.500+0000 7fe563e1f640 1 --2- 172.21.15.91:0/2345631953 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe55c1598e0 0x7fe55c156ad0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:24.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.500+0000 7fe563e1f640 1 -- 172.21.15.91:0/2345631953 >> 172.21.15.91:0/2345631953 conn(0x7fe55c0ca9d0 msgr2=0x7fe55c0cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:24.499 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.500+0000 7fe563e1f640 1 -- 172.21.15.91:0/2345631953 shutdown_connections 2023-11-27T18:14:24.499 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.500+0000 7fe563e1f640 1 -- 172.21.15.91:0/2345631953 wait complete. 2023-11-27T18:14:24.499 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.500+0000 7fe563e1f640 1 Processor -- start 2023-11-27T18:14:24.499 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.500+0000 7fe563e1f640 1 -- start start 2023-11-27T18:14:24.500 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.504+0000 7fe563e1f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe55c13f640 0x7fe55c06e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:24.500 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.504+0000 7fe563e1f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe55c157010 0x7fe55c06eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:24.500 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.504+0000 7fe563e1f640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe55c1598e0 0x7fe55c0c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:24.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.504+0000 7fe563e1f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55c155950 con 0x7fe55c13f640 2023-11-27T18:14:24.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.504+0000 7fe563e1f640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55c0c87d0 con 0x7fe55c157010 2023-11-27T18:14:24.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.504+0000 7fe563e1f640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe55c0c8ab0 con 0x7fe55c1598e0 2023-11-27T18:14:24.502 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.504+0000 7fe561bbb640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe55c13f640 0x7fe55c06e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:24.502 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.504+0000 7fe561bbb640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe55c13f640 0x7fe55c06e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:46138/0 (socket says 172.21.15.91:46138) 2023-11-27T18:14:24.502 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.504+0000 7fe561bbb640 1 -- 172.21.15.91:0/2419741276 learned_addr learned my addr 172.21.15.91:0/2419741276 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:24.502 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.504+0000 7fe5613ba640 1 --2- 172.21.15.91:0/2419741276 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe55c157010 0x7fe55c06eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:24.502 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.504+0000 7fe5623bc640 1 --2- 172.21.15.91:0/2419741276 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe55c1598e0 0x7fe55c0c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:24.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.508+0000 7fe561bbb640 1 -- 172.21.15.91:0/2419741276 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe55c1598e0 msgr2=0x7fe55c0c8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:24.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.508+0000 7fe561bbb640 1 --2- 172.21.15.91:0/2419741276 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe55c1598e0 0x7fe55c0c8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:24.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.508+0000 7fe561bbb640 1 -- 172.21.15.91:0/2419741276 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe55c157010 msgr2=0x7fe55c06eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:24.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.508+0000 7fe561bbb640 1 --2- 172.21.15.91:0/2419741276 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe55c157010 0x7fe55c06eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:24.506 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.508+0000 7fe561bbb640 1 -- 172.21.15.91:0/2419741276 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe54c009420 con 0x7fe55c13f640 2023-11-27T18:14:24.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.512+0000 7fe561bbb640 1 --2- 172.21.15.91:0/2419741276 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe55c13f640 0x7fe55c06e760 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe55800b410 tx=0x7fe55800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:24.518 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.520+0000 7fe5527fc640 1 -- 172.21.15.91:0/2419741276 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe558004020 con 0x7fe55c13f640 2023-11-27T18:14:24.518 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.520+0000 7fe5527fc640 1 -- 172.21.15.91:0/2419741276 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe558004180 con 0x7fe55c13f640 2023-11-27T18:14:24.518 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.520+0000 7fe5527fc640 1 -- 172.21.15.91:0/2419741276 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe558011630 con 0x7fe55c13f640 2023-11-27T18:14:24.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.520+0000 7fe563e1f640 1 -- 172.21.15.91:0/2419741276 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe55c1f29b0 con 0x7fe55c13f640 2023-11-27T18:14:24.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.520+0000 7fe563e1f640 1 -- 172.21.15.91:0/2419741276 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe55c1f2f70 con 0x7fe55c13f640 2023-11-27T18:14:24.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.520+0000 7fe563e1f640 1 -- 172.21.15.91:0/2419741276 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe55c04e850 con 0x7fe55c13f640 2023-11-27T18:14:24.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.544+0000 7fe5527fc640 1 -- 172.21.15.91:0/2419741276 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fe558011790 con 0x7fe55c13f640 2023-11-27T18:14:24.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.544+0000 7fe5527fc640 1 --2- 172.21.15.91:0/2419741276 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe540066840 0x7fe540068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:24.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.544+0000 7fe5613ba640 1 --2- 172.21.15.91:0/2419741276 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe540066840 0x7fe540068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:24.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.544+0000 7fe5613ba640 1 --2- 172.21.15.91:0/2419741276 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe540066840 0x7fe540068d00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe54c0ad000 tx=0x7fe54c008040 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:24.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.548+0000 7fe5527fc640 1 -- 172.21.15.91:0/2419741276 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe5580555c0 con 0x7fe55c13f640 2023-11-27T18:14:24.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.828+0000 7fe5527fc640 1 -- 172.21.15.91:0/2419741276 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fe558051900 con 0x7fe55c13f640 2023-11-27T18:14:24.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:24.996+0000 7fe563e1f640 1 -- 172.21.15.91:0/2419741276 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe55c0c4a30 con 0x7fe55c13f640 2023-11-27T18:14:25.007 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.008+0000 7fe5527fc640 1 -- 172.21.15.91:0/2419741276 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v32) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe558015070 con 0x7fe55c13f640 2023-11-27T18:14:25.007 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T18:14:25.009 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.012+0000 7fe563e1f640 1 -- 172.21.15.91:0/2419741276 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe540066840 msgr2=0x7fe540068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:25.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.012+0000 7fe563e1f640 1 --2- 172.21.15.91:0/2419741276 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe540066840 0x7fe540068d00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe54c0ad000 tx=0x7fe54c008040 comp rx=0 tx=0).stop 2023-11-27T18:14:25.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.012+0000 7fe563e1f640 1 -- 172.21.15.91:0/2419741276 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe55c13f640 msgr2=0x7fe55c06e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:25.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.012+0000 7fe563e1f640 1 --2- 172.21.15.91:0/2419741276 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe55c13f640 0x7fe55c06e760 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe55800b410 tx=0x7fe55800b8d0 comp rx=0 tx=0).stop 2023-11-27T18:14:25.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.012+0000 7fe563e1f640 1 -- 172.21.15.91:0/2419741276 shutdown_connections 2023-11-27T18:14:25.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.012+0000 7fe563e1f640 1 --2- 172.21.15.91:0/2419741276 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe540066840 0x7fe540068d00 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:25.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.012+0000 7fe563e1f640 1 --2- 172.21.15.91:0/2419741276 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe55c1598e0 0x7fe55c0c8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:25.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.012+0000 7fe563e1f640 1 --2- 172.21.15.91:0/2419741276 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe55c157010 0x7fe55c06eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:25.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.012+0000 7fe563e1f640 1 --2- 172.21.15.91:0/2419741276 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe55c13f640 0x7fe55c06e760 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:25.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.012+0000 7fe563e1f640 1 -- 172.21.15.91:0/2419741276 >> 172.21.15.91:0/2419741276 conn(0x7fe55c0ca9d0 msgr2=0x7fe55c070ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:25.011 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.012+0000 7fe563e1f640 1 -- 172.21.15.91:0/2419741276 shutdown_connections 2023-11-27T18:14:25.011 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.012+0000 7fe563e1f640 1 -- 172.21.15.91:0/2419741276 wait complete. 2023-11-27T18:14:25.027 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T18:14:25.145 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.148+0000 7fa05bfce640 1 Processor -- start 2023-11-27T18:14:25.145 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.148+0000 7fa05bfce640 1 -- start start 2023-11-27T18:14:25.146 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.148+0000 7fa05bfce640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa054071910 0x7fa05415a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:25.146 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.148+0000 7fa05bfce640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa054071cf0 0x7fa05406a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:25.146 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.148+0000 7fa05bfce640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0540c6c50 con 0x7fa054072740 2023-11-27T18:14:25.146 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.148+0000 7fa05bfce640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa05415a670 con 0x7fa054071cf0 2023-11-27T18:14:25.146 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.148+0000 7fa05bfce640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa054066780 con 0x7fa054071910 2023-11-27T18:14:25.146 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.148+0000 7fa059569640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa054071cf0 0x7fa05406a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:25.147 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.148+0000 7fa059569640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa054071cf0 0x7fa05406a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:46148/0 (socket says 172.21.15.91:46148) 2023-11-27T18:14:25.147 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.148+0000 7fa059569640 1 -- 172.21.15.91:0/2970283194 learned_addr learned my addr 172.21.15.91:0/2970283194 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:25.147 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.152+0000 7fa059d6a640 1 --2- 172.21.15.91:0/2970283194 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa054071910 0x7fa05415a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:25.149 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.152+0000 7fa059569640 1 -- 172.21.15.91:0/2970283194 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa054071910 msgr2=0x7fa05415a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:25.149 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.152+0000 7fa059569640 1 --2- 172.21.15.91:0/2970283194 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa054071910 0x7fa05415a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:25.149 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.152+0000 7fa059569640 1 -- 172.21.15.91:0/2970283194 >> v1:172.21.15.94:6789/0 conn(0x7fa054072740 legacy=0x7fa0541534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:25.149 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.152+0000 7fa059569640 1 -- 172.21.15.91:0/2970283194 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0540c6ea0 con 0x7fa054071cf0 2023-11-27T18:14:25.153 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.156+0000 7fa059569640 1 --2- 172.21.15.91:0/2970283194 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa054071cf0 0x7fa05406a520 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa0440098a0 tx=0x7fa04401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c9925ca829ce134 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:25.156 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.160+0000 7fa058d68640 1 -- 172.21.15.91:0/2970283194 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0440aa650 con 0x7fa054071cf0 2023-11-27T18:14:25.156 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.160+0000 7fa058d68640 1 -- 172.21.15.91:0/2970283194 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0440aa7b0 con 0x7fa054071cf0 2023-11-27T18:14:25.157 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.160+0000 7fa058d68640 1 -- 172.21.15.91:0/2970283194 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0440aab40 con 0x7fa054071cf0 2023-11-27T18:14:25.157 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.160+0000 7fa05bfce640 1 -- 172.21.15.91:0/2970283194 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa054071cf0 msgr2=0x7fa05406a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:25.157 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.160+0000 7fa05bfce640 1 --2- 172.21.15.91:0/2970283194 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa054071cf0 0x7fa05406a520 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa0440098a0 tx=0x7fa04401c4f0 comp rx=0 tx=0).stop 2023-11-27T18:14:25.157 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.160+0000 7fa05bfce640 1 -- 172.21.15.91:0/2970283194 shutdown_connections 2023-11-27T18:14:25.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.160+0000 7fa05bfce640 1 --2- 172.21.15.91:0/2970283194 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa054071cf0 0x7fa05406a520 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:25.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.160+0000 7fa05bfce640 1 --2- 172.21.15.91:0/2970283194 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa054071910 0x7fa05415a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:25.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.160+0000 7fa05bfce640 1 -- 172.21.15.91:0/2970283194 >> 172.21.15.91:0/2970283194 conn(0x7fa0540cb430 msgr2=0x7fa0540cb840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:25.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.160+0000 7fa05bfce640 1 -- 172.21.15.91:0/2970283194 shutdown_connections 2023-11-27T18:14:25.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.160+0000 7fa05bfce640 1 -- 172.21.15.91:0/2970283194 wait complete. 2023-11-27T18:14:25.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.160+0000 7fa05bfce640 1 Processor -- start 2023-11-27T18:14:25.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.160+0000 7fa05bfce640 1 -- start start 2023-11-27T18:14:25.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.164+0000 7fa05bfce640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa054071910 0x7fa054154d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:25.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.164+0000 7fa05bfce640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa054071cf0 0x7fa054148150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:25.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.164+0000 7fa05bfce640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa054072740 0x7fa054149ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:25.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.164+0000 7fa05bfce640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa054148690 con 0x7fa054071cf0 2023-11-27T18:14:25.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.164+0000 7fa05bfce640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa054154040 con 0x7fa054071910 2023-11-27T18:14:25.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.164+0000 7fa05bfce640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa054154320 con 0x7fa054072740 2023-11-27T18:14:25.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.164+0000 7fa059569640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa054071cf0 0x7fa054148150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:25.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.164+0000 7fa059569640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa054071cf0 0x7fa054148150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:46154/0 (socket says 172.21.15.91:46154) 2023-11-27T18:14:25.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.164+0000 7fa059569640 1 -- 172.21.15.91:0/2650827780 learned_addr learned my addr 172.21.15.91:0/2650827780 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:25.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.164+0000 7fa05a56b640 1 --2- 172.21.15.91:0/2650827780 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa054072740 0x7fa054149ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:25.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.164+0000 7fa059d6a640 1 --2- 172.21.15.91:0/2650827780 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa054071910 0x7fa054154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:25.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.168+0000 7fa059569640 1 -- 172.21.15.91:0/2650827780 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa054072740 msgr2=0x7fa054149ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:25.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.168+0000 7fa059569640 1 --2- 172.21.15.91:0/2650827780 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa054072740 0x7fa054149ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:25.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.168+0000 7fa059569640 1 -- 172.21.15.91:0/2650827780 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa054071910 msgr2=0x7fa054154d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:25.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.168+0000 7fa059569640 1 --2- 172.21.15.91:0/2650827780 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa054071910 0x7fa054154d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:25.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.168+0000 7fa059569640 1 -- 172.21.15.91:0/2650827780 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0440094d0 con 0x7fa054071cf0 2023-11-27T18:14:25.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.168+0000 7fa059569640 1 --2- 172.21.15.91:0/2650827780 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa054071cf0 0x7fa054148150 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa0440ac040 tx=0x7fa04401ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:25.170 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.172+0000 7fa04a7fc640 1 -- 172.21.15.91:0/2650827780 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0440b3800 con 0x7fa054071cf0 2023-11-27T18:14:25.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.172+0000 7fa04a7fc640 1 -- 172.21.15.91:0/2650827780 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0440b3980 con 0x7fa054071cf0 2023-11-27T18:14:25.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.172+0000 7fa04a7fc640 1 -- 172.21.15.91:0/2650827780 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0440b3d30 con 0x7fa054071cf0 2023-11-27T18:14:25.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.172+0000 7fa05bfce640 1 -- 172.21.15.91:0/2650827780 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa054154600 con 0x7fa054071cf0 2023-11-27T18:14:25.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.172+0000 7fa05bfce640 1 -- 172.21.15.91:0/2650827780 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0541f1e20 con 0x7fa054071cf0 2023-11-27T18:14:25.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.172+0000 7fa05bfce640 1 -- 172.21.15.91:0/2650827780 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0541f2010 con 0x7fa054071cf0 2023-11-27T18:14:25.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.456+0000 7fa04a7fc640 1 -- 172.21.15.91:0/2650827780 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fa0440c7420 con 0x7fa054071cf0 2023-11-27T18:14:25.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.456+0000 7fa04a7fc640 1 --2- 172.21.15.91:0/2650827780 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa038066840 0x7fa038068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:25.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.456+0000 7fa059d6a640 1 --2- 172.21.15.91:0/2650827780 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa038066840 0x7fa038068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:25.454 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.456+0000 7fa059d6a640 1 --2- 172.21.15.91:0/2650827780 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa038066840 0x7fa038068d00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa050007a60 tx=0x7fa050008040 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:25.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.492+0000 7fa04a7fc640 1 -- 172.21.15.91:0/2650827780 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa0440efd20 con 0x7fa054071cf0 2023-11-27T18:14:25.489 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.492+0000 7fa04a7fc640 1 -- 172.21.15.91:0/2650827780 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fa0440ec060 con 0x7fa054071cf0 2023-11-27T18:14:25.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.688+0000 7fa05bfce640 1 -- 172.21.15.91:0/2650827780 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa05404e930 con 0x7fa054071cf0 2023-11-27T18:14:25.721 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.724+0000 7fa04a7fc640 1 -- 172.21.15.91:0/2650827780 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6491 (secure 0 0 0) 0x7fa0440ef680 con 0x7fa054071cf0 2023-11-27T18:14:25.722 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:14:25.722 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1156758494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1156758494},{"type":"v1","addr":"172.21.15.91:6835","nonce":1156758494}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4227,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/2636117364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2636117364},{"type":"v1","addr":"172.21.15.91:6837","nonce":2636117364}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6839/1813662020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6838","nonce":1813662020},{"type":"v1","addr":"172.21.15.91:6839","nonce":1813662020}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4243,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3605337236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3605337236},{"type":"v1","addr":"172.21.15.94:6833","nonce":3605337236}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4246,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/1691562292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1691562292},{"type":"v1","addr":"172.21.15.94:6835","nonce":1691562292}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T18:13:13.083833+0000","modified":"2023-11-27T18:13:54.891064+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":10,"addr":"172.21.15.94:6837/3938864244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":3938864244},{"type":"v1","addr":"172.21.15.94:6837","nonce":3938864244}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-27T18:14:25.722 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 9 2023-11-27T18:14:25.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.728+0000 7fa05bfce640 1 -- 172.21.15.91:0/2650827780 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa038066840 msgr2=0x7fa038068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:25.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.728+0000 7fa05bfce640 1 --2- 172.21.15.91:0/2650827780 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa038066840 0x7fa038068d00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa050007a60 tx=0x7fa050008040 comp rx=0 tx=0).stop 2023-11-27T18:14:25.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.728+0000 7fa05bfce640 1 -- 172.21.15.91:0/2650827780 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa054071cf0 msgr2=0x7fa054148150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:25.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.728+0000 7fa05bfce640 1 --2- 172.21.15.91:0/2650827780 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa054071cf0 0x7fa054148150 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa0440ac040 tx=0x7fa04401ad30 comp rx=0 tx=0).stop 2023-11-27T18:14:25.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.728+0000 7fa05bfce640 1 -- 172.21.15.91:0/2650827780 shutdown_connections 2023-11-27T18:14:25.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.728+0000 7fa05bfce640 1 --2- 172.21.15.91:0/2650827780 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa038066840 0x7fa038068d00 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:25.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.728+0000 7fa05bfce640 1 --2- 172.21.15.91:0/2650827780 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa054072740 0x7fa054149ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:25.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.728+0000 7fa05bfce640 1 --2- 172.21.15.91:0/2650827780 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa054071cf0 0x7fa054148150 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:25.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.728+0000 7fa05bfce640 1 --2- 172.21.15.91:0/2650827780 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa054071910 0x7fa054154d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:25.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.728+0000 7fa05bfce640 1 -- 172.21.15.91:0/2650827780 >> 172.21.15.91:0/2650827780 conn(0x7fa0540cb430 msgr2=0x7fa05414e410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:25.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.728+0000 7fa05bfce640 1 -- 172.21.15.91:0/2650827780 shutdown_connections 2023-11-27T18:14:25.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.728+0000 7fa05bfce640 1 -- 172.21.15.91:0/2650827780 wait complete. 2023-11-27T18:14:25.742 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T18:14:25.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.868+0000 7fed01551640 1 Processor -- start 2023-11-27T18:14:25.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.868+0000 7fed01551640 1 -- start start 2023-11-27T18:14:25.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.868+0000 7fed01551640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fecfc06e3b0 0x7fecfc1573a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:25.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.868+0000 7fed01551640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fecfc070110 0x7fecfc1511e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:25.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.868+0000 7fed01551640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecfc158360 con 0x7fecfc06dfd0 2023-11-27T18:14:25.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.868+0000 7fed01551640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecfc0c39e0 con 0x7fecfc06e3b0 2023-11-27T18:14:25.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.868+0000 7fed01551640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc1578e0 con 0x7fecfc070110 2023-11-27T18:14:25.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.868+0000 7fecfaffd640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fecfc06dfd0 0x7fecfc15b350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:53618/0 (socket says 172.21.15.91:53618) 2023-11-27T18:14:25.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.868+0000 7fecfaffd640 1 -- 172.21.15.91:0/3532970917 learned_addr learned my addr 172.21.15.91:0/3532970917 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:14:25.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.872+0000 7fecf9ffb640 1 -- 172.21.15.91:0/3532970917 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3915155210 0 0) 0x7fecfc158360 con 0x7fecfc06dfd0 2023-11-27T18:14:25.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.872+0000 7fecf9ffb640 1 -- 172.21.15.91:0/3532970917 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fece4003530 con 0x7fecfc06dfd0 2023-11-27T18:14:25.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.876+0000 7fecf9ffb640 1 -- 172.21.15.91:0/3532970917 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3967995164 0 0) 0x7fece4003530 con 0x7fecfc06dfd0 2023-11-27T18:14:25.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.876+0000 7fecf9ffb640 1 -- 172.21.15.91:0/3532970917 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fecfc070110 msgr2=0x7fecfc1511e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:25.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.876+0000 7fecf9ffb640 1 --2- 172.21.15.91:0/3532970917 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fecfc070110 0x7fecfc1511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:25.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.876+0000 7fecf9ffb640 1 -- 172.21.15.91:0/3532970917 >> v2:172.21.15.94:3300/0 conn(0x7fecfc06e3b0 msgr2=0x7fecfc1573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:25.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.876+0000 7fecf9ffb640 1 --2- 172.21.15.91:0/3532970917 >> v2:172.21.15.94:3300/0 conn(0x7fecfc06e3b0 0x7fecfc1573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:25.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.876+0000 7fecf9ffb640 1 -- 172.21.15.91:0/3532970917 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecfc157ac0 con 0x7fecfc06dfd0 2023-11-27T18:14:25.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.876+0000 7fecf9ffb640 1 -- 172.21.15.91:0/3532970917 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3378743932 0 0) 0x7fecec001a00 con 0x7fecfc06dfd0 2023-11-27T18:14:25.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.876+0000 7fecf9ffb640 1 -- 172.21.15.91:0/3532970917 >> v1:172.21.15.91:6789/0 conn(0x7fecfc06dfd0 legacy=0x7fecfc15b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:25.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.876+0000 7fecf9ffb640 1 --2- 172.21.15.91:0/3532970917 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fece4003980 0x7fece4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:25.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.876+0000 7fecf9ffb640 1 --2- 172.21.15.91:0/3532970917 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fece40047d0 0x7fece4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:25.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.876+0000 7fecf9ffb640 1 --2- 172.21.15.91:0/3532970917 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fecfc070110 0x7fece400fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:25.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.876+0000 7fecf9ffb640 1 -- 172.21.15.91:0/3532970917 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc0c39e0 con 0x7fece4003980 2023-11-27T18:14:25.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.876+0000 7fecf9ffb640 1 -- 172.21.15.91:0/3532970917 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc1578e0 con 0x7fece40047d0 2023-11-27T18:14:25.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.876+0000 7fecf9ffb640 1 -- 172.21.15.91:0/3532970917 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece4005550 con 0x7fecfc070110 2023-11-27T18:14:25.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.876+0000 7fecfaffd640 1 --2- 172.21.15.91:0/3532970917 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fece4003980 0x7fece4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:25.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.880+0000 7fecfb7fe640 1 --2- 172.21.15.91:0/3532970917 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fecfc070110 0x7fece400fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:25.882 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.884+0000 7fecfaffd640 1 -- 172.21.15.91:0/3532970917 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fecfc070110 msgr2=0x7fece400fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:25.882 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.884+0000 7fecfaffd640 1 --2- 172.21.15.91:0/3532970917 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fecfc070110 0x7fece400fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:25.882 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.884+0000 7fecfaffd640 1 -- 172.21.15.91:0/3532970917 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fece40047d0 msgr2=0x7fece4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:25.882 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.884+0000 7fecfaffd640 1 --2- 172.21.15.91:0/3532970917 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fece40047d0 0x7fece4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:25.882 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.884+0000 7fecfaffd640 1 -- 172.21.15.91:0/3532970917 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece4003530 con 0x7fece4003980 2023-11-27T18:14:25.957 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.960+0000 7fecfaffd640 1 --2- 172.21.15.91:0/3532970917 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fece4003980 0x7fece4003da0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fecec00a780 tx=0x7fecec01d250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9d1631edc435659 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:25.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.980+0000 7fecf9ffb640 1 -- 172.21.15.91:0/3532970917 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecec0ad430 con 0x7fece4003980 2023-11-27T18:14:25.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.980+0000 7fecf9ffb640 1 -- 172.21.15.91:0/3532970917 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecec0a8070 con 0x7fece4003980 2023-11-27T18:14:25.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.980+0000 7fecf9ffb640 1 -- 172.21.15.91:0/3532970917 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecec0ad850 con 0x7fece4003980 2023-11-27T18:14:25.978 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.980+0000 7fed01551640 1 -- 172.21.15.91:0/3532970917 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fece4003980 msgr2=0x7fece4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:25.979 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.980+0000 7fed01551640 1 --2- 172.21.15.91:0/3532970917 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fece4003980 0x7fece4003da0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fecec00a780 tx=0x7fecec01d250 comp rx=0 tx=0).stop 2023-11-27T18:14:25.979 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.980+0000 7fecfb7fe640 1 -- 172.21.15.91:0/3532970917 reap_dead start 2023-11-27T18:14:25.979 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.980+0000 7fed01551640 1 -- 172.21.15.91:0/3532970917 shutdown_connections 2023-11-27T18:14:25.979 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.980+0000 7fed01551640 1 -- 172.21.15.91:0/3532970917 >> 172.21.15.91:0/3532970917 conn(0x7fecfc0cbec0 msgr2=0x7fecfc0cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:25.979 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.980+0000 7fed01551640 1 -- 172.21.15.91:0/3532970917 shutdown_connections 2023-11-27T18:14:25.979 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.980+0000 7fed01551640 1 -- 172.21.15.91:0/3532970917 wait complete. 2023-11-27T18:14:25.980 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.984+0000 7fed01551640 1 Processor -- start 2023-11-27T18:14:25.980 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.984+0000 7fed01551640 1 -- start start 2023-11-27T18:14:25.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.984+0000 7fed01551640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fecfc147030 0x7fecfc1edd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:25.983 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.984+0000 7fed01551640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fecfc154a50 0x7fecfc144c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:25.983 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.984+0000 7fed01551640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fecfc147410 0x7fecfc1451c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:25.983 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.984+0000 7fed01551640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc1ee260 con 0x7fecfc147030 2023-11-27T18:14:25.983 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.984+0000 7fed01551640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc1f19f0 con 0x7fecfc154a50 2023-11-27T18:14:25.983 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.984+0000 7fed01551640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc1523a0 con 0x7fecfc147410 2023-11-27T18:14:25.983 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.988+0000 7fecfaffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fecfc147030 0x7fecfc1edd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:25.984 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.988+0000 7fecfaffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fecfc147030 0x7fecfc1edd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:38802/0 (socket says 172.21.15.91:38802) 2023-11-27T18:14:25.984 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.988+0000 7fecfaffd640 1 -- 172.21.15.91:0/3771474646 learned_addr learned my addr 172.21.15.91:0/3771474646 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:25.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.992+0000 7fecfaffd640 1 -- 172.21.15.91:0/3771474646 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fecfc147410 msgr2=0x7fecfc1451c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:25.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.992+0000 7fecfaffd640 1 --2- 172.21.15.91:0/3771474646 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fecfc147410 0x7fecfc1451c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:25.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.992+0000 7fecfaffd640 1 -- 172.21.15.91:0/3771474646 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fecfc154a50 msgr2=0x7fecfc144c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:25.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.992+0000 7fecfaffd640 1 --2- 172.21.15.91:0/3771474646 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fecfc154a50 0x7fecfc144c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:25.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.992+0000 7fecfaffd640 1 -- 172.21.15.91:0/3771474646 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecfc151de0 con 0x7fecfc147030 2023-11-27T18:14:25.991 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:25.992+0000 7fecfaffd640 1 --2- 172.21.15.91:0/3771474646 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fecfc147030 0x7fecfc1edd20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fecec00a780 tx=0x7fece4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:25.999 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.000+0000 7fece37fe640 1 -- 172.21.15.91:0/3771474646 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecec0070e0 con 0x7fecfc147030 2023-11-27T18:14:25.999 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.000+0000 7fece37fe640 1 -- 172.21.15.91:0/3771474646 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecec007240 con 0x7fecfc147030 2023-11-27T18:14:25.999 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.000+0000 7fece37fe640 1 -- 172.21.15.91:0/3771474646 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecec0075b0 con 0x7fecfc147030 2023-11-27T18:14:25.999 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.000+0000 7fed01551640 1 -- 172.21.15.91:0/3771474646 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecfc1520c0 con 0x7fecfc147030 2023-11-27T18:14:25.999 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.000+0000 7fed01551640 1 -- 172.21.15.91:0/3771474646 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecfc1f1680 con 0x7fecfc147030 2023-11-27T18:14:26.000 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.004+0000 7fed01551640 1 -- 172.21.15.91:0/3771474646 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecfc067810 con 0x7fecfc147030 2023-11-27T18:14:26.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.292+0000 7fece37fe640 1 -- 172.21.15.91:0/3771474646 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fecec0aa030 con 0x7fecfc147030 2023-11-27T18:14:26.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.292+0000 7fece37fe640 1 --2- 172.21.15.91:0/3771474646 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fece8066840 0x7fece8068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:26.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.296+0000 7fecfa7fc640 1 --2- 172.21.15.91:0/3771474646 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fece8066840 0x7fece8068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:26.292 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.296+0000 7fecfa7fc640 1 --2- 172.21.15.91:0/3771474646 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fece8066840 0x7fece8068d00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fecf0006fd0 tx=0x7fecf0006d80 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:26.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.328+0000 7fece37fe640 1 -- 172.21.15.91:0/3771474646 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fecec0efdc0 con 0x7fecfc147030 2023-11-27T18:14:26.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.328+0000 7fece37fe640 1 -- 172.21.15.91:0/3771474646 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fecec0eba00 con 0x7fecfc147030 2023-11-27T18:14:26.506 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.508+0000 7fed01551640 1 -- 172.21.15.91:0/3771474646 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fecfc0c4490 con 0x7fecfc147030 2023-11-27T18:14:26.598 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.600+0000 7fece37fe640 1 -- 172.21.15.91:0/3771474646 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+18421 (secure 0 0 0) 0x7fecec0bb030 con 0x7fecfc147030 2023-11-27T18:14:26.598 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:14:26.599 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":32,"fsid":"08c8ebbf-7936-4c41-a995-d5600de2d072","created":"2023-11-27T18:12:06.484593+0000","modified":"2023-11-27T18:14:21.835068+0000","last_up_change":"2023-11-27T18:12:33.154694+0000","last_in_change":"2023-11-27T18:12:23.622113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T18:12:35.450305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T18:13:09.589619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T18:13:11.439236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-27T18:13:18.514694+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ad53c08-dd19-4ae6-87c5-fa15bea3b4ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6811","nonce":472303992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6813","nonce":472303992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6817","nonce":472303992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6815","nonce":472303992}]},"public_addr":"172.21.15.91:6811/472303992","cluster_addr":"172.21.15.91:6813/472303992","heartbeat_back_addr":"172.21.15.91:6817/472303992","heartbeat_front_addr":"172.21.15.91:6815/472303992","state":["exists","up"]},{"osd":1,"uuid":"f8b5f147-ed29-4329-a787-a12cc34a2569","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6827","nonce":12316911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6829","nonce":12316911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6833","nonce":12316911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6831","nonce":12316911}]},"public_addr":"172.21.15.91:6827/12316911","cluster_addr":"172.21.15.91:6829/12316911","heartbeat_back_addr":"172.21.15.91:6833/12316911","heartbeat_front_addr":"172.21.15.91:6831/12316911","state":["exists","up"]},{"osd":2,"uuid":"c3029f9a-1c48-4f5d-983a-172a614d8795","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6803","nonce":3776125919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6805","nonce":3776125919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6809","nonce":3776125919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6807","nonce":3776125919}]},"public_addr":"172.21.15.91:6803/3776125919","cluster_addr":"172.21.15.91:6805/3776125919","heartbeat_back_addr":"172.21.15.91:6809/3776125919","heartbeat_front_addr":"172.21.15.91:6807/3776125919","state":["exists","up"]},{"osd":3,"uuid":"ab4b6fb2-0126-491b-9224-54a6badc5da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6819","nonce":1297704794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6821","nonce":1297704794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6825","nonce":1297704794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6823","nonce":1297704794}]},"public_addr":"172.21.15.91:6819/1297704794","cluster_addr":"172.21.15.91:6821/1297704794","heartbeat_back_addr":"172.21.15.91:6825/1297704794","heartbeat_front_addr":"172.21.15.91:6823/1297704794","state":["exists","up"]},{"osd":4,"uuid":"695071a8-2de8-4cba-bf20-050021a03bb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6809","nonce":2501531833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6811","nonce":2501531833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6815","nonce":2501531833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6813","nonce":2501531833}]},"public_addr":"172.21.15.94:6809/2501531833","cluster_addr":"172.21.15.94:6811/2501531833","heartbeat_back_addr":"172.21.15.94:6815/2501531833","heartbeat_front_addr":"172.21.15.94:6813/2501531833","state":["exists","up"]},{"osd":5,"uuid":"ca01da14-a700-4845-8db2-f5e3370677e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6817","nonce":2448969592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6819","nonce":2448969592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6823","nonce":2448969592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6821","nonce":2448969592}]},"public_addr":"172.21.15.94:6817/2448969592","cluster_addr":"172.21.15.94:6819/2448969592","heartbeat_back_addr":"172.21.15.94:6823/2448969592","heartbeat_front_addr":"172.21.15.94:6821/2448969592","state":["exists","up"]},{"osd":6,"uuid":"4784bc77-6c33-4e47-abba-d37484982f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6825","nonce":3389553935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6827","nonce":3389553935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6831","nonce":3389553935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6829","nonce":3389553935}]},"public_addr":"172.21.15.94:6825/3389553935","cluster_addr":"172.21.15.94:6827/3389553935","heartbeat_back_addr":"172.21.15.94:6831/3389553935","heartbeat_front_addr":"172.21.15.94:6829/3389553935","state":["exists","up"]},{"osd":7,"uuid":"b954cf3f-4a4f-4a75-9f90-014f72c16d15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6801","nonce":1606498064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6803","nonce":1606498064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6807","nonce":1606498064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6805","nonce":1606498064}]},"public_addr":"172.21.15.94:6801/1606498064","cluster_addr":"172.21.15.94:6803/1606498064","heartbeat_back_addr":"172.21.15.94:6807/1606498064","heartbeat_front_addr":"172.21.15.94:6805/1606498064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.534968+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.506182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.339267+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.532432+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:28.935756+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.471559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.485014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.352978+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":0,"to":7}]},{"pgid":"4.d","mappings":[{"from":3,"to":0}]},{"pgid":"4.1d","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T18:14:26.602 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.604+0000 7fed01551640 1 -- 172.21.15.91:0/3771474646 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fece8066840 msgr2=0x7fece8068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:26.602 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.604+0000 7fed01551640 1 --2- 172.21.15.91:0/3771474646 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fece8066840 0x7fece8068d00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fecf0006fd0 tx=0x7fecf0006d80 comp rx=0 tx=0).stop 2023-11-27T18:14:26.602 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.604+0000 7fed01551640 1 -- 172.21.15.91:0/3771474646 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fecfc147030 msgr2=0x7fecfc1edd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:26.602 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.604+0000 7fed01551640 1 --2- 172.21.15.91:0/3771474646 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fecfc147030 0x7fecfc1edd20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fecec00a780 tx=0x7fece4005800 comp rx=0 tx=0).stop 2023-11-27T18:14:26.602 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.604+0000 7fed01551640 1 -- 172.21.15.91:0/3771474646 shutdown_connections 2023-11-27T18:14:26.602 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.604+0000 7fed01551640 1 --2- 172.21.15.91:0/3771474646 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fece8066840 0x7fece8068d00 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:26.603 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.604+0000 7fed01551640 1 --2- 172.21.15.91:0/3771474646 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fecfc147410 0x7fecfc1451c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:26.603 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.604+0000 7fed01551640 1 --2- 172.21.15.91:0/3771474646 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fecfc154a50 0x7fecfc144c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:26.603 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.604+0000 7fed01551640 1 --2- 172.21.15.91:0/3771474646 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fecfc147030 0x7fecfc1edd20 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:26.603 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.604+0000 7fed01551640 1 -- 172.21.15.91:0/3771474646 >> 172.21.15.91:0/3771474646 conn(0x7fecfc0cbec0 msgr2=0x7fecfc150460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:26.603 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.604+0000 7fed01551640 1 -- 172.21.15.91:0/3771474646 shutdown_connections 2023-11-27T18:14:26.603 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.604+0000 7fed01551640 1 -- 172.21.15.91:0/3771474646 wait complete. 2023-11-27T18:14:26.623 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T18:14:26.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.748+0000 7f9a20d4a640 1 Processor -- start 2023-11-27T18:14:26.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.748+0000 7f9a20d4a640 1 -- start start 2023-11-27T18:14:26.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.748+0000 7f9a20d4a640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f9a1c151820 0x7f9a1c070e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:26.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.748+0000 7f9a20d4a640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9a1c0c85c0 0x7f9a1c06cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:26.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.748+0000 7f9a20d4a640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a1c072b70 con 0x7f9a1c0c5f10 2023-11-27T18:14:26.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.748+0000 7f9a20d4a640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a1c0c2d20 con 0x7f9a1c151820 2023-11-27T18:14:26.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.748+0000 7f9a20d4a640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a1c071350 con 0x7f9a1c0c85c0 2023-11-27T18:14:26.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.748+0000 7f9a1a59c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f9a1c151820 0x7f9a1c070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:26.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.748+0000 7f9a1a59c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f9a1c151820 0x7f9a1c070e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:38818/0 (socket says 172.21.15.91:38818) 2023-11-27T18:14:26.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.748+0000 7f9a1a59c640 1 -- 172.21.15.91:0/586965322 learned_addr learned my addr 172.21.15.91:0/586965322 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:26.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.748+0000 7f9a19d9b640 1 --2- 172.21.15.91:0/586965322 >> v2:172.21.15.94:3300/0 conn(0x7f9a1c0c85c0 0x7f9a1c06cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:26.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.752+0000 7f9a1a59c640 1 -- 172.21.15.91:0/586965322 >> v2:172.21.15.94:3300/0 conn(0x7f9a1c0c85c0 msgr2=0x7f9a1c06cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:26.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.752+0000 7f9a1a59c640 1 --2- 172.21.15.91:0/586965322 >> v2:172.21.15.94:3300/0 conn(0x7f9a1c0c85c0 0x7f9a1c06cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:26.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.752+0000 7f9a1a59c640 1 -- 172.21.15.91:0/586965322 >> v1:172.21.15.91:6789/0 conn(0x7f9a1c0c5f10 legacy=0x7f9a1c06d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:26.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.752+0000 7f9a1a59c640 1 -- 172.21.15.91:0/586965322 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a1c0c6490 con 0x7f9a1c151820 2023-11-27T18:14:26.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.756+0000 7f9a1a59c640 1 --2- 172.21.15.91:0/586965322 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9a1c151820 0x7f9a1c070e10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c06b3a0 tx=0x7f9a0c01ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1e400ec7863bb77 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:26.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.760+0000 7f9a1959a640 1 -- 172.21.15.91:0/586965322 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c0a89b0 con 0x7f9a1c151820 2023-11-27T18:14:26.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.760+0000 7f9a1959a640 1 -- 172.21.15.91:0/586965322 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a0c0a8b10 con 0x7f9a1c151820 2023-11-27T18:14:26.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.760+0000 7f9a1959a640 1 -- 172.21.15.91:0/586965322 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c0a8ea0 con 0x7f9a1c151820 2023-11-27T18:14:26.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.760+0000 7f9a20d4a640 1 -- 172.21.15.91:0/586965322 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9a1c151820 msgr2=0x7f9a1c070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:26.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.760+0000 7f9a20d4a640 1 --2- 172.21.15.91:0/586965322 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9a1c151820 0x7f9a1c070e10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c06b3a0 tx=0x7f9a0c01ecb0 comp rx=0 tx=0).stop 2023-11-27T18:14:26.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.760+0000 7f9a20d4a640 1 -- 172.21.15.91:0/586965322 shutdown_connections 2023-11-27T18:14:26.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.760+0000 7f9a20d4a640 1 --2- 172.21.15.91:0/586965322 >> v2:172.21.15.94:3300/0 conn(0x7f9a1c0c85c0 0x7f9a1c06cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:26.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.760+0000 7f9a20d4a640 1 --2- 172.21.15.91:0/586965322 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9a1c151820 0x7f9a1c070e10 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:26.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.760+0000 7f9a20d4a640 1 -- 172.21.15.91:0/586965322 >> 172.21.15.91:0/586965322 conn(0x7f9a1c0c79b0 msgr2=0x7f9a1c0c7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:26.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.760+0000 7f9a20d4a640 1 -- 172.21.15.91:0/586965322 shutdown_connections 2023-11-27T18:14:26.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.760+0000 7f9a20d4a640 1 -- 172.21.15.91:0/586965322 wait complete. 2023-11-27T18:14:26.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.764+0000 7f9a20d4a640 1 Processor -- start 2023-11-27T18:14:26.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.764+0000 7f9a20d4a640 1 -- start start 2023-11-27T18:14:26.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.764+0000 7f9a20d4a640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9a1c0c5f10 0x7f9a1c140ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:26.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.764+0000 7f9a20d4a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a1c0c85c0 0x7f9a1c06cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:26.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.764+0000 7f9a20d4a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9a1c151820 0x7f9a1c06d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:26.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.764+0000 7f9a20d4a640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1c1e2640 con 0x7f9a1c151820 2023-11-27T18:14:26.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.764+0000 7f9a20d4a640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1c157a30 con 0x7f9a1c0c85c0 2023-11-27T18:14:26.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.764+0000 7f9a20d4a640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1c157cd0 con 0x7f9a1c0c5f10 2023-11-27T18:14:26.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.764+0000 7f9a1ad9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9a1c151820 0x7f9a1c06d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:26.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.764+0000 7f9a1ad9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9a1c151820 0x7f9a1c06d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:38828/0 (socket says 172.21.15.91:38828) 2023-11-27T18:14:26.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.764+0000 7f9a1ad9d640 1 -- 172.21.15.91:0/1484057679 learned_addr learned my addr 172.21.15.91:0/1484057679 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:26.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.764+0000 7f9a19d9b640 1 --2- 172.21.15.91:0/1484057679 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a1c0c85c0 0x7f9a1c06cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:26.763 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.764+0000 7f9a1a59c640 1 --2- 172.21.15.91:0/1484057679 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9a1c0c5f10 0x7f9a1c140ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:26.765 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.768+0000 7f9a1ad9d640 1 -- 172.21.15.91:0/1484057679 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9a1c0c5f10 msgr2=0x7f9a1c140ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:26.765 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.768+0000 7f9a1ad9d640 1 --2- 172.21.15.91:0/1484057679 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9a1c0c5f10 0x7f9a1c140ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:26.766 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.768+0000 7f9a1ad9d640 1 -- 172.21.15.91:0/1484057679 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a1c0c85c0 msgr2=0x7f9a1c06cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:26.766 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.768+0000 7f9a1ad9d640 1 --2- 172.21.15.91:0/1484057679 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a1c0c85c0 0x7f9a1c06cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:26.766 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.768+0000 7f9a1ad9d640 1 -- 172.21.15.91:0/1484057679 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a0c0094d0 con 0x7f9a1c151820 2023-11-27T18:14:26.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.772+0000 7f9a1ad9d640 1 --2- 172.21.15.91:0/1484057679 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9a1c151820 0x7f9a1c06d060 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9a1400c780 tx=0x7f9a1400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:26.772 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.776+0000 7f9a0affd640 1 -- 172.21.15.91:0/1484057679 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1400a9f0 con 0x7f9a1c151820 2023-11-27T18:14:26.772 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.776+0000 7f9a0affd640 1 -- 172.21.15.91:0/1484057679 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a1400ce90 con 0x7f9a1c151820 2023-11-27T18:14:26.772 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.776+0000 7f9a20d4a640 1 -- 172.21.15.91:0/1484057679 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a1c157200 con 0x7f9a1c151820 2023-11-27T18:14:26.772 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.776+0000 7f9a0affd640 1 -- 172.21.15.91:0/1484057679 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1400add0 con 0x7f9a1c151820 2023-11-27T18:14:26.772 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.776+0000 7f9a20d4a640 1 -- 172.21.15.91:0/1484057679 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a1c0c5560 con 0x7f9a1c151820 2023-11-27T18:14:26.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.776+0000 7f9a20d4a640 1 -- 172.21.15.91:0/1484057679 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a1c1e27b0 con 0x7f9a1c151820 2023-11-27T18:14:26.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.796+0000 7f9a0affd640 1 -- 172.21.15.91:0/1484057679 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f9a14012420 con 0x7f9a1c151820 2023-11-27T18:14:26.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.796+0000 7f9a0affd640 1 --2- 172.21.15.91:0/1484057679 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f99fc066840 0x7f99fc068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:26.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.796+0000 7f9a1a59c640 1 --2- 172.21.15.91:0/1484057679 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f99fc066840 0x7f99fc068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:26.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.796+0000 7f9a1a59c640 1 --2- 172.21.15.91:0/1484057679 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f99fc066840 0x7f99fc068d00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c0b2000 tx=0x7f9a0c0aa070 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:26.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:26.800+0000 7f9a0affd640 1 -- 172.21.15.91:0/1484057679 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9a14026e40 con 0x7f9a1c151820 2023-11-27T18:14:27.068 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:27.068+0000 7f9a0affd640 1 -- 172.21.15.91:0/1484057679 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f9a14051cc0 con 0x7f9a1c151820 2023-11-27T18:14:27.259 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:27.260+0000 7f9a20d4a640 1 -- 172.21.15.91:0/1484057679 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9a1c1e2780 con 0x7f9a1c151820 2023-11-27T18:14:27.284 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:27.288+0000 7f9a0affd640 1 -- 172.21.15.91:0/1484057679 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6491 (secure 0 0 0) 0x7f9a14016020 con 0x7f9a1c151820 2023-11-27T18:14:27.285 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:14:27.285 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1156758494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1156758494},{"type":"v1","addr":"172.21.15.91:6835","nonce":1156758494}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4227,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/2636117364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2636117364},{"type":"v1","addr":"172.21.15.91:6837","nonce":2636117364}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6839/1813662020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6838","nonce":1813662020},{"type":"v1","addr":"172.21.15.91:6839","nonce":1813662020}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4243,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3605337236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3605337236},{"type":"v1","addr":"172.21.15.94:6833","nonce":3605337236}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4246,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/1691562292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1691562292},{"type":"v1","addr":"172.21.15.94:6835","nonce":1691562292}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T18:13:13.083833+0000","modified":"2023-11-27T18:13:54.891064+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":10,"addr":"172.21.15.94:6837/3938864244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":3938864244},{"type":"v1","addr":"172.21.15.94:6837","nonce":3938864244}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-27T18:14:27.285 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 9 2023-11-27T18:14:27.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:27.288+0000 7f9a20d4a640 1 -- 172.21.15.91:0/1484057679 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f99fc066840 msgr2=0x7f99fc068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:27.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:27.288+0000 7f9a20d4a640 1 --2- 172.21.15.91:0/1484057679 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f99fc066840 0x7f99fc068d00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c0b2000 tx=0x7f9a0c0aa070 comp rx=0 tx=0).stop 2023-11-27T18:14:27.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:27.288+0000 7f9a20d4a640 1 -- 172.21.15.91:0/1484057679 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9a1c151820 msgr2=0x7f9a1c06d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:27.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:27.288+0000 7f9a20d4a640 1 --2- 172.21.15.91:0/1484057679 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9a1c151820 0x7f9a1c06d060 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9a1400c780 tx=0x7f9a1400cc40 comp rx=0 tx=0).stop 2023-11-27T18:14:27.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:27.288+0000 7f9a20d4a640 1 -- 172.21.15.91:0/1484057679 shutdown_connections 2023-11-27T18:14:27.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:27.288+0000 7f9a20d4a640 1 --2- 172.21.15.91:0/1484057679 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f99fc066840 0x7f99fc068d00 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:27.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:27.288+0000 7f9a20d4a640 1 --2- 172.21.15.91:0/1484057679 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9a1c151820 0x7f9a1c06d060 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:27.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:27.288+0000 7f9a20d4a640 1 --2- 172.21.15.91:0/1484057679 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a1c0c85c0 0x7f9a1c06cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:27.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:27.288+0000 7f9a20d4a640 1 --2- 172.21.15.91:0/1484057679 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9a1c0c5f10 0x7f9a1c140ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:27.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:27.288+0000 7f9a20d4a640 1 -- 172.21.15.91:0/1484057679 >> 172.21.15.91:0/1484057679 conn(0x7f9a1c0c79b0 msgr2=0x7f9a1c0c9af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:27.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:27.288+0000 7f9a20d4a640 1 -- 172.21.15.91:0/1484057679 shutdown_connections 2023-11-27T18:14:27.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:27.288+0000 7f9a20d4a640 1 -- 172.21.15.91:0/1484057679 wait complete. 2023-11-27T18:14:27.912 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-27T18:13:13.083833+0000', 'modified': '2023-11-27T18:13:54.891064+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4255}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4255': {'gid': 4255, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.94:6837/3938864244', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.94:6836', 'nonce': 3938864244}, {'type': 'v1', 'addr': '172.21.15.94:6837', 'nonce': 3938864244}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-27T18:14:27.912 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-27T18:14:27.913 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-27T18:14:28.045 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.048+0000 7f99bebbb640 1 Processor -- start 2023-11-27T18:14:28.045 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.048+0000 7f99bebbb640 1 -- start start 2023-11-27T18:14:28.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.048+0000 7f99bebbb640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f99b8072820 0x7f99b80c44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:28.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.048+0000 7f99bebbb640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f99b81576e0 0x7f99b8157b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:28.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.048+0000 7f99bebbb640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99b81580b0 con 0x7f99b80c40e0 2023-11-27T18:14:28.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.048+0000 7f99bebbb640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99b80c7090 con 0x7f99b8072820 2023-11-27T18:14:28.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.048+0000 7f99bebbb640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b80c4a00 con 0x7f99b81576e0 2023-11-27T18:14:28.047 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.048+0000 7f99bc957640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f99b80c40e0 0x7f99b806ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:40010/0 (socket says 172.21.15.91:40010) 2023-11-27T18:14:28.047 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.048+0000 7f99bc957640 1 -- 172.21.15.91:0/637792954 learned_addr learned my addr 172.21.15.91:0/637792954 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:14:28.047 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.052+0000 7f99bd158640 1 --2- 172.21.15.91:0/637792954 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f99b81576e0 0x7f99b8157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:28.048 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.052+0000 7f99b7fff640 1 --2- 172.21.15.91:0/637792954 >> v2:172.21.15.94:3300/0 conn(0x7f99b8072820 0x7f99b80c44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:28.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.052+0000 7f99b77fe640 1 -- 172.21.15.91:0/637792954 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2714143811 0 0) 0x7f99b81580b0 con 0x7f99b80c40e0 2023-11-27T18:14:28.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.052+0000 7f99b77fe640 1 -- 172.21.15.91:0/637792954 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99a4003530 con 0x7f99b80c40e0 2023-11-27T18:14:28.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.056+0000 7f99b77fe640 1 -- 172.21.15.91:0/637792954 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2060195957 0 0) 0x7f99a4003530 con 0x7f99b80c40e0 2023-11-27T18:14:28.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.056+0000 7f99b77fe640 1 -- 172.21.15.91:0/637792954 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f99b81576e0 msgr2=0x7f99b8157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:28.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.056+0000 7f99b77fe640 1 --2- 172.21.15.91:0/637792954 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f99b81576e0 0x7f99b8157b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:28.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.056+0000 7f99b77fe640 1 -- 172.21.15.91:0/637792954 >> v2:172.21.15.94:3300/0 conn(0x7f99b8072820 msgr2=0x7f99b80c44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:28.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.056+0000 7f99b77fe640 1 --2- 172.21.15.91:0/637792954 >> v2:172.21.15.94:3300/0 conn(0x7f99b8072820 0x7f99b80c44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:28.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.056+0000 7f99b77fe640 1 -- 172.21.15.91:0/637792954 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b815aa00 con 0x7f99b80c40e0 2023-11-27T18:14:28.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.056+0000 7f99b77fe640 1 -- 172.21.15.91:0/637792954 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3378743932 0 0) 0x7f99b0001680 con 0x7f99b80c40e0 2023-11-27T18:14:28.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.056+0000 7f99b77fe640 1 -- 172.21.15.91:0/637792954 >> v1:172.21.15.91:6789/0 conn(0x7f99b80c40e0 legacy=0x7f99b806ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:28.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.056+0000 7f99b77fe640 1 --2- 172.21.15.91:0/637792954 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f99b81576e0 0x7f99a4003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:28.058 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.056+0000 7f99b77fe640 1 --2- 172.21.15.91:0/637792954 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99a4003f50 0x7f99a40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:28.058 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.056+0000 7f99b77fe640 1 --2- 172.21.15.91:0/637792954 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f99a4004d10 0x7f99a4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:28.059 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.056+0000 7f99b77fe640 1 -- 172.21.15.91:0/637792954 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b80c7090 con 0x7f99a4004d10 2023-11-27T18:14:28.059 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.056+0000 7f99b77fe640 1 -- 172.21.15.91:0/637792954 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b80c4a00 con 0x7f99a4003f50 2023-11-27T18:14:28.059 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.056+0000 7f99b77fe640 1 -- 172.21.15.91:0/637792954 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99a400b990 con 0x7f99b81576e0 2023-11-27T18:14:28.059 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.060+0000 7f99bd158640 1 --2- 172.21.15.91:0/637792954 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f99a4004d10 0x7f99a4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:28.062 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.064+0000 7f99bc957640 1 --2- 172.21.15.91:0/637792954 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f99b81576e0 0x7f99a4003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:28.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.064+0000 7f99bd158640 1 -- 172.21.15.91:0/637792954 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f99b81576e0 msgr2=0x7f99a4003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:28.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.064+0000 7f99b7fff640 1 --2- 172.21.15.91:0/637792954 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99a4003f50 0x7f99a40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:28.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.064+0000 7f99bd158640 1 --2- 172.21.15.91:0/637792954 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f99b81576e0 0x7f99a4003980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:28.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.064+0000 7f99bd158640 1 -- 172.21.15.91:0/637792954 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99a4003f50 msgr2=0x7f99a40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:28.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.064+0000 7f99bd158640 1 --2- 172.21.15.91:0/637792954 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99a4003f50 0x7f99a40047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:28.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.064+0000 7f99bd158640 1 -- 172.21.15.91:0/637792954 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a4003530 con 0x7f99a4004d10 2023-11-27T18:14:28.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.068+0000 7f99bd158640 1 --2- 172.21.15.91:0/637792954 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f99a4004d10 0x7f99a4005190 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f99a8009b10 tx=0x7f99a801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=748ce68bcab60844 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:28.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.072+0000 7f99b77fe640 1 -- 172.21.15.91:0/637792954 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a80a5640 con 0x7f99a4004d10 2023-11-27T18:14:28.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.072+0000 7f99b77fe640 1 -- 172.21.15.91:0/637792954 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a80a57a0 con 0x7f99a4004d10 2023-11-27T18:14:28.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.072+0000 7f99b77fe640 1 -- 172.21.15.91:0/637792954 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a80a5b90 con 0x7f99a4004d10 2023-11-27T18:14:28.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.072+0000 7f99bebbb640 1 -- 172.21.15.91:0/637792954 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f99a4004d10 msgr2=0x7f99a4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:28.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.072+0000 7f99bebbb640 1 --2- 172.21.15.91:0/637792954 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f99a4004d10 0x7f99a4005190 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f99a8009b10 tx=0x7f99a801ca50 comp rx=0 tx=0).stop 2023-11-27T18:14:28.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.072+0000 7f99bd158640 1 -- 172.21.15.91:0/637792954 reap_dead start 2023-11-27T18:14:28.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.072+0000 7f99bebbb640 1 -- 172.21.15.91:0/637792954 shutdown_connections 2023-11-27T18:14:28.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.072+0000 7f99bebbb640 1 -- 172.21.15.91:0/637792954 >> 172.21.15.91:0/637792954 conn(0x7f99b80ca9d0 msgr2=0x7f99b80cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:28.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.072+0000 7f99bebbb640 1 -- 172.21.15.91:0/637792954 shutdown_connections 2023-11-27T18:14:28.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.072+0000 7f99bebbb640 1 -- 172.21.15.91:0/637792954 wait complete. 2023-11-27T18:14:28.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.076+0000 7f99bebbb640 1 Processor -- start 2023-11-27T18:14:28.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.076+0000 7f99bebbb640 1 -- start start 2023-11-27T18:14:28.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.076+0000 7f99bebbb640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99a4004d10 0x7f99b81567f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:28.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.076+0000 7f99bebbb640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f99b80bdde0 0x7f99b80bf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:28.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.076+0000 7f99bebbb640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f99b80c9b50 0x7f99b80bfd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:28.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.076+0000 7f99bebbb640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b80bf360 con 0x7f99b80bdde0 2023-11-27T18:14:28.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.076+0000 7f99bebbb640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b814f820 con 0x7f99a4004d10 2023-11-27T18:14:28.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.076+0000 7f99bebbb640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b81efd90 con 0x7f99b80c9b50 2023-11-27T18:14:28.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.076+0000 7f99b7fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f99b80bdde0 0x7f99b80bf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:28.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.076+0000 7f99b7fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f99b80bdde0 0x7f99b80bf7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:38846/0 (socket says 172.21.15.91:38846) 2023-11-27T18:14:28.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.076+0000 7f99b7fff640 1 -- 172.21.15.91:0/1552341626 learned_addr learned my addr 172.21.15.91:0/1552341626 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:28.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.080+0000 7f99bd158640 1 --2- 172.21.15.91:0/1552341626 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f99b80c9b50 0x7f99b80bfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:28.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.080+0000 7f99bc957640 1 --2- 172.21.15.91:0/1552341626 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99a4004d10 0x7f99b81567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:28.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.080+0000 7f99b7fff640 1 -- 172.21.15.91:0/1552341626 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f99b80c9b50 msgr2=0x7f99b80bfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:28.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.080+0000 7f99b7fff640 1 --2- 172.21.15.91:0/1552341626 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f99b80c9b50 0x7f99b80bfd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:28.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.080+0000 7f99b7fff640 1 -- 172.21.15.91:0/1552341626 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99a4004d10 msgr2=0x7f99b81567f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:28.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.080+0000 7f99b7fff640 1 --2- 172.21.15.91:0/1552341626 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99a4004d10 0x7f99b81567f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:28.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.080+0000 7f99b7fff640 1 -- 172.21.15.91:0/1552341626 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b80cafe0 con 0x7f99b80bdde0 2023-11-27T18:14:28.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.084+0000 7f99b7fff640 1 --2- 172.21.15.91:0/1552341626 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f99b80bdde0 0x7f99b80bf7f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f99a000f350 tx=0x7f99a000f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:28.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.088+0000 7f99b57fa640 1 -- 172.21.15.91:0/1552341626 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a0017600 con 0x7f99b80bdde0 2023-11-27T18:14:28.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.088+0000 7f99b57fa640 1 -- 172.21.15.91:0/1552341626 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a0011040 con 0x7f99b80bdde0 2023-11-27T18:14:28.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.088+0000 7f99b57fa640 1 -- 172.21.15.91:0/1552341626 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a00179c0 con 0x7f99b80bdde0 2023-11-27T18:14:28.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.088+0000 7f99bebbb640 1 -- 172.21.15.91:0/1552341626 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99b814fa70 con 0x7f99b80bdde0 2023-11-27T18:14:28.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.088+0000 7f99bebbb640 1 -- 172.21.15.91:0/1552341626 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99b80beff0 con 0x7f99b80bdde0 2023-11-27T18:14:28.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.092+0000 7f99c1ceb000 1 Processor -- start 2023-11-27T18:14:28.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.092+0000 7f99c1ceb000 1 -- start start 2023-11-27T18:14:28.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.092+0000 7f99c1ceb000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e3fd652930 0x55e3fd652d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:28.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.092+0000 7f99c1ceb000 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55e3fd6579f0 0x55e3fd657dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:28.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.092+0000 7f99c1ceb000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e3fd658310 0x55e3fd6586f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:28.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.092+0000 7f99c1ceb000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3fd481130 con 0x55e3fd658310 2023-11-27T18:14:28.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.092+0000 7f99c1ceb000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3fd46e9a0 con 0x55e3fd652930 2023-11-27T18:14:28.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.092+0000 7f99c1ceb000 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e3fd46bed0 con 0x55e3fd6579f0 2023-11-27T18:14:28.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.096+0000 7f99bc957640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55e3fd6579f0 0x55e3fd657dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:28.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.096+0000 7f99bc957640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55e3fd6579f0 0x55e3fd657dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.91:50400/0 (socket says 172.21.15.91:50400) 2023-11-27T18:14:28.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.096+0000 7f99bc957640 1 -- 172.21.15.91:0/965374610 learned_addr learned my addr 172.21.15.91:0/965374610 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:28.095 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.096+0000 7f99bd158640 1 --2- 172.21.15.91:0/965374610 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e3fd652930 0x55e3fd652d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:28.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.100+0000 7f99bc957640 1 -- 172.21.15.91:0/965374610 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e3fd652930 msgr2=0x55e3fd652d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:28.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.100+0000 7f99bc957640 1 --2- 172.21.15.91:0/965374610 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e3fd652930 0x55e3fd652d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:28.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.100+0000 7f99bc957640 1 -- 172.21.15.91:0/965374610 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e3fd658310 msgr2=0x55e3fd6586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:28.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.100+0000 7f99bc957640 1 --2- 172.21.15.91:0/965374610 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e3fd658310 0x55e3fd6586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:28.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.100+0000 7f99bc957640 1 -- 172.21.15.91:0/965374610 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3fd15f890 con 0x55e3fd6579f0 2023-11-27T18:14:28.104 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.108+0000 7f99bc957640 1 --2- 172.21.15.91:0/965374610 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55e3fd6579f0 0x55e3fd657dd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f99b0007850 tx=0x7f99b0007d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54881e0d16bab410 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:28.110 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.112+0000 7f99b57fa640 1 -- 172.21.15.91:0/1552341626 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f99a0017b20 con 0x7f99b80bdde0 2023-11-27T18:14:28.110 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.112+0000 7f99b57fa640 1 --2- 172.21.15.91:0/1552341626 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f9998066870 0x7f9998068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:28.110 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.112+0000 7f99bd158640 1 --2- 172.21.15.91:0/1552341626 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f9998066870 0x7f9998068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:28.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.112+0000 7f99bd158640 1 --2- 172.21.15.91:0/1552341626 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f9998066870 0x7f9998068d30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f99a80af000 tx=0x7f99a80046d0 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:28.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.116+0000 7f99b57fa640 1 -- 172.21.15.91:0/1552341626 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f99a0055ed0 con 0x7f99b80bdde0 2023-11-27T18:14:28.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.124+0000 7f99ae7fc640 1 -- 172.21.15.91:0/965374610 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b00074e0 con 0x55e3fd6579f0 2023-11-27T18:14:28.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.124+0000 7f99ae7fc640 1 -- 172.21.15.91:0/965374610 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b000d040 con 0x55e3fd6579f0 2023-11-27T18:14:28.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.124+0000 7f99ae7fc640 1 -- 172.21.15.91:0/965374610 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b0004a30 con 0x55e3fd6579f0 2023-11-27T18:14:28.122 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.124+0000 7f99c1ceb000 1 -- 172.21.15.91:0/965374610 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55e3fd6579f0 msgr2=0x55e3fd657dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:28.123 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.124+0000 7f99c1ceb000 1 --2- 172.21.15.91:0/965374610 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55e3fd6579f0 0x55e3fd657dd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f99b0007850 tx=0x7f99b0007d10 comp rx=0 tx=0).stop 2023-11-27T18:14:28.123 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.124+0000 7f99c1ceb000 1 -- 172.21.15.91:0/965374610 shutdown_connections 2023-11-27T18:14:28.123 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.124+0000 7f99c1ceb000 1 --2- 172.21.15.91:0/965374610 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55e3fd6579f0 0x55e3fd657dd0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:28.123 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.124+0000 7f99c1ceb000 1 --2- 172.21.15.91:0/965374610 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e3fd658310 0x55e3fd6586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:28.123 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.124+0000 7f99c1ceb000 1 --2- 172.21.15.91:0/965374610 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e3fd652930 0x55e3fd652d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:28.123 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.124+0000 7f99c1ceb000 1 -- 172.21.15.91:0/965374610 >> 172.21.15.91:0/965374610 conn(0x55e3fd6537a0 msgr2=0x55e3fd655b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:28.123 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.124+0000 7f99c1ceb000 1 -- 172.21.15.91:0/965374610 shutdown_connections 2023-11-27T18:14:28.123 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.124+0000 7f99c1ceb000 1 -- 172.21.15.91:0/965374610 wait complete. 2023-11-27T18:14:28.123 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.124+0000 7f99c1ceb000 1 -- start start 2023-11-27T18:14:28.123 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.124+0000 7f99c1ceb000 1 Processor -- start 2023-11-27T18:14:28.124 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.128+0000 7f99c1ceb000 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55e3fd652930 0x55e3fd651d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:28.124 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.128+0000 7f99c1ceb000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e3fd6579f0 0x55e3fd652250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:28.125 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.128+0000 7f99c1ceb000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e3fd658310 0x55e3fd661990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:28.125 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.128+0000 7f99c1ceb000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3fd4677c0 con 0x55e3fd6579f0 2023-11-27T18:14:28.125 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.128+0000 7f99c1ceb000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3fd41fbf0 con 0x55e3fd658310 2023-11-27T18:14:28.125 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.128+0000 7f99c1ceb000 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e3fd425a90 con 0x55e3fd652930 2023-11-27T18:14:28.125 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.128+0000 7f99c1ceb000 10 client.0 _ll_register_callbacks cb 0x55e3fd6023c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-27T18:14:28.125 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.128+0000 7f99b7fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e3fd6579f0 0x55e3fd652250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:28.125 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.128+0000 7f99b7fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e3fd6579f0 0x55e3fd652250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:38860/0 (socket says 172.21.15.91:38860) 2023-11-27T18:14:28.125 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.128+0000 7f99b7fff640 1 -- 172.21.15.91:0/3686679458 learned_addr learned my addr 172.21.15.91:0/3686679458 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:28.125 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.128+0000 7f99bd158640 1 --2- 172.21.15.91:0/3686679458 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e3fd658310 0x55e3fd661990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:28.128 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.132+0000 7f99b7fff640 1 -- 172.21.15.91:0/3686679458 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55e3fd652930 msgr2=0x55e3fd651d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:28.128 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.132+0000 7f99b7fff640 1 --2- 172.21.15.91:0/3686679458 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55e3fd652930 0x55e3fd651d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:28.128 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.132+0000 7f99b7fff640 1 -- 172.21.15.91:0/3686679458 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e3fd658310 msgr2=0x55e3fd661990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:28.128 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.132+0000 7f99b7fff640 1 --2- 172.21.15.91:0/3686679458 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e3fd658310 0x55e3fd661990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:28.128 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.132+0000 7f99b7fff640 1 -- 172.21.15.91:0/3686679458 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99b815aa00 con 0x55e3fd6579f0 2023-11-27T18:14:28.130 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.132+0000 7f99b7fff640 1 --2- 172.21.15.91:0/3686679458 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e3fd6579f0 0x55e3fd652250 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f99a005d5a0 tx=0x7f99a005dad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b1dd4785a5adadd server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:28.130 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.132+0000 7f99977fe640 10 client.0 ms_handle_connect on v2:172.21.15.91:3300/0 2023-11-27T18:14:28.133 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.136+0000 7f99977fe640 1 -- 172.21.15.91:0/3686679458 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a0081070 con 0x55e3fd6579f0 2023-11-27T18:14:28.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.136+0000 7f99977fe640 1 -- 172.21.15.91:0/3686679458 <== mon.0 v2:172.21.15.91:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f99a0054cc0 con 0x55e3fd6579f0 2023-11-27T18:14:28.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.136+0000 7f99c1ceb000 1 -- 172.21.15.91:0/3686679458 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e3fd429470 con 0x55e3fd6579f0 2023-11-27T18:14:28.137 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.136+0000 7f99977fe640 1 -- 172.21.15.91:0/3686679458 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99a0055d00 con 0x55e3fd6579f0 2023-11-27T18:14:28.137 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.136+0000 7f99c1ceb000 10 client.4722 fetch_fsmap learned FSMap version 9 2023-11-27T18:14:28.137 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.136+0000 7f99c1ceb000 1 -- 172.21.15.91:0/3686679458 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55e3fd428190 con 0x55e3fd6579f0 2023-11-27T18:14:28.139 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.140+0000 7f99977fe640 1 -- 172.21.15.91:0/3686679458 <== mon.0 v2:172.21.15.91:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e3fd429470 con 0x55e3fd6579f0 2023-11-27T18:14:28.140 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.140+0000 7f99977fe640 1 -- 172.21.15.91:0/3686679458 <== mon.0 v2:172.21.15.91:3300/0 5 ==== fsmap(e 9) v1 ==== 4452+0+0 (secure 0 0 0) 0x7f99a0005d20 con 0x55e3fd6579f0 2023-11-27T18:14:28.140 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.140+0000 7f99c1ceb000 10 client.4722 fetch_fsmap finished waiting for FSMap version 9 2023-11-27T18:14:28.140 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.140+0000 7f99c1ceb000 10 client.4722 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-27T18:14:28.140 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.140+0000 7f99c1ceb000 20 client.4722 populate_metadata read hostname 'smithi091' 2023-11-27T18:14:28.140 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.144+0000 7f99c1ceb000 1 --2- 172.21.15.91:0/3686679458 >> [v2:172.21.15.94:6836/3938864244,v1:172.21.15.94:6837/3938864244] conn(0x55e3fd6626d0 0x55e3fd662ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:28.140 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.144+0000 7f99c1ceb000 4 client.4722 mds_command: new command op to 4255 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-27T18:14:28.140 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.144+0000 7f99c1ceb000 1 -- 172.21.15.91:0/3686679458 --> [v2:172.21.15.94:6836/3938864244,v1:172.21.15.94:6837/3938864244] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e3fd42cb50 con 0x55e3fd6626d0 2023-11-27T18:14:28.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.144+0000 7f99bc957640 1 --2- 172.21.15.91:0/3686679458 >> [v2:172.21.15.94:6836/3938864244,v1:172.21.15.94:6837/3938864244] conn(0x55e3fd6626d0 0x55e3fd662ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:28.146 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.148+0000 7f99bc957640 1 --2- 172.21.15.91:0/3686679458 >> [v2:172.21.15.94:6836/3938864244,v1:172.21.15.94:6837/3938864244] conn(0x55e3fd6626d0 0x55e3fd662ab0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=382bf202398bf924 server_cookie=7678c11609b7d420 in_seq=0 out_seq=0 2023-11-27T18:14:28.147 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.148+0000 7f99977fe640 10 client.4722 ms_handle_connect on v2:172.21.15.94:6836/3938864244 2023-11-27T18:14:28.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.192+0000 7f99977fe640 1 -- 172.21.15.91:0/3686679458 <== mds.0 v2:172.21.15.94:6836/3938864244 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e3fd42cb50 con 0x55e3fd6626d0 2023-11-27T18:14:28.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.192+0000 7f99977fe640 10 client.4722 handle_command_reply: tid=0 2023-11-27T18:14:28.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.192+0000 7f99c1ceb000 1 client.4722 shutdown 2023-11-27T18:14:28.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.192+0000 7f99c1ceb000 1 -- 172.21.15.91:0/3686679458 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e3fd6579f0 msgr2=0x55e3fd652250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:28.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.192+0000 7f99c1ceb000 1 --2- 172.21.15.91:0/3686679458 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e3fd6579f0 0x55e3fd652250 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f99a005d5a0 tx=0x7f99a005dad0 comp rx=0 tx=0).stop 2023-11-27T18:14:28.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.192+0000 7f99c1ceb000 1 -- 172.21.15.91:0/3686679458 shutdown_connections 2023-11-27T18:14:28.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.192+0000 7f99c1ceb000 1 --2- 172.21.15.91:0/3686679458 >> [v2:172.21.15.94:6836/3938864244,v1:172.21.15.94:6837/3938864244] conn(0x55e3fd6626d0 0x55e3fd662ab0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:28.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.192+0000 7f99c1ceb000 1 --2- 172.21.15.91:0/3686679458 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e3fd658310 0x55e3fd661990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:28.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.192+0000 7f99c1ceb000 1 --2- 172.21.15.91:0/3686679458 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e3fd6579f0 0x55e3fd652250 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:28.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.192+0000 7f99977fe640 0 client.4722 ms_handle_reset on v2:172.21.15.94:6836/3938864244 2023-11-27T18:14:28.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.192+0000 7f99c1ceb000 1 --2- 172.21.15.91:0/3686679458 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55e3fd652930 0x55e3fd651d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:28.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.192+0000 7f99c1ceb000 1 -- 172.21.15.91:0/3686679458 >> 172.21.15.91:0/3686679458 conn(0x55e3fd6537a0 msgr2=0x55e3fd61cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:28.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.192+0000 7f99c1ceb000 1 -- 172.21.15.91:0/3686679458 shutdown_connections 2023-11-27T18:14:28.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.192+0000 7f99c1ceb000 1 -- 172.21.15.91:0/3686679458 wait complete. 2023-11-27T18:14:28.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.196+0000 7f99c1ceb000 20 client.4722 trim_cache size 0 max 16384 2023-11-27T18:14:28.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.228+0000 7f99c1ceb000 1 Processor -- start 2023-11-27T18:14:28.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.228+0000 7f99c1ceb000 1 -- start start 2023-11-27T18:14:28.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.232+0000 7f99c1ceb000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e3fd652930 0x55e3fd661640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:28.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.232+0000 7f99c1ceb000 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55e3fd6579f0 0x55e3fd661b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:28.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.232+0000 7f99c1ceb000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e3fd658310 0x55e3fd655b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:28.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.232+0000 7f99c1ceb000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3fd120940 con 0x55e3fd652930 2023-11-27T18:14:28.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.232+0000 7f99c1ceb000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3fd4a9140 con 0x55e3fd658310 2023-11-27T18:14:28.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.232+0000 7f99c1ceb000 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e3fd430910 con 0x55e3fd6579f0 2023-11-27T18:14:28.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.232+0000 7f99bc957640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e3fd652930 0x55e3fd661640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:28.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.232+0000 7f99bc957640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e3fd652930 0x55e3fd661640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:38862/0 (socket says 172.21.15.91:38862) 2023-11-27T18:14:28.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.232+0000 7f99bc957640 1 -- 172.21.15.91:0/3585179240 learned_addr learned my addr 172.21.15.91:0/3585179240 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:28.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.232+0000 7f99b7fff640 1 --2- 172.21.15.91:0/3585179240 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55e3fd6579f0 0x55e3fd661b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:28.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.232+0000 7f99bd158640 1 --2- 172.21.15.91:0/3585179240 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e3fd658310 0x55e3fd655b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:28.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.236+0000 7f99bc957640 1 -- 172.21.15.91:0/3585179240 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55e3fd6579f0 msgr2=0x55e3fd661b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:28.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.236+0000 7f99bc957640 1 --2- 172.21.15.91:0/3585179240 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55e3fd6579f0 0x55e3fd661b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:28.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.236+0000 7f99bc957640 1 -- 172.21.15.91:0/3585179240 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e3fd658310 msgr2=0x55e3fd655b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:28.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.236+0000 7f99bc957640 1 --2- 172.21.15.91:0/3585179240 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e3fd658310 0x55e3fd655b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:28.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.236+0000 7f99bc957640 1 -- 172.21.15.91:0/3585179240 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3fd40e490 con 0x55e3fd652930 2023-11-27T18:14:28.235 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.236+0000 7f99bc957640 1 --2- 172.21.15.91:0/3585179240 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e3fd652930 0x55e3fd661640 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f99b0012000 tx=0x7f99b0006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68cdacbb8ad99472 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:28.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.244+0000 7f99aeffd640 1 -- 172.21.15.91:0/3585179240 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b0007560 con 0x55e3fd652930 2023-11-27T18:14:28.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.244+0000 7f99aeffd640 1 -- 172.21.15.91:0/3585179240 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b0000ee0 con 0x55e3fd652930 2023-11-27T18:14:28.243 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.244+0000 7f99aeffd640 1 -- 172.21.15.91:0/3585179240 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b00076c0 con 0x55e3fd652930 2023-11-27T18:14:28.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.248+0000 7f99c1ceb000 1 -- 172.21.15.91:0/3585179240 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e3fd652930 msgr2=0x55e3fd661640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:28.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.248+0000 7f99c1ceb000 1 --2- 172.21.15.91:0/3585179240 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e3fd652930 0x55e3fd661640 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f99b0012000 tx=0x7f99b0006000 comp rx=0 tx=0).stop 2023-11-27T18:14:28.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.248+0000 7f99c1ceb000 1 -- 172.21.15.91:0/3585179240 shutdown_connections 2023-11-27T18:14:28.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.248+0000 7f99c1ceb000 1 --2- 172.21.15.91:0/3585179240 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55e3fd6579f0 0x55e3fd661b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:28.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.248+0000 7f99c1ceb000 1 --2- 172.21.15.91:0/3585179240 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e3fd658310 0x55e3fd655b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:28.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.248+0000 7f99c1ceb000 1 --2- 172.21.15.91:0/3585179240 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e3fd652930 0x55e3fd661640 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:28.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.248+0000 7f99c1ceb000 1 -- 172.21.15.91:0/3585179240 >> 172.21.15.91:0/3585179240 conn(0x55e3fd6537a0 msgr2=0x55e3fd6640f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:28.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.248+0000 7f99c1ceb000 1 -- 172.21.15.91:0/3585179240 shutdown_connections 2023-11-27T18:14:28.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.248+0000 7f99c1ceb000 1 -- 172.21.15.91:0/3585179240 wait complete. 2023-11-27T18:14:28.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.248+0000 7f99c1ceb000 1 -- start start 2023-11-27T18:14:28.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.248+0000 7f99c1ceb000 1 Processor -- start 2023-11-27T18:14:28.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.248+0000 7f99c1ceb000 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55e3fd652930 0x55e3fd6b6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:28.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.248+0000 7f99c1ceb000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e3fd6579f0 0x55e3fd6b7370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:28.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.248+0000 7f99c1ceb000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e3fd658310 0x55e3fd61a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:28.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.248+0000 7f99c1ceb000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3fd4028a0 con 0x55e3fd658310 2023-11-27T18:14:28.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.248+0000 7f99c1ceb000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3fd651d60 con 0x55e3fd6579f0 2023-11-27T18:14:28.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.248+0000 7f99c1ceb000 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e3fd441e30 con 0x55e3fd652930 2023-11-27T18:14:28.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.248+0000 7f99c1ceb000 10 client.0 _ll_register_callbacks cb 0x55e3fd5e2bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-27T18:14:28.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.252+0000 7f99bd158640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e3fd658310 0x55e3fd61a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:28.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.252+0000 7f99bd158640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e3fd658310 0x55e3fd61a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:38870/0 (socket says 172.21.15.91:38870) 2023-11-27T18:14:28.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.252+0000 7f99bd158640 1 -- 172.21.15.91:0/1074447043 learned_addr learned my addr 172.21.15.91:0/1074447043 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:28.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.252+0000 7f99bc957640 1 --2- 172.21.15.91:0/1074447043 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55e3fd652930 0x55e3fd6b6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:28.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.252+0000 7f99b7fff640 1 --2- 172.21.15.91:0/1074447043 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e3fd6579f0 0x55e3fd6b7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:28.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.256+0000 7f99bd158640 1 -- 172.21.15.91:0/1074447043 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55e3fd652930 msgr2=0x55e3fd6b6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:28.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.256+0000 7f99bd158640 1 --2- 172.21.15.91:0/1074447043 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55e3fd652930 0x55e3fd6b6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:28.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.256+0000 7f99bd158640 1 -- 172.21.15.91:0/1074447043 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e3fd6579f0 msgr2=0x55e3fd6b7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:28.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.256+0000 7f99bd158640 1 --2- 172.21.15.91:0/1074447043 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e3fd6579f0 0x55e3fd6b7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:28.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.256+0000 7f99bd158640 1 -- 172.21.15.91:0/1074447043 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e3fd15f890 con 0x55e3fd658310 2023-11-27T18:14:28.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.256+0000 7f99bd158640 1 --2- 172.21.15.91:0/1074447043 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e3fd658310 0x55e3fd61a0d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f99a801cf30 tx=0x7f99a80197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f61b99c143d2bc5 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:28.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.256+0000 7f99977fe640 10 client.0 ms_handle_connect on v2:172.21.15.91:3300/0 2023-11-27T18:14:28.259 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.260+0000 7f99977fe640 1 -- 172.21.15.91:0/1074447043 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a80ad890 con 0x55e3fd658310 2023-11-27T18:14:28.259 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.260+0000 7f99977fe640 1 -- 172.21.15.91:0/1074447043 <== mon.0 v2:172.21.15.91:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f99a80ad9f0 con 0x55e3fd658310 2023-11-27T18:14:28.259 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.260+0000 7f99c1ceb000 1 -- 172.21.15.91:0/1074447043 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e3fd466110 con 0x55e3fd658310 2023-11-27T18:14:28.261 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.264+0000 7f99977fe640 1 -- 172.21.15.91:0/1074447043 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99a80adbb0 con 0x55e3fd658310 2023-11-27T18:14:28.262 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.264+0000 7f99c1ceb000 10 client.4728 fetch_fsmap learned FSMap version 9 2023-11-27T18:14:28.262 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.264+0000 7f99c1ceb000 1 -- 172.21.15.91:0/1074447043 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55e3fd15fcc0 con 0x55e3fd658310 2023-11-27T18:14:28.269 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.272+0000 7f99977fe640 1 -- 172.21.15.91:0/1074447043 <== mon.0 v2:172.21.15.91:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e3fd466110 con 0x55e3fd658310 2023-11-27T18:14:28.269 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.272+0000 7f99977fe640 1 -- 172.21.15.91:0/1074447043 <== mon.0 v2:172.21.15.91:3300/0 5 ==== fsmap(e 9) v1 ==== 4452+0+0 (secure 0 0 0) 0x7f99a80add10 con 0x55e3fd658310 2023-11-27T18:14:28.269 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.272+0000 7f99c1ceb000 10 client.4728 fetch_fsmap finished waiting for FSMap version 9 2023-11-27T18:14:28.270 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.272+0000 7f99c1ceb000 10 client.4728 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-27T18:14:28.270 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.272+0000 7f99c1ceb000 20 client.4728 populate_metadata read hostname 'smithi091' 2023-11-27T18:14:28.270 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.272+0000 7f99c1ceb000 1 --2- 172.21.15.91:0/1074447043 >> [v2:172.21.15.94:6836/3938864244,v1:172.21.15.94:6837/3938864244] conn(0x55e3fd61a610 0x55e3fd61a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:28.270 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.272+0000 7f99c1ceb000 4 client.4728 mds_command: new command op to 4255 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-27T18:14:28.270 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.272+0000 7f99c1ceb000 1 -- 172.21.15.91:0/1074447043 --> [v2:172.21.15.94:6836/3938864244,v1:172.21.15.94:6837/3938864244] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e3fd4959a0 con 0x55e3fd61a610 2023-11-27T18:14:28.270 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.272+0000 7f99bc957640 1 --2- 172.21.15.91:0/1074447043 >> [v2:172.21.15.94:6836/3938864244,v1:172.21.15.94:6837/3938864244] conn(0x55e3fd61a610 0x55e3fd61a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:28.277 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.280+0000 7f99bc957640 1 --2- 172.21.15.91:0/1074447043 >> [v2:172.21.15.94:6836/3938864244,v1:172.21.15.94:6837/3938864244] conn(0x55e3fd61a610 0x55e3fd61a9f0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=983fcab4a72d9f09 server_cookie=a0203531c48a663f in_seq=0 out_seq=0 2023-11-27T18:14:28.277 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.280+0000 7f99977fe640 10 client.4728 ms_handle_connect on v2:172.21.15.94:6836/3938864244 2023-11-27T18:14:28.286 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.288+0000 7f99977fe640 1 -- 172.21.15.91:0/1074447043 <== mds.0 v2:172.21.15.94:6836/3938864244 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55e3fd4959a0 con 0x55e3fd61a610 2023-11-27T18:14:28.286 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.288+0000 7f99977fe640 10 client.4728 handle_command_reply: tid=0 2023-11-27T18:14:28.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.288+0000 7f99c1ceb000 1 client.4728 shutdown 2023-11-27T18:14:28.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.288+0000 7f99c1ceb000 1 -- 172.21.15.91:0/1074447043 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e3fd658310 msgr2=0x55e3fd61a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:28.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.288+0000 7f99c1ceb000 1 --2- 172.21.15.91:0/1074447043 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e3fd658310 0x55e3fd61a0d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f99a801cf30 tx=0x7f99a80197f0 comp rx=0 tx=0).stop 2023-11-27T18:14:28.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.288+0000 7f99c1ceb000 1 -- 172.21.15.91:0/1074447043 shutdown_connections 2023-11-27T18:14:28.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.288+0000 7f99c1ceb000 1 --2- 172.21.15.91:0/1074447043 >> [v2:172.21.15.94:6836/3938864244,v1:172.21.15.94:6837/3938864244] conn(0x55e3fd61a610 0x55e3fd61a9f0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:28.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.288+0000 7f99c1ceb000 1 --2- 172.21.15.91:0/1074447043 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e3fd658310 0x55e3fd61a0d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:28.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.288+0000 7f99977fe640 0 client.4728 ms_handle_reset on v2:172.21.15.94:6836/3938864244 2023-11-27T18:14:28.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.288+0000 7f99c1ceb000 1 --2- 172.21.15.91:0/1074447043 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e3fd6579f0 0x55e3fd6b7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:28.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.288+0000 7f99c1ceb000 1 --2- 172.21.15.91:0/1074447043 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55e3fd652930 0x55e3fd6b6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:28.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.288+0000 7f99c1ceb000 1 -- 172.21.15.91:0/1074447043 >> 172.21.15.91:0/1074447043 conn(0x55e3fd6537a0 msgr2=0x55e3fd663340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:28.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.288+0000 7f99c1ceb000 1 -- 172.21.15.91:0/1074447043 shutdown_connections 2023-11-27T18:14:28.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.288+0000 7f99c1ceb000 1 -- 172.21.15.91:0/1074447043 wait complete. 2023-11-27T18:14:28.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.288+0000 7f99c1ceb000 20 client.4728 trim_cache size 0 max 16384 2023-11-27T18:14:28.288 INFO:teuthology.orchestra.run.smithi091.stdout:{ 2023-11-27T18:14:28.288 INFO:teuthology.orchestra.run.smithi091.stdout: "cluster_fsid": "08c8ebbf-7936-4c41-a995-d5600de2d072", 2023-11-27T18:14:28.288 INFO:teuthology.orchestra.run.smithi091.stdout: "whoami": 0, 2023-11-27T18:14:28.288 INFO:teuthology.orchestra.run.smithi091.stdout: "id": 4255, 2023-11-27T18:14:28.288 INFO:teuthology.orchestra.run.smithi091.stdout: "want_state": "up:active", 2023-11-27T18:14:28.288 INFO:teuthology.orchestra.run.smithi091.stdout: "state": "up:active", 2023-11-27T18:14:28.289 INFO:teuthology.orchestra.run.smithi091.stdout: "fs_name": "cephfs", 2023-11-27T18:14:28.289 INFO:teuthology.orchestra.run.smithi091.stdout: "rank_uptime": 73.902004805999994, 2023-11-27T18:14:28.289 INFO:teuthology.orchestra.run.smithi091.stdout: "mdsmap_epoch": 9, 2023-11-27T18:14:28.289 INFO:teuthology.orchestra.run.smithi091.stdout: "osdmap_epoch": 32, 2023-11-27T18:14:28.289 INFO:teuthology.orchestra.run.smithi091.stdout: "osdmap_epoch_barrier": 30, 2023-11-27T18:14:28.289 INFO:teuthology.orchestra.run.smithi091.stdout: "uptime": 105.969434522 2023-11-27T18:14:28.289 INFO:teuthology.orchestra.run.smithi091.stdout:} 2023-11-27T18:14:28.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.288+0000 7f99bebbb640 1 -- 172.21.15.91:0/1552341626 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f9998066870 msgr2=0x7f9998068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:28.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.288+0000 7f99bebbb640 1 --2- 172.21.15.91:0/1552341626 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f9998066870 0x7f9998068d30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f99a80af000 tx=0x7f99a80046d0 comp rx=0 tx=0).stop 2023-11-27T18:14:28.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.288+0000 7f99bebbb640 1 -- 172.21.15.91:0/1552341626 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f99b80bdde0 msgr2=0x7f99b80bf7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:28.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.288+0000 7f99bebbb640 1 --2- 172.21.15.91:0/1552341626 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f99b80bdde0 0x7f99b80bf7f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f99a000f350 tx=0x7f99a000f810 comp rx=0 tx=0).stop 2023-11-27T18:14:28.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.288+0000 7f99bebbb640 1 -- 172.21.15.91:0/1552341626 shutdown_connections 2023-11-27T18:14:28.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.288+0000 7f99bebbb640 1 --2- 172.21.15.91:0/1552341626 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f9998066870 0x7f9998068d30 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:28.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.288+0000 7f99bebbb640 1 --2- 172.21.15.91:0/1552341626 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f99b80c9b50 0x7f99b80bfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:28.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.288+0000 7f99bebbb640 1 --2- 172.21.15.91:0/1552341626 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f99b80bdde0 0x7f99b80bf7f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:28.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.288+0000 7f99bebbb640 1 --2- 172.21.15.91:0/1552341626 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99a4004d10 0x7f99b81567f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:28.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.288+0000 7f99bebbb640 1 -- 172.21.15.91:0/1552341626 >> 172.21.15.91:0/1552341626 conn(0x7f99b80ca9d0 msgr2=0x7f99b80c87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:28.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.292+0000 7f99bebbb640 1 -- 172.21.15.91:0/1552341626 shutdown_connections 2023-11-27T18:14:28.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.292+0000 7f99bebbb640 1 -- 172.21.15.91:0/1552341626 wait complete. 2023-11-27T18:14:28.314 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-11-27T18:14:28.327 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-11-27T18:14:28.327 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2023-11-27T18:14:28.327 INFO:tasks.ceph_fuse:client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2023-11-27T18:14:28.327 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-27T18:14:28.327 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-27T18:14:28.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T18:14:28.328 DEBUG:teuthology.orchestra.run.smithi091:> ip netns list 2023-11-27T18:14:28.334 INFO:teuthology.orchestra.run.smithi091.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-11-27T18:14:28.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T18:14:28.335 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-27T18:14:28.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T18:14:28.393 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip link delete ceph-brx 2023-11-27T18:14:28.582 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-11-27T18:14:28.582 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-27T18:14:28.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.708+0000 7fda21036640 1 Processor -- start 2023-11-27T18:14:28.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.708+0000 7fda21036640 1 -- start start 2023-11-27T18:14:28.708 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.712+0000 7fda21036640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fda1c1504c0 0x7fda1c15a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:28.708 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.712+0000 7fda21036640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fda1c0c8610 0x7fda1c071f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:28.708 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.712+0000 7fda21036640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fda1c1508a0 0x7fda1c072460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:28.708 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.712+0000 7fda21036640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda1c0c1b10 con 0x7fda1c1504c0 2023-11-27T18:14:28.708 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.712+0000 7fda21036640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda1c15a900 con 0x7fda1c1508a0 2023-11-27T18:14:28.708 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.712+0000 7fda21036640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c1563c0 con 0x7fda1c0c8610 2023-11-27T18:14:28.709 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.712+0000 7fda1ad9d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fda1c1504c0 0x7fda1c15a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:28.709 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.712+0000 7fda1ad9d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fda1c1504c0 0x7fda1c15a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:38886/0 (socket says 172.21.15.91:38886) 2023-11-27T18:14:28.709 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.712+0000 7fda1ad9d640 1 -- 172.21.15.91:0/2660665866 learned_addr learned my addr 172.21.15.91:0/2660665866 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:28.711 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.712+0000 7fda1ad9d640 1 -- 172.21.15.91:0/2660665866 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fda1c0c8610 msgr2=0x7fda1c071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:28.711 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.716+0000 7fda1ad9d640 1 --2- 172.21.15.91:0/2660665866 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fda1c0c8610 0x7fda1c071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:28.711 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.716+0000 7fda1ad9d640 1 -- 172.21.15.91:0/2660665866 >> v2:172.21.15.94:3300/0 conn(0x7fda1c1508a0 msgr2=0x7fda1c072460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:14:28.712 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.716+0000 7fda1ad9d640 1 --2- 172.21.15.91:0/2660665866 >> v2:172.21.15.94:3300/0 conn(0x7fda1c1508a0 0x7fda1c072460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:28.712 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.716+0000 7fda1ad9d640 1 -- 172.21.15.91:0/2660665866 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda1c0c6200 con 0x7fda1c1504c0 2023-11-27T18:14:28.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.716+0000 7fda1ad9d640 1 --2- 172.21.15.91:0/2660665866 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fda1c1504c0 0x7fda1c15a3c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fda1c06b450 tx=0x7fda0c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d97f46fd00672d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:28.726 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.728+0000 7fda19d9b640 1 -- 172.21.15.91:0/2660665866 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0c0a89d0 con 0x7fda1c1504c0 2023-11-27T18:14:28.726 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.728+0000 7fda19d9b640 1 -- 172.21.15.91:0/2660665866 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda0c0a8b30 con 0x7fda1c1504c0 2023-11-27T18:14:28.726 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.728+0000 7fda19d9b640 1 -- 172.21.15.91:0/2660665866 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0c0b0440 con 0x7fda1c1504c0 2023-11-27T18:14:28.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.728+0000 7fda21036640 1 -- 172.21.15.91:0/2660665866 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fda1c1504c0 msgr2=0x7fda1c15a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:28.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.728+0000 7fda21036640 1 --2- 172.21.15.91:0/2660665866 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fda1c1504c0 0x7fda1c15a3c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fda1c06b450 tx=0x7fda0c01ed10 comp rx=0 tx=0).stop 2023-11-27T18:14:28.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.728+0000 7fda21036640 1 -- 172.21.15.91:0/2660665866 shutdown_connections 2023-11-27T18:14:28.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.728+0000 7fda21036640 1 --2- 172.21.15.91:0/2660665866 >> v2:172.21.15.94:3300/0 conn(0x7fda1c1508a0 0x7fda1c072460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:28.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.728+0000 7fda21036640 1 --2- 172.21.15.91:0/2660665866 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fda1c0c8610 0x7fda1c071f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:28.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.728+0000 7fda21036640 1 --2- 172.21.15.91:0/2660665866 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fda1c1504c0 0x7fda1c15a3c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:28.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.728+0000 7fda21036640 1 -- 172.21.15.91:0/2660665866 >> 172.21.15.91:0/2660665866 conn(0x7fda1c0c79b0 msgr2=0x7fda1c0c7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:28.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.728+0000 7fda21036640 1 -- 172.21.15.91:0/2660665866 shutdown_connections 2023-11-27T18:14:28.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.728+0000 7fda21036640 1 -- 172.21.15.91:0/2660665866 wait complete. 2023-11-27T18:14:28.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.732+0000 7fda21036640 1 Processor -- start 2023-11-27T18:14:28.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.732+0000 7fda21036640 1 -- start start 2023-11-27T18:14:28.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.732+0000 7fda21036640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fda1c0c8610 0x7fda1c1592a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:28.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.732+0000 7fda21036640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fda1c1504c0 0x7fda1c14bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:28.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.732+0000 7fda21036640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fda1c1508a0 0x7fda1c1efbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:28.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.732+0000 7fda21036640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c1597e0 con 0x7fda1c1508a0 2023-11-27T18:14:28.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.732+0000 7fda21036640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c0c2980 con 0x7fda1c1504c0 2023-11-27T18:14:28.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.732+0000 7fda21036640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c0c4040 con 0x7fda1c0c8610 2023-11-27T18:14:28.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.732+0000 7fda1a59c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fda1c1504c0 0x7fda1c14bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:28.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.732+0000 7fda1ad9d640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fda1c0c8610 0x7fda1c1592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:28.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.736+0000 7fda1a59c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fda1c1504c0 0x7fda1c14bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.91:40294/0 (socket says 172.21.15.91:40294) 2023-11-27T18:14:28.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.736+0000 7fda1a59c640 1 -- 172.21.15.91:0/807891684 learned_addr learned my addr 172.21.15.91:0/807891684 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:14:28.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.740+0000 7fda1b59e640 1 --2- 172.21.15.91:0/807891684 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fda1c1508a0 0x7fda1c1efbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:28.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.744+0000 7fda1a59c640 1 -- 172.21.15.91:0/807891684 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fda1c0c8610 msgr2=0x7fda1c1592a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:28.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.744+0000 7fda1a59c640 1 --2- 172.21.15.91:0/807891684 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fda1c0c8610 0x7fda1c1592a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:28.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.744+0000 7fda1a59c640 1 -- 172.21.15.91:0/807891684 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fda1c1508a0 msgr2=0x7fda1c1efbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:28.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.744+0000 7fda1a59c640 1 --2- 172.21.15.91:0/807891684 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fda1c1508a0 0x7fda1c1efbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:28.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.744+0000 7fda1a59c640 1 -- 172.21.15.91:0/807891684 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda0c0094d0 con 0x7fda1c1504c0 2023-11-27T18:14:28.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.756+0000 7fda1a59c640 1 --2- 172.21.15.91:0/807891684 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fda1c1504c0 0x7fda1c14bf30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fda1000b480 tx=0x7fda1000b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:28.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.884+0000 7fda037fe640 1 -- 172.21.15.91:0/807891684 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda10010870 con 0x7fda1c1504c0 2023-11-27T18:14:28.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.884+0000 7fda037fe640 1 -- 172.21.15.91:0/807891684 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda100109d0 con 0x7fda1c1504c0 2023-11-27T18:14:28.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.884+0000 7fda037fe640 1 -- 172.21.15.91:0/807891684 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda10010d80 con 0x7fda1c1504c0 2023-11-27T18:14:28.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.884+0000 7fda21036640 1 -- 172.21.15.91:0/807891684 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda1c0c4320 con 0x7fda1c1504c0 2023-11-27T18:14:28.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.884+0000 7fda21036640 1 -- 172.21.15.91:0/807891684 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda1c0c48e0 con 0x7fda1c1504c0 2023-11-27T18:14:28.882 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:28.884+0000 7fda21036640 1 -- 172.21.15.91:0/807891684 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda1c156920 con 0x7fda1c1504c0 2023-11-27T18:14:29.193 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:29.196+0000 7fda037fe640 1 -- 172.21.15.91:0/807891684 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fda10023480 con 0x7fda1c1504c0 2023-11-27T18:14:29.193 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:29.196+0000 7fda037fe640 1 --2- 172.21.15.91:0/807891684 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fda08066840 0x7fda08068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:14:29.193 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:29.196+0000 7fda1ad9d640 1 --2- 172.21.15.91:0/807891684 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fda08066840 0x7fda08068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:14:29.194 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:29.196+0000 7fda1ad9d640 1 --2- 172.21.15.91:0/807891684 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fda08066840 0x7fda08068d00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fda0c0b2000 tx=0x7fda0c0aa070 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:14:29.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:29.204+0000 7fda037fe640 1 -- 172.21.15.91:0/807891684 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fda10055570 con 0x7fda1c1504c0 2023-11-27T18:14:29.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:29.232+0000 7fda037fe640 1 -- 172.21.15.91:0/807891684 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fda100518b0 con 0x7fda1c1504c0 2023-11-27T18:14:29.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:29.452+0000 7fda21036640 1 -- 172.21.15.91:0/807891684 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fda1c067150 con 0x7fda1c1504c0 2023-11-27T18:14:29.464 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:29.468+0000 7fda037fe640 1 -- 172.21.15.91:0/807891684 <== mon.1 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fda1001e070 con 0x7fda1c1504c0 2023-11-27T18:14:29.465 INFO:teuthology.orchestra.run.smithi091.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-27T18:14:29.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:29.468+0000 7fda21036640 1 -- 172.21.15.91:0/807891684 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fda08066840 msgr2=0x7fda08068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:29.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:29.468+0000 7fda21036640 1 --2- 172.21.15.91:0/807891684 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fda08066840 0x7fda08068d00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fda0c0b2000 tx=0x7fda0c0aa070 comp rx=0 tx=0).stop 2023-11-27T18:14:29.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:29.468+0000 7fda21036640 1 -- 172.21.15.91:0/807891684 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fda1c1504c0 msgr2=0x7fda1c14bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:14:29.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:29.468+0000 7fda21036640 1 --2- 172.21.15.91:0/807891684 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fda1c1504c0 0x7fda1c14bf30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fda1000b480 tx=0x7fda1000b940 comp rx=0 tx=0).stop 2023-11-27T18:14:29.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:29.468+0000 7fda21036640 1 -- 172.21.15.91:0/807891684 shutdown_connections 2023-11-27T18:14:29.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:29.468+0000 7fda21036640 1 --2- 172.21.15.91:0/807891684 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fda08066840 0x7fda08068d00 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:29.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:29.468+0000 7fda21036640 1 --2- 172.21.15.91:0/807891684 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fda1c1508a0 0x7fda1c1efbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:29.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:29.468+0000 7fda21036640 1 --2- 172.21.15.91:0/807891684 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fda1c1504c0 0x7fda1c14bf30 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:29.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:29.468+0000 7fda21036640 1 --2- 172.21.15.91:0/807891684 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fda1c0c8610 0x7fda1c1592a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:14:29.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:29.468+0000 7fda21036640 1 -- 172.21.15.91:0/807891684 >> 172.21.15.91:0/807891684 conn(0x7fda1c0c79b0 msgr2=0x7fda1c155140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:14:29.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:29.468+0000 7fda21036640 1 -- 172.21.15.91:0/807891684 shutdown_connections 2023-11-27T18:14:29.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:29.468+0000 7fda21036640 1 -- 172.21.15.91:0/807891684 wait complete. 2023-11-27T18:14:29.484 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-27T18:14:29.484 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-27T18:14:29.484 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi091.front.sepia.ceph.com 2023-11-27T18:14:29.484 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-27T18:14:29.484 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-27T18:14:29.484 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-27T18:14:29.484 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-27T18:14:29.484 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-27T18:14:29.485 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-27T18:14:29.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T18:14:29.485 DEBUG:teuthology.orchestra.run.smithi091:> ip addr 2023-11-27T18:14:29.490 INFO:teuthology.orchestra.run.smithi091.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-27T18:14:29.490 INFO:teuthology.orchestra.run.smithi091.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-27T18:14:29.490 INFO:teuthology.orchestra.run.smithi091.stdout: inet 127.0.0.1/8 scope host lo 2023-11-27T18:14:29.491 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-27T18:14:29.491 INFO:teuthology.orchestra.run.smithi091.stdout: inet6 ::1/128 scope host 2023-11-27T18:14:29.491 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-27T18:14:29.491 INFO:teuthology.orchestra.run.smithi091.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-27T18:14:29.491 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 0c:c4:7a:d8:d9:c4 brd ff:ff:ff:ff:ff:ff 2023-11-27T18:14:29.491 INFO:teuthology.orchestra.run.smithi091.stdout: altname enp7s0f0 2023-11-27T18:14:29.491 INFO:teuthology.orchestra.run.smithi091.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-27T18:14:29.491 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 0c:c4:7a:d8:d9:c5 brd ff:ff:ff:ff:ff:ff 2023-11-27T18:14:29.491 INFO:teuthology.orchestra.run.smithi091.stdout: altname enp7s0f1 2023-11-27T18:14:29.491 INFO:teuthology.orchestra.run.smithi091.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-27T18:14:29.491 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 0c:c4:7a:8f:d3:d4 brd ff:ff:ff:ff:ff:ff 2023-11-27T18:14:29.491 INFO:teuthology.orchestra.run.smithi091.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-27T18:14:29.492 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 0c:c4:7a:8f:d3:d5 brd ff:ff:ff:ff:ff:ff 2023-11-27T18:14:29.492 INFO:teuthology.orchestra.run.smithi091.stdout: inet 172.21.15.91/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-27T18:14:29.492 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft 41776sec preferred_lft 41776sec 2023-11-27T18:14:29.492 INFO:teuthology.orchestra.run.smithi091.stdout: inet6 fe80::ec4:7aff:fe8f:d3d5/64 scope link 2023-11-27T18:14:29.492 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-27T18:14:29.492 INFO:teuthology.orchestra.run.smithi091.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-27T18:14:29.492 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 02:42:8f:16:d7:94 brd ff:ff:ff:ff:ff:ff 2023-11-27T18:14:29.492 INFO:teuthology.orchestra.run.smithi091.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-27T18:14:29.492 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-27T18:14:29.492 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-27T18:14:29.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T18:14:29.493 DEBUG:teuthology.orchestra.run.smithi091:> (cd / && exec bash -c ' 2023-11-27T18:14:29.493 DEBUG:teuthology.orchestra.run.smithi091:> set -e 2023-11-27T18:14:29.493 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip link add name ceph-brx type bridge 2023-11-27T18:14:29.493 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip addr flush dev ceph-brx 2023-11-27T18:14:29.493 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip link set ceph-brx up 2023-11-27T18:14:29.493 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-27T18:14:29.493 DEBUG:teuthology.orchestra.run.smithi091:> ') 2023-11-27T18:14:29.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T18:14:29.574 DEBUG:teuthology.orchestra.run.smithi091:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-27T18:14:29.625 INFO:teuthology.orchestra.run.smithi091.stdout:1 2023-11-27T18:14:29.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T18:14:29.627 DEBUG:teuthology.orchestra.run.smithi091:> route 2023-11-27T18:14:29.679 INFO:teuthology.orchestra.run.smithi091.stdout:Kernel IP routing table 2023-11-27T18:14:29.679 INFO:teuthology.orchestra.run.smithi091.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-27T18:14:29.679 INFO:teuthology.orchestra.run.smithi091.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-27T18:14:29.680 INFO:teuthology.orchestra.run.smithi091.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-27T18:14:29.680 INFO:teuthology.orchestra.run.smithi091.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-27T18:14:29.680 INFO:teuthology.orchestra.run.smithi091.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-27T18:14:29.680 INFO:teuthology.orchestra.run.smithi091.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-27T18:14:29.680 INFO:teuthology.orchestra.run.smithi091.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-27T18:14:29.680 INFO:teuthology.orchestra.run.smithi091.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-27T18:14:29.680 INFO:teuthology.orchestra.run.smithi091.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-27T18:14:29.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T18:14:29.680 DEBUG:teuthology.orchestra.run.smithi091:> (cd / && exec bash -c ' 2023-11-27T18:14:29.680 DEBUG:teuthology.orchestra.run.smithi091:> set -e 2023-11-27T18:14:29.681 DEBUG:teuthology.orchestra.run.smithi091:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-27T18:14:29.681 DEBUG:teuthology.orchestra.run.smithi091:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-27T18:14:29.681 DEBUG:teuthology.orchestra.run.smithi091:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-27T18:14:29.681 DEBUG:teuthology.orchestra.run.smithi091:> ') 2023-11-27T18:14:29.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T18:14:29.758 DEBUG:teuthology.orchestra.run.smithi091:> ip netns list 2023-11-27T18:14:29.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T18:14:29.809 DEBUG:teuthology.orchestra.run.smithi091:> ip netns list-id 2023-11-27T18:14:29.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T18:14:29.858 DEBUG:teuthology.orchestra.run.smithi091:> (cd / && exec bash -c ' 2023-11-27T18:14:29.858 DEBUG:teuthology.orchestra.run.smithi091:> set -e 2023-11-27T18:14:29.858 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T18:14:29.858 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-27T18:14:29.858 DEBUG:teuthology.orchestra.run.smithi091:> ') 2023-11-27T18:14:29.928 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-27T18:14:29.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T18:14:29.929 DEBUG:teuthology.orchestra.run.smithi091:> (cd / && exec bash -c ' 2023-11-27T18:14:29.929 DEBUG:teuthology.orchestra.run.smithi091:> set -e 2023-11-27T18:14:29.929 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-27T18:14:29.929 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-27T18:14:29.929 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-27T18:14:29.929 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-27T18:14:29.929 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-27T18:14:29.929 DEBUG:teuthology.orchestra.run.smithi091:> ') 2023-11-27T18:14:30.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T18:14:30.021 DEBUG:teuthology.orchestra.run.smithi091:> (cd / && exec bash -c ' 2023-11-27T18:14:30.021 DEBUG:teuthology.orchestra.run.smithi091:> set -e 2023-11-27T18:14:30.021 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip link set brx.0 up 2023-11-27T18:14:30.021 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip link set dev brx.0 master ceph-brx 2023-11-27T18:14:30.022 DEBUG:teuthology.orchestra.run.smithi091:> ') 2023-11-27T18:14:30.041 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2023-11-27T18:14:30.041 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T18:14:30.041 DEBUG:teuthology.orchestra.run.smithi091:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-27T18:14:30.087 INFO:teuthology.orchestra.run.smithi091.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-27T18:14:30.088 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T18:14:30.088 DEBUG:teuthology.orchestra.run.smithi091:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-27T18:14:30.140 DEBUG:tasks.ceph_manager:running client.0 under valgrind with args ['sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/client.0.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-11-27T18:14:30.140 DEBUG:teuthology.orchestra.run.smithi091:> sudo modprobe fuse 2023-11-27T18:14:30.197 DEBUG:teuthology.orchestra.run.smithi091:> cat /proc/self/mounts | awk '{print $2}' 2023-11-27T18:14:30.245 INFO:teuthology.orchestra.run.smithi091.stdout:/sys 2023-11-27T18:14:30.245 INFO:teuthology.orchestra.run.smithi091.stdout:/proc 2023-11-27T18:14:30.245 INFO:teuthology.orchestra.run.smithi091.stdout:/dev 2023-11-27T18:14:30.245 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/pts 2023-11-27T18:14:30.245 INFO:teuthology.orchestra.run.smithi091.stdout:/run 2023-11-27T18:14:30.245 INFO:teuthology.orchestra.run.smithi091.stdout:/ 2023-11-27T18:14:30.245 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/security 2023-11-27T18:14:30.246 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/shm 2023-11-27T18:14:30.246 INFO:teuthology.orchestra.run.smithi091.stdout:/run/lock 2023-11-27T18:14:30.246 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/cgroup 2023-11-27T18:14:30.246 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/pstore 2023-11-27T18:14:30.246 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/bpf 2023-11-27T18:14:30.246 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/sys/fs/binfmt_misc 2023-11-27T18:14:30.246 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/hugepages 2023-11-27T18:14:30.246 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/mqueue 2023-11-27T18:14:30.246 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/debug 2023-11-27T18:14:30.246 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/tracing 2023-11-27T18:14:30.247 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/fs/nfsd 2023-11-27T18:14:30.247 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/fuse/connections 2023-11-27T18:14:30.247 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/config 2023-11-27T18:14:30.247 INFO:teuthology.orchestra.run.smithi091.stdout:/run/credentials/systemd-sysusers.service 2023-11-27T18:14:30.247 INFO:teuthology.orchestra.run.smithi091.stdout:/run/rpc_pipefs 2023-11-27T18:14:30.247 INFO:teuthology.orchestra.run.smithi091.stdout:/run/user/1000 2023-11-27T18:14:30.247 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph 2023-11-27T18:14:30.247 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-0 2023-11-27T18:14:30.247 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-1 2023-11-27T18:14:30.247 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-2 2023-11-27T18:14:30.247 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-3 2023-11-27T18:14:30.247 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns 2023-11-27T18:14:30.248 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T18:14:30.248 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T18:14:30.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T18:14:30.249 DEBUG:teuthology.orchestra.run.smithi091:> ls /sys/fs/fuse/connections 2023-11-27T18:14:30.296 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-27T18:14:30.297 DEBUG:teuthology.orchestra.run.smithi091:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/client.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-27T18:14:30.341 DEBUG:teuthology.orchestra.run.smithi091:> sudo modprobe fuse 2023-11-27T18:14:30.356 DEBUG:teuthology.orchestra.run.smithi091:> cat /proc/self/mounts | awk '{print $2}' 2023-11-27T18:14:30.406 INFO:teuthology.orchestra.run.smithi091.stdout:/sys 2023-11-27T18:14:30.406 INFO:teuthology.orchestra.run.smithi091.stdout:/proc 2023-11-27T18:14:30.406 INFO:teuthology.orchestra.run.smithi091.stdout:/dev 2023-11-27T18:14:30.406 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/pts 2023-11-27T18:14:30.406 INFO:teuthology.orchestra.run.smithi091.stdout:/run 2023-11-27T18:14:30.407 INFO:teuthology.orchestra.run.smithi091.stdout:/ 2023-11-27T18:14:30.407 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/security 2023-11-27T18:14:30.407 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/shm 2023-11-27T18:14:30.407 INFO:teuthology.orchestra.run.smithi091.stdout:/run/lock 2023-11-27T18:14:30.407 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/cgroup 2023-11-27T18:14:30.407 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/pstore 2023-11-27T18:14:30.407 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/bpf 2023-11-27T18:14:30.407 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/sys/fs/binfmt_misc 2023-11-27T18:14:30.407 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/hugepages 2023-11-27T18:14:30.407 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/mqueue 2023-11-27T18:14:30.407 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/debug 2023-11-27T18:14:30.407 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/tracing 2023-11-27T18:14:30.408 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/fs/nfsd 2023-11-27T18:14:30.408 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/fuse/connections 2023-11-27T18:14:30.408 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/config 2023-11-27T18:14:30.408 INFO:teuthology.orchestra.run.smithi091.stdout:/run/credentials/systemd-sysusers.service 2023-11-27T18:14:30.408 INFO:teuthology.orchestra.run.smithi091.stdout:/run/rpc_pipefs 2023-11-27T18:14:30.408 INFO:teuthology.orchestra.run.smithi091.stdout:/run/user/1000 2023-11-27T18:14:30.408 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph 2023-11-27T18:14:30.408 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-0 2023-11-27T18:14:30.408 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-1 2023-11-27T18:14:30.408 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-2 2023-11-27T18:14:30.408 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-3 2023-11-27T18:14:30.408 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns 2023-11-27T18:14:30.409 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T18:14:30.409 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T18:14:30.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T18:14:30.410 DEBUG:teuthology.orchestra.run.smithi091:> ls /sys/fs/fuse/connections 2023-11-27T18:14:31.558 DEBUG:teuthology.orchestra.run.smithi091:> sudo modprobe fuse 2023-11-27T18:14:31.573 DEBUG:teuthology.orchestra.run.smithi091:> cat /proc/self/mounts | awk '{print $2}' 2023-11-27T18:14:31.620 INFO:teuthology.orchestra.run.smithi091.stdout:/sys 2023-11-27T18:14:31.620 INFO:teuthology.orchestra.run.smithi091.stdout:/proc 2023-11-27T18:14:31.620 INFO:teuthology.orchestra.run.smithi091.stdout:/dev 2023-11-27T18:14:31.620 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/pts 2023-11-27T18:14:31.620 INFO:teuthology.orchestra.run.smithi091.stdout:/run 2023-11-27T18:14:31.620 INFO:teuthology.orchestra.run.smithi091.stdout:/ 2023-11-27T18:14:31.621 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/security 2023-11-27T18:14:31.621 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/shm 2023-11-27T18:14:31.621 INFO:teuthology.orchestra.run.smithi091.stdout:/run/lock 2023-11-27T18:14:31.621 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/cgroup 2023-11-27T18:14:31.621 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/pstore 2023-11-27T18:14:31.621 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/bpf 2023-11-27T18:14:31.621 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/sys/fs/binfmt_misc 2023-11-27T18:14:31.621 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/hugepages 2023-11-27T18:14:31.621 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/mqueue 2023-11-27T18:14:31.621 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/debug 2023-11-27T18:14:31.621 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/tracing 2023-11-27T18:14:31.621 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/fs/nfsd 2023-11-27T18:14:31.621 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/fuse/connections 2023-11-27T18:14:31.621 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/config 2023-11-27T18:14:31.622 INFO:teuthology.orchestra.run.smithi091.stdout:/run/credentials/systemd-sysusers.service 2023-11-27T18:14:31.622 INFO:teuthology.orchestra.run.smithi091.stdout:/run/rpc_pipefs 2023-11-27T18:14:31.622 INFO:teuthology.orchestra.run.smithi091.stdout:/run/user/1000 2023-11-27T18:14:31.622 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph 2023-11-27T18:14:31.622 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-0 2023-11-27T18:14:31.622 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-1 2023-11-27T18:14:31.622 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-2 2023-11-27T18:14:31.622 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-3 2023-11-27T18:14:31.622 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns 2023-11-27T18:14:31.622 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T18:14:31.622 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T18:14:31.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T18:14:31.623 DEBUG:teuthology.orchestra.run.smithi091:> ls /sys/fs/fuse/connections 2023-11-27T18:14:32.773 DEBUG:teuthology.orchestra.run.smithi091:> sudo modprobe fuse 2023-11-27T18:14:32.789 DEBUG:teuthology.orchestra.run.smithi091:> cat /proc/self/mounts | awk '{print $2}' 2023-11-27T18:14:32.838 INFO:teuthology.orchestra.run.smithi091.stdout:/sys 2023-11-27T18:14:32.838 INFO:teuthology.orchestra.run.smithi091.stdout:/proc 2023-11-27T18:14:32.839 INFO:teuthology.orchestra.run.smithi091.stdout:/dev 2023-11-27T18:14:32.839 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/pts 2023-11-27T18:14:32.839 INFO:teuthology.orchestra.run.smithi091.stdout:/run 2023-11-27T18:14:32.839 INFO:teuthology.orchestra.run.smithi091.stdout:/ 2023-11-27T18:14:32.839 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/security 2023-11-27T18:14:32.839 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/shm 2023-11-27T18:14:32.839 INFO:teuthology.orchestra.run.smithi091.stdout:/run/lock 2023-11-27T18:14:32.839 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/cgroup 2023-11-27T18:14:32.839 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/pstore 2023-11-27T18:14:32.839 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/bpf 2023-11-27T18:14:32.839 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/sys/fs/binfmt_misc 2023-11-27T18:14:32.839 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/hugepages 2023-11-27T18:14:32.839 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/mqueue 2023-11-27T18:14:32.840 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/debug 2023-11-27T18:14:32.840 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/tracing 2023-11-27T18:14:32.840 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/fs/nfsd 2023-11-27T18:14:32.840 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/fuse/connections 2023-11-27T18:14:32.840 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/config 2023-11-27T18:14:32.840 INFO:teuthology.orchestra.run.smithi091.stdout:/run/credentials/systemd-sysusers.service 2023-11-27T18:14:32.840 INFO:teuthology.orchestra.run.smithi091.stdout:/run/rpc_pipefs 2023-11-27T18:14:32.840 INFO:teuthology.orchestra.run.smithi091.stdout:/run/user/1000 2023-11-27T18:14:32.840 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph 2023-11-27T18:14:32.840 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-0 2023-11-27T18:14:32.840 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-1 2023-11-27T18:14:32.840 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-2 2023-11-27T18:14:32.840 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-3 2023-11-27T18:14:32.841 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns 2023-11-27T18:14:32.841 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T18:14:32.841 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T18:14:32.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T18:14:32.842 DEBUG:teuthology.orchestra.run.smithi091:> ls /sys/fs/fuse/connections 2023-11-27T18:14:33.989 DEBUG:teuthology.orchestra.run.smithi091:> sudo modprobe fuse 2023-11-27T18:14:34.005 DEBUG:teuthology.orchestra.run.smithi091:> cat /proc/self/mounts | awk '{print $2}' 2023-11-27T18:14:34.054 INFO:teuthology.orchestra.run.smithi091.stdout:/sys 2023-11-27T18:14:34.054 INFO:teuthology.orchestra.run.smithi091.stdout:/proc 2023-11-27T18:14:34.054 INFO:teuthology.orchestra.run.smithi091.stdout:/dev 2023-11-27T18:14:34.054 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/pts 2023-11-27T18:14:34.054 INFO:teuthology.orchestra.run.smithi091.stdout:/run 2023-11-27T18:14:34.054 INFO:teuthology.orchestra.run.smithi091.stdout:/ 2023-11-27T18:14:34.054 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/security 2023-11-27T18:14:34.055 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/shm 2023-11-27T18:14:34.055 INFO:teuthology.orchestra.run.smithi091.stdout:/run/lock 2023-11-27T18:14:34.055 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/cgroup 2023-11-27T18:14:34.055 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/pstore 2023-11-27T18:14:34.055 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/bpf 2023-11-27T18:14:34.055 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/sys/fs/binfmt_misc 2023-11-27T18:14:34.056 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/hugepages 2023-11-27T18:14:34.056 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/mqueue 2023-11-27T18:14:34.056 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/debug 2023-11-27T18:14:34.056 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/tracing 2023-11-27T18:14:34.056 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/fs/nfsd 2023-11-27T18:14:34.056 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/fuse/connections 2023-11-27T18:14:34.056 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/config 2023-11-27T18:14:34.056 INFO:teuthology.orchestra.run.smithi091.stdout:/run/credentials/systemd-sysusers.service 2023-11-27T18:14:34.057 INFO:teuthology.orchestra.run.smithi091.stdout:/run/rpc_pipefs 2023-11-27T18:14:34.057 INFO:teuthology.orchestra.run.smithi091.stdout:/run/user/1000 2023-11-27T18:14:34.057 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph 2023-11-27T18:14:34.057 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-0 2023-11-27T18:14:34.057 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-1 2023-11-27T18:14:34.057 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-2 2023-11-27T18:14:34.057 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-3 2023-11-27T18:14:34.057 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns 2023-11-27T18:14:34.057 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T18:14:34.058 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T18:14:34.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T18:14:34.058 DEBUG:teuthology.orchestra.run.smithi091:> ls /sys/fs/fuse/connections 2023-11-27T18:14:34.698 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:14:34.701 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:14:35.201 DEBUG:teuthology.orchestra.run.smithi091:> sudo modprobe fuse 2023-11-27T18:14:35.216 DEBUG:teuthology.orchestra.run.smithi091:> cat /proc/self/mounts | awk '{print $2}' 2023-11-27T18:14:35.264 INFO:teuthology.orchestra.run.smithi091.stdout:/sys 2023-11-27T18:14:35.264 INFO:teuthology.orchestra.run.smithi091.stdout:/proc 2023-11-27T18:14:35.265 INFO:teuthology.orchestra.run.smithi091.stdout:/dev 2023-11-27T18:14:35.265 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/pts 2023-11-27T18:14:35.265 INFO:teuthology.orchestra.run.smithi091.stdout:/run 2023-11-27T18:14:35.265 INFO:teuthology.orchestra.run.smithi091.stdout:/ 2023-11-27T18:14:35.265 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/security 2023-11-27T18:14:35.265 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/shm 2023-11-27T18:14:35.265 INFO:teuthology.orchestra.run.smithi091.stdout:/run/lock 2023-11-27T18:14:35.265 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/cgroup 2023-11-27T18:14:35.265 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/pstore 2023-11-27T18:14:35.265 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/bpf 2023-11-27T18:14:35.265 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/sys/fs/binfmt_misc 2023-11-27T18:14:35.265 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/hugepages 2023-11-27T18:14:35.265 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/mqueue 2023-11-27T18:14:35.266 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/debug 2023-11-27T18:14:35.266 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/tracing 2023-11-27T18:14:35.266 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/fs/nfsd 2023-11-27T18:14:35.266 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/fuse/connections 2023-11-27T18:14:35.266 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/config 2023-11-27T18:14:35.266 INFO:teuthology.orchestra.run.smithi091.stdout:/run/credentials/systemd-sysusers.service 2023-11-27T18:14:35.266 INFO:teuthology.orchestra.run.smithi091.stdout:/run/rpc_pipefs 2023-11-27T18:14:35.266 INFO:teuthology.orchestra.run.smithi091.stdout:/run/user/1000 2023-11-27T18:14:35.266 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph 2023-11-27T18:14:35.266 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-0 2023-11-27T18:14:35.267 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-1 2023-11-27T18:14:35.267 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-2 2023-11-27T18:14:35.267 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-3 2023-11-27T18:14:35.267 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns 2023-11-27T18:14:35.267 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T18:14:35.267 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T18:14:35.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T18:14:35.268 DEBUG:teuthology.orchestra.run.smithi091:> ls /sys/fs/fuse/connections 2023-11-27T18:14:36.417 DEBUG:teuthology.orchestra.run.smithi091:> sudo modprobe fuse 2023-11-27T18:14:36.434 DEBUG:teuthology.orchestra.run.smithi091:> cat /proc/self/mounts | awk '{print $2}' 2023-11-27T18:14:36.481 INFO:teuthology.orchestra.run.smithi091.stdout:/sys 2023-11-27T18:14:36.481 INFO:teuthology.orchestra.run.smithi091.stdout:/proc 2023-11-27T18:14:36.481 INFO:teuthology.orchestra.run.smithi091.stdout:/dev 2023-11-27T18:14:36.481 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/pts 2023-11-27T18:14:36.481 INFO:teuthology.orchestra.run.smithi091.stdout:/run 2023-11-27T18:14:36.481 INFO:teuthology.orchestra.run.smithi091.stdout:/ 2023-11-27T18:14:36.482 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/security 2023-11-27T18:14:36.482 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/shm 2023-11-27T18:14:36.482 INFO:teuthology.orchestra.run.smithi091.stdout:/run/lock 2023-11-27T18:14:36.482 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/cgroup 2023-11-27T18:14:36.482 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/pstore 2023-11-27T18:14:36.482 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/bpf 2023-11-27T18:14:36.482 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/sys/fs/binfmt_misc 2023-11-27T18:14:36.482 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/hugepages 2023-11-27T18:14:36.482 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/mqueue 2023-11-27T18:14:36.482 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/debug 2023-11-27T18:14:36.482 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/tracing 2023-11-27T18:14:36.482 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/fs/nfsd 2023-11-27T18:14:36.483 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/fuse/connections 2023-11-27T18:14:36.483 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/config 2023-11-27T18:14:36.483 INFO:teuthology.orchestra.run.smithi091.stdout:/run/credentials/systemd-sysusers.service 2023-11-27T18:14:36.483 INFO:teuthology.orchestra.run.smithi091.stdout:/run/rpc_pipefs 2023-11-27T18:14:36.483 INFO:teuthology.orchestra.run.smithi091.stdout:/run/user/1000 2023-11-27T18:14:36.483 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph 2023-11-27T18:14:36.483 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-0 2023-11-27T18:14:36.483 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-1 2023-11-27T18:14:36.483 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-2 2023-11-27T18:14:36.483 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-3 2023-11-27T18:14:36.483 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns 2023-11-27T18:14:36.483 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T18:14:36.483 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T18:14:36.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T18:14:36.485 DEBUG:teuthology.orchestra.run.smithi091:> ls /sys/fs/fuse/connections 2023-11-27T18:14:37.286 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi091.stderr:ceph-fuse[45187]: starting ceph client 2023-11-27T18:14:37.376 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi091.stderr:2023-11-27T18:14:37.172+0000 68d1100 -1 init, newargv = 0x7e7c010 newargc=15 2023-11-27T18:14:37.633 DEBUG:teuthology.orchestra.run.smithi091:> sudo modprobe fuse 2023-11-27T18:14:37.647 DEBUG:teuthology.orchestra.run.smithi091:> cat /proc/self/mounts | awk '{print $2}' 2023-11-27T18:14:37.697 INFO:teuthology.orchestra.run.smithi091.stdout:/sys 2023-11-27T18:14:37.697 INFO:teuthology.orchestra.run.smithi091.stdout:/proc 2023-11-27T18:14:37.697 INFO:teuthology.orchestra.run.smithi091.stdout:/dev 2023-11-27T18:14:37.697 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/pts 2023-11-27T18:14:37.697 INFO:teuthology.orchestra.run.smithi091.stdout:/run 2023-11-27T18:14:37.697 INFO:teuthology.orchestra.run.smithi091.stdout:/ 2023-11-27T18:14:37.697 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/security 2023-11-27T18:14:37.697 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/shm 2023-11-27T18:14:37.698 INFO:teuthology.orchestra.run.smithi091.stdout:/run/lock 2023-11-27T18:14:37.698 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/cgroup 2023-11-27T18:14:37.698 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/pstore 2023-11-27T18:14:37.698 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/bpf 2023-11-27T18:14:37.698 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/sys/fs/binfmt_misc 2023-11-27T18:14:37.698 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/hugepages 2023-11-27T18:14:37.698 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/mqueue 2023-11-27T18:14:37.698 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/debug 2023-11-27T18:14:37.698 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/tracing 2023-11-27T18:14:37.698 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/fs/nfsd 2023-11-27T18:14:37.698 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/fuse/connections 2023-11-27T18:14:37.699 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/config 2023-11-27T18:14:37.699 INFO:teuthology.orchestra.run.smithi091.stdout:/run/credentials/systemd-sysusers.service 2023-11-27T18:14:37.699 INFO:teuthology.orchestra.run.smithi091.stdout:/run/rpc_pipefs 2023-11-27T18:14:37.699 INFO:teuthology.orchestra.run.smithi091.stdout:/run/user/1000 2023-11-27T18:14:37.699 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph 2023-11-27T18:14:37.699 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-0 2023-11-27T18:14:37.699 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-1 2023-11-27T18:14:37.699 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-2 2023-11-27T18:14:37.699 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-3 2023-11-27T18:14:37.699 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns 2023-11-27T18:14:37.699 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T18:14:37.699 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T18:14:37.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T18:14:37.701 DEBUG:teuthology.orchestra.run.smithi091:> ls /sys/fs/fuse/connections 2023-11-27T18:14:38.476 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi091.stderr:ceph-fuse[45187]: starting fuse 2023-11-27T18:14:38.849 DEBUG:teuthology.orchestra.run.smithi091:> sudo modprobe fuse 2023-11-27T18:14:38.865 DEBUG:teuthology.orchestra.run.smithi091:> cat /proc/self/mounts | awk '{print $2}' 2023-11-27T18:14:38.913 INFO:teuthology.orchestra.run.smithi091.stdout:/sys 2023-11-27T18:14:38.913 INFO:teuthology.orchestra.run.smithi091.stdout:/proc 2023-11-27T18:14:38.913 INFO:teuthology.orchestra.run.smithi091.stdout:/dev 2023-11-27T18:14:38.913 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/pts 2023-11-27T18:14:38.913 INFO:teuthology.orchestra.run.smithi091.stdout:/run 2023-11-27T18:14:38.914 INFO:teuthology.orchestra.run.smithi091.stdout:/ 2023-11-27T18:14:38.914 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/security 2023-11-27T18:14:38.914 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/shm 2023-11-27T18:14:38.914 INFO:teuthology.orchestra.run.smithi091.stdout:/run/lock 2023-11-27T18:14:38.914 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/cgroup 2023-11-27T18:14:38.914 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/pstore 2023-11-27T18:14:38.914 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/bpf 2023-11-27T18:14:38.914 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/sys/fs/binfmt_misc 2023-11-27T18:14:38.914 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/hugepages 2023-11-27T18:14:38.914 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/mqueue 2023-11-27T18:14:38.915 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/debug 2023-11-27T18:14:38.915 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/tracing 2023-11-27T18:14:38.915 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/fs/nfsd 2023-11-27T18:14:38.915 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/fuse/connections 2023-11-27T18:14:38.915 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/config 2023-11-27T18:14:38.915 INFO:teuthology.orchestra.run.smithi091.stdout:/run/credentials/systemd-sysusers.service 2023-11-27T18:14:38.915 INFO:teuthology.orchestra.run.smithi091.stdout:/run/rpc_pipefs 2023-11-27T18:14:38.915 INFO:teuthology.orchestra.run.smithi091.stdout:/run/user/1000 2023-11-27T18:14:38.915 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph 2023-11-27T18:14:38.915 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-0 2023-11-27T18:14:38.915 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-1 2023-11-27T18:14:38.915 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-2 2023-11-27T18:14:38.916 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-3 2023-11-27T18:14:38.916 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns 2023-11-27T18:14:38.916 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T18:14:38.916 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T18:14:38.916 INFO:teuthology.orchestra.run.smithi091.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-27T18:14:38.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T18:14:38.917 DEBUG:teuthology.orchestra.run.smithi091:> ls /sys/fs/fuse/connections 2023-11-27T18:14:38.964 INFO:teuthology.orchestra.run.smithi091.stdout:45 2023-11-27T18:14:38.964 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-11-27T18:14:38.964 DEBUG:teuthology.orchestra.run.smithi091:> sudo stdin-killer -- python3 -c ' 2023-11-27T18:14:38.964 DEBUG:teuthology.orchestra.run.smithi091:> import glob 2023-11-27T18:14:38.964 DEBUG:teuthology.orchestra.run.smithi091:> import re 2023-11-27T18:14:38.965 DEBUG:teuthology.orchestra.run.smithi091:> import os 2023-11-27T18:14:38.965 DEBUG:teuthology.orchestra.run.smithi091:> import subprocess 2023-11-27T18:14:38.965 DEBUG:teuthology.orchestra.run.smithi091:> 2023-11-27T18:14:38.965 DEBUG:teuthology.orchestra.run.smithi091:> def _find_admin_socket(client_name): 2023-11-27T18:14:38.965 DEBUG:teuthology.orchestra.run.smithi091:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-27T18:14:38.965 DEBUG:teuthology.orchestra.run.smithi091:> files = glob.glob(asok_path) 2023-11-27T18:14:38.965 DEBUG:teuthology.orchestra.run.smithi091:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-27T18:14:38.965 DEBUG:teuthology.orchestra.run.smithi091:> 2023-11-27T18:14:38.965 DEBUG:teuthology.orchestra.run.smithi091:> # Given a non-glob path, it better be there 2023-11-27T18:14:38.965 DEBUG:teuthology.orchestra.run.smithi091:> if "*" not in asok_path: 2023-11-27T18:14:38.965 DEBUG:teuthology.orchestra.run.smithi091:> assert(len(files) == 1) 2023-11-27T18:14:38.965 DEBUG:teuthology.orchestra.run.smithi091:> return files[0] 2023-11-27T18:14:38.966 DEBUG:teuthology.orchestra.run.smithi091:> 2023-11-27T18:14:38.966 DEBUG:teuthology.orchestra.run.smithi091:> for f in files: 2023-11-27T18:14:38.966 DEBUG:teuthology.orchestra.run.smithi091:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-27T18:14:38.966 DEBUG:teuthology.orchestra.run.smithi091:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-27T18:14:38.966 DEBUG:teuthology.orchestra.run.smithi091:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-27T18:14:38.966 DEBUG:teuthology.orchestra.run.smithi091:> contents = proc_f.read() 2023-11-27T18:14:38.966 DEBUG:teuthology.orchestra.run.smithi091:> if mountpoint in contents: 2023-11-27T18:14:38.966 DEBUG:teuthology.orchestra.run.smithi091:> return f 2023-11-27T18:14:38.966 DEBUG:teuthology.orchestra.run.smithi091:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-27T18:14:38.966 DEBUG:teuthology.orchestra.run.smithi091:> 2023-11-27T18:14:38.966 DEBUG:teuthology.orchestra.run.smithi091:> print(_find_admin_socket("client.0")) 2023-11-27T18:14:38.967 DEBUG:teuthology.orchestra.run.smithi091:> ' 2023-11-27T18:14:39.089 INFO:teuthology.orchestra.run.smithi091.stdout:/var/run/ceph/ceph-client.0.45187.asok 2023-11-27T18:14:39.093 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:14:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-27T18:14:39.101 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.45187.asok 2023-11-27T18:14:39.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T18:14:39.102 DEBUG:teuthology.orchestra.run.smithi091:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.45187.asok status 2023-11-27T18:14:39.417 INFO:teuthology.orchestra.run.smithi091.stdout:{ 2023-11-27T18:14:39.417 INFO:teuthology.orchestra.run.smithi091.stdout: "metadata": { 2023-11-27T18:14:39.418 INFO:teuthology.orchestra.run.smithi091.stdout: "ceph_sha1": "369173db14b6995b2bd07c60ec5f63d01cf21631", 2023-11-27T18:14:39.418 INFO:teuthology.orchestra.run.smithi091.stdout: "ceph_version": "ceph version 18.0.0-7498-g369173db (369173db14b6995b2bd07c60ec5f63d01cf21631) squid (dev)", 2023-11-27T18:14:39.418 INFO:teuthology.orchestra.run.smithi091.stdout: "entity_id": "0", 2023-11-27T18:14:39.418 INFO:teuthology.orchestra.run.smithi091.stdout: "hostname": "smithi091", 2023-11-27T18:14:39.418 INFO:teuthology.orchestra.run.smithi091.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-27T18:14:39.418 INFO:teuthology.orchestra.run.smithi091.stdout: "pid": "45187", 2023-11-27T18:14:39.418 INFO:teuthology.orchestra.run.smithi091.stdout: "root": "/" 2023-11-27T18:14:39.418 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T18:14:39.418 INFO:teuthology.orchestra.run.smithi091.stdout: "dentry_count": 0, 2023-11-27T18:14:39.418 INFO:teuthology.orchestra.run.smithi091.stdout: "dentry_pinned_count": 0, 2023-11-27T18:14:39.418 INFO:teuthology.orchestra.run.smithi091.stdout: "id": 4553, 2023-11-27T18:14:39.418 INFO:teuthology.orchestra.run.smithi091.stdout: "inst": { 2023-11-27T18:14:39.419 INFO:teuthology.orchestra.run.smithi091.stdout: "name": { 2023-11-27T18:14:39.419 INFO:teuthology.orchestra.run.smithi091.stdout: "type": "client", 2023-11-27T18:14:39.419 INFO:teuthology.orchestra.run.smithi091.stdout: "num": 4553 2023-11-27T18:14:39.419 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T18:14:39.419 INFO:teuthology.orchestra.run.smithi091.stdout: "addr": { 2023-11-27T18:14:39.419 INFO:teuthology.orchestra.run.smithi091.stdout: "type": "v1", 2023-11-27T18:14:39.419 INFO:teuthology.orchestra.run.smithi091.stdout: "addr": "172.21.15.91:0", 2023-11-27T18:14:39.419 INFO:teuthology.orchestra.run.smithi091.stdout: "nonce": 1390446972 2023-11-27T18:14:39.419 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T18:14:39.419 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T18:14:39.419 INFO:teuthology.orchestra.run.smithi091.stdout: "addr": { 2023-11-27T18:14:39.419 INFO:teuthology.orchestra.run.smithi091.stdout: "type": "v1", 2023-11-27T18:14:39.420 INFO:teuthology.orchestra.run.smithi091.stdout: "addr": "172.21.15.91:0", 2023-11-27T18:14:39.420 INFO:teuthology.orchestra.run.smithi091.stdout: "nonce": 1390446972 2023-11-27T18:14:39.420 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T18:14:39.420 INFO:teuthology.orchestra.run.smithi091.stdout: "inst_str": "client.4553 172.21.15.91:0/1390446972", 2023-11-27T18:14:39.420 INFO:teuthology.orchestra.run.smithi091.stdout: "addr_str": "172.21.15.91:0/1390446972", 2023-11-27T18:14:39.420 INFO:teuthology.orchestra.run.smithi091.stdout: "inode_count": 1, 2023-11-27T18:14:39.420 INFO:teuthology.orchestra.run.smithi091.stdout: "mds_epoch": 9, 2023-11-27T18:14:39.420 INFO:teuthology.orchestra.run.smithi091.stdout: "osd_epoch": 32, 2023-11-27T18:14:39.420 INFO:teuthology.orchestra.run.smithi091.stdout: "osd_epoch_barrier": 0, 2023-11-27T18:14:39.420 INFO:teuthology.orchestra.run.smithi091.stdout: "blocklisted": false, 2023-11-27T18:14:39.420 INFO:teuthology.orchestra.run.smithi091.stdout: "fs_name": "cephfs" 2023-11-27T18:14:39.420 INFO:teuthology.orchestra.run.smithi091.stdout:} 2023-11-27T18:14:39.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T18:14:39.435 DEBUG:teuthology.orchestra.run.smithi091:> stat --file-system '--printf=%T 2023-11-27T18:14:39.435 DEBUG:teuthology.orchestra.run.smithi091:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-27T18:14:39.589 INFO:teuthology.orchestra.run.smithi091.stdout:fuseblk 2023-11-27T18:14:39.589 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-27T18:14:39.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T18:14:39.590 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-27T18:14:39.637 INFO:teuthology.run_tasks:Running task workunit... 2023-11-27T18:14:39.650 INFO:tasks.workunit:Pulling workunits from ref 369173db14b6995b2bd07c60ec5f63d01cf21631 2023-11-27T18:14:39.650 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-11-27T18:14:39.651 INFO:tasks.workunit:timeout=3h 2023-11-27T18:14:39.651 INFO:tasks.workunit:cleanup=True 2023-11-27T18:14:39.651 DEBUG:teuthology.orchestra.run.smithi091:> stat -- /home/ubuntu/cephtest/mnt.0 2023-11-27T18:14:39.658 INFO:teuthology.orchestra.run.smithi091.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-11-27T18:14:39.658 INFO:teuthology.orchestra.run.smithi091.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2023-11-27T18:14:39.658 INFO:teuthology.orchestra.run.smithi091.stdout:Device: 2dh/45d Inode: 1 Links: 2 2023-11-27T18:14:39.658 INFO:teuthology.orchestra.run.smithi091.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-27T18:14:39.658 INFO:teuthology.orchestra.run.smithi091.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-11-27T18:14:39.658 INFO:teuthology.orchestra.run.smithi091.stdout:Modify: 2023-11-27 18:13:14.679461198 +0000 2023-11-27T18:14:39.658 INFO:teuthology.orchestra.run.smithi091.stdout:Change: 2023-11-27 18:13:33.583798579 +0000 2023-11-27T18:14:39.658 INFO:teuthology.orchestra.run.smithi091.stdout: Birth: - 2023-11-27T18:14:39.658 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-11-27T18:14:39.659 DEBUG:teuthology.orchestra.run.smithi091:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-11-27T18:14:40.357 DEBUG:teuthology.orchestra.run.smithi091:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 369173db14b6995b2bd07c60ec5f63d01cf21631 2023-11-27T18:14:40.365 INFO:tasks.workunit.client.0.smithi091.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-11-27T18:15:04.742 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:15:04.745 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:15:34.858 INFO:tasks.workunit.client.0.smithi091.stderr:Note: switching to '369173db14b6995b2bd07c60ec5f63d01cf21631'. 2023-11-27T18:15:34.859 INFO:tasks.workunit.client.0.smithi091.stderr: 2023-11-27T18:15:34.859 INFO:tasks.workunit.client.0.smithi091.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-11-27T18:15:34.859 INFO:tasks.workunit.client.0.smithi091.stderr:changes and commit them, and you can discard any commits you make in this 2023-11-27T18:15:34.859 INFO:tasks.workunit.client.0.smithi091.stderr:state without impacting any branches by switching back to a branch. 2023-11-27T18:15:34.859 INFO:tasks.workunit.client.0.smithi091.stderr: 2023-11-27T18:15:34.859 INFO:tasks.workunit.client.0.smithi091.stderr:If you want to create a new branch to retain commits you create, you may 2023-11-27T18:15:34.860 INFO:tasks.workunit.client.0.smithi091.stderr:do so (now or later) by using -c with the switch command. Example: 2023-11-27T18:15:34.860 INFO:tasks.workunit.client.0.smithi091.stderr: 2023-11-27T18:15:34.860 INFO:tasks.workunit.client.0.smithi091.stderr: git switch -c 2023-11-27T18:15:34.860 INFO:tasks.workunit.client.0.smithi091.stderr: 2023-11-27T18:15:34.860 INFO:tasks.workunit.client.0.smithi091.stderr:Or undo this operation with: 2023-11-27T18:15:34.860 INFO:tasks.workunit.client.0.smithi091.stderr: 2023-11-27T18:15:34.861 INFO:tasks.workunit.client.0.smithi091.stderr: git switch - 2023-11-27T18:15:34.861 INFO:tasks.workunit.client.0.smithi091.stderr: 2023-11-27T18:15:34.861 INFO:tasks.workunit.client.0.smithi091.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-11-27T18:15:34.861 INFO:tasks.workunit.client.0.smithi091.stderr: 2023-11-27T18:15:34.861 INFO:tasks.workunit.client.0.smithi091.stderr:HEAD is now at 369173db14b Merge branch 'wip-all-kickoff-s-2' of https://github.com/rzarzynski/ceph into wip-yuri10-testing-2023-11-22-1112 2023-11-27T18:15:34.862 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:15:34.864 DEBUG:teuthology.orchestra.run.smithi091:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-11-27T18:15:34.864 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:15:34.911 INFO:tasks.workunit.client.0.smithi091.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-11-27T18:15:34.914 INFO:tasks.workunit.client.0.smithi091.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-11-27T18:15:34.915 INFO:tasks.workunit.client.0.smithi091.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-11-27T18:15:35.832 INFO:tasks.workunit.client.0.smithi091.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-11-27T18:15:35.917 INFO:tasks.workunit.client.0.smithi091.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-11-27T18:15:35.975 INFO:tasks.workunit.client.0.smithi091.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-11-27T18:15:35.976 INFO:tasks.workunit.client.0.smithi091.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-11-27T18:15:35.976 INFO:tasks.workunit.client.0.smithi091.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-11-27T18:15:36.022 INFO:tasks.workunit.client.0.smithi091.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-11-27T18:15:36.026 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T18:15:36.026 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-11-27T18:15:36.031 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2023-11-27T18:15:36.033 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2023-11-27T18:15:36.034 DEBUG:teuthology.orchestra.run.smithi091:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=369173db14b6995b2bd07c60ec5f63d01cf21631 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2023-11-27T18:15:36.405 INFO:tasks.workunit.client.0.smithi091.stderr:+ dbench 1 2023-11-27T18:15:36.412 INFO:tasks.workunit.client.0.smithi091.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2023-11-27T18:15:36.412 INFO:tasks.workunit.client.0.smithi091.stdout: 2023-11-27T18:15:36.412 INFO:tasks.workunit.client.0.smithi091.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2023-11-27T18:15:36.413 INFO:tasks.workunit.client.0.smithi091.stdout:0 of 1 processes prepared for launch 0 sec 2023-11-27T18:15:36.514 INFO:tasks.workunit.client.0.smithi091.stdout:1 of 1 processes prepared for launch 0 sec 2023-11-27T18:15:36.514 INFO:tasks.workunit.client.0.smithi091.stdout:releasing clients 2023-11-27T18:15:37.514 INFO:tasks.workunit.client.0.smithi091.stdout: 0 8 0.00 MB/sec warmup 1 sec latency 112.351 ms 2023-11-27T18:15:38.514 INFO:tasks.workunit.client.0.smithi091.stdout: 0 12 0.00 MB/sec warmup 2 sec latency 153.688 ms 2023-11-27T18:15:39.514 INFO:tasks.workunit.client.0.smithi091.stdout: 1 44 0.57 MB/sec warmup 3 sec latency 560.040 ms 2023-11-27T18:15:40.514 INFO:tasks.workunit.client.0.smithi091.stdout: 1 71 0.79 MB/sec warmup 4 sec latency 447.743 ms 2023-11-27T18:15:41.514 INFO:tasks.workunit.client.0.smithi091.stdout: 1 111 1.05 MB/sec warmup 5 sec latency 457.327 ms 2023-11-27T18:15:42.517 INFO:tasks.workunit.client.0.smithi091.stdout: 1 124 0.92 MB/sec warmup 6 sec latency 454.858 ms 2023-11-27T18:15:43.515 INFO:tasks.workunit.client.0.smithi091.stdout: 1 137 0.86 MB/sec warmup 7 sec latency 685.363 ms 2023-11-27T18:15:44.514 INFO:tasks.workunit.client.0.smithi091.stdout: 1 147 0.79 MB/sec warmup 8 sec latency 509.178 ms 2023-11-27T18:15:45.514 INFO:tasks.workunit.client.0.smithi091.stdout: 1 165 0.76 MB/sec warmup 9 sec latency 510.424 ms 2023-11-27T18:15:46.515 INFO:tasks.workunit.client.0.smithi091.stdout: 1 181 0.73 MB/sec warmup 10 sec latency 484.652 ms 2023-11-27T18:15:47.515 INFO:tasks.workunit.client.0.smithi091.stdout: 1 197 0.71 MB/sec warmup 11 sec latency 501.228 ms 2023-11-27T18:15:48.515 INFO:tasks.workunit.client.0.smithi091.stdout: 1 207 0.68 MB/sec warmup 12 sec latency 476.110 ms 2023-11-27T18:15:49.515 INFO:tasks.workunit.client.0.smithi091.stdout: 1 223 0.66 MB/sec warmup 13 sec latency 441.984 ms 2023-11-27T18:15:50.515 INFO:tasks.workunit.client.0.smithi091.stdout: 1 239 0.65 MB/sec warmup 14 sec latency 487.601 ms 2023-11-27T18:15:51.515 INFO:tasks.workunit.client.0.smithi091.stdout: 1 255 0.64 MB/sec warmup 15 sec latency 499.805 ms 2023-11-27T18:15:52.515 INFO:tasks.workunit.client.0.smithi091.stdout: 1 271 0.64 MB/sec warmup 16 sec latency 527.508 ms 2023-11-27T18:15:53.515 INFO:tasks.workunit.client.0.smithi091.stdout: 1 287 0.63 MB/sec warmup 17 sec latency 556.702 ms 2023-11-27T18:15:54.515 INFO:tasks.workunit.client.0.smithi091.stdout: 1 297 0.61 MB/sec warmup 18 sec latency 397.798 ms 2023-11-27T18:15:55.515 INFO:tasks.workunit.client.0.smithi091.stdout: 1 313 0.60 MB/sec warmup 19 sec latency 509.951 ms 2023-11-27T18:15:56.515 INFO:tasks.workunit.client.0.smithi091.stdout: 1 327 0.59 MB/sec warmup 20 sec latency 551.251 ms 2023-11-27T18:15:57.515 INFO:tasks.workunit.client.0.smithi091.stdout: 1 341 0.58 MB/sec warmup 21 sec latency 466.778 ms 2023-11-27T18:15:58.516 INFO:tasks.workunit.client.0.smithi091.stdout: 1 357 0.58 MB/sec warmup 22 sec latency 497.962 ms 2023-11-27T18:15:59.516 INFO:tasks.workunit.client.0.smithi091.stdout: 1 373 0.58 MB/sec warmup 23 sec latency 463.966 ms 2023-11-27T18:16:00.516 INFO:tasks.workunit.client.0.smithi091.stdout: 1 389 0.58 MB/sec warmup 24 sec latency 464.197 ms 2023-11-27T18:16:01.516 INFO:tasks.workunit.client.0.smithi091.stdout: 1 405 0.57 MB/sec warmup 25 sec latency 510.195 ms 2023-11-27T18:16:02.516 INFO:tasks.workunit.client.0.smithi091.stdout: 1 416 0.56 MB/sec warmup 26 sec latency 588.443 ms 2023-11-27T18:16:03.516 INFO:tasks.workunit.client.0.smithi091.stdout: 1 429 0.56 MB/sec warmup 27 sec latency 562.882 ms 2023-11-27T18:16:04.516 INFO:tasks.workunit.client.0.smithi091.stdout: 1 445 0.56 MB/sec warmup 28 sec latency 519.247 ms 2023-11-27T18:16:04.992 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:16:04.995 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:16:05.516 INFO:tasks.workunit.client.0.smithi091.stdout: 1 461 0.56 MB/sec warmup 29 sec latency 605.991 ms 2023-11-27T18:16:06.516 INFO:tasks.workunit.client.0.smithi091.stdout: 1 469 0.55 MB/sec warmup 30 sec latency 545.646 ms 2023-11-27T18:16:07.516 INFO:tasks.workunit.client.0.smithi091.stdout: 1 485 0.55 MB/sec warmup 31 sec latency 562.898 ms 2023-11-27T18:16:08.516 INFO:tasks.workunit.client.0.smithi091.stdout: 1 501 0.55 MB/sec warmup 32 sec latency 525.257 ms 2023-11-27T18:16:09.516 INFO:tasks.workunit.client.0.smithi091.stdout: 1 511 0.54 MB/sec warmup 33 sec latency 422.883 ms 2023-11-27T18:16:10.516 INFO:tasks.workunit.client.0.smithi091.stdout: 1 524 0.53 MB/sec warmup 34 sec latency 585.116 ms 2023-11-27T18:16:11.516 INFO:tasks.workunit.client.0.smithi091.stdout: 1 596 0.59 MB/sec warmup 35 sec latency 474.669 ms 2023-11-27T18:16:12.517 INFO:tasks.workunit.client.0.smithi091.stdout: 1 606 0.58 MB/sec warmup 36 sec latency 712.931 ms 2023-11-27T18:16:13.517 INFO:tasks.workunit.client.0.smithi091.stdout: 1 609 0.57 MB/sec warmup 37 sec latency 568.418 ms 2023-11-27T18:16:14.517 INFO:tasks.workunit.client.0.smithi091.stdout: 1 614 0.55 MB/sec warmup 38 sec latency 952.522 ms 2023-11-27T18:16:15.517 INFO:tasks.workunit.client.0.smithi091.stdout: 1 644 0.54 MB/sec warmup 39 sec latency 953.030 ms 2023-11-27T18:16:16.517 INFO:tasks.workunit.client.0.smithi091.stdout: 1 645 0.53 MB/sec warmup 40 sec latency 973.074 ms 2023-11-27T18:16:26.042 INFO:tasks.workunit.client.0.smithi091.stdout: 1 645 0.51 MB/sec warmup 41 sec latency 1071.293 ms 2023-11-27T18:16:26.042 INFO:tasks.workunit.client.0.smithi091.stdout: 1 653 0.50 MB/sec warmup 42 sec latency 1105.839 ms 2023-11-27T18:16:26.042 INFO:tasks.workunit.client.0.smithi091.stdout: 1 654 0.49 MB/sec warmup 43 sec latency 876.862 ms 2023-11-27T18:16:26.042 INFO:tasks.workunit.client.0.smithi091.stdout: 1 672 0.48 MB/sec warmup 44 sec latency 438.889 ms 2023-11-27T18:16:26.042 INFO:tasks.workunit.client.0.smithi091.stdout: 1 680 0.47 MB/sec warmup 45 sec latency 677.047 ms 2023-11-27T18:16:26.042 INFO:tasks.workunit.client.0.smithi091.stdout: 1 682 0.46 MB/sec warmup 46 sec latency 1025.569 ms 2023-11-27T18:16:26.042 INFO:tasks.workunit.client.0.smithi091.stdout: 1 699 0.45 MB/sec warmup 47 sec latency 861.655 ms 2023-11-27T18:16:26.042 INFO:tasks.workunit.client.0.smithi091.stdout: 1 710 0.44 MB/sec warmup 48 sec latency 645.577 ms 2023-11-27T18:16:26.043 INFO:tasks.workunit.client.0.smithi091.stdout: 1 725 0.43 MB/sec warmup 49 sec latency 682.044 ms 2023-11-27T18:16:26.517 INFO:tasks.workunit.client.0.smithi091.stdout: 1 744 0.43 MB/sec warmup 50 sec latency 170.777 ms 2023-11-27T18:16:27.518 INFO:tasks.workunit.client.0.smithi091.stdout: 1 746 0.42 MB/sec warmup 51 sec latency 901.637 ms 2023-11-27T18:16:28.518 INFO:tasks.workunit.client.0.smithi091.stdout: 1 747 0.41 MB/sec warmup 52 sec latency 1176.166 ms 2023-11-27T18:16:29.518 INFO:tasks.workunit.client.0.smithi091.stdout: 1 773 0.40 MB/sec warmup 53 sec latency 446.557 ms 2023-11-27T18:16:30.518 INFO:tasks.workunit.client.0.smithi091.stdout: 1 779 0.40 MB/sec warmup 54 sec latency 585.627 ms 2023-11-27T18:16:31.518 INFO:tasks.workunit.client.0.smithi091.stdout: 1 798 0.39 MB/sec warmup 55 sec latency 298.525 ms 2023-11-27T18:16:32.518 INFO:tasks.workunit.client.0.smithi091.stdout: 1 812 0.38 MB/sec warmup 56 sec latency 317.961 ms 2023-11-27T18:16:33.518 INFO:tasks.workunit.client.0.smithi091.stdout: 1 813 0.38 MB/sec warmup 57 sec latency 1087.353 ms 2023-11-27T18:16:34.518 INFO:tasks.workunit.client.0.smithi091.stdout: 1 817 0.37 MB/sec warmup 58 sec latency 871.641 ms 2023-11-27T18:16:35.208 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:16:35.211 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:16:35.518 INFO:tasks.workunit.client.0.smithi091.stdout: 1 820 0.36 MB/sec warmup 59 sec latency 865.151 ms 2023-11-27T18:16:36.518 INFO:tasks.workunit.client.0.smithi091.stdout: 1 825 0.36 MB/sec warmup 60 sec latency 866.449 ms 2023-11-27T18:16:37.518 INFO:tasks.workunit.client.0.smithi091.stdout: 1 853 0.35 MB/sec warmup 61 sec latency 763.693 ms 2023-11-27T18:16:38.518 INFO:tasks.workunit.client.0.smithi091.stdout: 1 854 0.35 MB/sec warmup 62 sec latency 905.369 ms 2023-11-27T18:16:39.518 INFO:tasks.workunit.client.0.smithi091.stdout: 1 862 0.34 MB/sec warmup 63 sec latency 1226.585 ms 2023-11-27T18:16:40.518 INFO:tasks.workunit.client.0.smithi091.stdout: 1 863 0.34 MB/sec warmup 64 sec latency 924.690 ms 2023-11-27T18:16:41.518 INFO:tasks.workunit.client.0.smithi091.stdout: 1 878 0.33 MB/sec warmup 65 sec latency 400.955 ms 2023-11-27T18:16:42.518 INFO:tasks.workunit.client.0.smithi091.stdout: 1 888 0.33 MB/sec warmup 66 sec latency 867.506 ms 2023-11-27T18:16:43.519 INFO:tasks.workunit.client.0.smithi091.stdout: 1 902 0.32 MB/sec warmup 67 sec latency 417.110 ms 2023-11-27T18:16:44.519 INFO:tasks.workunit.client.0.smithi091.stdout: 1 904 0.32 MB/sec warmup 68 sec latency 699.793 ms 2023-11-27T18:16:45.519 INFO:tasks.workunit.client.0.smithi091.stdout: 1 926 0.32 MB/sec warmup 69 sec latency 235.740 ms 2023-11-27T18:16:46.519 INFO:tasks.workunit.client.0.smithi091.stdout: 1 928 0.31 MB/sec warmup 70 sec latency 874.231 ms 2023-11-27T18:16:47.519 INFO:tasks.workunit.client.0.smithi091.stdout: 1 929 0.31 MB/sec warmup 71 sec latency 900.346 ms 2023-11-27T18:16:48.519 INFO:tasks.workunit.client.0.smithi091.stdout: 1 931 0.30 MB/sec warmup 72 sec latency 675.518 ms 2023-11-27T18:16:49.519 INFO:tasks.workunit.client.0.smithi091.stdout: 1 933 0.30 MB/sec warmup 73 sec latency 994.173 ms 2023-11-27T18:16:50.519 INFO:tasks.workunit.client.0.smithi091.stdout: 1 937 0.29 MB/sec warmup 74 sec latency 361.267 ms 2023-11-27T18:16:51.519 INFO:tasks.workunit.client.0.smithi091.stdout: 1 942 0.29 MB/sec warmup 75 sec latency 874.413 ms 2023-11-27T18:16:52.519 INFO:tasks.workunit.client.0.smithi091.stdout: 1 959 0.29 MB/sec warmup 76 sec latency 881.555 ms 2023-11-27T18:16:53.520 INFO:tasks.workunit.client.0.smithi091.stdout: 1 970 0.28 MB/sec warmup 77 sec latency 489.572 ms 2023-11-27T18:16:54.519 INFO:tasks.workunit.client.0.smithi091.stdout: 1 986 0.28 MB/sec warmup 78 sec latency 322.965 ms 2023-11-27T18:16:55.519 INFO:tasks.workunit.client.0.smithi091.stdout: 1 994 0.28 MB/sec warmup 79 sec latency 592.801 ms 2023-11-27T18:16:56.520 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1018 0.28 MB/sec warmup 80 sec latency 889.570 ms 2023-11-27T18:16:57.519 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1028 0.28 MB/sec warmup 81 sec latency 875.679 ms 2023-11-27T18:16:58.520 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1033 0.28 MB/sec warmup 82 sec latency 349.654 ms 2023-11-27T18:16:59.520 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1041 0.28 MB/sec warmup 83 sec latency 900.982 ms 2023-11-27T18:17:00.520 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1046 0.27 MB/sec warmup 84 sec latency 754.584 ms 2023-11-27T18:17:01.520 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1047 0.27 MB/sec warmup 85 sec latency 911.113 ms 2023-11-27T18:17:02.520 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1048 0.27 MB/sec warmup 86 sec latency 982.446 ms 2023-11-27T18:17:03.520 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1060 0.26 MB/sec warmup 87 sec latency 1060.220 ms 2023-11-27T18:17:04.520 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1064 0.26 MB/sec warmup 88 sec latency 351.752 ms 2023-11-27T18:17:05.258 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:17:05.262 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:17:05.520 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1088 0.26 MB/sec warmup 89 sec latency 379.289 ms 2023-11-27T18:17:06.520 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1091 0.25 MB/sec warmup 90 sec latency 841.679 ms 2023-11-27T18:17:07.520 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1100 0.25 MB/sec warmup 91 sec latency 296.302 ms 2023-11-27T18:17:08.520 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1103 0.25 MB/sec warmup 92 sec latency 1102.281 ms 2023-11-27T18:17:09.520 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1114 0.25 MB/sec warmup 93 sec latency 566.915 ms 2023-11-27T18:17:10.521 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1118 0.24 MB/sec warmup 94 sec latency 1021.348 ms 2023-11-27T18:17:11.521 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1134 0.24 MB/sec warmup 95 sec latency 424.505 ms 2023-11-27T18:17:12.521 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1149 0.24 MB/sec warmup 96 sec latency 485.963 ms 2023-11-27T18:17:13.521 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1157 0.24 MB/sec warmup 97 sec latency 578.554 ms 2023-11-27T18:17:14.521 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1168 0.23 MB/sec warmup 98 sec latency 898.914 ms 2023-11-27T18:17:15.521 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1169 0.23 MB/sec warmup 99 sec latency 909.161 ms 2023-11-27T18:17:16.521 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1170 0.23 MB/sec warmup 100 sec latency 999.158 ms 2023-11-27T18:17:17.521 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1171 0.23 MB/sec warmup 101 sec latency 1004.965 ms 2023-11-27T18:17:18.521 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1176 0.23 MB/sec warmup 102 sec latency 455.036 ms 2023-11-27T18:17:19.521 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1180 0.22 MB/sec warmup 103 sec latency 386.650 ms 2023-11-27T18:17:20.523 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1200 0.22 MB/sec warmup 104 sec latency 339.420 ms 2023-11-27T18:17:21.522 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1204 0.22 MB/sec warmup 105 sec latency 776.928 ms 2023-11-27T18:17:22.522 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1214 0.22 MB/sec warmup 106 sec latency 937.298 ms 2023-11-27T18:17:23.522 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1231 0.22 MB/sec warmup 107 sec latency 341.258 ms 2023-11-27T18:17:24.522 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1244 0.21 MB/sec warmup 108 sec latency 352.653 ms 2023-11-27T18:17:25.522 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1248 0.21 MB/sec warmup 109 sec latency 656.101 ms 2023-11-27T18:17:26.522 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1255 0.21 MB/sec warmup 110 sec latency 946.621 ms 2023-11-27T18:17:27.522 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1278 0.21 MB/sec warmup 111 sec latency 195.875 ms 2023-11-27T18:17:28.522 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1278 0.21 MB/sec warmup 112 sec latency 1122.052 ms 2023-11-27T18:17:29.522 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1280 0.20 MB/sec warmup 113 sec latency 1330.208 ms 2023-11-27T18:17:30.522 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1281 0.20 MB/sec warmup 114 sec latency 1012.042 ms 2023-11-27T18:17:31.522 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1284 0.20 MB/sec warmup 115 sec latency 884.866 ms 2023-11-27T18:17:32.522 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1376 0.22 MB/sec warmup 116 sec latency 916.904 ms 2023-11-27T18:17:33.522 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1377 0.22 MB/sec warmup 117 sec latency 928.497 ms 2023-11-27T18:17:34.522 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1381 0.22 MB/sec warmup 118 sec latency 877.777 ms 2023-11-27T18:17:35.372 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:17:35.374 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:17:35.522 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1385 0.22 MB/sec warmup 119 sec latency 865.850 ms 2023-11-27T18:17:37.523 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1397 0.00 MB/sec execute 1 sec latency 830.647 ms 2023-11-27T18:17:38.523 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1403 0.00 MB/sec execute 2 sec latency 895.931 ms 2023-11-27T18:17:39.523 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1417 0.00 MB/sec execute 3 sec latency 611.148 ms 2023-11-27T18:17:40.523 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1419 0.00 MB/sec execute 4 sec latency 856.534 ms 2023-11-27T18:17:41.523 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1441 0.00 MB/sec execute 5 sec latency 401.889 ms 2023-11-27T18:17:42.523 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1448 0.00 MB/sec execute 6 sec latency 484.001 ms 2023-11-27T18:17:43.523 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1453 0.00 MB/sec execute 7 sec latency 886.125 ms 2023-11-27T18:17:44.523 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1465 0.00 MB/sec execute 8 sec latency 180.527 ms 2023-11-27T18:17:45.523 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1466 0.00 MB/sec execute 9 sec latency 896.154 ms 2023-11-27T18:17:46.523 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1485 0.00 MB/sec execute 10 sec latency 951.668 ms 2023-11-27T18:17:47.524 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1487 0.00 MB/sec execute 11 sec latency 988.315 ms 2023-11-27T18:17:48.524 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1490 0.00 MB/sec execute 12 sec latency 493.324 ms 2023-11-27T18:17:49.524 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1499 0.00 MB/sec execute 13 sec latency 1204.841 ms 2023-11-27T18:17:50.524 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1512 0.00 MB/sec execute 14 sec latency 390.493 ms 2023-11-27T18:17:51.524 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1523 0.01 MB/sec execute 15 sec latency 422.111 ms 2023-11-27T18:17:52.524 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1526 0.01 MB/sec execute 16 sec latency 553.359 ms 2023-11-27T18:17:53.524 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1530 0.01 MB/sec execute 17 sec latency 903.946 ms 2023-11-27T18:17:54.524 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1551 0.01 MB/sec execute 18 sec latency 926.992 ms 2023-11-27T18:17:55.524 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1555 0.00 MB/sec execute 19 sec latency 421.840 ms 2023-11-27T18:17:56.525 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1562 0.00 MB/sec execute 20 sec latency 879.676 ms 2023-11-27T18:17:57.525 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1578 0.01 MB/sec execute 21 sec latency 159.769 ms 2023-11-27T18:17:58.525 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1586 0.01 MB/sec execute 22 sec latency 287.824 ms 2023-11-27T18:17:59.525 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1589 0.01 MB/sec execute 23 sec latency 555.241 ms 2023-11-27T18:18:00.525 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1603 0.01 MB/sec execute 24 sec latency 1087.843 ms 2023-11-27T18:18:01.525 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1606 0.01 MB/sec execute 25 sec latency 777.712 ms 2023-11-27T18:18:02.525 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1610 0.01 MB/sec execute 26 sec latency 873.430 ms 2023-11-27T18:18:03.525 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1616 0.01 MB/sec execute 27 sec latency 855.484 ms 2023-11-27T18:18:04.525 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1617 0.01 MB/sec execute 28 sec latency 923.271 ms 2023-11-27T18:18:05.504 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:18:05.507 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:18:05.525 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1641 0.01 MB/sec execute 29 sec latency 941.431 ms 2023-11-27T18:18:06.526 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1644 0.01 MB/sec execute 30 sec latency 816.950 ms 2023-11-27T18:18:07.526 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1653 0.01 MB/sec execute 31 sec latency 965.519 ms 2023-11-27T18:18:08.526 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1662 0.01 MB/sec execute 32 sec latency 589.472 ms 2023-11-27T18:18:09.526 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1686 0.01 MB/sec execute 33 sec latency 550.193 ms 2023-11-27T18:18:10.526 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1689 0.01 MB/sec execute 34 sec latency 624.394 ms 2023-11-27T18:18:11.526 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1700 0.01 MB/sec execute 35 sec latency 548.600 ms 2023-11-27T18:18:16.968 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1702 0.01 MB/sec execute 36 sec latency 893.259 ms 2023-11-27T18:18:16.969 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1707 0.01 MB/sec execute 37 sec latency 871.516 ms 2023-11-27T18:18:16.969 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1731 0.01 MB/sec execute 38 sec latency 897.781 ms 2023-11-27T18:18:16.969 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1770 0.01 MB/sec execute 39 sec latency 205.040 ms 2023-11-27T18:18:16.969 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1772 0.01 MB/sec execute 40 sec latency 513.118 ms 2023-11-27T18:18:17.527 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1791 0.01 MB/sec execute 41 sec latency 859.648 ms 2023-11-27T18:18:18.529 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1804 0.01 MB/sec execute 42 sec latency 332.805 ms 2023-11-27T18:18:19.527 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1806 0.01 MB/sec execute 43 sec latency 616.017 ms 2023-11-27T18:18:20.527 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1820 0.01 MB/sec execute 44 sec latency 891.652 ms 2023-11-27T18:18:21.527 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1822 0.01 MB/sec execute 45 sec latency 856.049 ms 2023-11-27T18:18:22.527 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1826 0.01 MB/sec execute 46 sec latency 870.336 ms 2023-11-27T18:18:23.528 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1838 0.01 MB/sec execute 47 sec latency 863.487 ms 2023-11-27T18:18:24.528 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1841 0.01 MB/sec execute 48 sec latency 398.231 ms 2023-11-27T18:18:25.528 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1855 0.01 MB/sec execute 49 sec latency 901.982 ms 2023-11-27T18:18:26.529 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1858 0.01 MB/sec execute 50 sec latency 695.020 ms 2023-11-27T18:18:27.528 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1862 0.01 MB/sec execute 51 sec latency 893.044 ms 2023-11-27T18:18:28.528 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1866 0.01 MB/sec execute 52 sec latency 885.857 ms 2023-11-27T18:18:29.528 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1869 0.01 MB/sec execute 53 sec latency 541.639 ms 2023-11-27T18:18:30.528 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1892 0.01 MB/sec execute 54 sec latency 867.918 ms 2023-11-27T18:18:31.528 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1898 0.01 MB/sec execute 55 sec latency 889.188 ms 2023-11-27T18:18:32.528 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1903 0.01 MB/sec execute 56 sec latency 908.425 ms 2023-11-27T18:18:33.529 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1912 0.01 MB/sec execute 57 sec latency 893.408 ms 2023-11-27T18:18:34.529 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1919 0.01 MB/sec execute 58 sec latency 876.705 ms 2023-11-27T18:18:35.529 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1924 0.01 MB/sec execute 59 sec latency 873.131 ms 2023-11-27T18:18:35.629 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:18:35.633 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:18:36.529 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1967 0.01 MB/sec execute 60 sec latency 209.068 ms 2023-11-27T18:18:37.529 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1975 0.01 MB/sec execute 61 sec latency 517.254 ms 2023-11-27T18:18:38.529 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1976 0.01 MB/sec execute 62 sec latency 943.440 ms 2023-11-27T18:18:39.529 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1997 0.01 MB/sec execute 63 sec latency 287.527 ms 2023-11-27T18:18:40.529 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2004 0.01 MB/sec execute 64 sec latency 796.578 ms 2023-11-27T18:18:41.529 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2030 0.01 MB/sec execute 65 sec latency 188.668 ms 2023-11-27T18:18:42.530 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2034 0.01 MB/sec execute 66 sec latency 670.263 ms 2023-11-27T18:18:43.530 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2043 0.01 MB/sec execute 67 sec latency 885.486 ms 2023-11-27T18:18:44.530 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2051 0.01 MB/sec execute 68 sec latency 911.337 ms 2023-11-27T18:18:45.530 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2053 0.01 MB/sec execute 69 sec latency 828.166 ms 2023-11-27T18:18:46.530 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2059 0.01 MB/sec execute 70 sec latency 863.559 ms 2023-11-27T18:18:47.530 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2061 0.01 MB/sec execute 71 sec latency 570.443 ms 2023-11-27T18:18:48.530 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2079 0.01 MB/sec execute 72 sec latency 832.466 ms 2023-11-27T18:18:49.530 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2080 0.01 MB/sec execute 73 sec latency 1153.168 ms 2023-11-27T18:18:50.530 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2083 0.01 MB/sec execute 74 sec latency 971.847 ms 2023-11-27T18:18:51.531 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2093 0.01 MB/sec execute 75 sec latency 369.347 ms 2023-11-27T18:18:52.530 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2096 0.01 MB/sec execute 76 sec latency 865.182 ms 2023-11-27T18:18:53.530 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2108 0.01 MB/sec execute 77 sec latency 922.117 ms 2023-11-27T18:18:54.531 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2139 0.01 MB/sec execute 78 sec latency 407.274 ms 2023-11-27T18:18:55.531 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2145 0.01 MB/sec execute 79 sec latency 836.906 ms 2023-11-27T18:18:56.531 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2150 0.01 MB/sec execute 80 sec latency 824.656 ms 2023-11-27T18:18:57.531 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2173 0.01 MB/sec execute 81 sec latency 419.683 ms 2023-11-27T18:18:58.531 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2175 0.01 MB/sec execute 82 sec latency 882.443 ms 2023-11-27T18:18:59.531 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2178 0.01 MB/sec execute 83 sec latency 1076.717 ms 2023-11-27T18:19:00.531 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2181 0.01 MB/sec execute 84 sec latency 446.880 ms 2023-11-27T18:19:01.532 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2185 0.01 MB/sec execute 85 sec latency 964.064 ms 2023-11-27T18:19:02.531 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2200 0.01 MB/sec execute 86 sec latency 489.285 ms 2023-11-27T18:19:03.532 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2221 0.01 MB/sec execute 87 sec latency 315.421 ms 2023-11-27T18:19:04.532 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2226 0.01 MB/sec execute 88 sec latency 902.259 ms 2023-11-27T18:19:05.532 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2262 0.01 MB/sec execute 89 sec latency 165.327 ms 2023-11-27T18:19:05.676 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:19:05.682 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:19:06.532 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2292 0.02 MB/sec execute 90 sec latency 426.447 ms 2023-11-27T18:19:07.532 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2298 0.02 MB/sec execute 91 sec latency 854.164 ms 2023-11-27T18:19:08.532 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2303 0.02 MB/sec execute 92 sec latency 483.741 ms 2023-11-27T18:19:09.532 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2306 0.02 MB/sec execute 93 sec latency 995.716 ms 2023-11-27T18:19:10.532 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2307 0.02 MB/sec execute 94 sec latency 1012.808 ms 2023-11-27T18:19:11.532 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2321 0.02 MB/sec execute 95 sec latency 1301.259 ms 2023-11-27T18:19:12.533 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2324 0.02 MB/sec execute 96 sec latency 1034.357 ms 2023-11-27T18:19:13.533 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2324 0.02 MB/sec execute 97 sec latency 1086.336 ms 2023-11-27T18:19:14.533 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2334 0.02 MB/sec execute 98 sec latency 1237.730 ms 2023-11-27T18:19:15.533 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2336 0.02 MB/sec execute 99 sec latency 866.112 ms 2023-11-27T18:19:16.533 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2340 0.02 MB/sec execute 100 sec latency 643.298 ms 2023-11-27T18:19:17.533 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2354 0.02 MB/sec execute 101 sec latency 941.043 ms 2023-11-27T18:19:18.533 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2361 0.02 MB/sec execute 102 sec latency 436.062 ms 2023-11-27T18:19:19.533 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2362 0.02 MB/sec execute 103 sec latency 1083.552 ms 2023-11-27T18:19:20.533 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2364 0.02 MB/sec execute 104 sec latency 975.071 ms 2023-11-27T18:19:21.534 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2366 0.02 MB/sec execute 105 sec latency 911.350 ms 2023-11-27T18:19:22.534 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2368 0.02 MB/sec execute 106 sec latency 968.551 ms 2023-11-27T18:19:23.534 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2371 0.02 MB/sec execute 107 sec latency 940.420 ms 2023-11-27T18:19:24.534 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2388 0.02 MB/sec execute 108 sec latency 1069.975 ms 2023-11-27T18:19:25.534 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2391 0.02 MB/sec execute 109 sec latency 632.548 ms 2023-11-27T18:19:26.534 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2395 0.02 MB/sec execute 110 sec latency 963.838 ms 2023-11-27T18:19:27.534 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2401 0.02 MB/sec execute 111 sec latency 377.148 ms 2023-11-27T18:19:28.535 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2410 0.02 MB/sec execute 112 sec latency 288.977 ms 2023-11-27T18:19:29.534 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2417 0.02 MB/sec execute 113 sec latency 1032.521 ms 2023-11-27T18:19:30.534 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2429 0.02 MB/sec execute 114 sec latency 564.739 ms 2023-11-27T18:19:31.535 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2431 0.02 MB/sec execute 115 sec latency 914.532 ms 2023-11-27T18:19:32.535 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2434 0.02 MB/sec execute 116 sec latency 932.775 ms 2023-11-27T18:19:33.535 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2440 0.02 MB/sec execute 117 sec latency 319.848 ms 2023-11-27T18:19:36.231 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:19:36.231 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2448 0.02 MB/sec execute 118 sec latency 336.353 ms 2023-11-27T18:19:36.231 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2454 0.02 MB/sec execute 119 sec latency 352.770 ms 2023-11-27T18:19:36.237 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:19:36.535 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2470 0.02 MB/sec execute 120 sec latency 351.224 ms 2023-11-27T18:19:37.535 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2478 0.02 MB/sec execute 121 sec latency 924.908 ms 2023-11-27T18:19:38.535 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2489 0.02 MB/sec execute 122 sec latency 605.790 ms 2023-11-27T18:19:39.535 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2492 0.02 MB/sec execute 123 sec latency 794.015 ms 2023-11-27T18:19:40.535 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2494 0.02 MB/sec execute 124 sec latency 915.071 ms 2023-11-27T18:19:41.537 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2501 0.02 MB/sec execute 125 sec latency 991.464 ms 2023-11-27T18:19:42.536 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2506 0.02 MB/sec execute 126 sec latency 578.021 ms 2023-11-27T18:19:43.536 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2549 0.02 MB/sec execute 127 sec latency 888.705 ms 2023-11-27T18:19:44.536 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2551 0.02 MB/sec execute 128 sec latency 825.103 ms 2023-11-27T18:19:45.536 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2559 0.02 MB/sec execute 129 sec latency 831.732 ms 2023-11-27T18:19:46.536 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2561 0.02 MB/sec execute 130 sec latency 841.468 ms 2023-11-27T18:19:47.536 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2574 0.02 MB/sec execute 131 sec latency 353.142 ms 2023-11-27T18:19:48.536 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2580 0.02 MB/sec execute 132 sec latency 489.419 ms 2023-11-27T18:19:49.537 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2581 0.02 MB/sec execute 133 sec latency 1169.150 ms 2023-11-27T18:19:50.536 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2583 0.02 MB/sec execute 134 sec latency 921.805 ms 2023-11-27T18:19:51.536 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2596 0.02 MB/sec execute 135 sec latency 536.213 ms 2023-11-27T18:19:52.536 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2600 0.02 MB/sec execute 136 sec latency 722.650 ms 2023-11-27T18:19:53.536 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2604 0.02 MB/sec execute 137 sec latency 999.382 ms 2023-11-27T18:19:54.537 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2615 0.02 MB/sec execute 138 sec latency 395.130 ms 2023-11-27T18:19:55.537 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2617 0.02 MB/sec execute 139 sec latency 903.337 ms 2023-11-27T18:19:56.537 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2618 0.02 MB/sec execute 140 sec latency 899.738 ms 2023-11-27T18:19:57.537 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2621 0.02 MB/sec execute 141 sec latency 902.667 ms 2023-11-27T18:19:58.537 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2655 0.03 MB/sec execute 142 sec latency 898.743 ms 2023-11-27T18:19:59.537 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2718 0.04 MB/sec execute 143 sec latency 684.687 ms 2023-11-27T18:20:00.537 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2745 0.04 MB/sec execute 144 sec latency 887.261 ms 2023-11-27T18:20:01.537 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2752 0.04 MB/sec execute 145 sec latency 967.802 ms 2023-11-27T18:20:02.538 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2760 0.04 MB/sec execute 146 sec latency 531.746 ms 2023-11-27T18:20:03.537 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2763 0.04 MB/sec execute 147 sec latency 914.760 ms 2023-11-27T18:20:04.538 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2775 0.04 MB/sec execute 148 sec latency 297.631 ms 2023-11-27T18:20:05.538 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2780 0.04 MB/sec execute 149 sec latency 431.640 ms 2023-11-27T18:20:06.308 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:20:06.310 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:20:06.538 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2798 0.04 MB/sec execute 150 sec latency 844.246 ms 2023-11-27T18:20:07.538 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2872 0.04 MB/sec execute 151 sec latency 972.285 ms 2023-11-27T18:20:08.538 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2880 0.04 MB/sec execute 152 sec latency 1002.546 ms 2023-11-27T18:20:16.735 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2896 0.04 MB/sec execute 153 sec latency 584.319 ms 2023-11-27T18:20:16.736 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2902 0.04 MB/sec execute 154 sec latency 269.151 ms 2023-11-27T18:20:16.736 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2918 0.05 MB/sec execute 155 sec latency 402.119 ms 2023-11-27T18:20:16.736 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2931 0.05 MB/sec execute 156 sec latency 385.004 ms 2023-11-27T18:20:16.736 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2938 0.05 MB/sec execute 157 sec latency 632.617 ms 2023-11-27T18:20:16.736 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2944 0.05 MB/sec execute 158 sec latency 876.313 ms 2023-11-27T18:20:16.736 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2966 0.05 MB/sec execute 159 sec latency 949.122 ms 2023-11-27T18:20:16.736 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2974 0.05 MB/sec execute 160 sec latency 1014.036 ms 2023-11-27T18:20:17.539 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2975 0.05 MB/sec execute 161 sec latency 897.598 ms 2023-11-27T18:20:18.539 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2984 0.05 MB/sec execute 162 sec latency 453.785 ms 2023-11-27T18:20:19.539 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2993 0.05 MB/sec execute 163 sec latency 334.284 ms 2023-11-27T18:20:20.539 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2995 0.05 MB/sec execute 164 sec latency 837.487 ms 2023-11-27T18:20:21.540 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3012 0.05 MB/sec execute 165 sec latency 297.782 ms 2023-11-27T18:20:22.539 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3017 0.05 MB/sec execute 166 sec latency 603.419 ms 2023-11-27T18:20:23.542 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3024 0.05 MB/sec execute 167 sec latency 281.813 ms 2023-11-27T18:20:24.539 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3031 0.05 MB/sec execute 168 sec latency 593.762 ms 2023-11-27T18:20:25.539 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3167 0.05 MB/sec execute 169 sec latency 860.465 ms 2023-11-27T18:20:26.540 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3175 0.05 MB/sec execute 170 sec latency 881.430 ms 2023-11-27T18:20:27.540 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3188 0.05 MB/sec execute 171 sec latency 419.184 ms 2023-11-27T18:20:28.540 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3189 0.05 MB/sec execute 172 sec latency 920.463 ms 2023-11-27T18:20:29.540 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3204 0.05 MB/sec execute 173 sec latency 543.008 ms 2023-11-27T18:20:30.540 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3212 0.05 MB/sec execute 174 sec latency 579.515 ms 2023-11-27T18:20:31.541 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3266 0.05 MB/sec execute 175 sec latency 319.400 ms 2023-11-27T18:20:32.540 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3268 0.05 MB/sec execute 176 sec latency 857.302 ms 2023-11-27T18:20:33.540 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3271 0.05 MB/sec execute 177 sec latency 929.086 ms 2023-11-27T18:20:34.540 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3280 0.05 MB/sec execute 178 sec latency 349.135 ms 2023-11-27T18:20:35.540 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3281 0.05 MB/sec execute 179 sec latency 887.048 ms 2023-11-27T18:20:36.432 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:20:36.435 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:20:36.540 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3282 0.05 MB/sec execute 180 sec latency 905.533 ms 2023-11-27T18:20:37.541 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3283 0.05 MB/sec execute 181 sec latency 956.667 ms 2023-11-27T18:20:38.541 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3285 0.05 MB/sec execute 182 sec latency 955.335 ms 2023-11-27T18:20:39.541 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3286 0.05 MB/sec execute 183 sec latency 1130.269 ms 2023-11-27T18:20:40.541 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3287 0.05 MB/sec execute 184 sec latency 921.325 ms 2023-11-27T18:20:41.541 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3290 0.05 MB/sec execute 185 sec latency 892.529 ms 2023-11-27T18:20:42.541 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3291 0.05 MB/sec execute 186 sec latency 897.859 ms 2023-11-27T18:20:43.541 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3292 0.05 MB/sec execute 187 sec latency 926.747 ms 2023-11-27T18:20:44.541 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3294 0.05 MB/sec execute 188 sec latency 944.789 ms 2023-11-27T18:20:45.541 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3295 0.05 MB/sec execute 189 sec latency 903.975 ms 2023-11-27T18:20:46.541 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3298 0.05 MB/sec execute 190 sec latency 902.565 ms 2023-11-27T18:20:47.543 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3299 0.05 MB/sec execute 191 sec latency 878.711 ms 2023-11-27T18:20:48.542 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3303 0.05 MB/sec execute 192 sec latency 847.341 ms 2023-11-27T18:20:49.542 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3306 0.05 MB/sec execute 193 sec latency 1049.181 ms 2023-11-27T18:20:50.542 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3307 0.05 MB/sec execute 194 sec latency 840.563 ms 2023-11-27T18:20:51.542 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3308 0.05 MB/sec execute 195 sec latency 882.089 ms 2023-11-27T18:20:52.542 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3309 0.05 MB/sec execute 196 sec latency 862.240 ms 2023-11-27T18:20:53.542 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3310 0.05 MB/sec execute 197 sec latency 892.280 ms 2023-11-27T18:20:54.543 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3311 0.05 MB/sec execute 198 sec latency 902.955 ms 2023-11-27T18:20:55.542 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3312 0.05 MB/sec execute 199 sec latency 896.852 ms 2023-11-27T18:20:56.542 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3314 0.05 MB/sec execute 200 sec latency 869.676 ms 2023-11-27T18:20:57.542 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3316 0.05 MB/sec execute 201 sec latency 898.987 ms 2023-11-27T18:20:58.543 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3317 0.05 MB/sec execute 202 sec latency 908.776 ms 2023-11-27T18:20:59.543 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3318 0.05 MB/sec execute 203 sec latency 1005.607 ms 2023-11-27T18:21:00.543 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3319 0.05 MB/sec execute 204 sec latency 870.330 ms 2023-11-27T18:21:01.543 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3320 0.05 MB/sec execute 205 sec latency 849.893 ms 2023-11-27T18:21:02.543 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3322 0.05 MB/sec execute 206 sec latency 853.865 ms 2023-11-27T18:21:03.543 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3324 0.05 MB/sec execute 207 sec latency 877.417 ms 2023-11-27T18:21:04.543 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3325 0.04 MB/sec execute 208 sec latency 853.334 ms 2023-11-27T18:21:05.543 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3326 0.04 MB/sec execute 209 sec latency 851.672 ms 2023-11-27T18:21:06.540 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:21:06.543 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:21:06.544 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3327 0.04 MB/sec execute 210 sec latency 845.635 ms 2023-11-27T18:21:07.544 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3330 0.04 MB/sec execute 211 sec latency 860.998 ms 2023-11-27T18:21:08.544 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3331 0.04 MB/sec execute 212 sec latency 830.187 ms 2023-11-27T18:21:09.544 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3332 0.04 MB/sec execute 213 sec latency 884.243 ms 2023-11-27T18:21:10.544 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3334 0.04 MB/sec execute 214 sec latency 883.206 ms 2023-11-27T18:21:11.544 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3335 0.04 MB/sec execute 215 sec latency 843.794 ms 2023-11-27T18:21:12.544 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3336 0.04 MB/sec execute 216 sec latency 877.682 ms 2023-11-27T18:21:13.544 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3337 0.04 MB/sec execute 217 sec latency 855.691 ms 2023-11-27T18:21:14.544 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3342 0.04 MB/sec execute 218 sec latency 891.744 ms 2023-11-27T18:21:15.544 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3353 0.04 MB/sec execute 219 sec latency 355.210 ms 2023-11-27T18:21:16.544 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3364 0.04 MB/sec execute 220 sec latency 312.363 ms 2023-11-27T18:21:17.545 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3372 0.04 MB/sec execute 221 sec latency 346.670 ms 2023-11-27T18:21:18.545 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3379 0.04 MB/sec execute 222 sec latency 369.601 ms 2023-11-27T18:21:19.545 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3391 0.04 MB/sec execute 223 sec latency 416.583 ms 2023-11-27T18:21:20.545 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3393 0.04 MB/sec execute 224 sec latency 883.038 ms 2023-11-27T18:21:21.545 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3395 0.04 MB/sec execute 225 sec latency 1147.684 ms 2023-11-27T18:21:22.545 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3398 0.04 MB/sec execute 226 sec latency 937.929 ms 2023-11-27T18:21:23.545 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3399 0.04 MB/sec execute 227 sec latency 1016.105 ms 2023-11-27T18:21:24.545 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3494 0.05 MB/sec execute 228 sec latency 346.218 ms 2023-11-27T18:21:25.545 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3513 0.05 MB/sec execute 229 sec latency 242.570 ms 2023-11-27T18:21:26.542 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:09:47.624 38308== Warning: unimplemented fcntl command: 1036 2023-11-27T18:21:26.545 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3516 0.05 MB/sec execute 230 sec latency 531.452 ms 2023-11-27T18:21:26.770 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:09:47.853 38308== Warning: unimplemented fcntl command: 1036 2023-11-27T18:21:26.853 INFO:tasks.ceph.mon.c.smithi094.stderr:==00:00:09:47.878 38307== Warning: unimplemented fcntl command: 1036 2023-11-27T18:21:27.089 INFO:tasks.ceph.mon.c.smithi094.stderr:==00:00:09:48.115 38307== Warning: unimplemented fcntl command: 1036 2023-11-27T18:21:27.151 INFO:tasks.ceph.mon.b.smithi094.stderr:==00:00:09:48.178 38305== Warning: unimplemented fcntl command: 1036 2023-11-27T18:21:27.356 INFO:tasks.ceph.mon.b.smithi094.stderr:==00:00:09:48.383 38305== Warning: unimplemented fcntl command: 1036 2023-11-27T18:21:27.546 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3527 0.05 MB/sec execute 231 sec latency 523.698 ms 2023-11-27T18:21:28.092 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:09:49.174 38308== Warning: unimplemented fcntl command: 1036 2023-11-27T18:21:28.326 INFO:tasks.ceph.mon.c.smithi094.stderr:==00:00:09:49.352 38307== Warning: unimplemented fcntl command: 1036 2023-11-27T18:21:28.546 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3527 0.05 MB/sec execute 232 sec latency 1523.754 ms 2023-11-27T18:21:28.556 INFO:tasks.ceph.mon.b.smithi094.stderr:==00:00:09:49.582 38305== Warning: unimplemented fcntl command: 1036 2023-11-27T18:21:29.546 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3527 0.05 MB/sec execute 233 sec latency 2523.848 ms 2023-11-27T18:21:30.546 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3531 0.05 MB/sec execute 234 sec latency 2975.218 ms 2023-11-27T18:21:31.546 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3533 0.05 MB/sec execute 235 sec latency 943.272 ms 2023-11-27T18:21:32.546 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3548 0.05 MB/sec execute 236 sec latency 278.604 ms 2023-11-27T18:21:33.548 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3557 0.05 MB/sec execute 237 sec latency 413.499 ms 2023-11-27T18:21:34.546 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3557 0.05 MB/sec execute 238 sec latency 1079.006 ms 2023-11-27T18:21:35.546 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3563 0.05 MB/sec execute 239 sec latency 1163.569 ms 2023-11-27T18:21:36.546 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3573 0.05 MB/sec execute 240 sec latency 463.152 ms 2023-11-27T18:21:36.588 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:21:36.591 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:21:37.547 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3584 0.05 MB/sec execute 241 sec latency 839.338 ms 2023-11-27T18:21:38.547 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3588 0.05 MB/sec execute 242 sec latency 595.705 ms 2023-11-27T18:21:39.547 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3617 0.05 MB/sec execute 243 sec latency 929.805 ms 2023-11-27T18:21:40.547 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3628 0.05 MB/sec execute 244 sec latency 476.405 ms 2023-11-27T18:21:41.547 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3641 0.05 MB/sec execute 245 sec latency 354.767 ms 2023-11-27T18:21:42.547 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3642 0.05 MB/sec execute 246 sec latency 862.668 ms 2023-11-27T18:21:43.547 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3663 0.05 MB/sec execute 247 sec latency 886.507 ms 2023-11-27T18:21:44.547 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3671 0.05 MB/sec execute 248 sec latency 404.654 ms 2023-11-27T18:21:45.548 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3672 0.05 MB/sec execute 249 sec latency 878.499 ms 2023-11-27T18:21:46.548 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3676 0.05 MB/sec execute 250 sec latency 969.499 ms 2023-11-27T18:21:47.548 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3686 0.05 MB/sec execute 251 sec latency 280.750 ms 2023-11-27T18:21:48.548 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3689 0.05 MB/sec execute 252 sec latency 909.092 ms 2023-11-27T18:21:49.548 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3697 0.05 MB/sec execute 253 sec latency 410.091 ms 2023-11-27T18:21:50.548 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3707 0.05 MB/sec execute 254 sec latency 396.792 ms 2023-11-27T18:21:51.548 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3716 0.05 MB/sec execute 255 sec latency 364.039 ms 2023-11-27T18:21:52.548 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3738 0.05 MB/sec execute 256 sec latency 277.716 ms 2023-11-27T18:21:53.549 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3758 0.05 MB/sec execute 257 sec latency 672.782 ms 2023-11-27T18:21:54.549 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3760 0.05 MB/sec execute 258 sec latency 1138.165 ms 2023-11-27T18:21:55.548 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3771 0.05 MB/sec execute 259 sec latency 503.308 ms 2023-11-27T18:21:56.549 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3776 0.05 MB/sec execute 260 sec latency 351.741 ms 2023-11-27T18:21:57.549 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3784 0.05 MB/sec execute 261 sec latency 356.311 ms 2023-11-27T18:21:58.549 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3789 0.05 MB/sec execute 262 sec latency 481.760 ms 2023-11-27T18:21:59.549 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3791 0.05 MB/sec execute 263 sec latency 534.194 ms 2023-11-27T18:22:00.549 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3796 0.05 MB/sec execute 264 sec latency 487.874 ms 2023-11-27T18:22:01.549 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3800 0.05 MB/sec execute 265 sec latency 587.990 ms 2023-11-27T18:22:02.549 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3805 0.05 MB/sec execute 266 sec latency 392.334 ms 2023-11-27T18:22:03.549 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3812 0.05 MB/sec execute 267 sec latency 342.659 ms 2023-11-27T18:22:04.550 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3816 0.05 MB/sec execute 268 sec latency 374.688 ms 2023-11-27T18:22:12.791 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:22:12.793 INFO:tasks.ceph.mon.c.smithi094.stderr:==00:00:10:31.106 38307== Warning: unimplemented fcntl command: 1036 2023-11-27T18:22:12.793 INFO:tasks.ceph.mon.b.smithi094.stderr:==00:00:10:31.117 38305== Warning: unimplemented fcntl command: 1036 2023-11-27T18:22:12.794 INFO:tasks.ceph.mon.c.smithi094.stderr:==00:00:10:31.150 38307== Warning: unimplemented fcntl command: 1036 2023-11-27T18:22:12.795 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3823 0.05 MB/sec execute 269 sec latency 326.600 ms 2023-11-27T18:22:12.795 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3831 0.05 MB/sec execute 270 sec latency 313.799 ms 2023-11-27T18:22:12.796 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3837 0.05 MB/sec execute 271 sec latency 386.011 ms 2023-11-27T18:22:12.796 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3844 0.05 MB/sec execute 272 sec latency 293.842 ms 2023-11-27T18:22:12.796 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3850 0.05 MB/sec execute 273 sec latency 375.421 ms 2023-11-27T18:22:12.797 INFO:tasks.ceph.mon.b.smithi094.stderr:==00:00:10:31.239 38305== Warning: unimplemented fcntl command: 1036 2023-11-27T18:22:12.797 INFO:tasks.ceph.mon.b.smithi094.stderr:==00:00:10:31.512 38305== Warning: unimplemented fcntl command: 1036 2023-11-27T18:22:12.797 INFO:tasks.ceph.mon.c.smithi094.stderr:==00:00:10:31.635 38307== Warning: unimplemented fcntl command: 1036 2023-11-27T18:22:12.797 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:10:30.984 38308== Warning: unimplemented fcntl command: 1036 2023-11-27T18:22:12.798 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:10:31.034 38308== Warning: unimplemented fcntl command: 1036 2023-11-27T18:22:12.798 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:10:31.500 38308== Warning: unimplemented fcntl command: 1036 2023-11-27T18:22:12.798 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3856 0.05 MB/sec execute 274 sec latency 393.369 ms 2023-11-27T18:22:12.798 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3863 0.05 MB/sec execute 275 sec latency 299.199 ms 2023-11-27T18:22:12.798 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3869 0.05 MB/sec execute 276 sec latency 325.706 ms 2023-11-27T18:22:12.801 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:22:13.550 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3871 0.05 MB/sec execute 277 sec latency 815.559 ms 2023-11-27T18:22:14.550 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3876 0.05 MB/sec execute 278 sec latency 271.807 ms 2023-11-27T18:22:15.550 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3880 0.05 MB/sec execute 279 sec latency 849.948 ms 2023-11-27T18:22:16.551 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3885 0.05 MB/sec execute 280 sec latency 391.659 ms 2023-11-27T18:22:17.551 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3896 0.05 MB/sec execute 281 sec latency 609.073 ms 2023-11-27T18:22:18.551 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3898 0.05 MB/sec execute 282 sec latency 871.422 ms 2023-11-27T18:22:19.551 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3903 0.05 MB/sec execute 283 sec latency 873.067 ms 2023-11-27T18:22:20.551 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3914 0.05 MB/sec execute 284 sec latency 547.576 ms 2023-11-27T18:22:21.551 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3920 0.05 MB/sec execute 285 sec latency 907.141 ms 2023-11-27T18:22:22.551 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3927 0.05 MB/sec execute 286 sec latency 414.283 ms 2023-11-27T18:22:23.551 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3932 0.05 MB/sec execute 287 sec latency 409.549 ms 2023-11-27T18:22:24.552 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3936 0.05 MB/sec execute 288 sec latency 506.051 ms 2023-11-27T18:22:25.551 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3938 0.05 MB/sec execute 289 sec latency 481.543 ms 2023-11-27T18:22:26.552 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3943 0.05 MB/sec execute 290 sec latency 543.012 ms 2023-11-27T18:22:27.552 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3947 0.05 MB/sec execute 291 sec latency 540.323 ms 2023-11-27T18:22:28.552 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3953 0.05 MB/sec execute 292 sec latency 431.739 ms 2023-11-27T18:22:29.552 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3959 0.05 MB/sec execute 293 sec latency 307.863 ms 2023-11-27T18:22:30.552 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3967 0.05 MB/sec execute 294 sec latency 389.237 ms 2023-11-27T18:22:31.553 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3971 0.05 MB/sec execute 295 sec latency 374.380 ms 2023-11-27T18:22:32.552 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3979 0.05 MB/sec execute 296 sec latency 355.733 ms 2023-11-27T18:22:33.552 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3984 0.05 MB/sec execute 297 sec latency 376.825 ms 2023-11-27T18:22:34.552 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3991 0.05 MB/sec execute 298 sec latency 282.765 ms 2023-11-27T18:22:35.553 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3998 0.05 MB/sec execute 299 sec latency 417.265 ms 2023-11-27T18:22:36.553 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4002 0.05 MB/sec execute 300 sec latency 416.141 ms 2023-11-27T18:22:37.553 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4009 0.05 MB/sec execute 301 sec latency 368.963 ms 2023-11-27T18:22:38.553 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4015 0.05 MB/sec execute 302 sec latency 328.541 ms 2023-11-27T18:22:39.553 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4022 0.05 MB/sec execute 303 sec latency 278.639 ms 2023-11-27T18:22:40.553 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4027 0.05 MB/sec execute 304 sec latency 478.738 ms 2023-11-27T18:22:41.553 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4031 0.05 MB/sec execute 305 sec latency 880.651 ms 2023-11-27T18:22:42.553 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4032 0.05 MB/sec execute 306 sec latency 915.757 ms 2023-11-27T18:22:42.852 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:22:42.855 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:22:43.553 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4035 0.05 MB/sec execute 307 sec latency 974.110 ms 2023-11-27T18:22:44.553 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4037 0.05 MB/sec execute 308 sec latency 1157.134 ms 2023-11-27T18:22:45.553 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4044 0.05 MB/sec execute 309 sec latency 157.767 ms 2023-11-27T18:22:46.553 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4047 0.05 MB/sec execute 310 sec latency 771.642 ms 2023-11-27T18:22:47.554 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4058 0.05 MB/sec execute 311 sec latency 876.982 ms 2023-11-27T18:22:48.554 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4062 0.05 MB/sec execute 312 sec latency 840.374 ms 2023-11-27T18:22:49.554 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4068 0.04 MB/sec execute 313 sec latency 176.878 ms 2023-11-27T18:22:50.554 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4076 0.04 MB/sec execute 314 sec latency 862.350 ms 2023-11-27T18:22:51.554 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4082 0.04 MB/sec execute 315 sec latency 855.933 ms 2023-11-27T18:22:52.554 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4094 0.04 MB/sec execute 316 sec latency 884.572 ms 2023-11-27T18:22:53.554 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4105 0.04 MB/sec execute 317 sec latency 405.704 ms 2023-11-27T18:22:54.557 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4112 0.04 MB/sec execute 318 sec latency 411.219 ms 2023-11-27T18:22:55.554 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4120 0.04 MB/sec execute 319 sec latency 526.285 ms 2023-11-27T18:22:56.555 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4131 0.04 MB/sec execute 320 sec latency 294.028 ms 2023-11-27T18:22:57.555 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4147 0.04 MB/sec execute 321 sec latency 158.322 ms 2023-11-27T18:22:58.555 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4153 0.04 MB/sec execute 322 sec latency 418.630 ms 2023-11-27T18:22:59.555 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4161 0.04 MB/sec execute 323 sec latency 786.025 ms 2023-11-27T18:23:00.555 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4168 0.04 MB/sec execute 324 sec latency 511.985 ms 2023-11-27T18:23:01.555 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4173 0.04 MB/sec execute 325 sec latency 456.035 ms 2023-11-27T18:23:02.555 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4176 0.04 MB/sec execute 326 sec latency 955.577 ms 2023-11-27T18:23:03.555 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4180 0.04 MB/sec execute 327 sec latency 813.468 ms 2023-11-27T18:23:04.555 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4181 0.04 MB/sec execute 328 sec latency 930.053 ms 2023-11-27T18:23:05.555 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4186 0.04 MB/sec execute 329 sec latency 1116.700 ms 2023-11-27T18:23:06.555 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4216 0.04 MB/sec execute 330 sec latency 851.740 ms 2023-11-27T18:23:07.555 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4217 0.04 MB/sec execute 331 sec latency 949.410 ms 2023-11-27T18:23:08.556 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4225 0.04 MB/sec execute 332 sec latency 974.917 ms 2023-11-27T18:23:09.556 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4226 0.04 MB/sec execute 333 sec latency 964.478 ms 2023-11-27T18:23:10.556 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4242 0.04 MB/sec execute 334 sec latency 282.126 ms 2023-11-27T18:23:11.556 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4252 0.04 MB/sec execute 335 sec latency 630.475 ms 2023-11-27T18:23:12.556 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4254 0.04 MB/sec execute 336 sec latency 883.738 ms 2023-11-27T18:23:12.976 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:23:12.979 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:23:13.556 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4270 0.04 MB/sec execute 337 sec latency 889.588 ms 2023-11-27T18:23:14.556 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4281 0.04 MB/sec execute 338 sec latency 390.179 ms 2023-11-27T18:23:15.556 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4292 0.04 MB/sec execute 339 sec latency 620.688 ms 2023-11-27T18:23:16.556 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4314 0.04 MB/sec execute 340 sec latency 167.094 ms 2023-11-27T18:23:17.557 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4317 0.04 MB/sec execute 341 sec latency 899.799 ms 2023-11-27T18:23:18.557 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4323 0.04 MB/sec execute 342 sec latency 853.309 ms 2023-11-27T18:23:19.557 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4344 0.04 MB/sec execute 343 sec latency 391.213 ms 2023-11-27T18:23:20.557 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4351 0.04 MB/sec execute 344 sec latency 561.006 ms 2023-11-27T18:23:21.557 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4372 0.04 MB/sec execute 345 sec latency 275.527 ms 2023-11-27T18:23:22.557 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4383 0.04 MB/sec execute 346 sec latency 404.695 ms 2023-11-27T18:23:23.557 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4384 0.04 MB/sec execute 347 sec latency 942.552 ms 2023-11-27T18:23:24.557 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4386 0.04 MB/sec execute 348 sec latency 1132.773 ms 2023-11-27T18:23:25.557 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4388 0.04 MB/sec execute 349 sec latency 825.742 ms 2023-11-27T18:23:26.557 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4395 0.04 MB/sec execute 350 sec latency 889.691 ms 2023-11-27T18:23:27.557 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4423 0.04 MB/sec execute 351 sec latency 751.978 ms 2023-11-27T18:23:28.558 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4424 0.04 MB/sec execute 352 sec latency 889.316 ms 2023-11-27T18:23:29.558 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4432 0.04 MB/sec execute 353 sec latency 994.967 ms 2023-11-27T18:23:30.558 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4433 0.04 MB/sec execute 354 sec latency 885.609 ms 2023-11-27T18:23:31.558 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4450 0.04 MB/sec execute 355 sec latency 432.527 ms 2023-11-27T18:23:32.558 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4460 0.04 MB/sec execute 356 sec latency 867.241 ms 2023-11-27T18:23:33.558 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4472 0.04 MB/sec execute 357 sec latency 368.425 ms 2023-11-27T18:23:34.558 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4474 0.04 MB/sec execute 358 sec latency 734.508 ms 2023-11-27T18:23:35.558 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4496 0.04 MB/sec execute 359 sec latency 242.100 ms 2023-11-27T18:23:36.558 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4498 0.04 MB/sec execute 360 sec latency 849.099 ms 2023-11-27T18:23:37.558 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4499 0.04 MB/sec execute 361 sec latency 858.698 ms 2023-11-27T18:23:38.558 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4501 0.04 MB/sec execute 362 sec latency 478.626 ms 2023-11-27T18:23:39.558 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4503 0.04 MB/sec execute 363 sec latency 1134.422 ms 2023-11-27T18:23:40.559 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4506 0.04 MB/sec execute 364 sec latency 526.400 ms 2023-11-27T18:23:41.559 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4511 0.04 MB/sec execute 365 sec latency 883.188 ms 2023-11-27T18:23:42.559 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4533 0.04 MB/sec execute 366 sec latency 830.938 ms 2023-11-27T18:23:43.197 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:23:43.200 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:23:43.559 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4539 0.04 MB/sec execute 367 sec latency 583.024 ms 2023-11-27T18:23:44.559 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4557 0.04 MB/sec execute 368 sec latency 283.526 ms 2023-11-27T18:23:45.559 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4563 0.04 MB/sec execute 369 sec latency 611.946 ms 2023-11-27T18:23:46.559 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4594 0.04 MB/sec execute 370 sec latency 899.955 ms 2023-11-27T18:23:47.559 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4597 0.04 MB/sec execute 371 sec latency 886.190 ms 2023-11-27T18:23:48.559 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4602 0.04 MB/sec execute 372 sec latency 438.909 ms 2023-11-27T18:23:49.559 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4611 0.04 MB/sec execute 373 sec latency 847.046 ms 2023-11-27T18:23:50.559 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4615 0.04 MB/sec execute 374 sec latency 855.323 ms 2023-11-27T18:23:51.562 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4616 0.04 MB/sec execute 375 sec latency 890.994 ms 2023-11-27T18:23:52.560 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4618 0.04 MB/sec execute 376 sec latency 943.924 ms 2023-11-27T18:23:53.560 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4629 0.04 MB/sec execute 377 sec latency 368.039 ms 2023-11-27T18:23:54.560 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4642 0.04 MB/sec execute 378 sec latency 483.936 ms 2023-11-27T18:23:55.560 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4656 0.04 MB/sec execute 379 sec latency 341.112 ms 2023-11-27T18:23:56.560 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4663 0.04 MB/sec execute 380 sec latency 947.000 ms 2023-11-27T18:23:57.560 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4668 0.04 MB/sec execute 381 sec latency 558.700 ms 2023-11-27T18:23:58.560 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4681 0.04 MB/sec execute 382 sec latency 888.756 ms 2023-11-27T18:23:59.560 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4683 0.04 MB/sec execute 383 sec latency 1147.393 ms 2023-11-27T18:24:00.560 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4695 0.04 MB/sec execute 384 sec latency 326.702 ms 2023-11-27T18:24:01.561 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4714 0.04 MB/sec execute 385 sec latency 355.430 ms 2023-11-27T18:24:02.561 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4724 0.04 MB/sec execute 386 sec latency 531.193 ms 2023-11-27T18:24:03.561 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4727 0.04 MB/sec execute 387 sec latency 891.810 ms 2023-11-27T18:24:04.561 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4734 0.04 MB/sec execute 388 sec latency 576.853 ms 2023-11-27T18:24:05.561 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4735 0.04 MB/sec execute 389 sec latency 1195.723 ms 2023-11-27T18:24:12.393 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4736 0.04 MB/sec execute 390 sec latency 908.963 ms 2023-11-27T18:24:12.393 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4739 0.04 MB/sec execute 391 sec latency 1025.784 ms 2023-11-27T18:24:12.394 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4745 0.04 MB/sec execute 392 sec latency 357.029 ms 2023-11-27T18:24:12.394 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4766 0.04 MB/sec execute 393 sec latency 285.734 ms 2023-11-27T18:24:12.394 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4770 0.04 MB/sec execute 394 sec latency 531.706 ms 2023-11-27T18:24:12.394 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4780 0.04 MB/sec execute 395 sec latency 887.434 ms 2023-11-27T18:24:12.561 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4795 0.04 MB/sec execute 396 sec latency 344.529 ms 2023-11-27T18:24:13.457 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:24:13.460 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:24:13.562 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4810 0.04 MB/sec execute 397 sec latency 352.135 ms 2023-11-27T18:24:14.562 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4814 0.04 MB/sec execute 398 sec latency 584.036 ms 2023-11-27T18:24:15.562 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4821 0.04 MB/sec execute 399 sec latency 1014.342 ms 2023-11-27T18:24:16.565 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4844 0.04 MB/sec execute 400 sec latency 190.220 ms 2023-11-27T18:24:17.562 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4846 0.04 MB/sec execute 401 sec latency 940.551 ms 2023-11-27T18:24:18.562 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4847 0.04 MB/sec execute 402 sec latency 1037.929 ms 2023-11-27T18:24:19.562 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4850 0.04 MB/sec execute 403 sec latency 1171.145 ms 2023-11-27T18:24:20.562 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4851 0.04 MB/sec execute 404 sec latency 880.597 ms 2023-11-27T18:24:21.562 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4942 0.05 MB/sec execute 405 sec latency 760.530 ms 2023-11-27T18:24:22.562 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4943 0.05 MB/sec execute 406 sec latency 897.998 ms 2023-11-27T18:24:23.563 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4947 0.05 MB/sec execute 407 sec latency 998.020 ms 2023-11-27T18:24:24.563 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4951 0.05 MB/sec execute 408 sec latency 849.185 ms 2023-11-27T18:24:25.563 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4957 0.05 MB/sec execute 409 sec latency 862.368 ms 2023-11-27T18:24:26.563 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4963 0.05 MB/sec execute 410 sec latency 272.106 ms 2023-11-27T18:24:27.563 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4969 0.05 MB/sec execute 411 sec latency 884.908 ms 2023-11-27T18:24:28.563 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4983 0.05 MB/sec execute 412 sec latency 492.006 ms 2023-11-27T18:24:29.563 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4985 0.05 MB/sec execute 413 sec latency 914.987 ms 2023-11-27T18:24:30.563 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5007 0.05 MB/sec execute 414 sec latency 399.160 ms 2023-11-27T18:24:31.563 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5014 0.05 MB/sec execute 415 sec latency 414.394 ms 2023-11-27T18:24:32.563 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5021 0.05 MB/sec execute 416 sec latency 856.159 ms 2023-11-27T18:24:33.563 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5031 0.05 MB/sec execute 417 sec latency 219.628 ms 2023-11-27T18:24:35.483 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5034 0.05 MB/sec execute 418 sec latency 871.902 ms 2023-11-27T18:24:35.564 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5051 0.05 MB/sec execute 419 sec latency 608.331 ms 2023-11-27T18:24:36.564 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5055 0.05 MB/sec execute 420 sec latency 876.541 ms 2023-11-27T18:24:37.564 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5056 0.05 MB/sec execute 421 sec latency 726.555 ms 2023-11-27T18:24:38.564 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5066 0.05 MB/sec execute 422 sec latency 967.232 ms 2023-11-27T18:24:39.564 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5078 0.05 MB/sec execute 423 sec latency 374.804 ms 2023-11-27T18:24:40.564 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5091 0.05 MB/sec execute 424 sec latency 454.932 ms 2023-11-27T18:24:41.564 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5092 0.05 MB/sec execute 425 sec latency 982.659 ms 2023-11-27T18:24:42.564 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5096 0.05 MB/sec execute 426 sec latency 1010.895 ms 2023-11-27T18:24:43.498 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:24:43.501 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:24:43.564 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5118 0.04 MB/sec execute 427 sec latency 974.389 ms 2023-11-27T18:24:44.564 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5120 0.04 MB/sec execute 428 sec latency 753.487 ms 2023-11-27T18:24:45.564 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5131 0.04 MB/sec execute 429 sec latency 1098.623 ms 2023-11-27T18:24:46.565 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5145 0.04 MB/sec execute 430 sec latency 191.578 ms 2023-11-27T18:24:47.565 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5153 0.04 MB/sec execute 431 sec latency 166.144 ms 2023-11-27T18:24:48.565 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5154 0.04 MB/sec execute 432 sec latency 853.994 ms 2023-11-27T18:24:49.566 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5171 0.04 MB/sec execute 433 sec latency 1007.407 ms 2023-11-27T18:24:50.565 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5172 0.04 MB/sec execute 434 sec latency 876.226 ms 2023-11-27T18:24:51.565 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5177 0.04 MB/sec execute 435 sec latency 826.699 ms 2023-11-27T18:24:52.565 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5182 0.04 MB/sec execute 436 sec latency 270.328 ms 2023-11-27T18:24:53.565 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5197 0.04 MB/sec execute 437 sec latency 877.525 ms 2023-11-27T18:24:54.565 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5206 0.04 MB/sec execute 438 sec latency 726.432 ms 2023-11-27T18:24:55.565 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5209 0.04 MB/sec execute 439 sec latency 1089.763 ms 2023-11-27T18:24:56.565 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5218 0.04 MB/sec execute 440 sec latency 954.326 ms 2023-11-27T18:24:57.566 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5227 0.04 MB/sec execute 441 sec latency 604.011 ms 2023-11-27T18:24:58.566 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5251 0.04 MB/sec execute 442 sec latency 433.801 ms 2023-11-27T18:24:59.566 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5263 0.04 MB/sec execute 443 sec latency 555.562 ms 2023-11-27T18:25:00.566 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5266 0.04 MB/sec execute 444 sec latency 423.079 ms 2023-11-27T18:25:01.566 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5272 0.04 MB/sec execute 445 sec latency 899.946 ms 2023-11-27T18:25:02.566 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5288 0.04 MB/sec execute 446 sec latency 829.070 ms 2023-11-27T18:25:03.566 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5330 0.04 MB/sec execute 447 sec latency 202.455 ms 2023-11-27T18:25:04.566 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5337 0.04 MB/sec execute 448 sec latency 597.452 ms 2023-11-27T18:25:05.566 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5344 0.04 MB/sec execute 449 sec latency 848.527 ms 2023-11-27T18:25:06.566 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5368 0.04 MB/sec execute 450 sec latency 178.712 ms 2023-11-27T18:25:07.566 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5371 0.04 MB/sec execute 451 sec latency 507.970 ms 2023-11-27T18:25:08.566 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5385 0.04 MB/sec execute 452 sec latency 923.970 ms 2023-11-27T18:25:09.566 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5387 0.04 MB/sec execute 453 sec latency 765.211 ms 2023-11-27T18:25:10.566 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5391 0.04 MB/sec execute 454 sec latency 835.059 ms 2023-11-27T18:25:11.567 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5402 0.04 MB/sec execute 455 sec latency 881.080 ms 2023-11-27T18:25:12.568 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5406 0.04 MB/sec execute 456 sec latency 384.387 ms 2023-11-27T18:25:13.567 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5420 0.04 MB/sec execute 457 sec latency 926.289 ms 2023-11-27T18:25:13.591 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:25:13.594 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:25:14.567 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5423 0.04 MB/sec execute 458 sec latency 746.913 ms 2023-11-27T18:25:15.567 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5427 0.04 MB/sec execute 459 sec latency 1073.927 ms 2023-11-27T18:25:16.567 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5432 0.04 MB/sec execute 460 sec latency 868.273 ms 2023-11-27T18:25:17.567 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5434 0.04 MB/sec execute 461 sec latency 679.065 ms 2023-11-27T18:25:18.567 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5461 0.04 MB/sec execute 462 sec latency 909.045 ms 2023-11-27T18:25:19.567 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5468 0.04 MB/sec execute 463 sec latency 894.773 ms 2023-11-27T18:25:20.568 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5474 0.04 MB/sec execute 464 sec latency 878.773 ms 2023-11-27T18:25:21.568 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5477 0.04 MB/sec execute 465 sec latency 421.115 ms 2023-11-27T18:25:22.568 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5485 0.04 MB/sec execute 466 sec latency 863.952 ms 2023-11-27T18:25:23.568 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5515 0.04 MB/sec execute 467 sec latency 859.796 ms 2023-11-27T18:25:24.568 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5537 0.04 MB/sec execute 468 sec latency 189.664 ms 2023-11-27T18:25:25.568 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5540 0.04 MB/sec execute 469 sec latency 478.987 ms 2023-11-27T18:25:26.568 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5553 0.04 MB/sec execute 470 sec latency 936.418 ms 2023-11-27T18:25:27.568 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5562 0.04 MB/sec execute 471 sec latency 582.112 ms 2023-11-27T18:25:28.569 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5585 0.04 MB/sec execute 472 sec latency 862.360 ms 2023-11-27T18:25:29.568 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5597 0.04 MB/sec execute 473 sec latency 257.329 ms 2023-11-27T18:25:30.568 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5605 0.04 MB/sec execute 474 sec latency 829.097 ms 2023-11-27T18:25:31.568 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5613 0.04 MB/sec execute 475 sec latency 923.103 ms 2023-11-27T18:25:32.568 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5615 0.04 MB/sec execute 476 sec latency 867.619 ms 2023-11-27T18:25:33.568 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5618 0.04 MB/sec execute 477 sec latency 817.013 ms 2023-11-27T18:25:34.569 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5623 0.04 MB/sec execute 478 sec latency 379.365 ms 2023-11-27T18:25:35.569 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5633 0.04 MB/sec execute 479 sec latency 877.247 ms 2023-11-27T18:25:36.569 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5641 0.04 MB/sec execute 480 sec latency 843.595 ms 2023-11-27T18:25:37.569 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5643 0.04 MB/sec execute 481 sec latency 951.693 ms 2023-11-27T18:25:38.569 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5653 0.04 MB/sec execute 482 sec latency 1025.523 ms 2023-11-27T18:25:39.185 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:14:00.265 38308== Warning: unimplemented fcntl command: 1036 2023-11-27T18:25:39.193 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:14:00.273 38308== Warning: unimplemented fcntl command: 1036 2023-11-27T18:25:39.308 INFO:tasks.ceph.mon.b.smithi094.stderr:==00:00:14:00.333 38305== Warning: unimplemented fcntl command: 1036 2023-11-27T18:25:39.317 INFO:tasks.ceph.mon.b.smithi094.stderr:==00:00:14:00.342 38305== Warning: unimplemented fcntl command: 1036 2023-11-27T18:25:39.331 INFO:tasks.ceph.mon.c.smithi094.stderr:==00:00:14:00.357 38307== Warning: unimplemented fcntl command: 1036 2023-11-27T18:25:39.347 INFO:tasks.ceph.mon.c.smithi094.stderr:==00:00:14:00.373 38307== Warning: unimplemented fcntl command: 1036 2023-11-27T18:25:39.569 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5658 0.04 MB/sec execute 483 sec latency 785.016 ms 2023-11-27T18:25:39.577 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:14:00.658 38308== Warning: unimplemented fcntl command: 1036 2023-11-27T18:25:39.637 INFO:tasks.ceph.mon.b.smithi094.stderr:==00:00:14:00.662 38305== Warning: unimplemented fcntl command: 1036 2023-11-27T18:25:39.698 INFO:tasks.ceph.mon.c.smithi094.stderr:==00:00:14:00.723 38307== Warning: unimplemented fcntl command: 1036 2023-11-27T18:25:40.569 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5666 0.04 MB/sec execute 484 sec latency 790.736 ms 2023-11-27T18:25:41.569 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5701 0.04 MB/sec execute 485 sec latency 425.609 ms 2023-11-27T18:25:42.569 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5703 0.04 MB/sec execute 486 sec latency 895.066 ms 2023-11-27T18:25:43.570 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5710 0.04 MB/sec execute 487 sec latency 879.082 ms 2023-11-27T18:25:43.712 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:25:43.715 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:25:44.570 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5735 0.04 MB/sec execute 488 sec latency 295.134 ms 2023-11-27T18:25:45.570 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5737 0.04 MB/sec execute 489 sec latency 966.509 ms 2023-11-27T18:25:46.570 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5738 0.04 MB/sec execute 490 sec latency 1151.219 ms 2023-11-27T18:25:47.570 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5743 0.04 MB/sec execute 491 sec latency 203.410 ms 2023-11-27T18:25:48.570 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5744 0.04 MB/sec execute 492 sec latency 878.950 ms 2023-11-27T18:25:49.570 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5761 0.04 MB/sec execute 493 sec latency 904.892 ms 2023-11-27T18:25:50.570 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5782 0.04 MB/sec execute 494 sec latency 278.069 ms 2023-11-27T18:25:51.570 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5792 0.04 MB/sec execute 495 sec latency 899.294 ms 2023-11-27T18:25:52.570 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5823 0.04 MB/sec execute 496 sec latency 180.844 ms 2023-11-27T18:25:53.570 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5853 0.04 MB/sec execute 497 sec latency 455.963 ms 2023-11-27T18:25:54.570 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5856 0.04 MB/sec execute 498 sec latency 829.847 ms 2023-11-27T18:25:55.570 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5863 0.04 MB/sec execute 499 sec latency 273.510 ms 2023-11-27T18:25:56.570 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5866 0.04 MB/sec execute 500 sec latency 825.424 ms 2023-11-27T18:25:57.571 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5867 0.04 MB/sec execute 501 sec latency 813.668 ms 2023-11-27T18:25:58.571 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5881 0.04 MB/sec execute 502 sec latency 1341.403 ms 2023-11-27T18:25:59.571 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5884 0.04 MB/sec execute 503 sec latency 920.461 ms 2023-11-27T18:26:00.571 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5887 0.04 MB/sec execute 504 sec latency 1058.154 ms 2023-11-27T18:26:01.571 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5895 0.04 MB/sec execute 505 sec latency 315.788 ms 2023-11-27T18:26:02.571 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5900 0.04 MB/sec execute 506 sec latency 857.413 ms 2023-11-27T18:26:03.571 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5905 0.04 MB/sec execute 507 sec latency 920.706 ms 2023-11-27T18:26:04.574 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5918 0.04 MB/sec execute 508 sec latency 356.097 ms 2023-11-27T18:26:05.572 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5921 0.04 MB/sec execute 509 sec latency 706.036 ms 2023-11-27T18:26:06.572 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5922 0.04 MB/sec execute 510 sec latency 882.028 ms 2023-11-27T18:26:07.572 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5924 0.04 MB/sec execute 511 sec latency 1036.013 ms 2023-11-27T18:26:13.708 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5926 0.04 MB/sec execute 512 sec latency 894.723 ms 2023-11-27T18:26:13.709 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5931 0.04 MB/sec execute 513 sec latency 1010.429 ms 2023-11-27T18:26:13.709 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5936 0.04 MB/sec execute 514 sec latency 1012.362 ms 2023-11-27T18:26:13.709 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5949 0.04 MB/sec execute 515 sec latency 573.190 ms 2023-11-27T18:26:13.709 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5951 0.04 MB/sec execute 516 sec latency 929.659 ms 2023-11-27T18:26:13.709 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5959 0.04 MB/sec execute 517 sec latency 959.435 ms 2023-11-27T18:26:14.083 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:26:14.086 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:26:14.572 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5966 0.04 MB/sec execute 518 sec latency 369.999 ms 2023-11-27T18:26:15.572 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5970 0.04 MB/sec execute 519 sec latency 541.532 ms 2023-11-27T18:26:16.572 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5986 0.04 MB/sec execute 520 sec latency 892.713 ms 2023-11-27T18:26:17.572 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5991 0.04 MB/sec execute 521 sec latency 563.833 ms 2023-11-27T18:26:18.573 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5992 0.04 MB/sec execute 522 sec latency 912.243 ms 2023-11-27T18:26:19.573 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5995 0.04 MB/sec execute 523 sec latency 945.368 ms 2023-11-27T18:26:20.573 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6001 0.04 MB/sec execute 524 sec latency 405.493 ms 2023-11-27T18:26:21.574 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6009 0.04 MB/sec execute 525 sec latency 302.766 ms 2023-11-27T18:26:22.573 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6021 0.04 MB/sec execute 526 sec latency 401.628 ms 2023-11-27T18:26:23.573 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6030 0.04 MB/sec execute 527 sec latency 389.624 ms 2023-11-27T18:26:24.573 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6044 0.04 MB/sec execute 528 sec latency 945.897 ms 2023-11-27T18:26:25.573 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6052 0.04 MB/sec execute 529 sec latency 556.886 ms 2023-11-27T18:26:26.574 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6054 0.04 MB/sec execute 530 sec latency 927.400 ms 2023-11-27T18:26:27.574 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6056 0.04 MB/sec execute 531 sec latency 1054.787 ms 2023-11-27T18:26:28.574 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6061 0.04 MB/sec execute 532 sec latency 389.838 ms 2023-11-27T18:26:29.574 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6064 0.04 MB/sec execute 533 sec latency 803.655 ms 2023-11-27T18:26:30.574 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6108 0.04 MB/sec execute 534 sec latency 909.075 ms 2023-11-27T18:26:31.574 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6111 0.04 MB/sec execute 535 sec latency 882.541 ms 2023-11-27T18:26:32.574 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6118 0.04 MB/sec execute 536 sec latency 393.448 ms 2023-11-27T18:26:33.574 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6120 0.04 MB/sec execute 537 sec latency 874.016 ms 2023-11-27T18:26:34.574 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6134 0.04 MB/sec execute 538 sec latency 323.755 ms 2023-11-27T18:26:35.574 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6138 0.04 MB/sec execute 539 sec latency 587.392 ms 2023-11-27T18:26:36.574 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6139 0.04 MB/sec execute 540 sec latency 876.022 ms 2023-11-27T18:26:37.575 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6151 0.04 MB/sec execute 541 sec latency 879.575 ms 2023-11-27T18:26:38.574 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6158 0.04 MB/sec execute 542 sec latency 657.959 ms 2023-11-27T18:26:39.574 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6160 0.04 MB/sec execute 543 sec latency 942.250 ms 2023-11-27T18:26:40.575 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6166 0.04 MB/sec execute 544 sec latency 416.242 ms 2023-11-27T18:26:41.575 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6173 0.04 MB/sec execute 545 sec latency 512.343 ms 2023-11-27T18:26:42.575 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6175 0.04 MB/sec execute 546 sec latency 897.384 ms 2023-11-27T18:26:43.575 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6176 0.04 MB/sec execute 547 sec latency 873.422 ms 2023-11-27T18:26:44.136 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:26:44.138 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:26:44.575 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6179 0.04 MB/sec execute 548 sec latency 885.239 ms 2023-11-27T18:26:45.576 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6274 0.05 MB/sec execute 549 sec latency 1182.269 ms 2023-11-27T18:26:46.575 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6276 0.05 MB/sec execute 550 sec latency 841.150 ms 2023-11-27T18:26:47.575 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6302 0.05 MB/sec execute 551 sec latency 721.103 ms 2023-11-27T18:26:48.575 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6308 0.05 MB/sec execute 552 sec latency 950.575 ms 2023-11-27T18:26:49.575 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6316 0.05 MB/sec execute 553 sec latency 781.456 ms 2023-11-27T18:26:50.576 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6320 0.05 MB/sec execute 554 sec latency 1050.372 ms 2023-11-27T18:26:51.575 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6335 0.05 MB/sec execute 555 sec latency 309.196 ms 2023-11-27T18:26:52.576 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6336 0.05 MB/sec execute 556 sec latency 746.191 ms 2023-11-27T18:26:53.576 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6427 0.05 MB/sec execute 557 sec latency 871.213 ms 2023-11-27T18:26:54.576 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6430 0.05 MB/sec execute 558 sec latency 1066.291 ms 2023-11-27T18:26:55.576 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6435 0.05 MB/sec execute 559 sec latency 394.593 ms 2023-11-27T18:26:56.576 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6452 0.05 MB/sec execute 560 sec latency 400.965 ms 2023-11-27T18:26:57.576 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6458 0.05 MB/sec execute 561 sec latency 351.559 ms 2023-11-27T18:26:58.576 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6480 0.05 MB/sec execute 562 sec latency 334.942 ms 2023-11-27T18:26:59.576 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6487 0.05 MB/sec execute 563 sec latency 585.271 ms 2023-11-27T18:27:00.576 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6493 0.05 MB/sec execute 564 sec latency 447.917 ms 2023-11-27T18:27:01.576 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6521 0.05 MB/sec execute 565 sec latency 816.986 ms 2023-11-27T18:27:02.576 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6524 0.05 MB/sec execute 566 sec latency 948.363 ms 2023-11-27T18:27:03.577 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6529 0.05 MB/sec execute 567 sec latency 580.509 ms 2023-11-27T18:27:04.577 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6532 0.05 MB/sec execute 568 sec latency 995.420 ms 2023-11-27T18:27:05.577 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6541 0.05 MB/sec execute 569 sec latency 341.214 ms 2023-11-27T18:27:06.577 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6549 0.05 MB/sec execute 570 sec latency 337.019 ms 2023-11-27T18:27:07.577 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6551 0.05 MB/sec execute 571 sec latency 900.986 ms 2023-11-27T18:27:08.577 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6567 0.05 MB/sec execute 572 sec latency 337.029 ms 2023-11-27T18:27:09.577 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6572 0.05 MB/sec execute 573 sec latency 571.615 ms 2023-11-27T18:27:10.577 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6579 0.05 MB/sec execute 574 sec latency 357.428 ms 2023-11-27T18:27:11.577 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6586 0.05 MB/sec execute 575 sec latency 658.719 ms 2023-11-27T18:27:12.578 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6722 0.05 MB/sec execute 576 sec latency 895.103 ms 2023-11-27T18:27:13.577 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6726 0.05 MB/sec execute 577 sec latency 882.597 ms 2023-11-27T18:27:14.249 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:27:14.253 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:27:14.578 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6743 0.05 MB/sec execute 578 sec latency 433.228 ms 2023-11-27T18:27:15.578 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6743 0.05 MB/sec execute 579 sec latency 1083.854 ms 2023-11-27T18:27:16.578 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6759 0.05 MB/sec execute 580 sec latency 1150.992 ms 2023-11-27T18:27:17.578 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6767 0.05 MB/sec execute 581 sec latency 611.660 ms 2023-11-27T18:27:18.578 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6820 0.05 MB/sec execute 582 sec latency 325.678 ms 2023-11-27T18:27:19.578 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6822 0.05 MB/sec execute 583 sec latency 913.505 ms 2023-11-27T18:27:20.578 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6823 0.05 MB/sec execute 584 sec latency 959.536 ms 2023-11-27T18:27:21.578 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6831 0.05 MB/sec execute 585 sec latency 323.323 ms 2023-11-27T18:27:22.578 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6835 0.05 MB/sec execute 586 sec latency 879.252 ms 2023-11-27T18:27:23.578 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6836 0.05 MB/sec execute 587 sec latency 1021.499 ms 2023-11-27T18:27:24.578 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6836 0.05 MB/sec execute 588 sec latency 1023.166 ms 2023-11-27T18:27:25.578 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6837 0.05 MB/sec execute 589 sec latency 1292.038 ms 2023-11-27T18:27:26.578 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6839 0.05 MB/sec execute 590 sec latency 890.133 ms 2023-11-27T18:27:27.578 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6841 0.05 MB/sec execute 591 sec latency 915.577 ms 2023-11-27T18:27:28.579 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6844 0.05 MB/sec execute 592 sec latency 824.056 ms 2023-11-27T18:27:29.579 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6845 0.05 MB/sec execute 593 sec latency 893.751 ms 2023-11-27T18:27:30.579 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6846 0.05 MB/sec execute 594 sec latency 984.512 ms 2023-11-27T18:27:31.579 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6847 0.05 MB/sec execute 595 sec latency 885.847 ms 2023-11-27T18:27:32.581 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6848 0.05 MB/sec execute 596 sec latency 860.608 ms 2023-11-27T18:27:33.579 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6849 0.05 MB/sec execute 597 sec latency 857.428 ms 2023-11-27T18:27:34.579 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6853 0.05 MB/sec execute 598 sec latency 864.789 ms 2023-11-27T18:27:35.579 INFO:tasks.workunit.client.0.smithi091.stdout: 1 6854 0.05 MB/sec execute 599 sec latency 907.287 ms 2023-11-27T18:27:36.580 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 600 sec 2023-11-27T18:27:37.579 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 601 sec 2023-11-27T18:27:38.580 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 602 sec 2023-11-27T18:27:39.580 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 603 sec 2023-11-27T18:27:40.580 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 604 sec 2023-11-27T18:27:41.580 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 605 sec 2023-11-27T18:27:42.580 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 606 sec 2023-11-27T18:27:43.580 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 607 sec 2023-11-27T18:27:44.369 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:27:44.372 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:27:44.580 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 608 sec 2023-11-27T18:27:45.581 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 609 sec 2023-11-27T18:27:46.580 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 610 sec 2023-11-27T18:27:47.580 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 611 sec 2023-11-27T18:27:48.580 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 612 sec 2023-11-27T18:27:49.581 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 613 sec 2023-11-27T18:27:50.581 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 614 sec 2023-11-27T18:27:51.581 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 615 sec 2023-11-27T18:27:52.581 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 616 sec 2023-11-27T18:27:53.581 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 617 sec 2023-11-27T18:27:54.581 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 618 sec 2023-11-27T18:27:55.281 INFO:tasks.workunit.client.0.smithi091.stdout: 0 cleanup 619 sec 2023-11-27T18:27:55.281 INFO:tasks.workunit.client.0.smithi091.stdout: 2023-11-27T18:27:55.281 INFO:tasks.workunit.client.0.smithi091.stdout: Operation Count AvgLat MaxLat 2023-11-27T18:27:55.281 INFO:tasks.workunit.client.0.smithi091.stdout: ---------------------------------------- 2023-11-27T18:27:55.281 INFO:tasks.workunit.client.0.smithi091.stdout: NTCreateX 912 166.137 611.137 2023-11-27T18:27:55.282 INFO:tasks.workunit.client.0.smithi091.stdout: Close 689 3.458 19.993 2023-11-27T18:27:55.282 INFO:tasks.workunit.client.0.smithi091.stdout: Rename 38 502.059 734.488 2023-11-27T18:27:55.282 INFO:tasks.workunit.client.0.smithi091.stdout: Unlink 156 166.212 309.267 2023-11-27T18:27:55.282 INFO:tasks.workunit.client.0.smithi091.stdout: Qpathinfo 884 93.172 597.438 2023-11-27T18:27:55.282 INFO:tasks.workunit.client.0.smithi091.stdout: Qfileinfo 170 2.763 9.442 2023-11-27T18:27:55.282 INFO:tasks.workunit.client.0.smithi091.stdout: Qfsinfo 138 69.811 2975.203 2023-11-27T18:27:55.282 INFO:tasks.workunit.client.0.smithi091.stdout: Sfileinfo 66 34.497 49.847 2023-11-27T18:27:55.282 INFO:tasks.workunit.client.0.smithi091.stdout: Find 322 910.942 1341.390 2023-11-27T18:27:55.282 INFO:tasks.workunit.client.0.smithi091.stdout: WriteX 480 11.196 228.257 2023-11-27T18:27:55.282 INFO:tasks.workunit.client.0.smithi091.stdout: ReadX 1546 0.065 4.503 2023-11-27T18:27:55.282 INFO:tasks.workunit.client.0.smithi091.stdout: LockX 4 54.791 123.014 2023-11-27T18:27:55.282 INFO:tasks.workunit.client.0.smithi091.stdout: UnlockX 4 41.603 52.345 2023-11-27T18:27:55.283 INFO:tasks.workunit.client.0.smithi091.stdout: Flush 59 125.272 276.885 2023-11-27T18:27:55.283 INFO:tasks.workunit.client.0.smithi091.stdout: 2023-11-27T18:27:55.283 INFO:tasks.workunit.client.0.smithi091.stdout:Throughput 0.0475149 MB/sec 1 clients 1 procs max_latency=2975.218 ms 2023-11-27T18:27:55.283 INFO:tasks.workunit.client.0.smithi091.stderr:+ dbench 10 2023-11-27T18:27:55.283 INFO:tasks.workunit.client.0.smithi091.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2023-11-27T18:27:55.283 INFO:tasks.workunit.client.0.smithi091.stdout: 2023-11-27T18:27:55.284 INFO:tasks.workunit.client.0.smithi091.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2023-11-27T18:27:55.284 INFO:tasks.workunit.client.0.smithi091.stdout:5 of 10 processes prepared for launch 0 sec 2023-11-27T18:27:55.385 INFO:tasks.workunit.client.0.smithi091.stdout:10 of 10 processes prepared for launch 0 sec 2023-11-27T18:27:55.385 INFO:tasks.workunit.client.0.smithi091.stdout:releasing clients 2023-11-27T18:27:56.385 INFO:tasks.workunit.client.0.smithi091.stdout: 0 2 0.00 MB/sec warmup 1 sec latency 999.835 ms 2023-11-27T18:27:57.385 INFO:tasks.workunit.client.0.smithi091.stdout: 0 2 0.00 MB/sec warmup 2 sec latency 1999.951 ms 2023-11-27T18:27:58.385 INFO:tasks.workunit.client.0.smithi091.stdout: 0 4 0.00 MB/sec warmup 3 sec latency 3000.010 ms 2023-11-27T18:27:59.385 INFO:tasks.workunit.client.0.smithi091.stdout: 0 5 0.00 MB/sec warmup 4 sec latency 4000.101 ms 2023-11-27T18:28:00.385 INFO:tasks.workunit.client.0.smithi091.stdout: 0 6 0.00 MB/sec warmup 5 sec latency 5000.180 ms 2023-11-27T18:28:01.385 INFO:tasks.workunit.client.0.smithi091.stdout: 1 8 0.00 MB/sec warmup 6 sec latency 929.121 ms 2023-11-27T18:28:02.385 INFO:tasks.workunit.client.0.smithi091.stdout: 3 12 0.17 MB/sec warmup 7 sec latency 1322.397 ms 2023-11-27T18:28:03.386 INFO:tasks.workunit.client.0.smithi091.stdout: 4 17 0.48 MB/sec warmup 8 sec latency 1466.541 ms 2023-11-27T18:28:04.385 INFO:tasks.workunit.client.0.smithi091.stdout: 8 22 0.63 MB/sec warmup 9 sec latency 1601.795 ms 2023-11-27T18:28:05.386 INFO:tasks.workunit.client.0.smithi091.stdout: 9 30 1.00 MB/sec warmup 10 sec latency 1662.047 ms 2023-11-27T18:28:06.386 INFO:tasks.workunit.client.0.smithi091.stdout: 9 35 1.19 MB/sec warmup 11 sec latency 1553.369 ms 2023-11-27T18:28:07.386 INFO:tasks.workunit.client.0.smithi091.stdout: 10 40 1.28 MB/sec warmup 12 sec latency 1789.329 ms 2023-11-27T18:28:08.386 INFO:tasks.workunit.client.0.smithi091.stdout: 10 46 1.41 MB/sec warmup 13 sec latency 1939.755 ms 2023-11-27T18:28:16.729 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:28:16.730 INFO:tasks.workunit.client.0.smithi091.stdout: 10 53 1.59 MB/sec warmup 14 sec latency 1756.988 ms 2023-11-27T18:28:16.730 INFO:tasks.workunit.client.0.smithi091.stdout: 10 59 1.66 MB/sec warmup 15 sec latency 1797.686 ms 2023-11-27T18:28:16.730 INFO:tasks.workunit.client.0.smithi091.stdout: 10 64 1.73 MB/sec warmup 16 sec latency 2040.998 ms 2023-11-27T18:28:16.730 INFO:tasks.workunit.client.0.smithi091.stdout: 10 70 1.82 MB/sec warmup 17 sec latency 2117.398 ms 2023-11-27T18:28:16.730 INFO:tasks.workunit.client.0.smithi091.stdout: 10 76 1.87 MB/sec warmup 18 sec latency 2215.970 ms 2023-11-27T18:28:16.730 INFO:tasks.workunit.client.0.smithi091.stdout: 10 82 1.96 MB/sec warmup 19 sec latency 1838.491 ms 2023-11-27T18:28:16.731 INFO:tasks.workunit.client.0.smithi091.stdout: 10 87 1.98 MB/sec warmup 20 sec latency 1927.579 ms 2023-11-27T18:28:16.731 INFO:tasks.workunit.client.0.smithi091.stdout: 10 93 2.05 MB/sec warmup 21 sec latency 1810.009 ms 2023-11-27T18:28:16.735 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:28:17.386 INFO:tasks.workunit.client.0.smithi091.stdout: 10 98 2.07 MB/sec warmup 22 sec latency 2209.779 ms 2023-11-27T18:28:18.386 INFO:tasks.workunit.client.0.smithi091.stdout: 10 103 2.10 MB/sec warmup 23 sec latency 1603.827 ms 2023-11-27T18:28:19.387 INFO:tasks.workunit.client.0.smithi091.stdout: 10 109 2.14 MB/sec warmup 24 sec latency 2369.064 ms 2023-11-27T18:28:20.387 INFO:tasks.workunit.client.0.smithi091.stdout: 10 112 2.11 MB/sec warmup 25 sec latency 2176.828 ms 2023-11-27T18:28:21.387 INFO:tasks.workunit.client.0.smithi091.stdout: 10 115 2.03 MB/sec warmup 26 sec latency 2280.925 ms 2023-11-27T18:28:22.387 INFO:tasks.workunit.client.0.smithi091.stdout: 10 119 2.01 MB/sec warmup 27 sec latency 1306.911 ms 2023-11-27T18:28:23.387 INFO:tasks.workunit.client.0.smithi091.stdout: 10 121 1.97 MB/sec warmup 28 sec latency 2017.550 ms 2023-11-27T18:28:24.387 INFO:tasks.workunit.client.0.smithi091.stdout: 10 124 1.94 MB/sec warmup 29 sec latency 2407.582 ms 2023-11-27T18:28:25.387 INFO:tasks.workunit.client.0.smithi091.stdout: 10 129 1.92 MB/sec warmup 30 sec latency 2454.231 ms 2023-11-27T18:28:26.387 INFO:tasks.workunit.client.0.smithi091.stdout: 10 131 1.88 MB/sec warmup 31 sec latency 2172.192 ms 2023-11-27T18:28:27.387 INFO:tasks.workunit.client.0.smithi091.stdout: 10 135 1.86 MB/sec warmup 32 sec latency 2181.466 ms 2023-11-27T18:28:28.387 INFO:tasks.workunit.client.0.smithi091.stdout: 10 138 1.83 MB/sec warmup 33 sec latency 2289.522 ms 2023-11-27T18:28:29.387 INFO:tasks.workunit.client.0.smithi091.stdout: 10 139 1.78 MB/sec warmup 34 sec latency 2172.547 ms 2023-11-27T18:28:30.387 INFO:tasks.workunit.client.0.smithi091.stdout: 10 142 1.75 MB/sec warmup 35 sec latency 2190.165 ms 2023-11-27T18:28:31.388 INFO:tasks.workunit.client.0.smithi091.stdout: 10 144 1.72 MB/sec warmup 36 sec latency 2492.550 ms 2023-11-27T18:28:32.388 INFO:tasks.workunit.client.0.smithi091.stdout: 10 144 1.68 MB/sec warmup 37 sec latency 3492.680 ms 2023-11-27T18:28:33.388 INFO:tasks.workunit.client.0.smithi091.stdout: 10 146 1.65 MB/sec warmup 38 sec latency 3702.498 ms 2023-11-27T18:28:34.388 INFO:tasks.workunit.client.0.smithi091.stdout: 10 148 1.62 MB/sec warmup 39 sec latency 4029.480 ms 2023-11-27T18:28:35.388 INFO:tasks.workunit.client.0.smithi091.stdout: 10 150 1.60 MB/sec warmup 40 sec latency 4534.522 ms 2023-11-27T18:28:36.388 INFO:tasks.workunit.client.0.smithi091.stdout: 10 153 1.58 MB/sec warmup 41 sec latency 4924.191 ms 2023-11-27T18:28:37.388 INFO:tasks.workunit.client.0.smithi091.stdout: 10 154 1.55 MB/sec warmup 42 sec latency 3655.915 ms 2023-11-27T18:28:38.388 INFO:tasks.workunit.client.0.smithi091.stdout: 10 157 1.53 MB/sec warmup 43 sec latency 4142.985 ms 2023-11-27T18:28:39.388 INFO:tasks.workunit.client.0.smithi091.stdout: 10 159 1.50 MB/sec warmup 44 sec latency 3509.507 ms 2023-11-27T18:28:40.388 INFO:tasks.workunit.client.0.smithi091.stdout: 10 161 1.49 MB/sec warmup 45 sec latency 1944.387 ms 2023-11-27T18:28:41.388 INFO:tasks.workunit.client.0.smithi091.stdout: 10 165 1.48 MB/sec warmup 46 sec latency 2345.372 ms 2023-11-27T18:28:42.389 INFO:tasks.workunit.client.0.smithi091.stdout: 10 165 1.45 MB/sec warmup 47 sec latency 2466.605 ms 2023-11-27T18:28:43.389 INFO:tasks.workunit.client.0.smithi091.stdout: 10 166 1.43 MB/sec warmup 48 sec latency 3466.661 ms 2023-11-27T18:28:44.389 INFO:tasks.workunit.client.0.smithi091.stdout: 10 169 1.42 MB/sec warmup 49 sec latency 4197.180 ms 2023-11-27T18:28:45.389 INFO:tasks.workunit.client.0.smithi091.stdout: 10 173 1.42 MB/sec warmup 50 sec latency 4077.034 ms 2023-11-27T18:28:46.389 INFO:tasks.workunit.client.0.smithi091.stdout: 10 174 1.40 MB/sec warmup 51 sec latency 3444.869 ms 2023-11-27T18:28:46.845 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:28:46.848 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:28:47.389 INFO:tasks.workunit.client.0.smithi091.stdout: 10 177 1.38 MB/sec warmup 52 sec latency 3517.102 ms 2023-11-27T18:28:48.389 INFO:tasks.workunit.client.0.smithi091.stdout: 10 178 1.37 MB/sec warmup 53 sec latency 3689.081 ms 2023-11-27T18:28:49.390 INFO:tasks.workunit.client.0.smithi091.stdout: 10 182 1.36 MB/sec warmup 54 sec latency 3835.655 ms 2023-11-27T18:28:50.389 INFO:tasks.workunit.client.0.smithi091.stdout: 10 185 1.36 MB/sec warmup 55 sec latency 2535.369 ms 2023-11-27T18:28:51.389 INFO:tasks.workunit.client.0.smithi091.stdout: 10 188 1.35 MB/sec warmup 56 sec latency 2649.836 ms 2023-11-27T18:28:52.389 INFO:tasks.workunit.client.0.smithi091.stdout: 10 189 1.33 MB/sec warmup 57 sec latency 2870.791 ms 2023-11-27T18:28:53.389 INFO:tasks.workunit.client.0.smithi091.stdout: 10 190 1.32 MB/sec warmup 58 sec latency 3670.059 ms 2023-11-27T18:28:54.390 INFO:tasks.workunit.client.0.smithi091.stdout: 10 193 1.30 MB/sec warmup 59 sec latency 3789.040 ms 2023-11-27T18:28:55.390 INFO:tasks.workunit.client.0.smithi091.stdout: 10 198 1.31 MB/sec warmup 60 sec latency 3563.497 ms 2023-11-27T18:28:56.390 INFO:tasks.workunit.client.0.smithi091.stdout: 10 199 1.29 MB/sec warmup 61 sec latency 1894.215 ms 2023-11-27T18:28:57.390 INFO:tasks.workunit.client.0.smithi091.stdout: 10 199 1.27 MB/sec warmup 62 sec latency 2837.000 ms 2023-11-27T18:28:58.390 INFO:tasks.workunit.client.0.smithi091.stdout: 10 200 1.26 MB/sec warmup 63 sec latency 3675.631 ms 2023-11-27T18:28:59.390 INFO:tasks.workunit.client.0.smithi091.stdout: 10 203 1.25 MB/sec warmup 64 sec latency 4123.338 ms 2023-11-27T18:29:00.390 INFO:tasks.workunit.client.0.smithi091.stdout: 10 206 1.24 MB/sec warmup 65 sec latency 2226.341 ms 2023-11-27T18:29:01.390 INFO:tasks.workunit.client.0.smithi091.stdout: 10 208 1.24 MB/sec warmup 66 sec latency 2470.028 ms 2023-11-27T18:29:02.390 INFO:tasks.workunit.client.0.smithi091.stdout: 10 208 1.22 MB/sec warmup 67 sec latency 3470.125 ms 2023-11-27T18:29:03.390 INFO:tasks.workunit.client.0.smithi091.stdout: 10 211 1.21 MB/sec warmup 68 sec latency 3997.420 ms 2023-11-27T18:29:04.390 INFO:tasks.workunit.client.0.smithi091.stdout: 10 211 1.20 MB/sec warmup 69 sec latency 4756.419 ms 2023-11-27T18:29:05.390 INFO:tasks.workunit.client.0.smithi091.stdout: 10 215 1.19 MB/sec warmup 70 sec latency 5067.035 ms 2023-11-27T18:29:06.390 INFO:tasks.workunit.client.0.smithi091.stdout: 10 219 1.20 MB/sec warmup 71 sec latency 4061.391 ms 2023-11-27T18:29:07.390 INFO:tasks.workunit.client.0.smithi091.stdout: 10 219 1.18 MB/sec warmup 72 sec latency 2811.656 ms 2023-11-27T18:29:08.391 INFO:tasks.workunit.client.0.smithi091.stdout: 10 222 1.18 MB/sec warmup 73 sec latency 3100.263 ms 2023-11-27T18:29:09.017 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:17:30.098 38308== Warning: unimplemented fcntl command: 1036 2023-11-27T18:29:09.034 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:17:30.115 38308== Warning: unimplemented fcntl command: 1036 2023-11-27T18:29:09.123 INFO:tasks.ceph.mon.b.smithi094.stderr:==00:00:17:30.148 38305== Warning: unimplemented fcntl command: 1036 2023-11-27T18:29:09.129 INFO:tasks.ceph.mon.b.smithi094.stderr:==00:00:17:30.154 38305== Warning: unimplemented fcntl command: 1036 2023-11-27T18:29:09.211 INFO:tasks.ceph.mon.c.smithi094.stderr:==00:00:17:30.236 38307== Warning: unimplemented fcntl command: 1036 2023-11-27T18:29:09.217 INFO:tasks.ceph.mon.c.smithi094.stderr:==00:00:17:30.242 38307== Warning: unimplemented fcntl command: 1036 2023-11-27T18:29:09.354 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:17:30.435 38308== Warning: unimplemented fcntl command: 1036 2023-11-27T18:29:09.391 INFO:tasks.workunit.client.0.smithi091.stdout: 10 227 1.19 MB/sec warmup 74 sec latency 2905.488 ms 2023-11-27T18:29:09.443 INFO:tasks.ceph.mon.b.smithi094.stderr:==00:00:17:30.468 38305== Warning: unimplemented fcntl command: 1036 2023-11-27T18:29:09.525 INFO:tasks.ceph.mon.c.smithi094.stderr:==00:00:17:30.550 38307== Warning: unimplemented fcntl command: 1036 2023-11-27T18:29:10.391 INFO:tasks.workunit.client.0.smithi091.stdout: 10 230 1.18 MB/sec warmup 75 sec latency 2037.549 ms 2023-11-27T18:29:11.391 INFO:tasks.workunit.client.0.smithi091.stdout: 10 232 1.18 MB/sec warmup 76 sec latency 2349.427 ms 2023-11-27T18:29:12.391 INFO:tasks.workunit.client.0.smithi091.stdout: 10 236 1.18 MB/sec warmup 77 sec latency 2588.629 ms 2023-11-27T18:29:13.391 INFO:tasks.workunit.client.0.smithi091.stdout: 10 239 1.17 MB/sec warmup 78 sec latency 2707.642 ms 2023-11-27T18:29:14.391 INFO:tasks.workunit.client.0.smithi091.stdout: 10 242 1.17 MB/sec warmup 79 sec latency 2637.503 ms 2023-11-27T18:29:15.392 INFO:tasks.workunit.client.0.smithi091.stdout: 10 246 1.17 MB/sec warmup 80 sec latency 2486.592 ms 2023-11-27T18:29:16.391 INFO:tasks.workunit.client.0.smithi091.stdout: 10 247 1.16 MB/sec warmup 81 sec latency 2557.450 ms 2023-11-27T18:29:16.914 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:29:16.918 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:29:17.392 INFO:tasks.workunit.client.0.smithi091.stdout: 10 248 1.15 MB/sec warmup 82 sec latency 3176.786 ms 2023-11-27T18:29:18.391 INFO:tasks.workunit.client.0.smithi091.stdout: 10 254 1.16 MB/sec warmup 83 sec latency 3182.203 ms 2023-11-27T18:29:19.391 INFO:tasks.workunit.client.0.smithi091.stdout: 10 256 1.16 MB/sec warmup 84 sec latency 3044.540 ms 2023-11-27T18:29:20.391 INFO:tasks.workunit.client.0.smithi091.stdout: 10 256 1.14 MB/sec warmup 85 sec latency 2625.694 ms 2023-11-27T18:29:21.392 INFO:tasks.workunit.client.0.smithi091.stdout: 10 260 1.14 MB/sec warmup 86 sec latency 3035.900 ms 2023-11-27T18:29:22.392 INFO:tasks.workunit.client.0.smithi091.stdout: 10 263 1.14 MB/sec warmup 87 sec latency 3596.002 ms 2023-11-27T18:29:23.392 INFO:tasks.workunit.client.0.smithi091.stdout: 10 264 1.13 MB/sec warmup 88 sec latency 3607.631 ms 2023-11-27T18:29:24.392 INFO:tasks.workunit.client.0.smithi091.stdout: 10 265 1.12 MB/sec warmup 89 sec latency 3686.273 ms 2023-11-27T18:29:25.392 INFO:tasks.workunit.client.0.smithi091.stdout: 10 270 1.13 MB/sec warmup 90 sec latency 3985.623 ms 2023-11-27T18:29:26.392 INFO:tasks.workunit.client.0.smithi091.stdout: 10 273 1.13 MB/sec warmup 91 sec latency 3126.379 ms 2023-11-27T18:29:27.392 INFO:tasks.workunit.client.0.smithi091.stdout: 10 274 1.12 MB/sec warmup 92 sec latency 2397.574 ms 2023-11-27T18:29:28.392 INFO:tasks.workunit.client.0.smithi091.stdout: 10 278 1.12 MB/sec warmup 93 sec latency 2862.006 ms 2023-11-27T18:29:29.392 INFO:tasks.workunit.client.0.smithi091.stdout: 10 281 1.12 MB/sec warmup 94 sec latency 2722.310 ms 2023-11-27T18:29:30.392 INFO:tasks.workunit.client.0.smithi091.stdout: 10 284 1.12 MB/sec warmup 95 sec latency 2127.529 ms 2023-11-27T18:29:31.392 INFO:tasks.workunit.client.0.smithi091.stdout: 10 287 1.12 MB/sec warmup 96 sec latency 2609.712 ms 2023-11-27T18:29:32.392 INFO:tasks.workunit.client.0.smithi091.stdout: 10 289 1.11 MB/sec warmup 97 sec latency 3055.903 ms 2023-11-27T18:29:33.393 INFO:tasks.workunit.client.0.smithi091.stdout: 10 289 1.10 MB/sec warmup 98 sec latency 3455.932 ms 2023-11-27T18:29:35.775 INFO:tasks.workunit.client.0.smithi091.stdout: 10 290 1.09 MB/sec warmup 99 sec latency 4327.578 ms 2023-11-27T18:29:35.775 INFO:tasks.workunit.client.0.smithi091.stdout: 10 293 1.09 MB/sec warmup 100 sec latency 4896.627 ms 2023-11-27T18:29:36.393 INFO:tasks.workunit.client.0.smithi091.stdout: 10 295 1.08 MB/sec warmup 101 sec latency 1838.957 ms 2023-11-27T18:29:37.393 INFO:tasks.workunit.client.0.smithi091.stdout: 10 299 1.08 MB/sec warmup 102 sec latency 2347.095 ms 2023-11-27T18:29:38.393 INFO:tasks.workunit.client.0.smithi091.stdout: 10 301 1.08 MB/sec warmup 103 sec latency 2475.265 ms 2023-11-27T18:29:39.393 INFO:tasks.workunit.client.0.smithi091.stdout: 10 305 1.08 MB/sec warmup 104 sec latency 2006.453 ms 2023-11-27T18:29:40.394 INFO:tasks.workunit.client.0.smithi091.stdout: 10 310 1.08 MB/sec warmup 105 sec latency 2203.913 ms 2023-11-27T18:29:41.393 INFO:tasks.workunit.client.0.smithi091.stdout: 10 311 1.08 MB/sec warmup 106 sec latency 2180.466 ms 2023-11-27T18:29:42.393 INFO:tasks.workunit.client.0.smithi091.stdout: 10 312 1.07 MB/sec warmup 107 sec latency 2871.533 ms 2023-11-27T18:29:43.393 INFO:tasks.workunit.client.0.smithi091.stdout: 10 315 1.07 MB/sec warmup 108 sec latency 3506.914 ms 2023-11-27T18:29:44.393 INFO:tasks.workunit.client.0.smithi091.stdout: 10 317 1.06 MB/sec warmup 109 sec latency 3747.896 ms 2023-11-27T18:29:45.393 INFO:tasks.workunit.client.0.smithi091.stdout: 10 319 1.06 MB/sec warmup 110 sec latency 3715.799 ms 2023-11-27T18:29:46.393 INFO:tasks.workunit.client.0.smithi091.stdout: 10 322 1.06 MB/sec warmup 111 sec latency 2397.882 ms 2023-11-27T18:29:46.434 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:18:07.515 38308== Warning: unimplemented fcntl command: 1036 2023-11-27T18:29:46.444 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:18:07.525 38308== Warning: unimplemented fcntl command: 1036 2023-11-27T18:29:46.544 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:18:07.625 38308== Warning: unimplemented fcntl command: 1036 2023-11-27T18:29:46.609 INFO:tasks.ceph.mon.b.smithi094.stderr:==00:00:18:07.634 38305== Warning: unimplemented fcntl command: 1036 2023-11-27T18:29:46.616 INFO:tasks.ceph.mon.b.smithi094.stderr:==00:00:18:07.641 38305== Warning: unimplemented fcntl command: 1036 2023-11-27T18:29:46.643 INFO:tasks.ceph.mon.c.smithi094.stderr:==00:00:18:07.668 38307== Warning: unimplemented fcntl command: 1036 2023-11-27T18:29:46.693 INFO:tasks.ceph.mon.c.smithi094.stderr:==00:00:18:07.718 38307== Warning: unimplemented fcntl command: 1036 2023-11-27T18:29:46.744 INFO:tasks.ceph.mon.b.smithi094.stderr:==00:00:18:07.769 38305== Warning: unimplemented fcntl command: 1036 2023-11-27T18:29:46.820 INFO:tasks.ceph.mon.c.smithi094.stderr:==00:00:18:07.845 38307== Warning: unimplemented fcntl command: 1036 2023-11-27T18:29:46.995 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:29:46.997 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:29:47.393 INFO:tasks.workunit.client.0.smithi091.stdout: 10 323 1.05 MB/sec warmup 112 sec latency 3397.925 ms 2023-11-27T18:29:48.394 INFO:tasks.workunit.client.0.smithi091.stdout: 10 328 1.05 MB/sec warmup 113 sec latency 3410.776 ms 2023-11-27T18:29:49.394 INFO:tasks.workunit.client.0.smithi091.stdout: 10 329 1.05 MB/sec warmup 114 sec latency 1791.364 ms 2023-11-27T18:29:50.394 INFO:tasks.workunit.client.0.smithi091.stdout: 10 333 1.05 MB/sec warmup 115 sec latency 2340.728 ms 2023-11-27T18:29:51.394 INFO:tasks.workunit.client.0.smithi091.stdout: 10 336 1.05 MB/sec warmup 116 sec latency 3054.298 ms 2023-11-27T18:29:52.394 INFO:tasks.workunit.client.0.smithi091.stdout: 10 339 1.05 MB/sec warmup 117 sec latency 2293.726 ms 2023-11-27T18:29:53.394 INFO:tasks.workunit.client.0.smithi091.stdout: 10 339 1.04 MB/sec warmup 118 sec latency 3293.831 ms 2023-11-27T18:29:54.394 INFO:tasks.workunit.client.0.smithi091.stdout: 10 341 1.04 MB/sec warmup 119 sec latency 4218.939 ms 2023-11-27T18:29:56.394 INFO:tasks.workunit.client.0.smithi091.stdout: 10 345 0.00 MB/sec execute 1 sec latency 3666.278 ms 2023-11-27T18:29:57.395 INFO:tasks.workunit.client.0.smithi091.stdout: 10 347 0.39 MB/sec execute 2 sec latency 3013.876 ms 2023-11-27T18:29:58.395 INFO:tasks.workunit.client.0.smithi091.stdout: 10 350 0.61 MB/sec execute 3 sec latency 3538.151 ms 2023-11-27T18:29:59.395 INFO:tasks.workunit.client.0.smithi091.stdout: 10 352 0.59 MB/sec execute 4 sec latency 4255.215 ms 2023-11-27T18:30:00.395 INFO:tasks.workunit.client.0.smithi091.stdout: 10 356 0.68 MB/sec execute 5 sec latency 2871.488 ms 2023-11-27T18:30:01.395 INFO:tasks.workunit.client.0.smithi091.stdout: 10 358 0.69 MB/sec execute 6 sec latency 2283.200 ms 2023-11-27T18:30:02.395 INFO:tasks.workunit.client.0.smithi091.stdout: 10 361 0.71 MB/sec execute 7 sec latency 3082.240 ms 2023-11-27T18:30:03.395 INFO:tasks.workunit.client.0.smithi091.stdout: 10 362 0.68 MB/sec execute 8 sec latency 3907.748 ms 2023-11-27T18:30:04.395 INFO:tasks.workunit.client.0.smithi091.stdout: 10 364 0.66 MB/sec execute 9 sec latency 3813.370 ms 2023-11-27T18:30:05.396 INFO:tasks.workunit.client.0.smithi091.stdout: 10 367 0.68 MB/sec execute 10 sec latency 4013.780 ms 2023-11-27T18:30:06.395 INFO:tasks.workunit.client.0.smithi091.stdout: 10 370 0.73 MB/sec execute 11 sec latency 3527.613 ms 2023-11-27T18:30:07.396 INFO:tasks.workunit.client.0.smithi091.stdout: 10 372 0.72 MB/sec execute 12 sec latency 3130.370 ms 2023-11-27T18:30:28.233 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:30:28.236 INFO:tasks.workunit.client.0.smithi091.stdout: 10 373 0.68 MB/sec execute 13 sec latency 3270.962 ms 2023-11-27T18:30:28.236 INFO:tasks.workunit.client.0.smithi091.stdout: 10 374 0.67 MB/sec execute 14 sec latency 3839.891 ms 2023-11-27T18:30:28.236 INFO:tasks.workunit.client.0.smithi091.stdout: 10 377 0.69 MB/sec execute 15 sec latency 3975.742 ms 2023-11-27T18:30:28.236 INFO:tasks.workunit.client.0.smithi091.stdout: 10 383 0.76 MB/sec execute 16 sec latency 4179.523 ms 2023-11-27T18:30:28.236 INFO:tasks.workunit.client.0.smithi091.stdout: 10 383 0.72 MB/sec execute 17 sec latency 2016.100 ms 2023-11-27T18:30:28.236 INFO:tasks.workunit.client.0.smithi091.stdout: 10 383 0.68 MB/sec execute 18 sec latency 3016.200 ms 2023-11-27T18:30:28.236 INFO:tasks.workunit.client.0.smithi091.stdout: 10 387 0.70 MB/sec execute 19 sec latency 3623.134 ms 2023-11-27T18:30:28.236 INFO:tasks.workunit.client.0.smithi091.stdout: 10 391 0.74 MB/sec execute 20 sec latency 3274.098 ms 2023-11-27T18:30:28.236 INFO:tasks.workunit.client.0.smithi091.stdout: 10 391 0.71 MB/sec execute 21 sec latency 2007.835 ms 2023-11-27T18:30:28.237 INFO:tasks.workunit.client.0.smithi091.stdout: 10 394 0.72 MB/sec execute 22 sec latency 2908.460 ms 2023-11-27T18:30:28.237 INFO:tasks.workunit.client.0.smithi091.stdout: 10 399 0.76 MB/sec execute 23 sec latency 3006.138 ms 2023-11-27T18:30:28.237 INFO:tasks.workunit.client.0.smithi091.stdout: 10 399 0.73 MB/sec execute 24 sec latency 2880.191 ms 2023-11-27T18:30:28.237 INFO:tasks.workunit.client.0.smithi091.stdout: 10 400 0.70 MB/sec execute 25 sec latency 3648.609 ms 2023-11-27T18:30:28.237 INFO:tasks.workunit.client.0.smithi091.stdout: 10 405 0.75 MB/sec execute 26 sec latency 3583.423 ms 2023-11-27T18:30:28.237 INFO:tasks.workunit.client.0.smithi091.stdout: 10 407 0.74 MB/sec execute 27 sec latency 3741.032 ms 2023-11-27T18:30:28.237 INFO:tasks.workunit.client.0.smithi091.stdout: 10 407 0.72 MB/sec execute 28 sec latency 2668.472 ms 2023-11-27T18:30:28.237 INFO:tasks.workunit.client.0.smithi091.stdout: 10 412 0.74 MB/sec execute 29 sec latency 3470.379 ms 2023-11-27T18:30:28.237 INFO:tasks.workunit.client.0.smithi091.stdout: 10 415 0.75 MB/sec execute 30 sec latency 3538.697 ms 2023-11-27T18:30:28.237 INFO:tasks.workunit.client.0.smithi091.stdout: 10 417 0.75 MB/sec execute 31 sec latency 2086.912 ms 2023-11-27T18:30:28.237 INFO:tasks.workunit.client.0.smithi091.stdout: 10 420 0.75 MB/sec execute 32 sec latency 2733.812 ms 2023-11-27T18:30:28.244 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:30:28.398 INFO:tasks.workunit.client.0.smithi091.stdout: 10 423 0.76 MB/sec execute 33 sec latency 3348.953 ms 2023-11-27T18:30:29.398 INFO:tasks.workunit.client.0.smithi091.stdout: 10 423 0.74 MB/sec execute 34 sec latency 3460.403 ms 2023-11-27T18:30:30.398 INFO:tasks.workunit.client.0.smithi091.stdout: 10 425 0.74 MB/sec execute 35 sec latency 3582.573 ms 2023-11-27T18:30:31.398 INFO:tasks.workunit.client.0.smithi091.stdout: 10 430 0.76 MB/sec execute 36 sec latency 3466.452 ms 2023-11-27T18:30:32.398 INFO:tasks.workunit.client.0.smithi091.stdout: 10 432 0.76 MB/sec execute 37 sec latency 2428.470 ms 2023-11-27T18:30:33.398 INFO:tasks.workunit.client.0.smithi091.stdout: 10 433 0.75 MB/sec execute 38 sec latency 2616.662 ms 2023-11-27T18:30:34.398 INFO:tasks.workunit.client.0.smithi091.stdout: 10 436 0.75 MB/sec execute 39 sec latency 3002.732 ms 2023-11-27T18:30:35.398 INFO:tasks.workunit.client.0.smithi091.stdout: 10 440 0.77 MB/sec execute 40 sec latency 3703.704 ms 2023-11-27T18:30:36.399 INFO:tasks.workunit.client.0.smithi091.stdout: 10 441 0.76 MB/sec execute 41 sec latency 3101.606 ms 2023-11-27T18:30:37.398 INFO:tasks.workunit.client.0.smithi091.stdout: 10 445 0.77 MB/sec execute 42 sec latency 2772.932 ms 2023-11-27T18:30:38.399 INFO:tasks.workunit.client.0.smithi091.stdout: 10 445 0.76 MB/sec execute 43 sec latency 3638.173 ms 2023-11-27T18:30:39.399 INFO:tasks.workunit.client.0.smithi091.stdout: 10 447 0.75 MB/sec execute 44 sec latency 3938.449 ms 2023-11-27T18:30:40.399 INFO:tasks.workunit.client.0.smithi091.stdout: 10 450 0.75 MB/sec execute 45 sec latency 4171.541 ms 2023-11-27T18:30:41.399 INFO:tasks.workunit.client.0.smithi091.stdout: 10 453 0.76 MB/sec execute 46 sec latency 3592.406 ms 2023-11-27T18:30:42.399 INFO:tasks.workunit.client.0.smithi091.stdout: 10 454 0.75 MB/sec execute 47 sec latency 3395.287 ms 2023-11-27T18:30:43.399 INFO:tasks.workunit.client.0.smithi091.stdout: 10 457 0.75 MB/sec execute 48 sec latency 3533.768 ms 2023-11-27T18:30:44.399 INFO:tasks.workunit.client.0.smithi091.stdout: 10 460 0.76 MB/sec execute 49 sec latency 3810.565 ms 2023-11-27T18:30:45.399 INFO:tasks.workunit.client.0.smithi091.stdout: 10 462 0.76 MB/sec execute 50 sec latency 2677.799 ms 2023-11-27T18:30:46.399 INFO:tasks.workunit.client.0.smithi091.stdout: 10 464 0.75 MB/sec execute 51 sec latency 3143.180 ms 2023-11-27T18:30:47.400 INFO:tasks.workunit.client.0.smithi091.stdout: 10 467 0.76 MB/sec execute 52 sec latency 3260.954 ms 2023-11-27T18:30:48.400 INFO:tasks.workunit.client.0.smithi091.stdout: 10 470 0.76 MB/sec execute 53 sec latency 3772.991 ms 2023-11-27T18:30:49.400 INFO:tasks.workunit.client.0.smithi091.stdout: 10 471 0.76 MB/sec execute 54 sec latency 3924.261 ms 2023-11-27T18:30:50.400 INFO:tasks.workunit.client.0.smithi091.stdout: 10 474 0.75 MB/sec execute 55 sec latency 3491.318 ms 2023-11-27T18:30:51.400 INFO:tasks.workunit.client.0.smithi091.stdout: 10 478 0.77 MB/sec execute 56 sec latency 4009.633 ms 2023-11-27T18:30:52.400 INFO:tasks.workunit.client.0.smithi091.stdout: 10 479 0.76 MB/sec execute 57 sec latency 3702.082 ms 2023-11-27T18:30:53.400 INFO:tasks.workunit.client.0.smithi091.stdout: 10 481 0.76 MB/sec execute 58 sec latency 3790.671 ms 2023-11-27T18:30:54.400 INFO:tasks.workunit.client.0.smithi091.stdout: 10 483 0.76 MB/sec execute 59 sec latency 3530.355 ms 2023-11-27T18:30:55.400 INFO:tasks.workunit.client.0.smithi091.stdout: 10 486 0.77 MB/sec execute 60 sec latency 3726.114 ms 2023-11-27T18:30:56.400 INFO:tasks.workunit.client.0.smithi091.stdout: 10 490 0.77 MB/sec execute 61 sec latency 3802.364 ms 2023-11-27T18:30:57.400 INFO:tasks.workunit.client.0.smithi091.stdout: 10 494 0.77 MB/sec execute 62 sec latency 2495.455 ms 2023-11-27T18:30:58.300 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:30:58.303 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:30:58.400 INFO:tasks.workunit.client.0.smithi091.stdout: 10 499 0.79 MB/sec execute 63 sec latency 2606.555 ms 2023-11-27T18:30:59.400 INFO:tasks.workunit.client.0.smithi091.stdout: 10 500 0.79 MB/sec execute 64 sec latency 3255.871 ms 2023-11-27T18:31:00.401 INFO:tasks.workunit.client.0.smithi091.stdout: 10 505 0.80 MB/sec execute 65 sec latency 3432.238 ms 2023-11-27T18:31:01.401 INFO:tasks.workunit.client.0.smithi091.stdout: 10 505 0.79 MB/sec execute 66 sec latency 2972.390 ms 2023-11-27T18:31:02.401 INFO:tasks.workunit.client.0.smithi091.stdout: 10 508 0.79 MB/sec execute 67 sec latency 3972.466 ms 2023-11-27T18:31:03.401 INFO:tasks.workunit.client.0.smithi091.stdout: 10 510 0.79 MB/sec execute 68 sec latency 4972.570 ms 2023-11-27T18:31:04.401 INFO:tasks.workunit.client.0.smithi091.stdout: 10 510 0.77 MB/sec execute 69 sec latency 5972.677 ms 2023-11-27T18:31:05.402 INFO:tasks.workunit.client.0.smithi091.stdout: 10 512 0.77 MB/sec execute 70 sec latency 6972.771 ms 2023-11-27T18:31:06.401 INFO:tasks.workunit.client.0.smithi091.stdout: 10 514 0.76 MB/sec execute 71 sec latency 7353.098 ms 2023-11-27T18:31:07.401 INFO:tasks.workunit.client.0.smithi091.stdout: 10 518 0.78 MB/sec execute 72 sec latency 4197.863 ms 2023-11-27T18:31:08.401 INFO:tasks.workunit.client.0.smithi091.stdout: 10 520 0.78 MB/sec execute 73 sec latency 2641.069 ms 2023-11-27T18:31:09.401 INFO:tasks.workunit.client.0.smithi091.stdout: 10 521 0.77 MB/sec execute 74 sec latency 2998.953 ms 2023-11-27T18:31:10.401 INFO:tasks.workunit.client.0.smithi091.stdout: 10 521 0.76 MB/sec execute 75 sec latency 3580.789 ms 2023-11-27T18:31:11.402 INFO:tasks.workunit.client.0.smithi091.stdout: 10 526 0.77 MB/sec execute 76 sec latency 4203.680 ms 2023-11-27T18:31:12.402 INFO:tasks.workunit.client.0.smithi091.stdout: 10 532 0.78 MB/sec execute 77 sec latency 4029.348 ms 2023-11-27T18:31:13.402 INFO:tasks.workunit.client.0.smithi091.stdout: 10 536 0.80 MB/sec execute 78 sec latency 5029.473 ms 2023-11-27T18:31:14.402 INFO:tasks.workunit.client.0.smithi091.stdout: 10 539 0.80 MB/sec execute 79 sec latency 6029.560 ms 2023-11-27T18:31:15.402 INFO:tasks.workunit.client.0.smithi091.stdout: 10 543 0.81 MB/sec execute 80 sec latency 7029.622 ms 2023-11-27T18:31:16.402 INFO:tasks.workunit.client.0.smithi091.stdout: 10 550 0.81 MB/sec execute 81 sec latency 7482.767 ms 2023-11-27T18:31:17.402 INFO:tasks.workunit.client.0.smithi091.stdout: 10 558 0.84 MB/sec execute 82 sec latency 3892.114 ms 2023-11-27T18:31:18.402 INFO:tasks.workunit.client.0.smithi091.stdout: 10 565 0.85 MB/sec execute 83 sec latency 2055.331 ms 2023-11-27T18:31:19.403 INFO:tasks.workunit.client.0.smithi091.stdout: 10 571 0.88 MB/sec execute 84 sec latency 3055.380 ms 2023-11-27T18:31:20.402 INFO:tasks.workunit.client.0.smithi091.stdout: 10 576 0.89 MB/sec execute 85 sec latency 3749.197 ms 2023-11-27T18:31:21.402 INFO:tasks.workunit.client.0.smithi091.stdout: 10 580 0.89 MB/sec execute 86 sec latency 4749.256 ms 2023-11-27T18:31:22.402 INFO:tasks.workunit.client.0.smithi091.stdout: 10 587 0.90 MB/sec execute 87 sec latency 5313.119 ms 2023-11-27T18:31:23.403 INFO:tasks.workunit.client.0.smithi091.stdout: 10 592 0.91 MB/sec execute 88 sec latency 3217.883 ms 2023-11-27T18:31:24.403 INFO:tasks.workunit.client.0.smithi091.stdout: 10 596 0.92 MB/sec execute 89 sec latency 4160.313 ms 2023-11-27T18:31:25.403 INFO:tasks.workunit.client.0.smithi091.stdout: 10 597 0.91 MB/sec execute 90 sec latency 4975.673 ms 2023-11-27T18:31:26.403 INFO:tasks.workunit.client.0.smithi091.stdout: 10 598 0.90 MB/sec execute 91 sec latency 3957.332 ms 2023-11-27T18:31:27.403 INFO:tasks.workunit.client.0.smithi091.stdout: 10 604 0.89 MB/sec execute 92 sec latency 4340.987 ms 2023-11-27T18:31:28.380 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:31:28.384 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:31:28.403 INFO:tasks.workunit.client.0.smithi091.stdout: 10 609 0.91 MB/sec execute 93 sec latency 4782.417 ms 2023-11-27T18:31:29.403 INFO:tasks.workunit.client.0.smithi091.stdout: 10 612 0.91 MB/sec execute 94 sec latency 4186.161 ms 2023-11-27T18:31:30.403 INFO:tasks.workunit.client.0.smithi091.stdout: 10 615 0.90 MB/sec execute 95 sec latency 4207.317 ms 2023-11-27T18:31:31.403 INFO:tasks.workunit.client.0.smithi091.stdout: 10 616 0.89 MB/sec execute 96 sec latency 3767.084 ms 2023-11-27T18:31:32.403 INFO:tasks.workunit.client.0.smithi091.stdout: 10 617 0.88 MB/sec execute 97 sec latency 3891.259 ms 2023-11-27T18:31:33.403 INFO:tasks.workunit.client.0.smithi091.stdout: 10 618 0.87 MB/sec execute 98 sec latency 4799.895 ms 2023-11-27T18:31:34.404 INFO:tasks.workunit.client.0.smithi091.stdout: 10 621 0.87 MB/sec execute 99 sec latency 4878.710 ms 2023-11-27T18:31:35.404 INFO:tasks.workunit.client.0.smithi091.stdout: 10 625 0.86 MB/sec execute 100 sec latency 4619.172 ms 2023-11-27T18:31:36.404 INFO:tasks.workunit.client.0.smithi091.stdout: 10 630 0.85 MB/sec execute 101 sec latency 4797.619 ms 2023-11-27T18:31:37.404 INFO:tasks.workunit.client.0.smithi091.stdout: 10 631 0.84 MB/sec execute 102 sec latency 3223.299 ms 2023-11-27T18:31:38.404 INFO:tasks.workunit.client.0.smithi091.stdout: 10 632 0.84 MB/sec execute 103 sec latency 4223.360 ms 2023-11-27T18:31:39.404 INFO:tasks.workunit.client.0.smithi091.stdout: 10 633 0.83 MB/sec execute 104 sec latency 4726.325 ms 2023-11-27T18:31:40.404 INFO:tasks.workunit.client.0.smithi091.stdout: 10 638 0.82 MB/sec execute 105 sec latency 4383.379 ms 2023-11-27T18:31:41.404 INFO:tasks.workunit.client.0.smithi091.stdout: 10 639 0.81 MB/sec execute 106 sec latency 4543.863 ms 2023-11-27T18:31:42.404 INFO:tasks.workunit.client.0.smithi091.stdout: 10 641 0.81 MB/sec execute 107 sec latency 4432.954 ms 2023-11-27T18:31:43.405 INFO:tasks.workunit.client.0.smithi091.stdout: 10 641 0.80 MB/sec execute 108 sec latency 3966.364 ms 2023-11-27T18:31:44.404 INFO:tasks.workunit.client.0.smithi091.stdout: 10 641 0.79 MB/sec execute 109 sec latency 4966.440 ms 2023-11-27T18:31:45.404 INFO:tasks.workunit.client.0.smithi091.stdout: 10 645 0.79 MB/sec execute 110 sec latency 5263.085 ms 2023-11-27T18:31:46.405 INFO:tasks.workunit.client.0.smithi091.stdout: 10 648 0.78 MB/sec execute 111 sec latency 5150.759 ms 2023-11-27T18:31:47.405 INFO:tasks.workunit.client.0.smithi091.stdout: 10 650 0.77 MB/sec execute 112 sec latency 5178.555 ms 2023-11-27T18:31:48.405 INFO:tasks.workunit.client.0.smithi091.stdout: 10 651 0.77 MB/sec execute 113 sec latency 2120.184 ms 2023-11-27T18:31:49.405 INFO:tasks.workunit.client.0.smithi091.stdout: 10 651 0.76 MB/sec execute 114 sec latency 3120.281 ms 2023-11-27T18:31:50.405 INFO:tasks.workunit.client.0.smithi091.stdout: 10 652 0.75 MB/sec execute 115 sec latency 4120.378 ms 2023-11-27T18:31:51.405 INFO:tasks.workunit.client.0.smithi091.stdout: 10 653 0.75 MB/sec execute 116 sec latency 5120.459 ms 2023-11-27T18:31:52.405 INFO:tasks.workunit.client.0.smithi091.stdout: 10 655 0.74 MB/sec execute 117 sec latency 5794.434 ms 2023-11-27T18:31:53.405 INFO:tasks.workunit.client.0.smithi091.stdout: 10 655 0.73 MB/sec execute 118 sec latency 5631.666 ms 2023-11-27T18:31:54.405 INFO:tasks.workunit.client.0.smithi091.stdout: 10 657 0.73 MB/sec execute 119 sec latency 4102.622 ms 2023-11-27T18:31:55.405 INFO:tasks.workunit.client.0.smithi091.stdout: 10 657 0.72 MB/sec execute 120 sec latency 5102.680 ms 2023-11-27T18:31:56.406 INFO:tasks.workunit.client.0.smithi091.stdout: 10 658 0.72 MB/sec execute 121 sec latency 5398.499 ms 2023-11-27T18:31:57.405 INFO:tasks.workunit.client.0.smithi091.stdout: 10 659 0.71 MB/sec execute 122 sec latency 5081.916 ms 2023-11-27T18:31:58.406 INFO:tasks.workunit.client.0.smithi091.stdout: 10 661 0.71 MB/sec execute 123 sec latency 5528.433 ms 2023-11-27T18:31:58.492 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:31:58.495 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:31:59.406 INFO:tasks.workunit.client.0.smithi091.stdout: 10 665 0.70 MB/sec execute 124 sec latency 4213.313 ms 2023-11-27T18:32:00.406 INFO:tasks.workunit.client.0.smithi091.stdout: 10 667 0.70 MB/sec execute 125 sec latency 1950.908 ms 2023-11-27T18:32:01.406 INFO:tasks.workunit.client.0.smithi091.stdout: 10 670 0.69 MB/sec execute 126 sec latency 2950.989 ms 2023-11-27T18:32:02.406 INFO:tasks.workunit.client.0.smithi091.stdout: 10 673 0.69 MB/sec execute 127 sec latency 3951.091 ms 2023-11-27T18:32:03.406 INFO:tasks.workunit.client.0.smithi091.stdout: 10 674 0.68 MB/sec execute 128 sec latency 4951.150 ms 2023-11-27T18:32:04.406 INFO:tasks.workunit.client.0.smithi091.stdout: 10 675 0.68 MB/sec execute 129 sec latency 5951.220 ms 2023-11-27T18:32:05.406 INFO:tasks.workunit.client.0.smithi091.stdout: 10 677 0.67 MB/sec execute 130 sec latency 6188.916 ms 2023-11-27T18:32:06.406 INFO:tasks.workunit.client.0.smithi091.stdout: 10 679 0.67 MB/sec execute 131 sec latency 5997.953 ms 2023-11-27T18:32:07.406 INFO:tasks.workunit.client.0.smithi091.stdout: 10 680 0.66 MB/sec execute 132 sec latency 5720.269 ms 2023-11-27T18:32:08.407 INFO:tasks.workunit.client.0.smithi091.stdout: 10 682 0.66 MB/sec execute 133 sec latency 5681.691 ms 2023-11-27T18:32:09.407 INFO:tasks.workunit.client.0.smithi091.stdout: 10 683 0.65 MB/sec execute 134 sec latency 6029.928 ms 2023-11-27T18:32:10.407 INFO:tasks.workunit.client.0.smithi091.stdout: 10 685 0.65 MB/sec execute 135 sec latency 6343.535 ms 2023-11-27T18:32:11.407 INFO:tasks.workunit.client.0.smithi091.stdout: 10 687 0.65 MB/sec execute 136 sec latency 5555.872 ms 2023-11-27T18:32:12.407 INFO:tasks.workunit.client.0.smithi091.stdout: 10 690 0.64 MB/sec execute 137 sec latency 5931.614 ms 2023-11-27T18:32:13.407 INFO:tasks.workunit.client.0.smithi091.stdout: 10 691 0.64 MB/sec execute 138 sec latency 6931.672 ms 2023-11-27T18:32:14.407 INFO:tasks.workunit.client.0.smithi091.stdout: 10 692 0.63 MB/sec execute 139 sec latency 7542.832 ms 2023-11-27T18:32:15.407 INFO:tasks.workunit.client.0.smithi091.stdout: 10 694 0.63 MB/sec execute 140 sec latency 7158.535 ms 2023-11-27T18:32:24.587 INFO:tasks.workunit.client.0.smithi091.stdout: 10 697 0.62 MB/sec execute 141 sec latency 5693.148 ms 2023-11-27T18:32:24.587 INFO:tasks.workunit.client.0.smithi091.stdout: 10 699 0.62 MB/sec execute 142 sec latency 4824.786 ms 2023-11-27T18:32:24.587 INFO:tasks.workunit.client.0.smithi091.stdout: 10 701 0.62 MB/sec execute 143 sec latency 5157.397 ms 2023-11-27T18:32:24.588 INFO:tasks.workunit.client.0.smithi091.stdout: 10 704 0.61 MB/sec execute 144 sec latency 4895.108 ms 2023-11-27T18:32:24.588 INFO:tasks.workunit.client.0.smithi091.stdout: 10 706 0.61 MB/sec execute 145 sec latency 2428.863 ms 2023-11-27T18:32:24.588 INFO:tasks.workunit.client.0.smithi091.stdout: 10 708 0.60 MB/sec execute 146 sec latency 3428.959 ms 2023-11-27T18:32:24.588 INFO:tasks.workunit.client.0.smithi091.stdout: 10 711 0.60 MB/sec execute 147 sec latency 4270.553 ms 2023-11-27T18:32:24.588 INFO:tasks.workunit.client.0.smithi091.stdout: 10 712 0.60 MB/sec execute 148 sec latency 4733.809 ms 2023-11-27T18:32:24.588 INFO:tasks.workunit.client.0.smithi091.stdout: 10 714 0.59 MB/sec execute 149 sec latency 5733.904 ms 2023-11-27T18:32:25.408 INFO:tasks.workunit.client.0.smithi091.stdout: 10 715 0.59 MB/sec execute 150 sec latency 6402.962 ms 2023-11-27T18:32:26.408 INFO:tasks.workunit.client.0.smithi091.stdout: 10 719 0.58 MB/sec execute 151 sec latency 6877.376 ms 2023-11-27T18:32:27.408 INFO:tasks.workunit.client.0.smithi091.stdout: 10 722 0.58 MB/sec execute 152 sec latency 1805.027 ms 2023-11-27T18:32:28.408 INFO:tasks.workunit.client.0.smithi091.stdout: 10 725 0.58 MB/sec execute 153 sec latency 2057.536 ms 2023-11-27T18:32:28.539 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:32:28.541 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:32:29.409 INFO:tasks.workunit.client.0.smithi091.stdout: 10 727 0.58 MB/sec execute 154 sec latency 3057.623 ms 2023-11-27T18:32:30.409 INFO:tasks.workunit.client.0.smithi091.stdout: 10 728 0.57 MB/sec execute 155 sec latency 4057.717 ms 2023-11-27T18:32:31.409 INFO:tasks.workunit.client.0.smithi091.stdout: 10 731 0.57 MB/sec execute 156 sec latency 5057.814 ms 2023-11-27T18:32:32.409 INFO:tasks.workunit.client.0.smithi091.stdout: 10 734 0.56 MB/sec execute 157 sec latency 5327.784 ms 2023-11-27T18:32:33.409 INFO:tasks.workunit.client.0.smithi091.stdout: 10 737 0.56 MB/sec execute 158 sec latency 4828.353 ms 2023-11-27T18:32:34.409 INFO:tasks.workunit.client.0.smithi091.stdout: 10 739 0.56 MB/sec execute 159 sec latency 5828.444 ms 2023-11-27T18:32:35.409 INFO:tasks.workunit.client.0.smithi091.stdout: 10 741 0.56 MB/sec execute 160 sec latency 5925.853 ms 2023-11-27T18:32:36.409 INFO:tasks.workunit.client.0.smithi091.stdout: 10 743 0.55 MB/sec execute 161 sec latency 2271.085 ms 2023-11-27T18:32:37.410 INFO:tasks.workunit.client.0.smithi091.stdout: 10 746 0.55 MB/sec execute 162 sec latency 3271.182 ms 2023-11-27T18:32:38.410 INFO:tasks.workunit.client.0.smithi091.stdout: 10 747 0.55 MB/sec execute 163 sec latency 4271.282 ms 2023-11-27T18:32:39.410 INFO:tasks.workunit.client.0.smithi091.stdout: 10 748 0.54 MB/sec execute 164 sec latency 5271.358 ms 2023-11-27T18:32:40.410 INFO:tasks.workunit.client.0.smithi091.stdout: 10 750 0.54 MB/sec execute 165 sec latency 6271.422 ms 2023-11-27T18:32:41.410 INFO:tasks.workunit.client.0.smithi091.stdout: 10 752 0.54 MB/sec execute 166 sec latency 6999.188 ms 2023-11-27T18:32:42.410 INFO:tasks.workunit.client.0.smithi091.stdout: 10 755 0.53 MB/sec execute 167 sec latency 6423.527 ms 2023-11-27T18:32:43.410 INFO:tasks.workunit.client.0.smithi091.stdout: 10 758 0.53 MB/sec execute 168 sec latency 2176.682 ms 2023-11-27T18:32:44.410 INFO:tasks.workunit.client.0.smithi091.stdout: 10 758 0.53 MB/sec execute 169 sec latency 3176.742 ms 2023-11-27T18:32:45.410 INFO:tasks.workunit.client.0.smithi091.stdout: 10 759 0.53 MB/sec execute 170 sec latency 4176.836 ms 2023-11-27T18:32:46.410 INFO:tasks.workunit.client.0.smithi091.stdout: 10 760 0.52 MB/sec execute 171 sec latency 5176.933 ms 2023-11-27T18:32:47.410 INFO:tasks.workunit.client.0.smithi091.stdout: 10 761 0.52 MB/sec execute 172 sec latency 5915.545 ms 2023-11-27T18:32:48.410 INFO:tasks.workunit.client.0.smithi091.stdout: 10 765 0.52 MB/sec execute 173 sec latency 6015.806 ms 2023-11-27T18:32:49.411 INFO:tasks.workunit.client.0.smithi091.stdout: 10 769 0.51 MB/sec execute 174 sec latency 6915.762 ms 2023-11-27T18:32:50.410 INFO:tasks.workunit.client.0.smithi091.stdout: 10 770 0.51 MB/sec execute 175 sec latency 7225.315 ms 2023-11-27T18:32:51.411 INFO:tasks.workunit.client.0.smithi091.stdout: 10 773 0.51 MB/sec execute 176 sec latency 3892.900 ms 2023-11-27T18:32:52.411 INFO:tasks.workunit.client.0.smithi091.stdout: 10 775 0.51 MB/sec execute 177 sec latency 4893.017 ms 2023-11-27T18:32:53.411 INFO:tasks.workunit.client.0.smithi091.stdout: 10 776 0.50 MB/sec execute 178 sec latency 5633.817 ms 2023-11-27T18:32:54.411 INFO:tasks.workunit.client.0.smithi091.stdout: 10 779 0.50 MB/sec execute 179 sec latency 5589.139 ms 2023-11-27T18:32:55.411 INFO:tasks.workunit.client.0.smithi091.stdout: 10 781 0.50 MB/sec execute 180 sec latency 4983.586 ms 2023-11-27T18:32:56.411 INFO:tasks.workunit.client.0.smithi091.stdout: 10 784 0.50 MB/sec execute 181 sec latency 2577.364 ms 2023-11-27T18:32:57.411 INFO:tasks.workunit.client.0.smithi091.stdout: 10 786 0.49 MB/sec execute 182 sec latency 3577.429 ms 2023-11-27T18:32:58.411 INFO:tasks.workunit.client.0.smithi091.stdout: 10 789 0.49 MB/sec execute 183 sec latency 4512.021 ms 2023-11-27T18:32:58.659 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:32:58.662 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:32:59.411 INFO:tasks.workunit.client.0.smithi091.stdout: 10 792 0.49 MB/sec execute 184 sec latency 2698.611 ms 2023-11-27T18:33:00.411 INFO:tasks.workunit.client.0.smithi091.stdout: 10 794 0.49 MB/sec execute 185 sec latency 3226.030 ms 2023-11-27T18:33:01.411 INFO:tasks.workunit.client.0.smithi091.stdout: 10 795 0.48 MB/sec execute 186 sec latency 4226.087 ms 2023-11-27T18:33:02.412 INFO:tasks.workunit.client.0.smithi091.stdout: 10 796 0.48 MB/sec execute 187 sec latency 5226.182 ms 2023-11-27T18:33:03.412 INFO:tasks.workunit.client.0.smithi091.stdout: 10 799 0.48 MB/sec execute 188 sec latency 5714.143 ms 2023-11-27T18:33:04.412 INFO:tasks.workunit.client.0.smithi091.stdout: 10 801 0.48 MB/sec execute 189 sec latency 5858.619 ms 2023-11-27T18:33:05.412 INFO:tasks.workunit.client.0.smithi091.stdout: 10 803 0.48 MB/sec execute 190 sec latency 6344.772 ms 2023-11-27T18:33:06.412 INFO:tasks.workunit.client.0.smithi091.stdout: 10 806 0.47 MB/sec execute 191 sec latency 5383.699 ms 2023-11-27T18:33:07.413 INFO:tasks.workunit.client.0.smithi091.stdout: 10 808 0.47 MB/sec execute 192 sec latency 6313.781 ms 2023-11-27T18:33:08.413 INFO:tasks.workunit.client.0.smithi091.stdout: 10 810 0.47 MB/sec execute 193 sec latency 5230.003 ms 2023-11-27T18:33:09.412 INFO:tasks.workunit.client.0.smithi091.stdout: 10 812 0.47 MB/sec execute 194 sec latency 6230.098 ms 2023-11-27T18:33:10.412 INFO:tasks.workunit.client.0.smithi091.stdout: 10 816 0.47 MB/sec execute 195 sec latency 6262.276 ms 2023-11-27T18:33:11.412 INFO:tasks.workunit.client.0.smithi091.stdout: 10 817 0.46 MB/sec execute 196 sec latency 5803.767 ms 2023-11-27T18:33:12.413 INFO:tasks.workunit.client.0.smithi091.stdout: 10 817 0.46 MB/sec execute 197 sec latency 4839.842 ms 2023-11-27T18:33:13.413 INFO:tasks.workunit.client.0.smithi091.stdout: 10 821 0.46 MB/sec execute 198 sec latency 5303.937 ms 2023-11-27T18:33:14.413 INFO:tasks.workunit.client.0.smithi091.stdout: 10 821 0.46 MB/sec execute 199 sec latency 4271.934 ms 2023-11-27T18:33:15.413 INFO:tasks.workunit.client.0.smithi091.stdout: 10 821 0.45 MB/sec execute 200 sec latency 5133.987 ms 2023-11-27T18:33:16.413 INFO:tasks.workunit.client.0.smithi091.stdout: 10 822 0.45 MB/sec execute 201 sec latency 5339.857 ms 2023-11-27T18:33:17.413 INFO:tasks.workunit.client.0.smithi091.stdout: 10 822 0.45 MB/sec execute 202 sec latency 5069.653 ms 2023-11-27T18:33:18.413 INFO:tasks.workunit.client.0.smithi091.stdout: 10 823 0.45 MB/sec execute 203 sec latency 4244.806 ms 2023-11-27T18:33:19.413 INFO:tasks.workunit.client.0.smithi091.stdout: 10 824 0.45 MB/sec execute 204 sec latency 4059.289 ms 2023-11-27T18:33:20.413 INFO:tasks.workunit.client.0.smithi091.stdout: 10 824 0.44 MB/sec execute 205 sec latency 4188.976 ms 2023-11-27T18:33:21.413 INFO:tasks.workunit.client.0.smithi091.stdout: 10 825 0.44 MB/sec execute 206 sec latency 4700.024 ms 2023-11-27T18:33:22.414 INFO:tasks.workunit.client.0.smithi091.stdout: 10 829 0.44 MB/sec execute 207 sec latency 4251.771 ms 2023-11-27T18:33:23.414 INFO:tasks.workunit.client.0.smithi091.stdout: 10 831 0.44 MB/sec execute 208 sec latency 2269.681 ms 2023-11-27T18:33:24.414 INFO:tasks.workunit.client.0.smithi091.stdout: 10 832 0.44 MB/sec execute 209 sec latency 3269.791 ms 2023-11-27T18:33:25.414 INFO:tasks.workunit.client.0.smithi091.stdout: 10 832 0.43 MB/sec execute 210 sec latency 3689.365 ms 2023-11-27T18:33:26.414 INFO:tasks.workunit.client.0.smithi091.stdout: 10 835 0.43 MB/sec execute 211 sec latency 3628.531 ms 2023-11-27T18:33:27.414 INFO:tasks.workunit.client.0.smithi091.stdout: 10 837 0.43 MB/sec execute 212 sec latency 4008.085 ms 2023-11-27T18:33:28.414 INFO:tasks.workunit.client.0.smithi091.stdout: 10 844 0.43 MB/sec execute 213 sec latency 3247.896 ms 2023-11-27T18:33:28.803 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:33:28.806 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:33:29.414 INFO:tasks.workunit.client.0.smithi091.stdout: 10 846 0.43 MB/sec execute 214 sec latency 3988.825 ms 2023-11-27T18:33:30.414 INFO:tasks.workunit.client.0.smithi091.stdout: 10 849 0.43 MB/sec execute 215 sec latency 3408.227 ms 2023-11-27T18:33:31.414 INFO:tasks.workunit.client.0.smithi091.stdout: 10 850 0.42 MB/sec execute 216 sec latency 4222.785 ms 2023-11-27T18:33:32.415 INFO:tasks.workunit.client.0.smithi091.stdout: 10 852 0.42 MB/sec execute 217 sec latency 4861.121 ms 2023-11-27T18:33:33.415 INFO:tasks.workunit.client.0.smithi091.stdout: 10 857 0.42 MB/sec execute 218 sec latency 4346.191 ms 2023-11-27T18:33:34.415 INFO:tasks.workunit.client.0.smithi091.stdout: 10 859 0.42 MB/sec execute 219 sec latency 4458.054 ms 2023-11-27T18:33:35.415 INFO:tasks.workunit.client.0.smithi091.stdout: 10 860 0.42 MB/sec execute 220 sec latency 4532.181 ms 2023-11-27T18:33:36.415 INFO:tasks.workunit.client.0.smithi091.stdout: 10 861 0.42 MB/sec execute 221 sec latency 3826.162 ms 2023-11-27T18:33:37.415 INFO:tasks.workunit.client.0.smithi091.stdout: 10 862 0.41 MB/sec execute 222 sec latency 4336.899 ms 2023-11-27T18:33:38.415 INFO:tasks.workunit.client.0.smithi091.stdout: 10 863 0.41 MB/sec execute 223 sec latency 4042.041 ms 2023-11-27T18:33:39.415 INFO:tasks.workunit.client.0.smithi091.stdout: 10 865 0.41 MB/sec execute 224 sec latency 2459.392 ms 2023-11-27T18:33:40.415 INFO:tasks.workunit.client.0.smithi091.stdout: 10 867 0.41 MB/sec execute 225 sec latency 3459.458 ms 2023-11-27T18:33:41.415 INFO:tasks.workunit.client.0.smithi091.stdout: 10 868 0.41 MB/sec execute 226 sec latency 4459.528 ms 2023-11-27T18:33:42.415 INFO:tasks.workunit.client.0.smithi091.stdout: 10 870 0.40 MB/sec execute 227 sec latency 5459.591 ms 2023-11-27T18:33:43.416 INFO:tasks.workunit.client.0.smithi091.stdout: 10 870 0.40 MB/sec execute 228 sec latency 5670.106 ms 2023-11-27T18:33:44.416 INFO:tasks.workunit.client.0.smithi091.stdout: 10 871 0.40 MB/sec execute 229 sec latency 6457.930 ms 2023-11-27T18:33:45.416 INFO:tasks.workunit.client.0.smithi091.stdout: 10 872 0.40 MB/sec execute 230 sec latency 6059.360 ms 2023-11-27T18:33:46.416 INFO:tasks.workunit.client.0.smithi091.stdout: 10 875 0.40 MB/sec execute 231 sec latency 6080.490 ms 2023-11-27T18:33:47.416 INFO:tasks.workunit.client.0.smithi091.stdout: 10 877 0.40 MB/sec execute 232 sec latency 5833.737 ms 2023-11-27T18:33:48.416 INFO:tasks.workunit.client.0.smithi091.stdout: 10 878 0.40 MB/sec execute 233 sec latency 5628.581 ms 2023-11-27T18:33:49.416 INFO:tasks.workunit.client.0.smithi091.stdout: 10 882 0.39 MB/sec execute 234 sec latency 6232.527 ms 2023-11-27T18:33:50.416 INFO:tasks.workunit.client.0.smithi091.stdout: 10 885 0.39 MB/sec execute 235 sec latency 3549.119 ms 2023-11-27T18:33:51.416 INFO:tasks.workunit.client.0.smithi091.stdout: 10 886 0.39 MB/sec execute 236 sec latency 4549.178 ms 2023-11-27T18:33:52.416 INFO:tasks.workunit.client.0.smithi091.stdout: 10 887 0.39 MB/sec execute 237 sec latency 5549.274 ms 2023-11-27T18:33:53.416 INFO:tasks.workunit.client.0.smithi091.stdout: 10 888 0.39 MB/sec execute 238 sec latency 6140.593 ms 2023-11-27T18:33:54.417 INFO:tasks.workunit.client.0.smithi091.stdout: 10 888 0.39 MB/sec execute 239 sec latency 5501.464 ms 2023-11-27T18:33:55.417 INFO:tasks.workunit.client.0.smithi091.stdout: 10 889 0.39 MB/sec execute 240 sec latency 6052.901 ms 2023-11-27T18:33:56.417 INFO:tasks.workunit.client.0.smithi091.stdout: 10 891 0.38 MB/sec execute 241 sec latency 4805.449 ms 2023-11-27T18:33:57.417 INFO:tasks.workunit.client.0.smithi091.stdout: 10 894 0.38 MB/sec execute 242 sec latency 5203.663 ms 2023-11-27T18:33:58.417 INFO:tasks.workunit.client.0.smithi091.stdout: 10 897 0.38 MB/sec execute 243 sec latency 4416.539 ms 2023-11-27T18:33:58.908 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:33:58.911 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:33:59.417 INFO:tasks.workunit.client.0.smithi091.stdout: 10 899 0.38 MB/sec execute 244 sec latency 4003.397 ms 2023-11-27T18:34:00.418 INFO:tasks.workunit.client.0.smithi091.stdout: 10 901 0.38 MB/sec execute 245 sec latency 5003.493 ms 2023-11-27T18:34:01.417 INFO:tasks.workunit.client.0.smithi091.stdout: 10 903 0.38 MB/sec execute 246 sec latency 5388.256 ms 2023-11-27T18:34:02.417 INFO:tasks.workunit.client.0.smithi091.stdout: 10 904 0.38 MB/sec execute 247 sec latency 4083.387 ms 2023-11-27T18:34:03.417 INFO:tasks.workunit.client.0.smithi091.stdout: 10 905 0.37 MB/sec execute 248 sec latency 5083.494 ms 2023-11-27T18:34:04.417 INFO:tasks.workunit.client.0.smithi091.stdout: 10 906 0.37 MB/sec execute 249 sec latency 6083.554 ms 2023-11-27T18:34:05.418 INFO:tasks.workunit.client.0.smithi091.stdout: 10 908 0.37 MB/sec execute 250 sec latency 6258.042 ms 2023-11-27T18:34:06.418 INFO:tasks.workunit.client.0.smithi091.stdout: 10 910 0.37 MB/sec execute 251 sec latency 3640.385 ms 2023-11-27T18:34:12.816 INFO:tasks.workunit.client.0.smithi091.stdout: 10 911 0.37 MB/sec execute 252 sec latency 4640.458 ms 2023-11-27T18:34:12.817 INFO:tasks.workunit.client.0.smithi091.stdout: 10 914 0.37 MB/sec execute 253 sec latency 5181.637 ms 2023-11-27T18:34:12.817 INFO:tasks.workunit.client.0.smithi091.stdout: 10 917 0.37 MB/sec execute 254 sec latency 3619.496 ms 2023-11-27T18:34:12.817 INFO:tasks.workunit.client.0.smithi091.stdout: 10 918 0.37 MB/sec execute 255 sec latency 4619.561 ms 2023-11-27T18:34:12.817 INFO:tasks.workunit.client.0.smithi091.stdout: 10 920 0.36 MB/sec execute 256 sec latency 5505.515 ms 2023-11-27T18:34:12.817 INFO:tasks.workunit.client.0.smithi091.stdout: 10 922 0.36 MB/sec execute 257 sec latency 4459.202 ms 2023-11-27T18:34:13.418 INFO:tasks.workunit.client.0.smithi091.stdout: 10 923 0.36 MB/sec execute 258 sec latency 5459.258 ms 2023-11-27T18:34:14.418 INFO:tasks.workunit.client.0.smithi091.stdout: 10 924 0.36 MB/sec execute 259 sec latency 6459.353 ms 2023-11-27T18:34:15.418 INFO:tasks.workunit.client.0.smithi091.stdout: 10 925 0.36 MB/sec execute 260 sec latency 6735.078 ms 2023-11-27T18:34:16.418 INFO:tasks.workunit.client.0.smithi091.stdout: 10 927 0.36 MB/sec execute 261 sec latency 4421.953 ms 2023-11-27T18:34:17.418 INFO:tasks.workunit.client.0.smithi091.stdout: 10 928 0.36 MB/sec execute 262 sec latency 5376.166 ms 2023-11-27T18:34:18.419 INFO:tasks.workunit.client.0.smithi091.stdout: 10 930 0.36 MB/sec execute 263 sec latency 5057.541 ms 2023-11-27T18:34:19.419 INFO:tasks.workunit.client.0.smithi091.stdout: 10 930 0.35 MB/sec execute 264 sec latency 4375.336 ms 2023-11-27T18:34:20.419 INFO:tasks.workunit.client.0.smithi091.stdout: 10 931 0.35 MB/sec execute 265 sec latency 5320.637 ms 2023-11-27T18:34:21.419 INFO:tasks.workunit.client.0.smithi091.stdout: 10 931 0.35 MB/sec execute 266 sec latency 3981.506 ms 2023-11-27T18:34:22.419 INFO:tasks.workunit.client.0.smithi091.stdout: 10 932 0.35 MB/sec execute 267 sec latency 4757.240 ms 2023-11-27T18:34:23.419 INFO:tasks.workunit.client.0.smithi091.stdout: 10 933 0.35 MB/sec execute 268 sec latency 4292.293 ms 2023-11-27T18:34:24.419 INFO:tasks.workunit.client.0.smithi091.stdout: 10 935 0.35 MB/sec execute 269 sec latency 2201.809 ms 2023-11-27T18:34:25.419 INFO:tasks.workunit.client.0.smithi091.stdout: 10 937 0.35 MB/sec execute 270 sec latency 2779.419 ms 2023-11-27T18:34:26.419 INFO:tasks.workunit.client.0.smithi091.stdout: 10 937 0.35 MB/sec execute 271 sec latency 3779.483 ms 2023-11-27T18:34:27.419 INFO:tasks.workunit.client.0.smithi091.stdout: 10 938 0.34 MB/sec execute 272 sec latency 4026.387 ms 2023-11-27T18:34:28.419 INFO:tasks.workunit.client.0.smithi091.stdout: 10 938 0.34 MB/sec execute 273 sec latency 4011.389 ms 2023-11-27T18:34:29.079 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:34:29.081 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:34:29.419 INFO:tasks.workunit.client.0.smithi091.stdout: 10 939 0.34 MB/sec execute 274 sec latency 4924.692 ms 2023-11-27T18:34:30.420 INFO:tasks.workunit.client.0.smithi091.stdout: 10 940 0.34 MB/sec execute 275 sec latency 4040.523 ms 2023-11-27T18:34:31.420 INFO:tasks.workunit.client.0.smithi091.stdout: 10 941 0.34 MB/sec execute 276 sec latency 4504.739 ms 2023-11-27T18:34:32.420 INFO:tasks.workunit.client.0.smithi091.stdout: 10 943 0.34 MB/sec execute 277 sec latency 4566.031 ms 2023-11-27T18:34:33.420 INFO:tasks.workunit.client.0.smithi091.stdout: 10 945 0.34 MB/sec execute 278 sec latency 2709.178 ms 2023-11-27T18:34:34.759 INFO:tasks.workunit.client.0.smithi091.stdout: 10 947 0.34 MB/sec execute 279 sec latency 3687.595 ms 2023-11-27T18:34:35.420 INFO:tasks.workunit.client.0.smithi091.stdout: 10 949 0.34 MB/sec execute 280 sec latency 4192.526 ms 2023-11-27T18:34:36.420 INFO:tasks.workunit.client.0.smithi091.stdout: 10 950 0.33 MB/sec execute 281 sec latency 3981.796 ms 2023-11-27T18:34:37.420 INFO:tasks.workunit.client.0.smithi091.stdout: 10 951 0.33 MB/sec execute 282 sec latency 3807.367 ms 2023-11-27T18:34:38.420 INFO:tasks.workunit.client.0.smithi091.stdout: 10 953 0.33 MB/sec execute 283 sec latency 4062.861 ms 2023-11-27T18:34:39.420 INFO:tasks.workunit.client.0.smithi091.stdout: 10 954 0.33 MB/sec execute 284 sec latency 3982.295 ms 2023-11-27T18:34:40.420 INFO:tasks.workunit.client.0.smithi091.stdout: 10 955 0.33 MB/sec execute 285 sec latency 4367.568 ms 2023-11-27T18:34:41.420 INFO:tasks.workunit.client.0.smithi091.stdout: 10 958 0.33 MB/sec execute 286 sec latency 3790.059 ms 2023-11-27T18:34:42.421 INFO:tasks.workunit.client.0.smithi091.stdout: 10 963 0.33 MB/sec execute 287 sec latency 4283.051 ms 2023-11-27T18:34:43.421 INFO:tasks.workunit.client.0.smithi091.stdout: 10 968 0.33 MB/sec execute 288 sec latency 3871.860 ms 2023-11-27T18:34:44.421 INFO:tasks.workunit.client.0.smithi091.stdout: 10 972 0.33 MB/sec execute 289 sec latency 2041.931 ms 2023-11-27T18:34:45.421 INFO:tasks.workunit.client.0.smithi091.stdout: 10 973 0.33 MB/sec execute 290 sec latency 3042.023 ms 2023-11-27T18:34:46.421 INFO:tasks.workunit.client.0.smithi091.stdout: 10 975 0.33 MB/sec execute 291 sec latency 4042.121 ms 2023-11-27T18:34:47.421 INFO:tasks.workunit.client.0.smithi091.stdout: 10 977 0.33 MB/sec execute 292 sec latency 4625.921 ms 2023-11-27T18:34:48.421 INFO:tasks.workunit.client.0.smithi091.stdout: 10 980 0.33 MB/sec execute 293 sec latency 4980.768 ms 2023-11-27T18:34:49.421 INFO:tasks.workunit.client.0.smithi091.stdout: 10 981 0.33 MB/sec execute 294 sec latency 2473.802 ms 2023-11-27T18:34:50.421 INFO:tasks.workunit.client.0.smithi091.stdout: 10 983 0.33 MB/sec execute 295 sec latency 2573.767 ms 2023-11-27T18:34:51.421 INFO:tasks.workunit.client.0.smithi091.stdout: 10 985 0.33 MB/sec execute 296 sec latency 3495.958 ms 2023-11-27T18:34:52.422 INFO:tasks.workunit.client.0.smithi091.stdout: 10 987 0.32 MB/sec execute 297 sec latency 4255.934 ms 2023-11-27T18:34:53.422 INFO:tasks.workunit.client.0.smithi091.stdout: 10 991 0.32 MB/sec execute 298 sec latency 2399.650 ms 2023-11-27T18:34:54.422 INFO:tasks.workunit.client.0.smithi091.stdout: 10 992 0.32 MB/sec execute 299 sec latency 3399.716 ms 2023-11-27T18:34:55.422 INFO:tasks.workunit.client.0.smithi091.stdout: 10 993 0.32 MB/sec execute 300 sec latency 4399.819 ms 2023-11-27T18:34:56.422 INFO:tasks.workunit.client.0.smithi091.stdout: 10 994 0.32 MB/sec execute 301 sec latency 5399.912 ms 2023-11-27T18:34:57.422 INFO:tasks.workunit.client.0.smithi091.stdout: 10 997 0.32 MB/sec execute 302 sec latency 6399.973 ms 2023-11-27T18:34:58.422 INFO:tasks.workunit.client.0.smithi091.stdout: 10 999 0.32 MB/sec execute 303 sec latency 6568.426 ms 2023-11-27T18:34:59.422 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1001 0.32 MB/sec execute 304 sec latency 4801.968 ms 2023-11-27T18:34:59.450 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:34:59.453 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:35:00.422 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1003 0.32 MB/sec execute 305 sec latency 5802.107 ms 2023-11-27T18:35:01.422 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1004 0.32 MB/sec execute 306 sec latency 6802.241 ms 2023-11-27T18:35:02.422 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1006 0.32 MB/sec execute 307 sec latency 7524.809 ms 2023-11-27T18:35:03.422 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1008 0.32 MB/sec execute 308 sec latency 5726.072 ms 2023-11-27T18:35:04.423 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1011 0.32 MB/sec execute 309 sec latency 6726.168 ms 2023-11-27T18:35:05.423 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1011 0.32 MB/sec execute 310 sec latency 7557.335 ms 2023-11-27T18:35:06.423 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1012 0.32 MB/sec execute 311 sec latency 7502.363 ms 2023-11-27T18:35:07.423 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1015 0.32 MB/sec execute 312 sec latency 5170.878 ms 2023-11-27T18:35:08.423 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1021 0.32 MB/sec execute 313 sec latency 5623.334 ms 2023-11-27T18:35:09.423 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1026 0.33 MB/sec execute 314 sec latency 5812.658 ms 2023-11-27T18:35:10.423 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1028 0.33 MB/sec execute 315 sec latency 5748.891 ms 2023-11-27T18:35:11.423 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1030 0.33 MB/sec execute 316 sec latency 4972.991 ms 2023-11-27T18:35:12.423 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1032 0.33 MB/sec execute 317 sec latency 5386.230 ms 2023-11-27T18:35:13.423 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1033 0.33 MB/sec execute 318 sec latency 4371.549 ms 2023-11-27T18:35:14.423 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1033 0.33 MB/sec execute 319 sec latency 4167.746 ms 2023-11-27T18:35:15.424 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1034 0.33 MB/sec execute 320 sec latency 5039.841 ms 2023-11-27T18:35:16.424 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1035 0.33 MB/sec execute 321 sec latency 4587.131 ms 2023-11-27T18:35:17.424 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1036 0.33 MB/sec execute 322 sec latency 5343.514 ms 2023-11-27T18:35:18.424 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1037 0.32 MB/sec execute 323 sec latency 5108.366 ms 2023-11-27T18:35:19.424 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1038 0.32 MB/sec execute 324 sec latency 3590.074 ms 2023-11-27T18:35:20.424 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1038 0.32 MB/sec execute 325 sec latency 4590.141 ms 2023-11-27T18:35:21.424 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1041 0.32 MB/sec execute 326 sec latency 4647.661 ms 2023-11-27T18:35:22.424 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1042 0.32 MB/sec execute 327 sec latency 4806.861 ms 2023-11-27T18:35:23.424 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1044 0.32 MB/sec execute 328 sec latency 4859.990 ms 2023-11-27T18:35:24.424 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1045 0.32 MB/sec execute 329 sec latency 3942.755 ms 2023-11-27T18:35:25.424 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1046 0.32 MB/sec execute 330 sec latency 4942.822 ms 2023-11-27T18:35:26.424 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1048 0.32 MB/sec execute 331 sec latency 5026.162 ms 2023-11-27T18:35:27.424 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1050 0.32 MB/sec execute 332 sec latency 3104.895 ms 2023-11-27T18:35:28.424 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1053 0.31 MB/sec execute 333 sec latency 4104.974 ms 2023-11-27T18:35:29.425 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1054 0.31 MB/sec execute 334 sec latency 4364.808 ms 2023-11-27T18:35:29.491 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:35:29.493 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:35:30.425 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1054 0.31 MB/sec execute 335 sec latency 4963.802 ms 2023-11-27T18:35:31.425 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1055 0.31 MB/sec execute 336 sec latency 5119.467 ms 2023-11-27T18:35:32.425 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1056 0.31 MB/sec execute 337 sec latency 3740.545 ms 2023-11-27T18:35:33.425 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1056 0.31 MB/sec execute 338 sec latency 4316.963 ms 2023-11-27T18:35:34.425 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1057 0.31 MB/sec execute 339 sec latency 3806.384 ms 2023-11-27T18:35:35.425 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1058 0.31 MB/sec execute 340 sec latency 4652.548 ms 2023-11-27T18:35:36.425 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1059 0.31 MB/sec execute 341 sec latency 4770.915 ms 2023-11-27T18:35:37.425 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1060 0.31 MB/sec execute 342 sec latency 4423.982 ms 2023-11-27T18:35:38.425 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1061 0.31 MB/sec execute 343 sec latency 5033.843 ms 2023-11-27T18:35:39.426 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1063 0.30 MB/sec execute 344 sec latency 4882.287 ms 2023-11-27T18:35:40.426 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1064 0.30 MB/sec execute 345 sec latency 4691.087 ms 2023-11-27T18:35:41.426 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1067 0.30 MB/sec execute 346 sec latency 4838.186 ms 2023-11-27T18:35:42.426 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1069 0.30 MB/sec execute 347 sec latency 4468.444 ms 2023-11-27T18:35:43.426 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1071 0.30 MB/sec execute 348 sec latency 5468.547 ms 2023-11-27T18:35:44.426 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1073 0.30 MB/sec execute 349 sec latency 5830.399 ms 2023-11-27T18:35:45.426 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1074 0.30 MB/sec execute 350 sec latency 4019.963 ms 2023-11-27T18:35:46.426 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1075 0.30 MB/sec execute 351 sec latency 5020.066 ms 2023-11-27T18:35:47.426 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1076 0.30 MB/sec execute 352 sec latency 6020.165 ms 2023-11-27T18:35:48.426 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1078 0.30 MB/sec execute 353 sec latency 6798.955 ms 2023-11-27T18:35:49.427 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1080 0.30 MB/sec execute 354 sec latency 5791.229 ms 2023-11-27T18:35:50.427 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1083 0.30 MB/sec execute 355 sec latency 6789.820 ms 2023-11-27T18:35:51.427 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1085 0.30 MB/sec execute 356 sec latency 7754.069 ms 2023-11-27T18:35:52.427 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1088 0.29 MB/sec execute 357 sec latency 4178.137 ms 2023-11-27T18:35:53.427 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1090 0.29 MB/sec execute 358 sec latency 5178.235 ms 2023-11-27T18:35:54.427 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1092 0.29 MB/sec execute 359 sec latency 6003.436 ms 2023-11-27T18:35:55.427 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1094 0.29 MB/sec execute 360 sec latency 3428.958 ms 2023-11-27T18:35:56.427 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1094 0.29 MB/sec execute 361 sec latency 4429.051 ms 2023-11-27T18:35:57.428 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1097 0.29 MB/sec execute 362 sec latency 5202.079 ms 2023-11-27T18:35:58.427 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1099 0.29 MB/sec execute 363 sec latency 5178.662 ms 2023-11-27T18:35:59.427 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1101 0.29 MB/sec execute 364 sec latency 6118.004 ms 2023-11-27T18:35:59.583 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:35:59.587 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:36:00.427 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1103 0.29 MB/sec execute 365 sec latency 4253.505 ms 2023-11-27T18:36:01.428 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1105 0.29 MB/sec execute 366 sec latency 4558.461 ms 2023-11-27T18:36:02.428 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1107 0.29 MB/sec execute 367 sec latency 4782.778 ms 2023-11-27T18:36:03.428 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1109 0.29 MB/sec execute 368 sec latency 5461.995 ms 2023-11-27T18:36:04.428 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1110 0.29 MB/sec execute 369 sec latency 4424.753 ms 2023-11-27T18:36:04.651 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:24:25.729 38308== Warning: unimplemented fcntl command: 1036 2023-11-27T18:36:04.670 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:24:25.749 38308== Warning: unimplemented fcntl command: 1036 2023-11-27T18:36:04.798 INFO:tasks.ceph.mon.b.smithi094.stderr:==00:00:24:25.823 38305== Warning: unimplemented fcntl command: 1036 2023-11-27T18:36:04.839 INFO:tasks.ceph.mon.b.smithi094.stderr:==00:00:24:25.864 38305== Warning: unimplemented fcntl command: 1036 2023-11-27T18:36:04.893 INFO:tasks.ceph.mon.c.smithi094.stderr:==00:00:24:25.919 38307== Warning: unimplemented fcntl command: 1036 2023-11-27T18:36:04.990 INFO:tasks.ceph.mon.c.smithi094.stderr:==00:00:24:26.016 38307== Warning: unimplemented fcntl command: 1036 2023-11-27T18:36:05.428 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1111 0.28 MB/sec execute 370 sec latency 5424.820 ms 2023-11-27T18:36:05.621 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:24:26.699 38308== Warning: unimplemented fcntl command: 1036 2023-11-27T18:36:05.685 INFO:tasks.ceph.mon.b.smithi094.stderr:==00:00:24:26.710 38305== Warning: unimplemented fcntl command: 1036 2023-11-27T18:36:05.698 INFO:tasks.ceph.mon.c.smithi094.stderr:==00:00:24:26.724 38307== Warning: unimplemented fcntl command: 1036 2023-11-27T18:36:06.428 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1112 0.28 MB/sec execute 371 sec latency 6275.342 ms 2023-11-27T18:36:07.428 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1113 0.28 MB/sec execute 372 sec latency 5149.385 ms 2023-11-27T18:36:08.428 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1114 0.28 MB/sec execute 373 sec latency 4947.417 ms 2023-11-27T18:36:09.428 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1115 0.28 MB/sec execute 374 sec latency 4178.564 ms 2023-11-27T18:36:10.428 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1119 0.28 MB/sec execute 375 sec latency 3732.034 ms 2023-11-27T18:36:11.428 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1122 0.28 MB/sec execute 376 sec latency 4732.094 ms 2023-11-27T18:36:12.428 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1123 0.28 MB/sec execute 377 sec latency 4759.808 ms 2023-11-27T18:36:13.428 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1126 0.28 MB/sec execute 378 sec latency 2228.248 ms 2023-11-27T18:36:14.428 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1126 0.28 MB/sec execute 379 sec latency 3228.321 ms 2023-11-27T18:36:15.429 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1126 0.28 MB/sec execute 380 sec latency 4228.454 ms 2023-11-27T18:36:16.429 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1128 0.28 MB/sec execute 381 sec latency 5093.939 ms 2023-11-27T18:36:17.429 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1130 0.28 MB/sec execute 382 sec latency 4061.478 ms 2023-11-27T18:36:18.429 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1132 0.28 MB/sec execute 383 sec latency 4106.221 ms 2023-11-27T18:36:19.429 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1133 0.28 MB/sec execute 384 sec latency 2674.044 ms 2023-11-27T18:36:20.429 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1137 0.27 MB/sec execute 385 sec latency 3674.117 ms 2023-11-27T18:36:21.429 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1139 0.27 MB/sec execute 386 sec latency 4674.185 ms 2023-11-27T18:36:22.429 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1141 0.27 MB/sec execute 387 sec latency 5508.636 ms 2023-11-27T18:36:23.429 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1143 0.27 MB/sec execute 388 sec latency 4638.751 ms 2023-11-27T18:36:24.429 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1144 0.27 MB/sec execute 389 sec latency 2773.347 ms 2023-11-27T18:36:25.430 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1145 0.27 MB/sec execute 390 sec latency 3773.455 ms 2023-11-27T18:36:26.430 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1147 0.27 MB/sec execute 391 sec latency 4165.987 ms 2023-11-27T18:36:27.430 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1149 0.27 MB/sec execute 392 sec latency 4213.598 ms 2023-11-27T18:36:28.430 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1152 0.27 MB/sec execute 393 sec latency 3853.210 ms 2023-11-27T18:36:29.430 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1154 0.27 MB/sec execute 394 sec latency 2008.561 ms 2023-11-27T18:36:29.646 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:36:29.648 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:36:30.430 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1156 0.27 MB/sec execute 395 sec latency 2070.798 ms 2023-11-27T18:36:31.430 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1156 0.27 MB/sec execute 396 sec latency 3070.882 ms 2023-11-27T18:36:32.430 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1159 0.27 MB/sec execute 397 sec latency 3624.247 ms 2023-11-27T18:36:36.367 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1161 0.27 MB/sec execute 398 sec latency 3572.068 ms 2023-11-27T18:36:36.368 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1162 0.27 MB/sec execute 399 sec latency 4572.131 ms 2023-11-27T18:36:36.368 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1163 0.26 MB/sec execute 400 sec latency 4997.536 ms 2023-11-27T18:36:36.430 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1165 0.26 MB/sec execute 401 sec latency 4518.665 ms 2023-11-27T18:36:37.430 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1167 0.26 MB/sec execute 402 sec latency 4872.582 ms 2023-11-27T18:36:38.431 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1168 0.26 MB/sec execute 403 sec latency 4314.657 ms 2023-11-27T18:36:39.431 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1169 0.26 MB/sec execute 404 sec latency 4945.859 ms 2023-11-27T18:36:40.431 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1170 0.26 MB/sec execute 405 sec latency 4430.928 ms 2023-11-27T18:36:41.431 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1171 0.26 MB/sec execute 406 sec latency 4669.933 ms 2023-11-27T18:36:42.431 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1173 0.26 MB/sec execute 407 sec latency 4674.323 ms 2023-11-27T18:36:43.431 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1174 0.26 MB/sec execute 408 sec latency 4702.200 ms 2023-11-27T18:36:44.431 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1175 0.26 MB/sec execute 409 sec latency 4152.579 ms 2023-11-27T18:36:45.431 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1176 0.26 MB/sec execute 410 sec latency 4658.563 ms 2023-11-27T18:36:46.431 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1177 0.26 MB/sec execute 411 sec latency 4996.088 ms 2023-11-27T18:36:47.431 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1178 0.26 MB/sec execute 412 sec latency 5145.521 ms 2023-11-27T18:36:48.431 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1179 0.26 MB/sec execute 413 sec latency 5327.618 ms 2023-11-27T18:36:49.432 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1181 0.26 MB/sec execute 414 sec latency 5902.345 ms 2023-11-27T18:36:50.432 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1182 0.26 MB/sec execute 415 sec latency 3896.034 ms 2023-11-27T18:36:51.432 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1183 0.25 MB/sec execute 416 sec latency 4896.126 ms 2023-11-27T18:36:51.874 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:25:12.952 38308== Warning: unimplemented fcntl command: 1036 2023-11-27T18:36:51.891 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:25:12.969 38308== Warning: unimplemented fcntl command: 1036 2023-11-27T18:36:51.997 INFO:tasks.ceph.mon.c.smithi094.stderr:==00:00:25:13.023 38307== Warning: unimplemented fcntl command: 1036 2023-11-27T18:36:52.015 INFO:tasks.ceph.mon.c.smithi094.stderr:==00:00:25:13.041 38307== Warning: unimplemented fcntl command: 1036 2023-11-27T18:36:52.043 INFO:tasks.ceph.mon.b.smithi094.stderr:==00:00:25:13.068 38305== Warning: unimplemented fcntl command: 1036 2023-11-27T18:36:52.056 INFO:tasks.ceph.mon.b.smithi094.stderr:==00:00:25:13.082 38305== Warning: unimplemented fcntl command: 1036 2023-11-27T18:36:52.079 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:25:13.157 38308== Warning: unimplemented fcntl command: 1036 2023-11-27T18:36:52.137 INFO:tasks.ceph.mon.c.smithi094.stderr:==00:00:25:13.163 38307== Warning: unimplemented fcntl command: 1036 2023-11-27T18:36:52.182 INFO:tasks.ceph.mon.b.smithi094.stderr:==00:00:25:13.208 38305== Warning: unimplemented fcntl command: 1036 2023-11-27T18:36:52.432 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1184 0.25 MB/sec execute 417 sec latency 5492.622 ms 2023-11-27T18:36:53.432 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1186 0.25 MB/sec execute 418 sec latency 4693.837 ms 2023-11-27T18:36:54.433 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1188 0.25 MB/sec execute 419 sec latency 4628.170 ms 2023-11-27T18:36:55.432 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1189 0.25 MB/sec execute 420 sec latency 3403.750 ms 2023-11-27T18:36:56.432 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1191 0.25 MB/sec execute 421 sec latency 4389.174 ms 2023-11-27T18:36:57.432 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1191 0.25 MB/sec execute 422 sec latency 4895.177 ms 2023-11-27T18:36:58.432 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1192 0.25 MB/sec execute 423 sec latency 4980.257 ms 2023-11-27T18:36:59.432 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1194 0.25 MB/sec execute 424 sec latency 5519.776 ms 2023-11-27T18:36:59.783 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:36:59.786 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:37:00.432 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1194 0.25 MB/sec execute 425 sec latency 4181.542 ms 2023-11-27T18:37:01.432 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1195 0.25 MB/sec execute 426 sec latency 4770.020 ms 2023-11-27T18:37:02.433 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1197 0.25 MB/sec execute 427 sec latency 4520.323 ms 2023-11-27T18:37:03.433 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1198 0.25 MB/sec execute 428 sec latency 4870.515 ms 2023-11-27T18:37:04.433 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1199 0.25 MB/sec execute 429 sec latency 5275.988 ms 2023-11-27T18:37:05.433 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1202 0.25 MB/sec execute 430 sec latency 1271.642 ms 2023-11-27T18:37:06.433 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1205 0.25 MB/sec execute 431 sec latency 2079.123 ms 2023-11-27T18:37:07.433 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1207 0.25 MB/sec execute 432 sec latency 2059.756 ms 2023-11-27T18:37:08.433 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1210 0.25 MB/sec execute 433 sec latency 1763.001 ms 2023-11-27T18:37:09.433 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1213 0.25 MB/sec execute 434 sec latency 2283.131 ms 2023-11-27T18:37:10.433 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1217 0.24 MB/sec execute 435 sec latency 1882.526 ms 2023-11-27T18:37:11.433 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1219 0.24 MB/sec execute 436 sec latency 1507.789 ms 2023-11-27T18:37:12.433 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1221 0.24 MB/sec execute 437 sec latency 2284.936 ms 2023-11-27T18:37:13.433 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1223 0.24 MB/sec execute 438 sec latency 3285.014 ms 2023-11-27T18:37:14.433 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1224 0.24 MB/sec execute 439 sec latency 4285.088 ms 2023-11-27T18:37:15.434 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1225 0.24 MB/sec execute 440 sec latency 4345.916 ms 2023-11-27T18:37:16.434 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1227 0.24 MB/sec execute 441 sec latency 3442.842 ms 2023-11-27T18:37:17.434 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1228 0.24 MB/sec execute 442 sec latency 4442.900 ms 2023-11-27T18:37:18.434 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1229 0.24 MB/sec execute 443 sec latency 4986.148 ms 2023-11-27T18:37:19.434 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1231 0.24 MB/sec execute 444 sec latency 5313.539 ms 2023-11-27T18:37:20.434 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1233 0.24 MB/sec execute 445 sec latency 5503.677 ms 2023-11-27T18:37:21.434 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1233 0.24 MB/sec execute 446 sec latency 5595.809 ms 2023-11-27T18:37:22.434 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1234 0.24 MB/sec execute 447 sec latency 5883.880 ms 2023-11-27T18:37:23.434 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1235 0.24 MB/sec execute 448 sec latency 6106.325 ms 2023-11-27T18:37:24.434 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1238 0.24 MB/sec execute 449 sec latency 5677.926 ms 2023-11-27T18:37:25.434 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1241 0.24 MB/sec execute 450 sec latency 6175.941 ms 2023-11-27T18:37:26.435 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1244 0.24 MB/sec execute 451 sec latency 6037.352 ms 2023-11-27T18:37:27.434 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1244 0.24 MB/sec execute 452 sec latency 7037.416 ms 2023-11-27T18:37:28.434 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1246 0.24 MB/sec execute 453 sec latency 7872.163 ms 2023-11-27T18:37:29.435 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1248 0.24 MB/sec execute 454 sec latency 4438.943 ms 2023-11-27T18:37:29.854 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:37:29.858 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:37:30.435 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1250 0.23 MB/sec execute 455 sec latency 5439.027 ms 2023-11-27T18:37:31.435 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1251 0.23 MB/sec execute 456 sec latency 6439.131 ms 2023-11-27T18:37:32.435 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1254 0.23 MB/sec execute 457 sec latency 7439.213 ms 2023-11-27T18:37:33.435 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1256 0.23 MB/sec execute 458 sec latency 7983.311 ms 2023-11-27T18:37:34.435 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1257 0.23 MB/sec execute 459 sec latency 5790.900 ms 2023-11-27T18:37:35.435 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1259 0.23 MB/sec execute 460 sec latency 6142.549 ms 2023-11-27T18:37:36.435 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1260 0.23 MB/sec execute 461 sec latency 5749.287 ms 2023-11-27T18:37:37.435 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1263 0.23 MB/sec execute 462 sec latency 6749.344 ms 2023-11-27T18:37:38.435 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1269 0.24 MB/sec execute 463 sec latency 7523.472 ms 2023-11-27T18:37:39.435 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1271 0.24 MB/sec execute 464 sec latency 6601.384 ms 2023-11-27T18:37:40.436 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1274 0.24 MB/sec execute 465 sec latency 6613.257 ms 2023-11-27T18:37:41.436 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1280 0.24 MB/sec execute 466 sec latency 7083.594 ms 2023-11-27T18:37:42.436 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1282 0.24 MB/sec execute 467 sec latency 6712.369 ms 2023-11-27T18:37:43.436 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1283 0.24 MB/sec execute 468 sec latency 4664.832 ms 2023-11-27T18:37:44.436 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1285 0.24 MB/sec execute 469 sec latency 4766.452 ms 2023-11-27T18:37:45.436 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1286 0.24 MB/sec execute 470 sec latency 3634.703 ms 2023-11-27T18:37:46.436 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1288 0.24 MB/sec execute 471 sec latency 4197.735 ms 2023-11-27T18:37:47.436 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1290 0.24 MB/sec execute 472 sec latency 4427.991 ms 2023-11-27T18:37:48.436 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1293 0.24 MB/sec execute 473 sec latency 4898.756 ms 2023-11-27T18:37:49.436 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1295 0.24 MB/sec execute 474 sec latency 5514.731 ms 2023-11-27T18:37:50.436 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1298 0.24 MB/sec execute 475 sec latency 5790.473 ms 2023-11-27T18:37:51.436 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1299 0.24 MB/sec execute 476 sec latency 6762.884 ms 2023-11-27T18:37:52.436 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1300 0.24 MB/sec execute 477 sec latency 7223.381 ms 2023-11-27T18:37:53.437 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1309 0.24 MB/sec execute 478 sec latency 5295.194 ms 2023-11-27T18:37:54.437 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1309 0.24 MB/sec execute 479 sec latency 6295.293 ms 2023-11-27T18:37:55.437 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1309 0.24 MB/sec execute 480 sec latency 6487.810 ms 2023-11-27T18:37:56.437 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1309 0.24 MB/sec execute 481 sec latency 7183.568 ms 2023-11-27T18:37:57.437 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1310 0.24 MB/sec execute 482 sec latency 7835.956 ms 2023-11-27T18:37:58.437 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1319 0.25 MB/sec execute 483 sec latency 7990.335 ms 2023-11-27T18:37:59.437 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1320 0.25 MB/sec execute 484 sec latency 5134.213 ms 2023-11-27T18:37:59.901 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:37:59.904 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:38:00.437 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1320 0.24 MB/sec execute 485 sec latency 5117.169 ms 2023-11-27T18:38:01.437 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1320 0.24 MB/sec execute 486 sec latency 3664.033 ms 2023-11-27T18:38:02.437 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1321 0.24 MB/sec execute 487 sec latency 3717.822 ms 2023-11-27T18:38:03.437 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1322 0.24 MB/sec execute 488 sec latency 3532.544 ms 2023-11-27T18:38:04.437 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1323 0.24 MB/sec execute 489 sec latency 4320.515 ms 2023-11-27T18:38:05.438 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1323 0.24 MB/sec execute 490 sec latency 4007.473 ms 2023-11-27T18:38:06.438 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1323 0.24 MB/sec execute 491 sec latency 5007.544 ms 2023-11-27T18:38:07.438 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1325 0.24 MB/sec execute 492 sec latency 5378.904 ms 2023-11-27T18:38:07.798 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:26:28.876 38308== Warning: unimplemented fcntl command: 1036 2023-11-27T18:38:07.893 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:26:28.971 38308== Warning: unimplemented fcntl command: 1036 2023-11-27T18:38:08.084 INFO:tasks.ceph.mon.c.smithi094.stderr:==00:00:26:29.110 38307== Warning: unimplemented fcntl command: 1036 2023-11-27T18:38:08.091 INFO:tasks.ceph.mon.c.smithi094.stderr:==00:00:26:29.117 38307== Warning: unimplemented fcntl command: 1036 2023-11-27T18:38:08.092 INFO:tasks.ceph.mon.b.smithi094.stderr:==00:00:26:29.118 38305== Warning: unimplemented fcntl command: 1036 2023-11-27T18:38:08.133 INFO:tasks.ceph.mon.b.smithi094.stderr:==00:00:26:29.159 38305== Warning: unimplemented fcntl command: 1036 2023-11-27T18:38:08.183 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:26:29.261 38308== Warning: unimplemented fcntl command: 1036 2023-11-27T18:38:08.253 INFO:tasks.ceph.mon.c.smithi094.stderr:==00:00:26:29.279 38307== Warning: unimplemented fcntl command: 1036 2023-11-27T18:38:08.306 INFO:tasks.ceph.mon.b.smithi094.stderr:==00:00:26:29.333 38305== Warning: unimplemented fcntl command: 1036 2023-11-27T18:38:08.438 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1326 0.24 MB/sec execute 493 sec latency 4526.086 ms 2023-11-27T18:38:09.438 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1335 0.25 MB/sec execute 494 sec latency 4947.402 ms 2023-11-27T18:38:10.438 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1336 0.25 MB/sec execute 495 sec latency 4955.749 ms 2023-11-27T18:38:11.438 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1344 0.25 MB/sec execute 496 sec latency 4340.813 ms 2023-11-27T18:38:12.438 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1349 0.25 MB/sec execute 497 sec latency 4389.318 ms 2023-11-27T18:38:13.439 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1376 0.27 MB/sec execute 498 sec latency 4166.643 ms 2023-11-27T18:38:14.438 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1384 0.27 MB/sec execute 499 sec latency 4357.250 ms 2023-11-27T18:38:15.438 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1385 0.27 MB/sec execute 500 sec latency 4445.809 ms 2023-11-27T18:38:16.438 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1386 0.27 MB/sec execute 501 sec latency 5445.905 ms 2023-11-27T18:38:17.439 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1387 0.27 MB/sec execute 502 sec latency 5515.558 ms 2023-11-27T18:38:18.439 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1387 0.27 MB/sec execute 503 sec latency 4855.164 ms 2023-11-27T18:38:19.439 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1388 0.27 MB/sec execute 504 sec latency 4878.780 ms 2023-11-27T18:38:20.439 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1388 0.27 MB/sec execute 505 sec latency 4833.766 ms 2023-11-27T18:38:21.439 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1389 0.27 MB/sec execute 506 sec latency 4320.771 ms 2023-11-27T18:38:22.439 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1389 0.27 MB/sec execute 507 sec latency 4590.389 ms 2023-11-27T18:38:23.439 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1391 0.27 MB/sec execute 508 sec latency 5344.678 ms 2023-11-27T18:38:24.439 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1391 0.27 MB/sec execute 509 sec latency 5255.974 ms 2023-11-27T18:38:25.439 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1394 0.27 MB/sec execute 510 sec latency 4579.597 ms 2023-11-27T18:38:26.439 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1396 0.27 MB/sec execute 511 sec latency 5198.688 ms 2023-11-27T18:38:27.439 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1396 0.27 MB/sec execute 512 sec latency 4998.939 ms 2023-11-27T18:38:28.440 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1397 0.26 MB/sec execute 513 sec latency 5777.166 ms 2023-11-27T18:38:29.440 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1399 0.26 MB/sec execute 514 sec latency 4230.759 ms 2023-11-27T18:38:29.978 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:38:29.981 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:38:30.440 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1400 0.26 MB/sec execute 515 sec latency 5129.477 ms 2023-11-27T18:38:31.440 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1400 0.26 MB/sec execute 516 sec latency 5587.815 ms 2023-11-27T18:38:32.440 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1402 0.26 MB/sec execute 517 sec latency 5714.475 ms 2023-11-27T18:38:33.440 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1403 0.26 MB/sec execute 518 sec latency 4576.762 ms 2023-11-27T18:38:34.440 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1405 0.26 MB/sec execute 519 sec latency 4779.380 ms 2023-11-27T18:38:35.440 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1406 0.26 MB/sec execute 520 sec latency 2892.666 ms 2023-11-27T18:38:36.440 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1406 0.26 MB/sec execute 521 sec latency 3892.726 ms 2023-11-27T18:38:37.440 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1408 0.26 MB/sec execute 522 sec latency 4892.795 ms 2023-11-27T18:38:38.441 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1409 0.26 MB/sec execute 523 sec latency 5680.330 ms 2023-11-27T18:38:39.440 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1410 0.26 MB/sec execute 524 sec latency 5440.599 ms 2023-11-27T18:38:40.440 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1413 0.26 MB/sec execute 525 sec latency 2118.083 ms 2023-11-27T18:38:41.440 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1415 0.26 MB/sec execute 526 sec latency 3118.200 ms 2023-11-27T18:38:45.974 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1416 0.26 MB/sec execute 527 sec latency 4118.297 ms 2023-11-27T18:38:45.975 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1417 0.26 MB/sec execute 528 sec latency 5118.392 ms 2023-11-27T18:38:45.975 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1420 0.26 MB/sec execute 529 sec latency 5232.896 ms 2023-11-27T18:38:45.975 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1420 0.26 MB/sec execute 530 sec latency 5711.179 ms 2023-11-27T18:38:46.441 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1421 0.26 MB/sec execute 531 sec latency 2671.796 ms 2023-11-27T18:38:47.441 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1421 0.26 MB/sec execute 532 sec latency 3671.859 ms 2023-11-27T18:38:48.441 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1423 0.26 MB/sec execute 533 sec latency 4671.905 ms 2023-11-27T18:38:49.441 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1423 0.25 MB/sec execute 534 sec latency 5671.989 ms 2023-11-27T18:38:50.441 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1425 0.25 MB/sec execute 535 sec latency 6093.183 ms 2023-11-27T18:38:51.441 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1427 0.25 MB/sec execute 536 sec latency 6455.989 ms 2023-11-27T18:38:52.441 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1428 0.25 MB/sec execute 537 sec latency 6842.151 ms 2023-11-27T18:38:53.441 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1431 0.25 MB/sec execute 538 sec latency 4658.862 ms 2023-11-27T18:38:54.441 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1432 0.25 MB/sec execute 539 sec latency 4350.780 ms 2023-11-27T18:38:55.441 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1434 0.25 MB/sec execute 540 sec latency 4357.696 ms 2023-11-27T18:38:56.441 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1437 0.25 MB/sec execute 541 sec latency 3964.640 ms 2023-11-27T18:38:57.441 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1440 0.25 MB/sec execute 542 sec latency 1725.651 ms 2023-11-27T18:38:58.442 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1442 0.25 MB/sec execute 543 sec latency 2012.338 ms 2023-11-27T18:38:59.442 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1442 0.25 MB/sec execute 544 sec latency 3012.403 ms 2023-11-27T18:39:00.141 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:39:00.144 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:39:00.442 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1444 0.25 MB/sec execute 545 sec latency 3765.270 ms 2023-11-27T18:39:01.442 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1446 0.25 MB/sec execute 546 sec latency 4320.786 ms 2023-11-27T18:39:02.442 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1446 0.25 MB/sec execute 547 sec latency 4838.220 ms 2023-11-27T18:39:03.442 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1447 0.25 MB/sec execute 548 sec latency 5449.565 ms 2023-11-27T18:39:04.442 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1448 0.25 MB/sec execute 549 sec latency 4938.156 ms 2023-11-27T18:39:05.442 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1450 0.25 MB/sec execute 550 sec latency 4957.877 ms 2023-11-27T18:39:06.442 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1452 0.25 MB/sec execute 551 sec latency 4488.108 ms 2023-11-27T18:39:07.443 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1453 0.25 MB/sec execute 552 sec latency 5488.238 ms 2023-11-27T18:39:08.443 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1453 0.25 MB/sec execute 553 sec latency 6488.338 ms 2023-11-27T18:39:09.443 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1454 0.25 MB/sec execute 554 sec latency 7488.432 ms 2023-11-27T18:39:10.443 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1456 0.25 MB/sec execute 555 sec latency 7713.695 ms 2023-11-27T18:39:11.443 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1461 0.24 MB/sec execute 556 sec latency 6925.456 ms 2023-11-27T18:39:12.443 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1463 0.24 MB/sec execute 557 sec latency 7474.787 ms 2023-11-27T18:39:13.443 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1464 0.24 MB/sec execute 558 sec latency 7420.375 ms 2023-11-27T18:39:14.443 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1466 0.24 MB/sec execute 559 sec latency 7946.280 ms 2023-11-27T18:39:15.443 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1467 0.24 MB/sec execute 560 sec latency 2692.957 ms 2023-11-27T18:39:16.446 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1469 0.24 MB/sec execute 561 sec latency 3693.067 ms 2023-11-27T18:39:17.443 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1469 0.24 MB/sec execute 562 sec latency 4693.172 ms 2023-11-27T18:39:18.443 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1469 0.24 MB/sec execute 563 sec latency 5693.285 ms 2023-11-27T18:39:19.444 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1470 0.24 MB/sec execute 564 sec latency 6693.343 ms 2023-11-27T18:39:20.444 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1470 0.24 MB/sec execute 565 sec latency 7516.819 ms 2023-11-27T18:39:21.444 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1471 0.24 MB/sec execute 566 sec latency 7279.179 ms 2023-11-27T18:39:22.444 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1472 0.24 MB/sec execute 567 sec latency 7465.420 ms 2023-11-27T18:39:23.444 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1474 0.24 MB/sec execute 568 sec latency 7675.784 ms 2023-11-27T18:39:24.444 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1476 0.24 MB/sec execute 569 sec latency 3960.177 ms 2023-11-27T18:39:25.444 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1478 0.24 MB/sec execute 570 sec latency 4090.933 ms 2023-11-27T18:39:26.444 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1479 0.24 MB/sec execute 571 sec latency 2975.329 ms 2023-11-27T18:39:27.444 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1480 0.24 MB/sec execute 572 sec latency 3975.430 ms 2023-11-27T18:39:28.444 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1481 0.24 MB/sec execute 573 sec latency 4975.502 ms 2023-11-27T18:39:29.444 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1482 0.24 MB/sec execute 574 sec latency 5156.176 ms 2023-11-27T18:39:30.337 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:39:30.340 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:39:30.444 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1484 0.24 MB/sec execute 575 sec latency 5556.165 ms 2023-11-27T18:39:31.444 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1487 0.24 MB/sec execute 576 sec latency 1312.150 ms 2023-11-27T18:39:32.445 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1488 0.24 MB/sec execute 577 sec latency 1487.076 ms 2023-11-27T18:39:33.445 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1490 0.24 MB/sec execute 578 sec latency 1792.161 ms 2023-11-27T18:39:34.591 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1490 0.24 MB/sec execute 579 sec latency 2792.263 ms 2023-11-27T18:39:35.280 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:27:56.359 38308== Warning: unimplemented fcntl command: 1036 2023-11-27T18:39:35.398 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:27:56.477 38308== Warning: unimplemented fcntl command: 1036 2023-11-27T18:39:35.445 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1491 0.24 MB/sec execute 580 sec latency 3792.397 ms 2023-11-27T18:39:35.480 INFO:tasks.ceph.mon.c.smithi094.stderr:==00:00:27:56.507 38307== Warning: unimplemented fcntl command: 1036 2023-11-27T18:39:35.522 INFO:tasks.ceph.mon.b.smithi094.stderr:==00:00:27:56.548 38305== Warning: unimplemented fcntl command: 1036 2023-11-27T18:39:35.528 INFO:tasks.ceph.mon.b.smithi094.stderr:==00:00:27:56.555 38305== Warning: unimplemented fcntl command: 1036 2023-11-27T18:39:35.632 INFO:tasks.ceph.mon.c.smithi094.stderr:==00:00:27:56.659 38307== Warning: unimplemented fcntl command: 1036 2023-11-27T18:39:35.639 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:27:56.718 38308== Warning: unimplemented fcntl command: 1036 2023-11-27T18:39:35.712 INFO:tasks.ceph.mon.b.smithi094.stderr:==00:00:27:56.738 38305== Warning: unimplemented fcntl command: 1036 2023-11-27T18:39:35.865 INFO:tasks.ceph.mon.c.smithi094.stderr:==00:00:27:56.892 38307== Warning: unimplemented fcntl command: 1036 2023-11-27T18:39:36.445 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1491 0.23 MB/sec execute 581 sec latency 4595.542 ms 2023-11-27T18:39:37.445 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1495 0.23 MB/sec execute 582 sec latency 4980.381 ms 2023-11-27T18:39:38.445 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1498 0.23 MB/sec execute 583 sec latency 1252.045 ms 2023-11-27T18:39:39.445 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1501 0.23 MB/sec execute 584 sec latency 1462.155 ms 2023-11-27T18:39:40.445 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1503 0.23 MB/sec execute 585 sec latency 2462.216 ms 2023-11-27T18:39:41.445 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1505 0.23 MB/sec execute 586 sec latency 3462.319 ms 2023-11-27T18:39:42.445 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1505 0.23 MB/sec execute 587 sec latency 4462.425 ms 2023-11-27T18:39:43.445 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1506 0.23 MB/sec execute 588 sec latency 5169.116 ms 2023-11-27T18:39:44.445 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1507 0.23 MB/sec execute 589 sec latency 5499.654 ms 2023-11-27T18:39:45.445 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1508 0.23 MB/sec execute 590 sec latency 4769.991 ms 2023-11-27T18:39:46.446 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1508 0.23 MB/sec execute 591 sec latency 5657.585 ms 2023-11-27T18:39:47.446 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1508 0.23 MB/sec execute 592 sec latency 6657.690 ms 2023-11-27T18:39:48.447 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1509 0.23 MB/sec execute 593 sec latency 6974.874 ms 2023-11-27T18:39:49.446 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1511 0.23 MB/sec execute 594 sec latency 5732.145 ms 2023-11-27T18:39:50.446 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1512 0.23 MB/sec execute 595 sec latency 6173.111 ms 2023-11-27T18:39:51.446 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1513 0.23 MB/sec execute 596 sec latency 4217.735 ms 2023-11-27T18:39:52.446 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1515 0.23 MB/sec execute 597 sec latency 1821.816 ms 2023-11-27T18:39:53.446 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1516 0.23 MB/sec execute 598 sec latency 2151.768 ms 2023-11-27T18:39:54.446 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1518 0.23 MB/sec execute 599 sec latency 3151.835 ms 2023-11-27T18:39:55.447 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 600 sec 2023-11-27T18:39:56.447 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 601 sec 2023-11-27T18:39:57.447 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 602 sec 2023-11-27T18:39:58.447 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 603 sec 2023-11-27T18:39:59.447 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 604 sec 2023-11-27T18:40:00.390 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:40:00.393 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:40:00.447 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 605 sec 2023-11-27T18:40:01.447 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 606 sec 2023-11-27T18:40:02.447 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 607 sec 2023-11-27T18:40:03.447 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 608 sec 2023-11-27T18:40:04.447 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 609 sec 2023-11-27T18:40:05.447 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 610 sec 2023-11-27T18:40:06.447 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 611 sec 2023-11-27T18:40:07.447 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 612 sec 2023-11-27T18:40:08.447 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 613 sec 2023-11-27T18:40:09.447 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 614 sec 2023-11-27T18:40:10.448 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 615 sec 2023-11-27T18:40:11.448 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 616 sec 2023-11-27T18:40:12.448 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 617 sec 2023-11-27T18:40:13.448 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 618 sec 2023-11-27T18:40:14.448 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 619 sec 2023-11-27T18:40:15.448 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 620 sec 2023-11-27T18:40:16.448 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 621 sec 2023-11-27T18:40:17.448 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 622 sec 2023-11-27T18:40:18.448 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 623 sec 2023-11-27T18:40:19.448 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 624 sec 2023-11-27T18:40:20.448 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 625 sec 2023-11-27T18:40:21.448 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 626 sec 2023-11-27T18:40:22.448 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 627 sec 2023-11-27T18:40:23.448 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 628 sec 2023-11-27T18:40:24.449 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 629 sec 2023-11-27T18:40:25.449 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 630 sec 2023-11-27T18:40:26.449 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 631 sec 2023-11-27T18:40:27.449 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 632 sec 2023-11-27T18:40:28.449 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 633 sec 2023-11-27T18:40:29.449 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 634 sec 2023-11-27T18:40:30.449 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 635 sec 2023-11-27T18:40:30.455 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:40:30.458 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:40:31.449 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 636 sec 2023-11-27T18:40:32.449 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 637 sec 2023-11-27T18:40:33.449 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 638 sec 2023-11-27T18:40:34.449 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 639 sec 2023-11-27T18:40:35.450 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 640 sec 2023-11-27T18:40:36.450 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 641 sec 2023-11-27T18:40:37.450 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 642 sec 2023-11-27T18:40:38.450 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 643 sec 2023-11-27T18:40:39.450 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 644 sec 2023-11-27T18:40:40.450 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 645 sec 2023-11-27T18:40:41.450 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 646 sec 2023-11-27T18:40:42.450 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 647 sec 2023-11-27T18:40:43.450 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 648 sec 2023-11-27T18:40:44.450 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 649 sec 2023-11-27T18:40:45.451 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 650 sec 2023-11-27T18:40:46.451 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 651 sec 2023-11-27T18:40:47.451 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 652 sec 2023-11-27T18:40:48.451 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 653 sec 2023-11-27T18:40:49.451 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 654 sec 2023-11-27T18:40:50.451 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 655 sec 2023-11-27T18:40:51.451 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 656 sec 2023-11-27T18:40:52.451 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 657 sec 2023-11-27T18:40:53.451 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 658 sec 2023-11-27T18:40:54.451 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 659 sec 2023-11-27T18:40:55.451 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 660 sec 2023-11-27T18:40:56.451 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 661 sec 2023-11-27T18:40:57.451 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 662 sec 2023-11-27T18:40:58.451 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 663 sec 2023-11-27T18:40:59.451 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 664 sec 2023-11-27T18:41:00.452 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 665 sec 2023-11-27T18:41:04.349 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:41:04.351 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 666 sec 2023-11-27T18:41:04.351 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 667 sec 2023-11-27T18:41:04.351 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 668 sec 2023-11-27T18:41:04.354 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:41:04.452 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 669 sec 2023-11-27T18:41:05.452 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 670 sec 2023-11-27T18:41:06.452 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 671 sec 2023-11-27T18:41:07.453 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 672 sec 2023-11-27T18:41:08.452 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 673 sec 2023-11-27T18:41:09.452 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 674 sec 2023-11-27T18:41:10.453 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 675 sec 2023-11-27T18:41:11.453 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 676 sec 2023-11-27T18:41:12.453 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 677 sec 2023-11-27T18:41:13.453 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 678 sec 2023-11-27T18:41:14.453 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 679 sec 2023-11-27T18:41:15.453 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 680 sec 2023-11-27T18:41:16.453 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 681 sec 2023-11-27T18:41:17.453 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 682 sec 2023-11-27T18:41:18.453 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 683 sec 2023-11-27T18:41:19.454 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 684 sec 2023-11-27T18:41:20.454 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 685 sec 2023-11-27T18:41:21.454 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 686 sec 2023-11-27T18:41:22.454 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 687 sec 2023-11-27T18:41:23.454 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 688 sec 2023-11-27T18:41:24.454 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 689 sec 2023-11-27T18:41:25.454 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 690 sec 2023-11-27T18:41:26.454 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 691 sec 2023-11-27T18:41:27.454 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 692 sec 2023-11-27T18:41:28.454 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 693 sec 2023-11-27T18:41:29.454 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 694 sec 2023-11-27T18:41:30.454 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 695 sec 2023-11-27T18:41:31.454 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 696 sec 2023-11-27T18:41:32.455 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 697 sec 2023-11-27T18:41:33.455 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 698 sec 2023-11-27T18:41:34.455 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 699 sec 2023-11-27T18:41:34.511 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:41:34.514 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:41:35.455 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 700 sec 2023-11-27T18:41:36.455 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 701 sec 2023-11-27T18:41:37.456 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 702 sec 2023-11-27T18:41:38.455 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 703 sec 2023-11-27T18:41:39.455 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 704 sec 2023-11-27T18:41:40.455 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 705 sec 2023-11-27T18:41:41.456 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 706 sec 2023-11-27T18:41:42.456 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 707 sec 2023-11-27T18:41:43.456 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 708 sec 2023-11-27T18:41:44.456 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 709 sec 2023-11-27T18:41:45.456 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 710 sec 2023-11-27T18:41:46.456 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 711 sec 2023-11-27T18:41:47.456 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 712 sec 2023-11-27T18:41:48.456 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 713 sec 2023-11-27T18:41:49.456 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 714 sec 2023-11-27T18:41:50.456 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 715 sec 2023-11-27T18:41:51.456 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 716 sec 2023-11-27T18:41:52.456 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 717 sec 2023-11-27T18:41:53.457 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 718 sec 2023-11-27T18:41:54.457 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 719 sec 2023-11-27T18:41:55.457 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 720 sec 2023-11-27T18:41:56.457 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 721 sec 2023-11-27T18:41:57.457 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 722 sec 2023-11-27T18:41:58.457 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 723 sec 2023-11-27T18:41:59.457 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 724 sec 2023-11-27T18:42:00.457 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 725 sec 2023-11-27T18:42:01.457 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 726 sec 2023-11-27T18:42:02.457 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 727 sec 2023-11-27T18:42:03.458 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 728 sec 2023-11-27T18:42:04.458 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 729 sec 2023-11-27T18:42:04.552 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:42:04.554 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:42:05.458 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 730 sec 2023-11-27T18:42:06.458 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 731 sec 2023-11-27T18:42:07.458 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 732 sec 2023-11-27T18:42:08.458 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 733 sec 2023-11-27T18:42:09.458 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 734 sec 2023-11-27T18:42:10.458 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 735 sec 2023-11-27T18:42:11.459 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 736 sec 2023-11-27T18:42:12.459 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 737 sec 2023-11-27T18:42:13.459 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 738 sec 2023-11-27T18:42:14.459 INFO:tasks.workunit.client.0.smithi091.stdout: 9 cleanup 739 sec 2023-11-27T18:42:15.459 INFO:tasks.workunit.client.0.smithi091.stdout: 7 cleanup 740 sec 2023-11-27T18:42:16.459 INFO:tasks.workunit.client.0.smithi091.stdout: 6 cleanup 741 sec 2023-11-27T18:42:17.460 INFO:tasks.workunit.client.0.smithi091.stdout: 3 cleanup 742 sec 2023-11-27T18:42:18.459 INFO:tasks.workunit.client.0.smithi091.stdout: 2 cleanup 743 sec 2023-11-27T18:42:19.459 INFO:tasks.workunit.client.0.smithi091.stdout: 2 cleanup 744 sec 2023-11-27T18:42:20.459 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 745 sec 2023-11-27T18:42:20.935 INFO:tasks.workunit.client.0.smithi091.stdout: 0 cleanup 746 sec 2023-11-27T18:42:20.935 INFO:tasks.workunit.client.0.smithi091.stdout: 2023-11-27T18:42:20.935 INFO:tasks.workunit.client.0.smithi091.stdout: Operation Count AvgLat MaxLat 2023-11-27T18:42:20.936 INFO:tasks.workunit.client.0.smithi091.stdout: ---------------------------------------- 2023-11-27T18:42:20.936 INFO:tasks.workunit.client.0.smithi091.stdout: NTCreateX 1738 1102.211 4272.554 2023-11-27T18:42:20.936 INFO:tasks.workunit.client.0.smithi091.stdout: Close 1506 9.961 102.296 2023-11-27T18:42:20.936 INFO:tasks.workunit.client.0.smithi091.stdout: Rename 100 2185.291 3788.535 2023-11-27T18:42:20.936 INFO:tasks.workunit.client.0.smithi091.stdout: Unlink 197 727.299 1769.741 2023-11-27T18:42:20.936 INFO:tasks.workunit.client.0.smithi091.stdout: Qpathinfo 1200 547.083 3637.603 2023-11-27T18:42:20.936 INFO:tasks.workunit.client.0.smithi091.stdout: Qfileinfo 599 32.468 168.684 2023-11-27T18:42:20.936 INFO:tasks.workunit.client.0.smithi091.stdout: Qfsinfo 330 128.073 1262.766 2023-11-27T18:42:20.937 INFO:tasks.workunit.client.0.smithi091.stdout: Sfileinfo 340 200.143 490.367 2023-11-27T18:42:20.937 INFO:tasks.workunit.client.0.smithi091.stdout: Find 530 5020.847 7990.320 2023-11-27T18:42:20.937 INFO:tasks.workunit.client.0.smithi091.stdout: WriteX 2630 50.556 1373.377 2023-11-27T18:42:20.937 INFO:tasks.workunit.client.0.smithi091.stdout: ReadX 2354 0.338 130.401 2023-11-27T18:42:20.937 INFO:tasks.workunit.client.0.smithi091.stdout: Flush 250 599.301 2075.702 2023-11-27T18:42:20.937 INFO:tasks.workunit.client.0.smithi091.stdout: 2023-11-27T18:42:20.937 INFO:tasks.workunit.client.0.smithi091.stdout:Throughput 0.227903 MB/sec 10 clients 10 procs max_latency=7990.335 ms 2023-11-27T18:42:20.938 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-11-27T18:42:20.939 DEBUG:teuthology.orchestra.run.smithi091:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-11-27T18:42:34.678 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:42:34.684 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:43:02.684 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:31:23.762 38308== Warning: unimplemented fcntl command: 1036 2023-11-27T18:43:02.817 INFO:tasks.ceph.mon.c.smithi094.stderr:==00:00:31:23.843 38307== Warning: unimplemented fcntl command: 1036 2023-11-27T18:43:02.845 INFO:tasks.ceph.mon.c.smithi094.stderr:==00:00:31:23.871 38307== Warning: unimplemented fcntl command: 1036 2023-11-27T18:43:02.895 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:31:23.973 38308== Warning: unimplemented fcntl command: 1036 2023-11-27T18:43:02.979 INFO:tasks.ceph.mon.b.smithi094.stderr:==00:00:31:24.005 38305== Warning: unimplemented fcntl command: 1036 2023-11-27T18:43:03.000 INFO:tasks.ceph.mon.b.smithi094.stderr:==00:00:31:24.026 38305== Warning: unimplemented fcntl command: 1036 2023-11-27T18:43:03.304 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:31:24.382 38308== Warning: unimplemented fcntl command: 1036 2023-11-27T18:43:03.348 INFO:tasks.ceph.mon.b.smithi094.stderr:==00:00:31:24.374 38305== Warning: unimplemented fcntl command: 1036 2023-11-27T18:43:03.356 INFO:tasks.ceph.mon.c.smithi094.stderr:==00:00:31:24.383 38307== Warning: unimplemented fcntl command: 1036 2023-11-27T18:43:05.009 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:43:10.594 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:43:12.561 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.0... 2023-11-27T18:43:12.561 DEBUG:teuthology.orchestra.run.smithi091:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-11-27T18:43:12.865 DEBUG:teuthology.parallel:result is None 2023-11-27T18:43:12.866 DEBUG:teuthology.orchestra.run.smithi091:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-11-27T18:43:13.268 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-11-27T18:43:13.268 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-11-27T18:43:13.283 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-11-27T18:43:13.283 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T18:43:13.283 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T18:43:13.290 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T18:43:13.290 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T18:43:13.337 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T18:43:13.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.504+0000 7faa14b65640 1 Processor -- start 2023-11-27T18:43:13.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.504+0000 7faa14b65640 1 -- start start 2023-11-27T18:43:13.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.508+0000 7faa14b65640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa101504c0 0x7faa1015a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:13.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.508+0000 7faa14b65640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7faa101508a0 0x7faa100c6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:13.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.508+0000 7faa14b65640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa1015a900 con 0x7faa100c8610 2023-11-27T18:43:13.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.508+0000 7faa14b65640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa100c1b10 con 0x7faa101504c0 2023-11-27T18:43:13.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.508+0000 7faa14b65640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa101563c0 con 0x7faa101508a0 2023-11-27T18:43:13.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.508+0000 7faa0e59c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa101504c0 0x7faa1015a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:13.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.508+0000 7faa0dd9b640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7faa100c8610 0x7faa10071f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:34956/0 (socket says 172.21.15.91:34956) 2023-11-27T18:43:13.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.508+0000 7faa0dd9b640 1 -- 172.21.15.91:0/3285549040 learned_addr learned my addr 172.21.15.91:0/3285549040 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:43:13.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.508+0000 7faa0ed9d640 1 --2- 172.21.15.91:0/3285549040 >> v2:172.21.15.94:3300/0 conn(0x7faa101508a0 0x7faa100c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:13.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.512+0000 7faa0e59c640 1 -- 172.21.15.91:0/3285549040 >> v2:172.21.15.94:3300/0 conn(0x7faa101508a0 msgr2=0x7faa100c6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:13.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.512+0000 7faa0e59c640 1 --2- 172.21.15.91:0/3285549040 >> v2:172.21.15.94:3300/0 conn(0x7faa101508a0 0x7faa100c6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:13.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.512+0000 7faa0e59c640 1 -- 172.21.15.91:0/3285549040 >> v1:172.21.15.91:6789/0 conn(0x7faa100c8610 legacy=0x7faa10071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:13.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.512+0000 7faa0e59c640 1 -- 172.21.15.91:0/3285549040 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa100c6200 con 0x7faa101504c0 2023-11-27T18:43:13.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.520+0000 7faa0e59c640 1 --2- 172.21.15.91:0/3285549040 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faa101504c0 0x7faa1015a3c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7faa10070da0 tx=0x7faa00020e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f9d4ddd62519f14 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:13.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.524+0000 7faa0d59a640 1 -- 172.21.15.91:0/3285549040 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa000aab60 con 0x7faa101504c0 2023-11-27T18:43:13.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.524+0000 7faa0d59a640 1 -- 172.21.15.91:0/3285549040 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa000aacc0 con 0x7faa101504c0 2023-11-27T18:43:13.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.524+0000 7faa0d59a640 1 -- 172.21.15.91:0/3285549040 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa000b2660 con 0x7faa101504c0 2023-11-27T18:43:13.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.524+0000 7faa14b65640 1 -- 172.21.15.91:0/3285549040 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faa101504c0 msgr2=0x7faa1015a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:13.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.524+0000 7faa14b65640 1 --2- 172.21.15.91:0/3285549040 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faa101504c0 0x7faa1015a3c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7faa10070da0 tx=0x7faa00020e60 comp rx=0 tx=0).stop 2023-11-27T18:43:13.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.524+0000 7faa14b65640 1 -- 172.21.15.91:0/3285549040 shutdown_connections 2023-11-27T18:43:13.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.524+0000 7faa14b65640 1 --2- 172.21.15.91:0/3285549040 >> v2:172.21.15.94:3300/0 conn(0x7faa101508a0 0x7faa100c6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:13.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.524+0000 7faa14b65640 1 --2- 172.21.15.91:0/3285549040 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faa101504c0 0x7faa1015a3c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:13.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.524+0000 7faa14b65640 1 -- 172.21.15.91:0/3285549040 >> 172.21.15.91:0/3285549040 conn(0x7faa100c79b0 msgr2=0x7faa100c7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:13.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.524+0000 7faa14b65640 1 -- 172.21.15.91:0/3285549040 shutdown_connections 2023-11-27T18:43:13.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.524+0000 7faa14b65640 1 -- 172.21.15.91:0/3285549040 wait complete. 2023-11-27T18:43:13.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.524+0000 7faa14b65640 1 Processor -- start 2023-11-27T18:43:13.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.524+0000 7faa14b65640 1 -- start start 2023-11-27T18:43:13.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.528+0000 7faa14b65640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faa100c8610 0x7faa10071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:13.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.528+0000 7faa14b65640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faa101504c0 0x7faa101531b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:13.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.528+0000 7faa14b65640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faa101508a0 0x7faa1014f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:13.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.528+0000 7faa14b65640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa1014ee60 con 0x7faa100c8610 2023-11-27T18:43:13.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.528+0000 7faa14b65640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa10153ba0 con 0x7faa101504c0 2023-11-27T18:43:13.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.528+0000 7faa14b65640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa100afa30 con 0x7faa101508a0 2023-11-27T18:43:13.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.528+0000 7faa0e59c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faa100c8610 0x7faa10071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:13.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.528+0000 7faa0e59c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faa100c8610 0x7faa10071fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41030/0 (socket says 172.21.15.91:41030) 2023-11-27T18:43:13.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.528+0000 7faa0e59c640 1 -- 172.21.15.91:0/1385392320 learned_addr learned my addr 172.21.15.91:0/1385392320 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:13.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.528+0000 7faa0ed9d640 1 --2- 172.21.15.91:0/1385392320 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faa101508a0 0x7faa1014f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:13.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.528+0000 7faa0dd9b640 1 --2- 172.21.15.91:0/1385392320 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faa101504c0 0x7faa101531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:13.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.532+0000 7faa0e59c640 1 -- 172.21.15.91:0/1385392320 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faa101508a0 msgr2=0x7faa1014f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:13.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.532+0000 7faa0e59c640 1 --2- 172.21.15.91:0/1385392320 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faa101508a0 0x7faa1014f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:13.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.532+0000 7faa0e59c640 1 -- 172.21.15.91:0/1385392320 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faa101504c0 msgr2=0x7faa101531b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:13.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.532+0000 7faa0e59c640 1 --2- 172.21.15.91:0/1385392320 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faa101504c0 0x7faa101531b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:13.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.532+0000 7faa0e59c640 1 -- 172.21.15.91:0/1385392320 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa00009420 con 0x7faa100c8610 2023-11-27T18:43:13.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.532+0000 7faa0e59c640 1 --2- 172.21.15.91:0/1385392320 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faa100c8610 0x7faa10071fc0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7faa000b5040 tx=0x7faa0001dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:13.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.536+0000 7fa9feffd640 1 -- 172.21.15.91:0/1385392320 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa000b2dd0 con 0x7faa100c8610 2023-11-27T18:43:13.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.536+0000 7fa9feffd640 1 -- 172.21.15.91:0/1385392320 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa00006e20 con 0x7faa100c8610 2023-11-27T18:43:13.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.536+0000 7faa14b65640 1 -- 172.21.15.91:0/1385392320 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa100afd10 con 0x7faa100c8610 2023-11-27T18:43:13.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.536+0000 7fa9feffd640 1 -- 172.21.15.91:0/1385392320 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa000bb690 con 0x7faa100c8610 2023-11-27T18:43:13.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.540+0000 7faa14b65640 1 -- 172.21.15.91:0/1385392320 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa100b02d0 con 0x7faa100c8610 2023-11-27T18:43:13.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.540+0000 7faa14b65640 1 -- 172.21.15.91:0/1385392320 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa100b04c0 con 0x7faa100c8610 2023-11-27T18:43:13.827 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.824+0000 7fa9feffd640 1 -- 172.21.15.91:0/1385392320 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7faa000c43b0 con 0x7faa100c8610 2023-11-27T18:43:13.828 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.828+0000 7fa9feffd640 1 --2- 172.21.15.91:0/1385392320 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa9f0066870 0x7fa9f0068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:13.828 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.828+0000 7faa0dd9b640 1 --2- 172.21.15.91:0/1385392320 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa9f0066870 0x7fa9f0068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:13.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.828+0000 7faa0dd9b640 1 --2- 172.21.15.91:0/1385392320 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa9f0066870 0x7fa9f0068d30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7faa1014d970 tx=0x7faa04009040 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:13.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.864+0000 7fa9feffd640 1 -- 172.21.15.91:0/1385392320 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6547+0+0 (secure 0 0 0) 0x7faa000f29a0 con 0x7faa100c8610 2023-11-27T18:43:13.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:13.864+0000 7fa9feffd640 1 -- 172.21.15.91:0/1385392320 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7faa000eece0 con 0x7faa100c8610 2023-11-27T18:43:14.036 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.036+0000 7faa14b65640 1 -- 172.21.15.91:0/1385392320 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa100b04c0 con 0x7faa100c8610 2023-11-27T18:43:14.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.168+0000 7fa9feffd640 1 -- 172.21.15.91:0/1385392320 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+18421 (secure 0 0 0) 0x7faa100b04c0 con 0x7faa100c8610 2023-11-27T18:43:14.169 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:43:14.169 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":32,"fsid":"08c8ebbf-7936-4c41-a995-d5600de2d072","created":"2023-11-27T18:12:06.484593+0000","modified":"2023-11-27T18:14:21.835068+0000","last_up_change":"2023-11-27T18:12:33.154694+0000","last_in_change":"2023-11-27T18:12:23.622113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T18:12:35.450305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T18:13:09.589619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T18:13:11.439236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-27T18:13:18.514694+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ad53c08-dd19-4ae6-87c5-fa15bea3b4ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6811","nonce":472303992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6813","nonce":472303992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6817","nonce":472303992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6815","nonce":472303992}]},"public_addr":"172.21.15.91:6811/472303992","cluster_addr":"172.21.15.91:6813/472303992","heartbeat_back_addr":"172.21.15.91:6817/472303992","heartbeat_front_addr":"172.21.15.91:6815/472303992","state":["exists","up"]},{"osd":1,"uuid":"f8b5f147-ed29-4329-a787-a12cc34a2569","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6827","nonce":12316911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6829","nonce":12316911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6833","nonce":12316911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6831","nonce":12316911}]},"public_addr":"172.21.15.91:6827/12316911","cluster_addr":"172.21.15.91:6829/12316911","heartbeat_back_addr":"172.21.15.91:6833/12316911","heartbeat_front_addr":"172.21.15.91:6831/12316911","state":["exists","up"]},{"osd":2,"uuid":"c3029f9a-1c48-4f5d-983a-172a614d8795","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6803","nonce":3776125919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6805","nonce":3776125919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6809","nonce":3776125919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6807","nonce":3776125919}]},"public_addr":"172.21.15.91:6803/3776125919","cluster_addr":"172.21.15.91:6805/3776125919","heartbeat_back_addr":"172.21.15.91:6809/3776125919","heartbeat_front_addr":"172.21.15.91:6807/3776125919","state":["exists","up"]},{"osd":3,"uuid":"ab4b6fb2-0126-491b-9224-54a6badc5da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6819","nonce":1297704794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6821","nonce":1297704794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6825","nonce":1297704794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6823","nonce":1297704794}]},"public_addr":"172.21.15.91:6819/1297704794","cluster_addr":"172.21.15.91:6821/1297704794","heartbeat_back_addr":"172.21.15.91:6825/1297704794","heartbeat_front_addr":"172.21.15.91:6823/1297704794","state":["exists","up"]},{"osd":4,"uuid":"695071a8-2de8-4cba-bf20-050021a03bb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6809","nonce":2501531833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6811","nonce":2501531833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6815","nonce":2501531833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6813","nonce":2501531833}]},"public_addr":"172.21.15.94:6809/2501531833","cluster_addr":"172.21.15.94:6811/2501531833","heartbeat_back_addr":"172.21.15.94:6815/2501531833","heartbeat_front_addr":"172.21.15.94:6813/2501531833","state":["exists","up"]},{"osd":5,"uuid":"ca01da14-a700-4845-8db2-f5e3370677e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6817","nonce":2448969592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6819","nonce":2448969592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6823","nonce":2448969592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6821","nonce":2448969592}]},"public_addr":"172.21.15.94:6817/2448969592","cluster_addr":"172.21.15.94:6819/2448969592","heartbeat_back_addr":"172.21.15.94:6823/2448969592","heartbeat_front_addr":"172.21.15.94:6821/2448969592","state":["exists","up"]},{"osd":6,"uuid":"4784bc77-6c33-4e47-abba-d37484982f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6825","nonce":3389553935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6827","nonce":3389553935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6831","nonce":3389553935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6829","nonce":3389553935}]},"public_addr":"172.21.15.94:6825/3389553935","cluster_addr":"172.21.15.94:6827/3389553935","heartbeat_back_addr":"172.21.15.94:6831/3389553935","heartbeat_front_addr":"172.21.15.94:6829/3389553935","state":["exists","up"]},{"osd":7,"uuid":"b954cf3f-4a4f-4a75-9f90-014f72c16d15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6801","nonce":1606498064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6803","nonce":1606498064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6807","nonce":1606498064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6805","nonce":1606498064}]},"public_addr":"172.21.15.94:6801/1606498064","cluster_addr":"172.21.15.94:6803/1606498064","heartbeat_back_addr":"172.21.15.94:6807/1606498064","heartbeat_front_addr":"172.21.15.94:6805/1606498064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.534968+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.506182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.339267+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.532432+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:28.935756+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.471559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.485014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.352978+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":0,"to":7}]},{"pgid":"4.d","mappings":[{"from":3,"to":0}]},{"pgid":"4.1d","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T18:43:14.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.172+0000 7faa14b65640 1 -- 172.21.15.91:0/1385392320 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa9f0066870 msgr2=0x7fa9f0068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:14.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.172+0000 7faa14b65640 1 --2- 172.21.15.91:0/1385392320 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa9f0066870 0x7fa9f0068d30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7faa1014d970 tx=0x7faa04009040 comp rx=0 tx=0).stop 2023-11-27T18:43:14.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.172+0000 7faa14b65640 1 -- 172.21.15.91:0/1385392320 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faa100c8610 msgr2=0x7faa10071fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:14.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.172+0000 7faa14b65640 1 --2- 172.21.15.91:0/1385392320 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faa100c8610 0x7faa10071fc0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7faa000b5040 tx=0x7faa0001dc00 comp rx=0 tx=0).stop 2023-11-27T18:43:14.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.172+0000 7faa14b65640 1 -- 172.21.15.91:0/1385392320 shutdown_connections 2023-11-27T18:43:14.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.172+0000 7faa14b65640 1 --2- 172.21.15.91:0/1385392320 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa9f0066870 0x7fa9f0068d30 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:14.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.172+0000 7faa14b65640 1 --2- 172.21.15.91:0/1385392320 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faa101508a0 0x7faa1014f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:14.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.172+0000 7faa14b65640 1 --2- 172.21.15.91:0/1385392320 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faa101504c0 0x7faa101531b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:14.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.172+0000 7faa14b65640 1 --2- 172.21.15.91:0/1385392320 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faa100c8610 0x7faa10071fc0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:14.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.172+0000 7faa14b65640 1 -- 172.21.15.91:0/1385392320 >> 172.21.15.91:0/1385392320 conn(0x7faa100c79b0 msgr2=0x7faa101591f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:14.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.172+0000 7faa14b65640 1 -- 172.21.15.91:0/1385392320 shutdown_connections 2023-11-27T18:43:14.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.172+0000 7faa14b65640 1 -- 172.21.15.91:0/1385392320 wait complete. 2023-11-27T18:43:14.197 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T18:12:35.450305+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T18:13:09.589619+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T18:13:11.439236+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-27T18:13:18.514694+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-27T18:43:14.198 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T18:43:14.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.336+0000 7fe62e88c640 1 Processor -- start 2023-11-27T18:43:14.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.336+0000 7fe62e88c640 1 -- start start 2023-11-27T18:43:14.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.340+0000 7fe62e88c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fe6280c5730 0x7fe628072230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:14.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.340+0000 7fe62e88c640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe6280c6e10 0x7fe628072770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:14.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.340+0000 7fe62e88c640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe628070100 con 0x7fe62814fef0 2023-11-27T18:43:14.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.340+0000 7fe62e88c640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6280c2ad0 con 0x7fe6280c5730 2023-11-27T18:43:14.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.340+0000 7fe62e88c640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6280c2d70 con 0x7fe6280c6e10 2023-11-27T18:43:14.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.340+0000 7fe6277fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fe6280c5730 0x7fe628072230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:14.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.340+0000 7fe62ce29640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe6280c6e10 0x7fe628072770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:14.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.340+0000 7fe6277fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fe6280c5730 0x7fe628072230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41038/0 (socket says 172.21.15.91:41038) 2023-11-27T18:43:14.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.340+0000 7fe6277fe640 1 -- 172.21.15.91:0/2182099287 learned_addr learned my addr 172.21.15.91:0/2182099287 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:14.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.344+0000 7fe6277fe640 1 -- 172.21.15.91:0/2182099287 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe6280c6e10 msgr2=0x7fe628072770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:14.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.344+0000 7fe6277fe640 1 --2- 172.21.15.91:0/2182099287 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe6280c6e10 0x7fe628072770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:14.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.344+0000 7fe6277fe640 1 -- 172.21.15.91:0/2182099287 >> v1:172.21.15.94:6789/0 conn(0x7fe62814fef0 legacy=0x7fe6280c5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:14.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.344+0000 7fe6277fe640 1 -- 172.21.15.91:0/2182099287 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6280c4770 con 0x7fe6280c5730 2023-11-27T18:43:14.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.348+0000 7fe6277fe640 1 --2- 172.21.15.91:0/2182099287 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe6280c5730 0x7fe628072230 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe618009870 tx=0x7fe61801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7c0429bbfac82e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:14.352 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.352+0000 7fe626ffd640 1 -- 172.21.15.91:0/2182099287 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6180ab600 con 0x7fe6280c5730 2023-11-27T18:43:14.353 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.352+0000 7fe626ffd640 1 -- 172.21.15.91:0/2182099287 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6180a7050 con 0x7fe6280c5730 2023-11-27T18:43:14.353 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.352+0000 7fe626ffd640 1 -- 172.21.15.91:0/2182099287 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6180ab980 con 0x7fe6280c5730 2023-11-27T18:43:14.353 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.352+0000 7fe62e88c640 1 -- 172.21.15.91:0/2182099287 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe6280c5730 msgr2=0x7fe628072230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:14.353 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.352+0000 7fe62e88c640 1 --2- 172.21.15.91:0/2182099287 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe6280c5730 0x7fe628072230 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe618009870 tx=0x7fe61801c470 comp rx=0 tx=0).stop 2023-11-27T18:43:14.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.352+0000 7fe62e88c640 1 -- 172.21.15.91:0/2182099287 shutdown_connections 2023-11-27T18:43:14.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.352+0000 7fe62e88c640 1 --2- 172.21.15.91:0/2182099287 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe6280c6e10 0x7fe628072770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:14.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.352+0000 7fe62e88c640 1 --2- 172.21.15.91:0/2182099287 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe6280c5730 0x7fe628072230 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:14.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.352+0000 7fe62e88c640 1 -- 172.21.15.91:0/2182099287 >> 172.21.15.91:0/2182099287 conn(0x7fe628071740 msgr2=0x7fe628071b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:14.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.352+0000 7fe62e88c640 1 -- 172.21.15.91:0/2182099287 shutdown_connections 2023-11-27T18:43:14.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.352+0000 7fe62e88c640 1 -- 172.21.15.91:0/2182099287 wait complete. 2023-11-27T18:43:14.355 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.352+0000 7fe62e88c640 1 Processor -- start 2023-11-27T18:43:14.355 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.352+0000 7fe62e88c640 1 -- start start 2023-11-27T18:43:14.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.352+0000 7fe62e88c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6280c5730 0x7fe628141330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:14.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.352+0000 7fe62e88c640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe6280c6e10 0x7fe6281f03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:14.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.352+0000 7fe62e88c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe62814fef0 0x7fe62813eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:14.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.352+0000 7fe62e88c640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe628141ed0 con 0x7fe62814fef0 2023-11-27T18:43:14.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.356+0000 7fe62e88c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6281efcb0 con 0x7fe6280c5730 2023-11-27T18:43:14.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.356+0000 7fe62e88c640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe628141cd0 con 0x7fe6280c6e10 2023-11-27T18:43:14.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.356+0000 7fe62ce29640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe62814fef0 0x7fe62813eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:14.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.356+0000 7fe62ce29640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe62814fef0 0x7fe62813eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41042/0 (socket says 172.21.15.91:41042) 2023-11-27T18:43:14.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.356+0000 7fe62ce29640 1 -- 172.21.15.91:0/1216295679 learned_addr learned my addr 172.21.15.91:0/1216295679 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:14.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.356+0000 7fe6277fe640 1 --2- 172.21.15.91:0/1216295679 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe6280c6e10 0x7fe6281f03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:14.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.360+0000 7fe62ce29640 1 -- 172.21.15.91:0/1216295679 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe6280c6e10 msgr2=0x7fe6281f03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:14.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.360+0000 7fe62ce29640 1 --2- 172.21.15.91:0/1216295679 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe6280c6e10 0x7fe6281f03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:14.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.360+0000 7fe62ce29640 1 -- 172.21.15.91:0/1216295679 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6280c5730 msgr2=0x7fe628141330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:14.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.360+0000 7fe62ce29640 1 --2- 172.21.15.91:0/1216295679 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6280c5730 0x7fe628141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:14.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.360+0000 7fe62ce29640 1 -- 172.21.15.91:0/1216295679 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6180094d0 con 0x7fe62814fef0 2023-11-27T18:43:14.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.360+0000 7fe62ce29640 1 --2- 172.21.15.91:0/1216295679 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe62814fef0 0x7fe62813eaf0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe62000efc0 tx=0x7fe62000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:14.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.364+0000 7fe624ff9640 1 -- 172.21.15.91:0/1216295679 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe620014480 con 0x7fe62814fef0 2023-11-27T18:43:14.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.364+0000 7fe624ff9640 1 -- 172.21.15.91:0/1216295679 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe62000f040 con 0x7fe62814fef0 2023-11-27T18:43:14.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.364+0000 7fe624ff9640 1 -- 172.21.15.91:0/1216295679 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe620014820 con 0x7fe62814fef0 2023-11-27T18:43:14.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.364+0000 7fe62e88c640 1 -- 172.21.15.91:0/1216295679 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6281f3db0 con 0x7fe62814fef0 2023-11-27T18:43:14.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.364+0000 7fe62e88c640 1 -- 172.21.15.91:0/1216295679 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6280c9fd0 con 0x7fe62814fef0 2023-11-27T18:43:14.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.368+0000 7fe62e88c640 1 -- 172.21.15.91:0/1216295679 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe62804e850 con 0x7fe62814fef0 2023-11-27T18:43:14.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.648+0000 7fe624ff9640 1 -- 172.21.15.91:0/1216295679 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fe620014980 con 0x7fe62814fef0 2023-11-27T18:43:14.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.648+0000 7fe624ff9640 1 --2- 172.21.15.91:0/1216295679 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe614066870 0x7fe614068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:14.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.652+0000 7fe627fff640 1 --2- 172.21.15.91:0/1216295679 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe614066870 0x7fe614068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:14.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.652+0000 7fe627fff640 1 --2- 172.21.15.91:0/1216295679 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe614066870 0x7fe614068d30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe61c009650 tx=0x7fe61c006bb0 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:14.726 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.724+0000 7fe624ff9640 1 -- 172.21.15.91:0/1216295679 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe6200569b0 con 0x7fe62814fef0 2023-11-27T18:43:14.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.724+0000 7fe624ff9640 1 -- 172.21.15.91:0/1216295679 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fe6200525f0 con 0x7fe62814fef0 2023-11-27T18:43:14.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.892+0000 7fe62e88c640 1 -- 172.21.15.91:0/1216295679 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe6281600f0 con 0x7fe62814fef0 2023-11-27T18:43:14.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.932+0000 7fe624ff9640 1 -- 172.21.15.91:0/1216295679 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe620018070 con 0x7fe62814fef0 2023-11-27T18:43:14.934 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 1 2023-11-27T18:43:14.937 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.936+0000 7fe62e88c640 1 -- 172.21.15.91:0/1216295679 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe614066870 msgr2=0x7fe614068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:14.937 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.936+0000 7fe62e88c640 1 --2- 172.21.15.91:0/1216295679 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe614066870 0x7fe614068d30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe61c009650 tx=0x7fe61c006bb0 comp rx=0 tx=0).stop 2023-11-27T18:43:14.937 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.936+0000 7fe62e88c640 1 -- 172.21.15.91:0/1216295679 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe62814fef0 msgr2=0x7fe62813eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:14.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.936+0000 7fe62e88c640 1 --2- 172.21.15.91:0/1216295679 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe62814fef0 0x7fe62813eaf0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe62000efc0 tx=0x7fe62000c490 comp rx=0 tx=0).stop 2023-11-27T18:43:14.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.936+0000 7fe62e88c640 1 -- 172.21.15.91:0/1216295679 shutdown_connections 2023-11-27T18:43:14.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.936+0000 7fe62e88c640 1 --2- 172.21.15.91:0/1216295679 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe614066870 0x7fe614068d30 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:14.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.936+0000 7fe62e88c640 1 --2- 172.21.15.91:0/1216295679 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe6280c6e10 0x7fe6281f03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:14.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.936+0000 7fe62e88c640 1 --2- 172.21.15.91:0/1216295679 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe62814fef0 0x7fe62813eaf0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:14.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.936+0000 7fe62e88c640 1 --2- 172.21.15.91:0/1216295679 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6280c5730 0x7fe628141330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:14.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.936+0000 7fe62e88c640 1 -- 172.21.15.91:0/1216295679 >> 172.21.15.91:0/1216295679 conn(0x7fe628071740 msgr2=0x7fe62806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:14.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.936+0000 7fe62e88c640 1 -- 172.21.15.91:0/1216295679 shutdown_connections 2023-11-27T18:43:14.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:14.936+0000 7fe62e88c640 1 -- 172.21.15.91:0/1216295679 wait complete. 2023-11-27T18:43:14.956 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T18:43:15.084 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.084+0000 7f2cacdc4640 1 Processor -- start 2023-11-27T18:43:15.084 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.084+0000 7f2cacdc4640 1 -- start start 2023-11-27T18:43:15.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.084+0000 7f2cacdc4640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f2ca80c40e0 0x7f2ca80c44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:15.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.084+0000 7f2cacdc4640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2ca81576e0 0x7f2ca8157b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:15.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.084+0000 7f2cacdc4640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ca81580b0 con 0x7f2ca8072820 2023-11-27T18:43:15.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.084+0000 7f2cacdc4640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ca80c7090 con 0x7f2ca80c40e0 2023-11-27T18:43:15.086 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.084+0000 7f2cacdc4640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ca80c4a00 con 0x7f2ca81576e0 2023-11-27T18:43:15.086 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.084+0000 7f2ca659c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f2ca80c40e0 0x7f2ca80c44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:15.086 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.084+0000 7f2ca659c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f2ca80c40e0 0x7f2ca80c44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41048/0 (socket says 172.21.15.91:41048) 2023-11-27T18:43:15.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.084+0000 7f2ca6d9d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2ca81576e0 0x7f2ca8157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:15.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.084+0000 7f2ca659c640 1 -- 172.21.15.91:0/2229604827 learned_addr learned my addr 172.21.15.91:0/2229604827 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:15.089 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.088+0000 7f2ca659c640 1 -- 172.21.15.91:0/2229604827 >> v2:172.21.15.94:3300/0 conn(0x7f2ca81576e0 msgr2=0x7f2ca8157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:15.089 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.088+0000 7f2ca659c640 1 --2- 172.21.15.91:0/2229604827 >> v2:172.21.15.94:3300/0 conn(0x7f2ca81576e0 0x7f2ca8157b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:15.089 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.088+0000 7f2ca659c640 1 -- 172.21.15.91:0/2229604827 >> v1:172.21.15.94:6789/0 conn(0x7f2ca8072820 legacy=0x7f2ca806ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:15.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.088+0000 7f2ca659c640 1 -- 172.21.15.91:0/2229604827 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca815aa00 con 0x7f2ca80c40e0 2023-11-27T18:43:15.093 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.092+0000 7f2ca659c640 1 --2- 172.21.15.91:0/2229604827 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2ca80c40e0 0x7f2ca80c44c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2ca806ab40 tx=0x7f2c9801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c7f5a6c08161829 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:15.098 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.096+0000 7f2ca5d9b640 1 -- 172.21.15.91:0/2229604827 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c980aa620 con 0x7f2ca80c40e0 2023-11-27T18:43:15.098 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.096+0000 7f2ca5d9b640 1 -- 172.21.15.91:0/2229604827 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c980aa780 con 0x7f2ca80c40e0 2023-11-27T18:43:15.098 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.096+0000 7f2ca5d9b640 1 -- 172.21.15.91:0/2229604827 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c980aab10 con 0x7f2ca80c40e0 2023-11-27T18:43:15.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.096+0000 7f2cacdc4640 1 -- 172.21.15.91:0/2229604827 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2ca80c40e0 msgr2=0x7f2ca80c44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:15.100 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.096+0000 7f2cacdc4640 1 --2- 172.21.15.91:0/2229604827 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2ca80c40e0 0x7f2ca80c44c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2ca806ab40 tx=0x7f2c9801c4c0 comp rx=0 tx=0).stop 2023-11-27T18:43:15.100 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.096+0000 7f2cacdc4640 1 -- 172.21.15.91:0/2229604827 shutdown_connections 2023-11-27T18:43:15.100 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.096+0000 7f2cacdc4640 1 --2- 172.21.15.91:0/2229604827 >> v2:172.21.15.94:3300/0 conn(0x7f2ca81576e0 0x7f2ca8157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:15.100 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.096+0000 7f2cacdc4640 1 --2- 172.21.15.91:0/2229604827 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2ca80c40e0 0x7f2ca80c44c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:15.100 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.096+0000 7f2cacdc4640 1 -- 172.21.15.91:0/2229604827 >> 172.21.15.91:0/2229604827 conn(0x7f2ca80ca9d0 msgr2=0x7f2ca80cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:15.100 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.096+0000 7f2cacdc4640 1 -- 172.21.15.91:0/2229604827 shutdown_connections 2023-11-27T18:43:15.100 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.096+0000 7f2cacdc4640 1 -- 172.21.15.91:0/2229604827 wait complete. 2023-11-27T18:43:15.100 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.100+0000 7f2cacdc4640 1 Processor -- start 2023-11-27T18:43:15.101 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.100+0000 7f2cacdc4640 1 -- start start 2023-11-27T18:43:15.101 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.100+0000 7f2cacdc4640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2ca8072820 0x7f2ca814b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:15.102 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.100+0000 7f2cacdc4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2ca80c40e0 0x7f2ca80bf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:15.102 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.100+0000 7f2cacdc4640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2ca81576e0 0x7f2ca80c92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:15.102 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.100+0000 7f2cacdc4640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca8150ed0 con 0x7f2ca8072820 2023-11-27T18:43:15.102 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.100+0000 7f2cacdc4640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca814aa90 con 0x7f2ca80c40e0 2023-11-27T18:43:15.102 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.100+0000 7f2cacdc4640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca814bbf0 con 0x7f2ca81576e0 2023-11-27T18:43:15.102 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.100+0000 7f2ca659c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2ca8072820 0x7f2ca814b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:15.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.100+0000 7f2ca659c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2ca8072820 0x7f2ca814b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41050/0 (socket says 172.21.15.91:41050) 2023-11-27T18:43:15.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.100+0000 7f2ca659c640 1 -- 172.21.15.91:0/872136816 learned_addr learned my addr 172.21.15.91:0/872136816 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:15.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.100+0000 7f2ca6d9d640 1 --2- 172.21.15.91:0/872136816 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2ca81576e0 0x7f2ca80c92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:15.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.100+0000 7f2c9ffff640 1 --2- 172.21.15.91:0/872136816 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2ca80c40e0 0x7f2ca80bf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:15.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.104+0000 7f2ca659c640 1 -- 172.21.15.91:0/872136816 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2ca81576e0 msgr2=0x7f2ca80c92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:15.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.104+0000 7f2ca659c640 1 --2- 172.21.15.91:0/872136816 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2ca81576e0 0x7f2ca80c92a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:15.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.104+0000 7f2ca659c640 1 -- 172.21.15.91:0/872136816 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2ca80c40e0 msgr2=0x7f2ca80bf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:15.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.104+0000 7f2ca659c640 1 --2- 172.21.15.91:0/872136816 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2ca80c40e0 0x7f2ca80bf3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:15.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.104+0000 7f2ca659c640 1 -- 172.21.15.91:0/872136816 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c980094d0 con 0x7f2ca8072820 2023-11-27T18:43:15.109 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.108+0000 7f2ca659c640 1 --2- 172.21.15.91:0/872136816 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2ca8072820 0x7f2ca814b6b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2c9801ab70 tx=0x7f2c9801ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:15.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.112+0000 7f2c9effd640 1 -- 172.21.15.91:0/872136816 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c980aadc0 con 0x7f2ca8072820 2023-11-27T18:43:15.114 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.112+0000 7f2c9effd640 1 -- 172.21.15.91:0/872136816 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c980bd3f0 con 0x7f2ca8072820 2023-11-27T18:43:15.114 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.112+0000 7f2c9effd640 1 -- 172.21.15.91:0/872136816 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c980bd7a0 con 0x7f2ca8072820 2023-11-27T18:43:15.115 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.112+0000 7f2cacdc4640 1 -- 172.21.15.91:0/872136816 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ca80bf910 con 0x7f2ca8072820 2023-11-27T18:43:15.115 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.112+0000 7f2cacdc4640 1 -- 172.21.15.91:0/872136816 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ca814a160 con 0x7f2ca8072820 2023-11-27T18:43:15.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.112+0000 7f2cacdc4640 1 -- 172.21.15.91:0/872136816 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ca804e850 con 0x7f2ca8072820 2023-11-27T18:43:15.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.396+0000 7f2c9effd640 1 -- 172.21.15.91:0/872136816 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f2c980c7420 con 0x7f2ca8072820 2023-11-27T18:43:15.397 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.396+0000 7f2c9effd640 1 --2- 172.21.15.91:0/872136816 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f2c88066870 0x7f2c88068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:15.397 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.396+0000 7f2c9ffff640 1 --2- 172.21.15.91:0/872136816 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f2c88066870 0x7f2c88068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:15.398 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.396+0000 7f2c9ffff640 1 --2- 172.21.15.91:0/872136816 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f2c88066870 0x7f2c88068d30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8154070 tx=0x7f2c90009040 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:15.415 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.412+0000 7f2c9effd640 1 -- 172.21.15.91:0/872136816 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f2c980ef6f0 con 0x7f2ca8072820 2023-11-27T18:43:15.416 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.416+0000 7f2c9effd640 1 -- 172.21.15.91:0/872136816 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f2c980eba30 con 0x7f2ca8072820 2023-11-27T18:43:15.579 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.576+0000 7f2cacdc4640 1 -- 172.21.15.91:0/872136816 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2ca8070e90 con 0x7f2ca8072820 2023-11-27T18:43:15.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.644+0000 7f2c9effd640 1 -- 172.21.15.91:0/872136816 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v32) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2c980ef050 con 0x7f2ca8072820 2023-11-27T18:43:15.648 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T18:43:15.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.648+0000 7f2cacdc4640 1 -- 172.21.15.91:0/872136816 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f2c88066870 msgr2=0x7f2c88068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:15.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.648+0000 7f2cacdc4640 1 --2- 172.21.15.91:0/872136816 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f2c88066870 0x7f2c88068d30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8154070 tx=0x7f2c90009040 comp rx=0 tx=0).stop 2023-11-27T18:43:15.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.648+0000 7f2cacdc4640 1 -- 172.21.15.91:0/872136816 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2ca8072820 msgr2=0x7f2ca814b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:15.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.648+0000 7f2cacdc4640 1 --2- 172.21.15.91:0/872136816 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2ca8072820 0x7f2ca814b6b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2c9801ab70 tx=0x7f2c9801ad00 comp rx=0 tx=0).stop 2023-11-27T18:43:15.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.648+0000 7f2cacdc4640 1 -- 172.21.15.91:0/872136816 shutdown_connections 2023-11-27T18:43:15.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.648+0000 7f2cacdc4640 1 --2- 172.21.15.91:0/872136816 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f2c88066870 0x7f2c88068d30 secure :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8154070 tx=0x7f2c90009040 comp rx=0 tx=0).stop 2023-11-27T18:43:15.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.648+0000 7f2cacdc4640 1 --2- 172.21.15.91:0/872136816 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2ca81576e0 0x7f2ca80c92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:15.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.648+0000 7f2cacdc4640 1 --2- 172.21.15.91:0/872136816 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2ca80c40e0 0x7f2ca80bf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:15.653 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.648+0000 7f2cacdc4640 1 --2- 172.21.15.91:0/872136816 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2ca8072820 0x7f2ca814b6b0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:15.653 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.648+0000 7f2cacdc4640 1 -- 172.21.15.91:0/872136816 >> 172.21.15.91:0/872136816 conn(0x7f2ca80ca9d0 msgr2=0x7f2ca8073720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:15.653 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.648+0000 7f2cacdc4640 1 -- 172.21.15.91:0/872136816 shutdown_connections 2023-11-27T18:43:15.653 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.648+0000 7f2cacdc4640 1 -- 172.21.15.91:0/872136816 wait complete. 2023-11-27T18:43:15.673 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T18:43:15.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.800+0000 7fa7816fb640 1 Processor -- start 2023-11-27T18:43:15.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.800+0000 7fa7816fb640 1 -- start start 2023-11-27T18:43:15.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.800+0000 7fa7816fb640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa77c072820 0x7fa77c0c44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:15.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.800+0000 7fa7816fb640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa77c1576e0 0x7fa77c157b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:15.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.800+0000 7fa7816fb640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa77c1580b0 con 0x7fa77c0c40e0 2023-11-27T18:43:15.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.800+0000 7fa7816fb640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa77c0c7090 con 0x7fa77c072820 2023-11-27T18:43:15.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.800+0000 7fa7816fb640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa77c0c4a00 con 0x7fa77c1576e0 2023-11-27T18:43:15.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.800+0000 7fa77a7fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa77c072820 0x7fa77c0c44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:15.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.800+0000 7fa77a7fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa77c072820 0x7fa77c0c44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41064/0 (socket says 172.21.15.91:41064) 2023-11-27T18:43:15.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.800+0000 7fa77a7fc640 1 -- 172.21.15.91:0/3721627349 learned_addr learned my addr 172.21.15.91:0/3721627349 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:15.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.804+0000 7fa77a7fc640 1 -- 172.21.15.91:0/3721627349 >> v2:172.21.15.94:3300/0 conn(0x7fa77c1576e0 msgr2=0x7fa77c157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:15.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.804+0000 7fa77a7fc640 1 --2- 172.21.15.91:0/3721627349 >> v2:172.21.15.94:3300/0 conn(0x7fa77c1576e0 0x7fa77c157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:15.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.804+0000 7fa77a7fc640 1 -- 172.21.15.91:0/3721627349 >> v1:172.21.15.94:6789/0 conn(0x7fa77c0c40e0 legacy=0x7fa77c06ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:15.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.804+0000 7fa77a7fc640 1 -- 172.21.15.91:0/3721627349 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa77c15aa00 con 0x7fa77c072820 2023-11-27T18:43:15.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.808+0000 7fa77a7fc640 1 --2- 172.21.15.91:0/3721627349 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa77c072820 0x7fa77c0c44c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa77c06ab40 tx=0x7fa77001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8192f8c5a9cb4a0b server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:15.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.812+0000 7fa779ffb640 1 -- 172.21.15.91:0/3721627349 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7700aa620 con 0x7fa77c072820 2023-11-27T18:43:15.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.812+0000 7fa779ffb640 1 -- 172.21.15.91:0/3721627349 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7700aa780 con 0x7fa77c072820 2023-11-27T18:43:15.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.812+0000 7fa779ffb640 1 -- 172.21.15.91:0/3721627349 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7700aab10 con 0x7fa77c072820 2023-11-27T18:43:15.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.812+0000 7fa7816fb640 1 -- 172.21.15.91:0/3721627349 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa77c072820 msgr2=0x7fa77c0c44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:15.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.812+0000 7fa7816fb640 1 --2- 172.21.15.91:0/3721627349 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa77c072820 0x7fa77c0c44c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa77c06ab40 tx=0x7fa77001c4c0 comp rx=0 tx=0).stop 2023-11-27T18:43:15.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.812+0000 7fa7816fb640 1 -- 172.21.15.91:0/3721627349 shutdown_connections 2023-11-27T18:43:15.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.812+0000 7fa7816fb640 1 --2- 172.21.15.91:0/3721627349 >> v2:172.21.15.94:3300/0 conn(0x7fa77c1576e0 0x7fa77c157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:15.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.812+0000 7fa7816fb640 1 --2- 172.21.15.91:0/3721627349 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa77c072820 0x7fa77c0c44c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:15.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.812+0000 7fa7816fb640 1 -- 172.21.15.91:0/3721627349 >> 172.21.15.91:0/3721627349 conn(0x7fa77c0ca9d0 msgr2=0x7fa77c0cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:15.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.812+0000 7fa7816fb640 1 -- 172.21.15.91:0/3721627349 shutdown_connections 2023-11-27T18:43:15.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.812+0000 7fa7816fb640 1 -- 172.21.15.91:0/3721627349 wait complete. 2023-11-27T18:43:15.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.816+0000 7fa7816fb640 1 Processor -- start 2023-11-27T18:43:15.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.816+0000 7fa7816fb640 1 -- start start 2023-11-27T18:43:15.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.816+0000 7fa7816fb640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa77c072820 0x7fa77c14f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:15.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.816+0000 7fa7816fb640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa77c0c40e0 0x7fa77c149a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:15.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.816+0000 7fa7816fb640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa77c1576e0 0x7fa77c149f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:15.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.816+0000 7fa7816fb640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa77c1f4420 con 0x7fa77c1576e0 2023-11-27T18:43:15.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.816+0000 7fa7816fb640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa77c1473a0 con 0x7fa77c072820 2023-11-27T18:43:15.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.816+0000 7fa7816fb640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa77c1f1440 con 0x7fa77c0c40e0 2023-11-27T18:43:15.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.816+0000 7fa77b7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa77c1576e0 0x7fa77c149f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:15.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.816+0000 7fa77b7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa77c1576e0 0x7fa77c149f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41078/0 (socket says 172.21.15.91:41078) 2023-11-27T18:43:15.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.816+0000 7fa77b7fe640 1 -- 172.21.15.91:0/3858840304 learned_addr learned my addr 172.21.15.91:0/3858840304 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:15.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.820+0000 7fa77b7fe640 1 -- 172.21.15.91:0/3858840304 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa77c0c40e0 msgr2=0x7fa77c149a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:15.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.820+0000 7fa77b7fe640 1 --2- 172.21.15.91:0/3858840304 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa77c0c40e0 0x7fa77c149a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:15.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.820+0000 7fa77b7fe640 1 -- 172.21.15.91:0/3858840304 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa77c072820 msgr2=0x7fa77c14f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:15.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.820+0000 7fa77b7fe640 1 --2- 172.21.15.91:0/3858840304 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa77c072820 0x7fa77c14f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:15.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.820+0000 7fa77b7fe640 1 -- 172.21.15.91:0/3858840304 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7700094d0 con 0x7fa77c1576e0 2023-11-27T18:43:15.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.824+0000 7fa77b7fe640 1 --2- 172.21.15.91:0/3858840304 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa77c1576e0 0x7fa77c149f60 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa77400b9a0 tx=0x7fa77400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:15.828 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.828+0000 7fa7637fe640 1 -- 172.21.15.91:0/3858840304 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77400cba0 con 0x7fa77c1576e0 2023-11-27T18:43:15.828 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.828+0000 7fa7637fe640 1 -- 172.21.15.91:0/3858840304 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa77400cd20 con 0x7fa77c1576e0 2023-11-27T18:43:15.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.828+0000 7fa7816fb640 1 -- 172.21.15.91:0/3858840304 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa77c06e6f0 con 0x7fa77c1576e0 2023-11-27T18:43:15.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.828+0000 7fa7637fe640 1 -- 172.21.15.91:0/3858840304 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa774014680 con 0x7fa77c1576e0 2023-11-27T18:43:15.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.828+0000 7fa7816fb640 1 -- 172.21.15.91:0/3858840304 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa77c06ecb0 con 0x7fa77c1576e0 2023-11-27T18:43:15.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.828+0000 7fa7816fb640 1 -- 172.21.15.91:0/3858840304 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa77c04e850 con 0x7fa77c1576e0 2023-11-27T18:43:15.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.848+0000 7fa7637fe640 1 -- 172.21.15.91:0/3858840304 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fa77401d3b0 con 0x7fa77c1576e0 2023-11-27T18:43:15.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.848+0000 7fa7637fe640 1 --2- 172.21.15.91:0/3858840304 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa768066840 0x7fa768068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:15.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.848+0000 7fa77affd640 1 --2- 172.21.15.91:0/3858840304 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa768066840 0x7fa768068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:15.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.848+0000 7fa77affd640 1 --2- 172.21.15.91:0/3858840304 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa768066840 0x7fa768068d00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa76c007fd0 tx=0x7fa76c0079a0 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:15.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:15.852+0000 7fa7637fe640 1 -- 172.21.15.91:0/3858840304 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa774055b50 con 0x7fa77c1576e0 2023-11-27T18:43:16.127 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.124+0000 7fa7637fe640 1 -- 172.21.15.91:0/3858840304 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fa774051790 con 0x7fa77c1576e0 2023-11-27T18:43:16.300 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.296+0000 7fa7816fb640 1 -- 172.21.15.91:0/3858840304 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa77c070e90 con 0x7fa77c1576e0 2023-11-27T18:43:16.306 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.304+0000 7fa7637fe640 1 -- 172.21.15.91:0/3858840304 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v32) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa774019020 con 0x7fa77c1576e0 2023-11-27T18:43:16.307 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-11-27T18:43:16.309 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.308+0000 7fa7816fb640 1 -- 172.21.15.91:0/3858840304 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa768066840 msgr2=0x7fa768068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:16.309 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.308+0000 7fa7816fb640 1 --2- 172.21.15.91:0/3858840304 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa768066840 0x7fa768068d00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa76c007fd0 tx=0x7fa76c0079a0 comp rx=0 tx=0).stop 2023-11-27T18:43:16.309 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.308+0000 7fa7816fb640 1 -- 172.21.15.91:0/3858840304 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa77c1576e0 msgr2=0x7fa77c149f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:16.309 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.308+0000 7fa7816fb640 1 --2- 172.21.15.91:0/3858840304 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa77c1576e0 0x7fa77c149f60 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa77400b9a0 tx=0x7fa77400be60 comp rx=0 tx=0).stop 2023-11-27T18:43:16.309 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.308+0000 7fa7816fb640 1 -- 172.21.15.91:0/3858840304 shutdown_connections 2023-11-27T18:43:16.309 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.308+0000 7fa7816fb640 1 --2- 172.21.15.91:0/3858840304 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa768066840 0x7fa768068d00 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:16.309 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.308+0000 7fa7816fb640 1 --2- 172.21.15.91:0/3858840304 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa77c0c40e0 0x7fa77c149a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:16.309 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.308+0000 7fa7816fb640 1 --2- 172.21.15.91:0/3858840304 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa77c1576e0 0x7fa77c149f60 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:16.309 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.308+0000 7fa7816fb640 1 --2- 172.21.15.91:0/3858840304 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa77c072820 0x7fa77c14f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:16.310 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.308+0000 7fa7816fb640 1 -- 172.21.15.91:0/3858840304 >> 172.21.15.91:0/3858840304 conn(0x7fa77c0ca9d0 msgr2=0x7fa77c0c7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:16.310 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.308+0000 7fa7816fb640 1 -- 172.21.15.91:0/3858840304 shutdown_connections 2023-11-27T18:43:16.310 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.308+0000 7fa7816fb640 1 -- 172.21.15.91:0/3858840304 wait complete. 2023-11-27T18:43:16.326 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-27T18:43:16.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.452+0000 7f9b81d39640 1 Processor -- start 2023-11-27T18:43:16.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.452+0000 7f9b81d39640 1 -- start start 2023-11-27T18:43:16.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.452+0000 7f9b81d39640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9b7c072820 0x7f9b7c0c44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:16.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.452+0000 7f9b81d39640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f9b7c1576e0 0x7f9b7c157b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:16.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.452+0000 7f9b81d39640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b7c1580b0 con 0x7f9b7c0c40e0 2023-11-27T18:43:16.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.452+0000 7f9b81d39640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b7c0c7090 con 0x7f9b7c1576e0 2023-11-27T18:43:16.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.452+0000 7f9b81d39640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7c0c4a00 con 0x7f9b7c072820 2023-11-27T18:43:16.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.452+0000 7f9b7bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f9b7c1576e0 0x7f9b7c157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:16.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.452+0000 7f9b7bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f9b7c1576e0 0x7f9b7c157b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:54380/0 (socket says 172.21.15.91:54380) 2023-11-27T18:43:16.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.452+0000 7f9b7bfff640 1 -- 172.21.15.91:0/3433135280 learned_addr learned my addr 172.21.15.91:0/3433135280 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:16.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.452+0000 7f9b72ffd640 1 --2- 172.21.15.91:0/3433135280 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9b7c072820 0x7f9b7c0c44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:16.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.456+0000 7f9b7bfff640 1 -- 172.21.15.91:0/3433135280 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9b7c072820 msgr2=0x7f9b7c0c44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:16.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.456+0000 7f9b7bfff640 1 --2- 172.21.15.91:0/3433135280 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9b7c072820 0x7f9b7c0c44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:16.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.456+0000 7f9b7bfff640 1 -- 172.21.15.91:0/3433135280 >> v1:172.21.15.94:6789/0 conn(0x7f9b7c0c40e0 legacy=0x7f9b7c06ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:16.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.456+0000 7f9b7bfff640 1 -- 172.21.15.91:0/3433135280 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b7c15aa00 con 0x7f9b7c1576e0 2023-11-27T18:43:16.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.464+0000 7f9b7bfff640 1 --2- 172.21.15.91:0/3433135280 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9b7c1576e0 0x7f9b7c157b70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9b74009e50 tx=0x7f9b7401ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6736324d1169a35f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:16.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.468+0000 7f9b7affd640 1 -- 172.21.15.91:0/3433135280 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b740a58e0 con 0x7f9b7c1576e0 2023-11-27T18:43:16.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.468+0000 7f9b7affd640 1 -- 172.21.15.91:0/3433135280 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b740a5a40 con 0x7f9b7c1576e0 2023-11-27T18:43:16.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.468+0000 7f9b7affd640 1 -- 172.21.15.91:0/3433135280 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b740a5dd0 con 0x7f9b7c1576e0 2023-11-27T18:43:16.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.468+0000 7f9b81d39640 1 -- 172.21.15.91:0/3433135280 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9b7c1576e0 msgr2=0x7f9b7c157b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:16.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.468+0000 7f9b81d39640 1 --2- 172.21.15.91:0/3433135280 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9b7c1576e0 0x7f9b7c157b70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9b74009e50 tx=0x7f9b7401ca10 comp rx=0 tx=0).stop 2023-11-27T18:43:16.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.468+0000 7f9b81d39640 1 -- 172.21.15.91:0/3433135280 shutdown_connections 2023-11-27T18:43:16.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.468+0000 7f9b81d39640 1 --2- 172.21.15.91:0/3433135280 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9b7c1576e0 0x7f9b7c157b70 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:16.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.468+0000 7f9b81d39640 1 --2- 172.21.15.91:0/3433135280 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9b7c072820 0x7f9b7c0c44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:16.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.468+0000 7f9b81d39640 1 -- 172.21.15.91:0/3433135280 >> 172.21.15.91:0/3433135280 conn(0x7f9b7c0ca9d0 msgr2=0x7f9b7c0cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:16.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.468+0000 7f9b81d39640 1 -- 172.21.15.91:0/3433135280 shutdown_connections 2023-11-27T18:43:16.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.468+0000 7f9b81d39640 1 -- 172.21.15.91:0/3433135280 wait complete. 2023-11-27T18:43:16.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.472+0000 7f9b81d39640 1 Processor -- start 2023-11-27T18:43:16.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.472+0000 7f9b81d39640 1 -- start start 2023-11-27T18:43:16.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.472+0000 7f9b81d39640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9b7c072820 0x7f9b7c0c1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:16.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.472+0000 7f9b81d39640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9b7c0c40e0 0x7f9b7c1f5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:16.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.472+0000 7f9b81d39640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9b7c1576e0 0x7f9b7c143290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:16.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.472+0000 7f9b81d39640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7c0bf630 con 0x7f9b7c1576e0 2023-11-27T18:43:16.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.472+0000 7f9b81d39640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7c1f65c0 con 0x7f9b7c072820 2023-11-27T18:43:16.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.472+0000 7f9b81d39640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7c0bf100 con 0x7f9b7c0c40e0 2023-11-27T18:43:16.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.472+0000 7f9b7bfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9b7c1576e0 0x7f9b7c143290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:16.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.472+0000 7f9b7bfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9b7c1576e0 0x7f9b7c143290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:54396/0 (socket says 172.21.15.91:54396) 2023-11-27T18:43:16.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.472+0000 7f9b7bfff640 1 -- 172.21.15.91:0/407060557 learned_addr learned my addr 172.21.15.91:0/407060557 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:16.479 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.476+0000 7f9b72ffd640 1 --2- 172.21.15.91:0/407060557 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9b7c0c40e0 0x7f9b7c1f5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:16.480 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.480+0000 7f9b7bfff640 1 -- 172.21.15.91:0/407060557 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9b7c0c40e0 msgr2=0x7f9b7c1f5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:16.480 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.480+0000 7f9b7bfff640 1 --2- 172.21.15.91:0/407060557 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9b7c0c40e0 0x7f9b7c1f5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:16.480 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.480+0000 7f9b7bfff640 1 -- 172.21.15.91:0/407060557 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9b7c072820 msgr2=0x7f9b7c0c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:16.480 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.480+0000 7f9b7bfff640 1 --2- 172.21.15.91:0/407060557 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9b7c072820 0x7f9b7c0c1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:16.480 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.480+0000 7f9b7bfff640 1 -- 172.21.15.91:0/407060557 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b74009b30 con 0x7f9b7c1576e0 2023-11-27T18:43:16.482 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.480+0000 7f9b7bfff640 1 --2- 172.21.15.91:0/407060557 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9b7c1576e0 0x7f9b7c143290 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9b7401a640 tx=0x7f9b740197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:16.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.488+0000 7f9b78ff9640 1 -- 172.21.15.91:0/407060557 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b740b6620 con 0x7f9b7c1576e0 2023-11-27T18:43:16.489 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.488+0000 7f9b78ff9640 1 -- 172.21.15.91:0/407060557 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b740b6780 con 0x7f9b7c1576e0 2023-11-27T18:43:16.489 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.488+0000 7f9b78ff9640 1 -- 172.21.15.91:0/407060557 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b740b6b10 con 0x7f9b7c1576e0 2023-11-27T18:43:16.489 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.488+0000 7f9b81d39640 1 -- 172.21.15.91:0/407060557 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b7c0bf390 con 0x7f9b7c1576e0 2023-11-27T18:43:16.489 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.488+0000 7f9b81d39640 1 -- 172.21.15.91:0/407060557 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b7c0c0560 con 0x7f9b7c1576e0 2023-11-27T18:43:16.489 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.488+0000 7f9b81d39640 1 -- 172.21.15.91:0/407060557 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b7c04e850 con 0x7f9b7c1576e0 2023-11-27T18:43:16.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.928+0000 7f9b78ff9640 1 -- 172.21.15.91:0/407060557 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f9b740b6c70 con 0x7f9b7c1576e0 2023-11-27T18:43:16.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.928+0000 7f9b78ff9640 1 --2- 172.21.15.91:0/407060557 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f9b5c066840 0x7f9b5c068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:16.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.928+0000 7f9b7b7fe640 1 --2- 172.21.15.91:0/407060557 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f9b5c066840 0x7f9b5c068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:16.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:16.928+0000 7f9b7b7fe640 1 --2- 172.21.15.91:0/407060557 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f9b5c066840 0x7f9b5c068d00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c000f70 tx=0x7f9b6c0079e0 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:17.011 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.008+0000 7f9b78ff9640 1 -- 172.21.15.91:0/407060557 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9b740f1080 con 0x7f9b7c1576e0 2023-11-27T18:43:17.011 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.008+0000 7f9b78ff9640 1 -- 172.21.15.91:0/407060557 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f9b740eccc0 con 0x7f9b7c1576e0 2023-11-27T18:43:17.177 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.176+0000 7f9b81d39640 1 -- 172.21.15.91:0/407060557 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f9b7c070e90 con 0x7f9b7c1576e0 2023-11-27T18:43:17.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.188+0000 7f9b78ff9640 1 -- 172.21.15.91:0/407060557 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v32) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9b740f02e0 con 0x7f9b7c1576e0 2023-11-27T18:43:17.190 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T18:43:17.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.188+0000 7f9b81d39640 1 -- 172.21.15.91:0/407060557 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f9b5c066840 msgr2=0x7f9b5c068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:17.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.188+0000 7f9b81d39640 1 --2- 172.21.15.91:0/407060557 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f9b5c066840 0x7f9b5c068d00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c000f70 tx=0x7f9b6c0079e0 comp rx=0 tx=0).stop 2023-11-27T18:43:17.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.188+0000 7f9b81d39640 1 -- 172.21.15.91:0/407060557 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9b7c1576e0 msgr2=0x7f9b7c143290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:17.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.188+0000 7f9b81d39640 1 --2- 172.21.15.91:0/407060557 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9b7c1576e0 0x7f9b7c143290 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9b7401a640 tx=0x7f9b740197b0 comp rx=0 tx=0).stop 2023-11-27T18:43:17.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.192+0000 7f9b81d39640 1 -- 172.21.15.91:0/407060557 shutdown_connections 2023-11-27T18:43:17.193 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.192+0000 7f9b81d39640 1 --2- 172.21.15.91:0/407060557 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f9b5c066840 0x7f9b5c068d00 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:17.193 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.192+0000 7f9b81d39640 1 --2- 172.21.15.91:0/407060557 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9b7c0c40e0 0x7f9b7c1f5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:17.193 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.192+0000 7f9b81d39640 1 --2- 172.21.15.91:0/407060557 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9b7c1576e0 0x7f9b7c143290 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:17.193 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.192+0000 7f9b81d39640 1 --2- 172.21.15.91:0/407060557 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9b7c072820 0x7f9b7c0c1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:17.193 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.192+0000 7f9b81d39640 1 -- 172.21.15.91:0/407060557 >> 172.21.15.91:0/407060557 conn(0x7f9b7c0ca9d0 msgr2=0x7f9b7c0cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:17.193 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.192+0000 7f9b81d39640 1 -- 172.21.15.91:0/407060557 shutdown_connections 2023-11-27T18:43:17.193 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.192+0000 7f9b81d39640 1 -- 172.21.15.91:0/407060557 wait complete. 2023-11-27T18:43:17.210 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-27T18:43:17.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.328+0000 7ff8a9a8f640 1 Processor -- start 2023-11-27T18:43:17.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.328+0000 7ff8a9a8f640 1 -- start start 2023-11-27T18:43:17.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.328+0000 7ff8a9a8f640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff8a4150340 0x7ff8a40c18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:17.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.328+0000 7ff8a9a8f640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8a4156f10 con 0x7ff8a414ff60 2023-11-27T18:43:17.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.328+0000 7ff8a9a8f640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8a4156080 con 0x7ff8a40cbaf0 2023-11-27T18:43:17.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.328+0000 7ff8a9a8f640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a4156300 con 0x7ff8a4150340 2023-11-27T18:43:17.333 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.332+0000 7ff8a37fe640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7ff8a414ff60 0x7ff8a406fdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:44354/0 (socket says 172.21.15.91:44354) 2023-11-27T18:43:17.334 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.332+0000 7ff8a37fe640 1 -- 172.21.15.91:0/1321251545 learned_addr learned my addr 172.21.15.91:0/1321251545 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:43:17.334 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.332+0000 7ff89bfff640 1 --2- 172.21.15.91:0/1321251545 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff8a4150340 0x7ff8a40c18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:17.336 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.336+0000 7ff8a2ffd640 1 -- 172.21.15.91:0/1321251545 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3223741859 0 0) 0x7ff8a4156f10 con 0x7ff8a414ff60 2023-11-27T18:43:17.336 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.336+0000 7ff8a2ffd640 1 -- 172.21.15.91:0/1321251545 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff890003530 con 0x7ff8a414ff60 2023-11-27T18:43:17.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.340+0000 7ff8a2ffd640 1 -- 172.21.15.91:0/1321251545 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1542159474 0 0) 0x7ff890003530 con 0x7ff8a414ff60 2023-11-27T18:43:17.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.340+0000 7ff8a2ffd640 1 -- 172.21.15.91:0/1321251545 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff8a4150340 msgr2=0x7ff8a40c18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:17.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.340+0000 7ff8a2ffd640 1 --2- 172.21.15.91:0/1321251545 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff8a4150340 0x7ff8a40c18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:17.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.340+0000 7ff8a2ffd640 1 -- 172.21.15.91:0/1321251545 >> v1:172.21.15.94:6789/0 conn(0x7ff8a40cbaf0 legacy=0x7ff8a4157720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:17.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.340+0000 7ff8a2ffd640 1 -- 172.21.15.91:0/1321251545 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a41565e0 con 0x7ff8a414ff60 2023-11-27T18:43:17.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.340+0000 7ff8a2ffd640 1 -- 172.21.15.91:0/1321251545 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3378743932 0 0) 0x7ff894001680 con 0x7ff8a414ff60 2023-11-27T18:43:17.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.340+0000 7ff8a2ffd640 1 -- 172.21.15.91:0/1321251545 >> v1:172.21.15.91:6789/0 conn(0x7ff8a414ff60 legacy=0x7ff8a406fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:17.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.340+0000 7ff8a2ffd640 1 --2- 172.21.15.91:0/1321251545 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff8a4150340 0x7ff8900039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:17.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.340+0000 7ff8a2ffd640 1 --2- 172.21.15.91:0/1321251545 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff890003f60 0x7ff8900047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:17.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.340+0000 7ff8a2ffd640 1 --2- 172.21.15.91:0/1321251545 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff890004d10 0x7ff890005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:17.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.340+0000 7ff8a2ffd640 1 -- 172.21.15.91:0/1321251545 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a4156300 con 0x7ff890004d10 2023-11-27T18:43:17.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.340+0000 7ff8a2ffd640 1 -- 172.21.15.91:0/1321251545 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff89000dce0 con 0x7ff890003f60 2023-11-27T18:43:17.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.340+0000 7ff8a2ffd640 1 -- 172.21.15.91:0/1321251545 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff89000dea0 con 0x7ff8a4150340 2023-11-27T18:43:17.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.340+0000 7ff8a3fff640 1 --2- 172.21.15.91:0/1321251545 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff890004d10 0x7ff890005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:17.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.344+0000 7ff8a3fff640 1 -- 172.21.15.91:0/1321251545 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff8a4150340 msgr2=0x7ff8900039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:17.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.344+0000 7ff8a3fff640 1 --2- 172.21.15.91:0/1321251545 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff8a4150340 0x7ff8900039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:17.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.344+0000 7ff8a3fff640 1 -- 172.21.15.91:0/1321251545 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff890003f60 msgr2=0x7ff8900047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:17.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.344+0000 7ff8a3fff640 1 --2- 172.21.15.91:0/1321251545 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff890003f60 0x7ff8900047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:17.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.344+0000 7ff8a3fff640 1 -- 172.21.15.91:0/1321251545 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff890003530 con 0x7ff890004d10 2023-11-27T18:43:17.350 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.348+0000 7ff8a3fff640 1 --2- 172.21.15.91:0/1321251545 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff890004d10 0x7ff890005190 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff89c0044b0 tx=0x7ff89c01c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3be96dd8c4b08c7b server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:17.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.352+0000 7ff8a2ffd640 1 -- 172.21.15.91:0/1321251545 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89c0a9680 con 0x7ff890004d10 2023-11-27T18:43:17.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.352+0000 7ff8a2ffd640 1 -- 172.21.15.91:0/1321251545 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff89c0a9800 con 0x7ff890004d10 2023-11-27T18:43:17.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.352+0000 7ff8a2ffd640 1 -- 172.21.15.91:0/1321251545 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89c0a9bb0 con 0x7ff890004d10 2023-11-27T18:43:17.355 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.352+0000 7ff8a9a8f640 1 -- 172.21.15.91:0/1321251545 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff890004d10 msgr2=0x7ff890005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:17.355 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.352+0000 7ff8a9a8f640 1 --2- 172.21.15.91:0/1321251545 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff890004d10 0x7ff890005190 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff89c0044b0 tx=0x7ff89c01c680 comp rx=0 tx=0).stop 2023-11-27T18:43:17.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.352+0000 7ff8a3fff640 1 -- 172.21.15.91:0/1321251545 reap_dead start 2023-11-27T18:43:17.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.352+0000 7ff8a9a8f640 1 -- 172.21.15.91:0/1321251545 shutdown_connections 2023-11-27T18:43:17.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.352+0000 7ff8a9a8f640 1 -- 172.21.15.91:0/1321251545 >> 172.21.15.91:0/1321251545 conn(0x7ff8a4071da0 msgr2=0x7ff8a40721b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:17.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.352+0000 7ff8a9a8f640 1 -- 172.21.15.91:0/1321251545 shutdown_connections 2023-11-27T18:43:17.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.352+0000 7ff8a9a8f640 1 -- 172.21.15.91:0/1321251545 wait complete. 2023-11-27T18:43:17.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.356+0000 7ff8a9a8f640 1 Processor -- start 2023-11-27T18:43:17.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.356+0000 7ff8a9a8f640 1 -- start start 2023-11-27T18:43:17.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.356+0000 7ff8a9a8f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8a406b900 0x7ff8a40c33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:17.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.356+0000 7ff8a9a8f640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff8a406bce0 0x7ff8a41ea8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:17.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.356+0000 7ff8a9a8f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8a41eea90 0x7ff8a4144340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:17.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.356+0000 7ff8a9a8f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a41555e0 con 0x7ff8a406b900 2023-11-27T18:43:17.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.356+0000 7ff8a9a8f640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a40c3930 con 0x7ff8a41eea90 2023-11-27T18:43:17.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.356+0000 7ff8a9a8f640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a40c40f0 con 0x7ff8a406bce0 2023-11-27T18:43:17.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.356+0000 7ff8a37fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8a406b900 0x7ff8a40c33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:17.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.356+0000 7ff8a37fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8a406b900 0x7ff8a40c33f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:54410/0 (socket says 172.21.15.91:54410) 2023-11-27T18:43:17.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.356+0000 7ff8a37fe640 1 -- 172.21.15.91:0/3349994055 learned_addr learned my addr 172.21.15.91:0/3349994055 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:17.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.360+0000 7ff8a3fff640 1 --2- 172.21.15.91:0/3349994055 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8a41eea90 0x7ff8a4144340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:17.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.360+0000 7ff8a37fe640 1 -- 172.21.15.91:0/3349994055 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff8a406bce0 msgr2=0x7ff8a41ea8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:17.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.360+0000 7ff8a37fe640 1 --2- 172.21.15.91:0/3349994055 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff8a406bce0 0x7ff8a41ea8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:17.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.360+0000 7ff8a37fe640 1 -- 172.21.15.91:0/3349994055 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8a41eea90 msgr2=0x7ff8a4144340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:17.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.360+0000 7ff8a37fe640 1 --2- 172.21.15.91:0/3349994055 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8a41eea90 0x7ff8a4144340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:17.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.360+0000 7ff8a37fe640 1 -- 172.21.15.91:0/3349994055 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a41edff0 con 0x7ff8a406b900 2023-11-27T18:43:17.365 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.364+0000 7ff8a37fe640 1 --2- 172.21.15.91:0/3349994055 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8a406b900 0x7ff8a40c33f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff89400cad0 tx=0x7ff89400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:17.370 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.368+0000 7ff8a0ff9640 1 -- 172.21.15.91:0/3349994055 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff894004cc0 con 0x7ff8a406b900 2023-11-27T18:43:17.370 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.368+0000 7ff8a0ff9640 1 -- 172.21.15.91:0/3349994055 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff894004e40 con 0x7ff8a406b900 2023-11-27T18:43:17.370 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.368+0000 7ff8a0ff9640 1 -- 172.21.15.91:0/3349994055 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff894007310 con 0x7ff8a406b900 2023-11-27T18:43:17.370 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.368+0000 7ff8a9a8f640 1 -- 172.21.15.91:0/3349994055 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8a41eae20 con 0x7ff8a406b900 2023-11-27T18:43:17.370 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.368+0000 7ff8a9a8f640 1 -- 172.21.15.91:0/3349994055 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8a40c3e10 con 0x7ff8a406b900 2023-11-27T18:43:17.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.368+0000 7ff8a9a8f640 1 -- 172.21.15.91:0/3349994055 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8a406f9b0 con 0x7ff8a406b900 2023-11-27T18:43:17.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.648+0000 7ff8a0ff9640 1 -- 172.21.15.91:0/3349994055 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7ff894007470 con 0x7ff8a406b900 2023-11-27T18:43:17.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.648+0000 7ff8a0ff9640 1 --2- 172.21.15.91:0/3349994055 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7ff884066840 0x7ff884068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:17.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.648+0000 7ff89bfff640 1 --2- 172.21.15.91:0/3349994055 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7ff884066840 0x7ff884068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:17.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.648+0000 7ff89bfff640 1 --2- 172.21.15.91:0/3349994055 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7ff884066840 0x7ff884068d00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4145270 tx=0x7ff88c004740 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:17.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.672+0000 7ff8a0ff9640 1 -- 172.21.15.91:0/3349994055 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff894007720 con 0x7ff8a406b900 2023-11-27T18:43:17.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.672+0000 7ff8a0ff9640 1 -- 172.21.15.91:0/3349994055 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7ff8940511b0 con 0x7ff8a406b900 2023-11-27T18:43:17.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.860+0000 7ff8a9a8f640 1 -- 172.21.15.91:0/3349994055 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff8a41ede50 con 0x7ff8a406b900 2023-11-27T18:43:17.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.864+0000 7ff8a0ff9640 1 -- 172.21.15.91:0/3349994055 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v32) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff8a41ede50 con 0x7ff8a406b900 2023-11-27T18:43:17.867 INFO:teuthology.orchestra.run.smithi091.stderr:listed 0 entries 2023-11-27T18:43:17.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.868+0000 7ff8a9a8f640 1 -- 172.21.15.91:0/3349994055 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7ff884066840 msgr2=0x7ff884068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:17.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.868+0000 7ff8a9a8f640 1 --2- 172.21.15.91:0/3349994055 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7ff884066840 0x7ff884068d00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4145270 tx=0x7ff88c004740 comp rx=0 tx=0).stop 2023-11-27T18:43:17.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.868+0000 7ff8a9a8f640 1 -- 172.21.15.91:0/3349994055 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8a406b900 msgr2=0x7ff8a40c33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:17.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.868+0000 7ff8a9a8f640 1 --2- 172.21.15.91:0/3349994055 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8a406b900 0x7ff8a40c33f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff89400cad0 tx=0x7ff89400cf90 comp rx=0 tx=0).stop 2023-11-27T18:43:17.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.868+0000 7ff8a9a8f640 1 -- 172.21.15.91:0/3349994055 shutdown_connections 2023-11-27T18:43:17.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.868+0000 7ff8a9a8f640 1 --2- 172.21.15.91:0/3349994055 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7ff884066840 0x7ff884068d00 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:17.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.868+0000 7ff8a9a8f640 1 --2- 172.21.15.91:0/3349994055 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff8a406bce0 0x7ff8a41ea8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:17.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.868+0000 7ff8a9a8f640 1 --2- 172.21.15.91:0/3349994055 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8a41eea90 0x7ff8a4144340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:17.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.868+0000 7ff8a9a8f640 1 --2- 172.21.15.91:0/3349994055 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8a406b900 0x7ff8a40c33f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:17.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.868+0000 7ff8a9a8f640 1 -- 172.21.15.91:0/3349994055 >> 172.21.15.91:0/3349994055 conn(0x7ff8a4071da0 msgr2=0x7ff8a40ca0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:17.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.868+0000 7ff8a9a8f640 1 -- 172.21.15.91:0/3349994055 shutdown_connections 2023-11-27T18:43:17.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:17.868+0000 7ff8a9a8f640 1 -- 172.21.15.91:0/3349994055 wait complete. 2023-11-27T18:43:17.888 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T18:43:17.889 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T18:43:17.895 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T18:43:18.059 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.056+0000 7f183dae4640 1 Processor -- start 2023-11-27T18:43:18.059 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.056+0000 7f183dae4640 1 -- start start 2023-11-27T18:43:18.060 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.060+0000 7f183dae4640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f18381504c0 0x7f183815a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:18.060 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.060+0000 7f183dae4640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f18380c8610 0x7f1838071f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:18.060 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.060+0000 7f183dae4640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f183815a900 con 0x7f18381508a0 2023-11-27T18:43:18.060 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.060+0000 7f183dae4640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18380c1b10 con 0x7f18381504c0 2023-11-27T18:43:18.060 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.060+0000 7f183dae4640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18381563c0 con 0x7f18380c8610 2023-11-27T18:43:18.061 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.060+0000 7f18377fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f18381504c0 0x7f183815a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:18.061 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.060+0000 7f1837fff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f18381508a0 0x7f18380c6680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:44370/0 (socket says 172.21.15.91:44370) 2023-11-27T18:43:18.061 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.060+0000 7f1837fff640 1 -- 172.21.15.91:0/4163223837 learned_addr learned my addr 172.21.15.91:0/4163223837 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:43:18.062 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.060+0000 7f1836ffd640 1 --2- 172.21.15.91:0/4163223837 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f18380c8610 0x7f1838071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:18.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.064+0000 7f18377fe640 1 -- 172.21.15.91:0/4163223837 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f18380c8610 msgr2=0x7f1838071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:18.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.064+0000 7f18377fe640 1 --2- 172.21.15.91:0/4163223837 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f18380c8610 0x7f1838071f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:18.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.064+0000 7f18377fe640 1 -- 172.21.15.91:0/4163223837 >> v1:172.21.15.91:6789/0 conn(0x7f18381508a0 legacy=0x7f18380c6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:18.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.064+0000 7f18377fe640 1 -- 172.21.15.91:0/4163223837 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18380c6200 con 0x7f18381504c0 2023-11-27T18:43:18.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.068+0000 7f18377fe640 1 --2- 172.21.15.91:0/4163223837 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f18381504c0 0x7f183815a3c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f18280097c0 tx=0x7f182801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c7bc3f2110c1a78 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:18.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.072+0000 7f18367fc640 1 -- 172.21.15.91:0/4163223837 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18280a8970 con 0x7f18381504c0 2023-11-27T18:43:18.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.072+0000 7f18367fc640 1 -- 172.21.15.91:0/4163223837 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18280a8ad0 con 0x7f18381504c0 2023-11-27T18:43:18.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.072+0000 7f18367fc640 1 -- 172.21.15.91:0/4163223837 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18280a8e60 con 0x7f18381504c0 2023-11-27T18:43:18.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.076+0000 7f183dae4640 1 -- 172.21.15.91:0/4163223837 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f18381504c0 msgr2=0x7f183815a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:18.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.076+0000 7f183dae4640 1 --2- 172.21.15.91:0/4163223837 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f18381504c0 0x7f183815a3c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f18280097c0 tx=0x7f182801ec70 comp rx=0 tx=0).stop 2023-11-27T18:43:18.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.076+0000 7f183dae4640 1 -- 172.21.15.91:0/4163223837 shutdown_connections 2023-11-27T18:43:18.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.076+0000 7f183dae4640 1 --2- 172.21.15.91:0/4163223837 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f18380c8610 0x7f1838071f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:18.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.076+0000 7f183dae4640 1 --2- 172.21.15.91:0/4163223837 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f18381504c0 0x7f183815a3c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:18.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.076+0000 7f183dae4640 1 -- 172.21.15.91:0/4163223837 >> 172.21.15.91:0/4163223837 conn(0x7f18380c79b0 msgr2=0x7f18380c7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:18.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.076+0000 7f183dae4640 1 -- 172.21.15.91:0/4163223837 shutdown_connections 2023-11-27T18:43:18.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.076+0000 7f183dae4640 1 -- 172.21.15.91:0/4163223837 wait complete. 2023-11-27T18:43:18.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.076+0000 7f183dae4640 1 Processor -- start 2023-11-27T18:43:18.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.076+0000 7f183dae4640 1 -- start start 2023-11-27T18:43:18.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.076+0000 7f183dae4640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f18380c8610 0x7f18381ed8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:18.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.076+0000 7f183dae4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f18381504c0 0x7f1838158810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:18.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.076+0000 7f183dae4640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f18381508a0 0x7f18381484a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:18.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.076+0000 7f183dae4640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183814c4f0 con 0x7f18381508a0 2023-11-27T18:43:18.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.076+0000 7f183dae4640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18381ecec0 con 0x7f18381504c0 2023-11-27T18:43:18.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.076+0000 7f183dae4640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18381ed440 con 0x7f18380c8610 2023-11-27T18:43:18.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.076+0000 7f1837fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f18381508a0 0x7f18381484a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:18.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.076+0000 7f1837fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f18381508a0 0x7f18381484a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:54434/0 (socket says 172.21.15.91:54434) 2023-11-27T18:43:18.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.076+0000 7f1837fff640 1 -- 172.21.15.91:0/1415543114 learned_addr learned my addr 172.21.15.91:0/1415543114 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:18.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.080+0000 7f18377fe640 1 --2- 172.21.15.91:0/1415543114 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f18380c8610 0x7f18381ed8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:18.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.080+0000 7f1836ffd640 1 --2- 172.21.15.91:0/1415543114 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f18381504c0 0x7f1838158810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:18.083 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.080+0000 7f1837fff640 1 -- 172.21.15.91:0/1415543114 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f18380c8610 msgr2=0x7f18381ed8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:18.083 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.080+0000 7f1837fff640 1 --2- 172.21.15.91:0/1415543114 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f18380c8610 0x7f18381ed8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:18.083 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.080+0000 7f1837fff640 1 -- 172.21.15.91:0/1415543114 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f18381504c0 msgr2=0x7f1838158810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:18.083 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.080+0000 7f1837fff640 1 --2- 172.21.15.91:0/1415543114 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f18381504c0 0x7f1838158810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:18.084 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.080+0000 7f1837fff640 1 -- 172.21.15.91:0/1415543114 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1828009420 con 0x7f18381508a0 2023-11-27T18:43:18.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.084+0000 7f1837fff640 1 --2- 172.21.15.91:0/1415543114 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f18381508a0 0x7f18381484a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f183000cb40 tx=0x7f183000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:18.089 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.088+0000 7f1827fff640 1 -- 172.21.15.91:0/1415543114 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183000aca0 con 0x7f18381508a0 2023-11-27T18:43:18.089 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.088+0000 7f1827fff640 1 -- 172.21.15.91:0/1415543114 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f183000ae00 con 0x7f18381508a0 2023-11-27T18:43:18.089 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.088+0000 7f1827fff640 1 -- 172.21.15.91:0/1415543114 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1830012600 con 0x7f18381508a0 2023-11-27T18:43:18.089 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.088+0000 7f183dae4640 1 -- 172.21.15.91:0/1415543114 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f183814d6d0 con 0x7f18381508a0 2023-11-27T18:43:18.089 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.088+0000 7f183dae4640 1 -- 172.21.15.91:0/1415543114 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1838153070 con 0x7f18381508a0 2023-11-27T18:43:18.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.088+0000 7f183dae4640 1 -- 172.21.15.91:0/1415543114 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1838067150 con 0x7f18381508a0 2023-11-27T18:43:18.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.356+0000 7f1827fff640 1 -- 172.21.15.91:0/1415543114 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f1830007070 con 0x7f18381508a0 2023-11-27T18:43:18.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.356+0000 7f1827fff640 1 --2- 172.21.15.91:0/1415543114 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f1818066870 0x7f1818068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:18.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.356+0000 7f18377fe640 1 --2- 172.21.15.91:0/1415543114 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f1818066870 0x7f1818068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:18.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.356+0000 7f18377fe640 1 --2- 172.21.15.91:0/1415543114 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f1818066870 0x7f1818068d30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f18280b2000 tx=0x7f1828008040 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:18.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.396+0000 7f1827fff640 1 -- 172.21.15.91:0/1415543114 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1830055490 con 0x7f18381508a0 2023-11-27T18:43:18.398 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.396+0000 7f1827fff640 1 -- 172.21.15.91:0/1415543114 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f18300517d0 con 0x7f18381508a0 2023-11-27T18:43:18.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.564+0000 7f183dae4640 1 -- 172.21.15.91:0/1415543114 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18381ed580 con 0x7f18381508a0 2023-11-27T18:43:18.617 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.616+0000 7f1827fff640 1 -- 172.21.15.91:0/1415543114 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+18421 (secure 0 0 0) 0x7f1830021090 con 0x7f18381508a0 2023-11-27T18:43:18.618 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:43:18.618 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":32,"fsid":"08c8ebbf-7936-4c41-a995-d5600de2d072","created":"2023-11-27T18:12:06.484593+0000","modified":"2023-11-27T18:14:21.835068+0000","last_up_change":"2023-11-27T18:12:33.154694+0000","last_in_change":"2023-11-27T18:12:23.622113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T18:12:35.450305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T18:13:09.589619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T18:13:11.439236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-27T18:13:18.514694+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ad53c08-dd19-4ae6-87c5-fa15bea3b4ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6811","nonce":472303992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6813","nonce":472303992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6817","nonce":472303992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6815","nonce":472303992}]},"public_addr":"172.21.15.91:6811/472303992","cluster_addr":"172.21.15.91:6813/472303992","heartbeat_back_addr":"172.21.15.91:6817/472303992","heartbeat_front_addr":"172.21.15.91:6815/472303992","state":["exists","up"]},{"osd":1,"uuid":"f8b5f147-ed29-4329-a787-a12cc34a2569","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6827","nonce":12316911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6829","nonce":12316911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6833","nonce":12316911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6831","nonce":12316911}]},"public_addr":"172.21.15.91:6827/12316911","cluster_addr":"172.21.15.91:6829/12316911","heartbeat_back_addr":"172.21.15.91:6833/12316911","heartbeat_front_addr":"172.21.15.91:6831/12316911","state":["exists","up"]},{"osd":2,"uuid":"c3029f9a-1c48-4f5d-983a-172a614d8795","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6803","nonce":3776125919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6805","nonce":3776125919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6809","nonce":3776125919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6807","nonce":3776125919}]},"public_addr":"172.21.15.91:6803/3776125919","cluster_addr":"172.21.15.91:6805/3776125919","heartbeat_back_addr":"172.21.15.91:6809/3776125919","heartbeat_front_addr":"172.21.15.91:6807/3776125919","state":["exists","up"]},{"osd":3,"uuid":"ab4b6fb2-0126-491b-9224-54a6badc5da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6819","nonce":1297704794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6821","nonce":1297704794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6825","nonce":1297704794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6823","nonce":1297704794}]},"public_addr":"172.21.15.91:6819/1297704794","cluster_addr":"172.21.15.91:6821/1297704794","heartbeat_back_addr":"172.21.15.91:6825/1297704794","heartbeat_front_addr":"172.21.15.91:6823/1297704794","state":["exists","up"]},{"osd":4,"uuid":"695071a8-2de8-4cba-bf20-050021a03bb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6809","nonce":2501531833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6811","nonce":2501531833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6815","nonce":2501531833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6813","nonce":2501531833}]},"public_addr":"172.21.15.94:6809/2501531833","cluster_addr":"172.21.15.94:6811/2501531833","heartbeat_back_addr":"172.21.15.94:6815/2501531833","heartbeat_front_addr":"172.21.15.94:6813/2501531833","state":["exists","up"]},{"osd":5,"uuid":"ca01da14-a700-4845-8db2-f5e3370677e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6817","nonce":2448969592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6819","nonce":2448969592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6823","nonce":2448969592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6821","nonce":2448969592}]},"public_addr":"172.21.15.94:6817/2448969592","cluster_addr":"172.21.15.94:6819/2448969592","heartbeat_back_addr":"172.21.15.94:6823/2448969592","heartbeat_front_addr":"172.21.15.94:6821/2448969592","state":["exists","up"]},{"osd":6,"uuid":"4784bc77-6c33-4e47-abba-d37484982f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6825","nonce":3389553935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6827","nonce":3389553935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6831","nonce":3389553935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6829","nonce":3389553935}]},"public_addr":"172.21.15.94:6825/3389553935","cluster_addr":"172.21.15.94:6827/3389553935","heartbeat_back_addr":"172.21.15.94:6831/3389553935","heartbeat_front_addr":"172.21.15.94:6829/3389553935","state":["exists","up"]},{"osd":7,"uuid":"b954cf3f-4a4f-4a75-9f90-014f72c16d15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6801","nonce":1606498064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6803","nonce":1606498064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6807","nonce":1606498064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6805","nonce":1606498064}]},"public_addr":"172.21.15.94:6801/1606498064","cluster_addr":"172.21.15.94:6803/1606498064","heartbeat_back_addr":"172.21.15.94:6807/1606498064","heartbeat_front_addr":"172.21.15.94:6805/1606498064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.534968+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.506182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.339267+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.532432+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:28.935756+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.471559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.485014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.352978+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":0,"to":7}]},{"pgid":"4.d","mappings":[{"from":3,"to":0}]},{"pgid":"4.1d","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T18:43:18.620 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.620+0000 7f183dae4640 1 -- 172.21.15.91:0/1415543114 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f1818066870 msgr2=0x7f1818068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:18.620 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.620+0000 7f183dae4640 1 --2- 172.21.15.91:0/1415543114 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f1818066870 0x7f1818068d30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f18280b2000 tx=0x7f1828008040 comp rx=0 tx=0).stop 2023-11-27T18:43:18.620 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.620+0000 7f183dae4640 1 -- 172.21.15.91:0/1415543114 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f18381508a0 msgr2=0x7f18381484a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:18.621 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.620+0000 7f183dae4640 1 --2- 172.21.15.91:0/1415543114 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f18381508a0 0x7f18381484a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f183000cb40 tx=0x7f183000a060 comp rx=0 tx=0).stop 2023-11-27T18:43:18.621 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.620+0000 7f183dae4640 1 -- 172.21.15.91:0/1415543114 shutdown_connections 2023-11-27T18:43:18.621 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.620+0000 7f183dae4640 1 --2- 172.21.15.91:0/1415543114 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f1818066870 0x7f1818068d30 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:18.621 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.620+0000 7f183dae4640 1 --2- 172.21.15.91:0/1415543114 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f18381508a0 0x7f18381484a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:18.621 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.620+0000 7f183dae4640 1 --2- 172.21.15.91:0/1415543114 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f18381504c0 0x7f1838158810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:18.621 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.620+0000 7f183dae4640 1 --2- 172.21.15.91:0/1415543114 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f18380c8610 0x7f18381ed8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:18.621 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.620+0000 7f183dae4640 1 -- 172.21.15.91:0/1415543114 >> 172.21.15.91:0/1415543114 conn(0x7f18380c79b0 msgr2=0x7f1838154ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:18.621 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.620+0000 7f183dae4640 1 -- 172.21.15.91:0/1415543114 shutdown_connections 2023-11-27T18:43:18.621 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.620+0000 7f183dae4640 1 -- 172.21.15.91:0/1415543114 wait complete. 2023-11-27T18:43:18.638 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T18:12:35.450305+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T18:13:09.589619+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T18:13:11.439236+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-27T18:13:18.514694+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-27T18:43:18.639 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T18:43:18.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.760+0000 7f3117f31640 1 Processor -- start 2023-11-27T18:43:18.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.760+0000 7f3117f31640 1 -- start start 2023-11-27T18:43:18.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.760+0000 7f3117f31640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f311014fca0 0x7f3110156460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:18.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.760+0000 7f3117f31640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f311006fa40 0x7f31100c6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:18.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.760+0000 7f3117f31640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31100c27c0 con 0x7f31100c5d70 2023-11-27T18:43:18.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.760+0000 7f3117f31640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31100c2fd0 con 0x7f311014fca0 2023-11-27T18:43:18.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.760+0000 7f3117f31640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3110072040 con 0x7f311006fa40 2023-11-27T18:43:18.763 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.760+0000 7f3115ccd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f311014fca0 0x7f3110156460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:18.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.768+0000 7f31164ce640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f311006fa40 0x7f31100c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:18.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.792+0000 7f31164ce640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f311006fa40 0x7f31100c6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.91:46710/0 (socket says 172.21.15.91:46710) 2023-11-27T18:43:18.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.792+0000 7f31164ce640 1 -- 172.21.15.91:0/1736189474 learned_addr learned my addr 172.21.15.91:0/1736189474 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:18.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.796+0000 7f31164ce640 1 -- 172.21.15.91:0/1736189474 >> v2:172.21.15.91:3300/0 conn(0x7f311014fca0 msgr2=0x7f3110156460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:18.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.796+0000 7f31164ce640 1 --2- 172.21.15.91:0/1736189474 >> v2:172.21.15.91:3300/0 conn(0x7f311014fca0 0x7f3110156460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:18.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.796+0000 7f31164ce640 1 -- 172.21.15.91:0/1736189474 >> v1:172.21.15.94:6789/0 conn(0x7f31100c5d70 legacy=0x7f31100c44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:18.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.796+0000 7f31164ce640 1 -- 172.21.15.91:0/1736189474 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f311006fef0 con 0x7f311006fa40 2023-11-27T18:43:18.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.808+0000 7f31164ce640 1 --2- 172.21.15.91:0/1736189474 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f311006fa40 0x7f31100c6540 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f311015a020 tx=0x7f310801e940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28015836c0880f96 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:18.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.916+0000 7f3114ccb640 1 -- 172.21.15.91:0/1736189474 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3108004230 con 0x7f311006fa40 2023-11-27T18:43:18.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.916+0000 7f3114ccb640 1 -- 172.21.15.91:0/1736189474 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31080ab070 con 0x7f311006fa40 2023-11-27T18:43:18.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.916+0000 7f3114ccb640 1 -- 172.21.15.91:0/1736189474 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31080a7790 con 0x7f311006fa40 2023-11-27T18:43:18.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.916+0000 7f3117f31640 1 -- 172.21.15.91:0/1736189474 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f311006fa40 msgr2=0x7f31100c6540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:18.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.916+0000 7f3117f31640 1 --2- 172.21.15.91:0/1736189474 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f311006fa40 0x7f31100c6540 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f311015a020 tx=0x7f310801e940 comp rx=0 tx=0).stop 2023-11-27T18:43:18.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.916+0000 7f3117f31640 1 -- 172.21.15.91:0/1736189474 shutdown_connections 2023-11-27T18:43:18.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.916+0000 7f3117f31640 1 --2- 172.21.15.91:0/1736189474 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f311006fa40 0x7f31100c6540 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:18.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.916+0000 7f3117f31640 1 --2- 172.21.15.91:0/1736189474 >> v2:172.21.15.91:3300/0 conn(0x7f311014fca0 0x7f3110156460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:18.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.916+0000 7f3117f31640 1 -- 172.21.15.91:0/1736189474 >> 172.21.15.91:0/1736189474 conn(0x7f3110071520 msgr2=0x7f3110071930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:18.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.916+0000 7f3117f31640 1 -- 172.21.15.91:0/1736189474 shutdown_connections 2023-11-27T18:43:18.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.916+0000 7f3117f31640 1 -- 172.21.15.91:0/1736189474 wait complete. 2023-11-27T18:43:18.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.920+0000 7f3117f31640 1 Processor -- start 2023-11-27T18:43:18.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.920+0000 7f3117f31640 1 -- start start 2023-11-27T18:43:18.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.920+0000 7f3117f31640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f311006fa40 0x7f311006b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:18.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.920+0000 7f3117f31640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31100c5d70 0x7f31101f27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:18.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.920+0000 7f3117f31640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f311014fca0 0x7f31101f2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:18.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.920+0000 7f3117f31640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3110145150 con 0x7f31100c5d70 2023-11-27T18:43:18.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.920+0000 7f3117f31640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3110143de0 con 0x7f311006fa40 2023-11-27T18:43:18.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.920+0000 7f3117f31640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3110144b20 con 0x7f311014fca0 2023-11-27T18:43:18.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.924+0000 7f31164ce640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f311014fca0 0x7f31101f2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:18.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.924+0000 7f31164ce640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f311014fca0 0x7f31101f2d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.91:42462/0 (socket says 172.21.15.91:42462) 2023-11-27T18:43:18.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.924+0000 7f31164ce640 1 -- 172.21.15.91:0/1201120744 learned_addr learned my addr 172.21.15.91:0/1201120744 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:18.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.932+0000 7f31164ce640 1 -- 172.21.15.91:0/1201120744 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f311006fa40 msgr2=0x7f311006b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:18.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.932+0000 7f31164ce640 1 --2- 172.21.15.91:0/1201120744 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f311006fa40 0x7f311006b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:18.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.932+0000 7f31164ce640 1 -- 172.21.15.91:0/1201120744 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31100c5d70 msgr2=0x7f31101f27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:18.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.932+0000 7f31164ce640 1 --2- 172.21.15.91:0/1201120744 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31100c5d70 0x7f31101f27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:18.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.932+0000 7f31164ce640 1 -- 172.21.15.91:0/1201120744 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f310800b780 con 0x7f311014fca0 2023-11-27T18:43:18.940 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.936+0000 7f31164ce640 1 --2- 172.21.15.91:0/1201120744 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f311014fca0 0x7f31101f2d00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f310801e980 tx=0x7f310801b6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:18.946 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.944+0000 7f310e7fc640 1 -- 172.21.15.91:0/1201120744 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31080a7b60 con 0x7f311014fca0 2023-11-27T18:43:18.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.944+0000 7f310e7fc640 1 -- 172.21.15.91:0/1201120744 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31080a7ce0 con 0x7f311014fca0 2023-11-27T18:43:18.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.944+0000 7f310e7fc640 1 -- 172.21.15.91:0/1201120744 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31080a7e90 con 0x7f311014fca0 2023-11-27T18:43:18.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.944+0000 7f3117f31640 1 -- 172.21.15.91:0/1201120744 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31101443d0 con 0x7f311014fca0 2023-11-27T18:43:18.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.944+0000 7f3117f31640 1 -- 172.21.15.91:0/1201120744 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31100c3690 con 0x7f311014fca0 2023-11-27T18:43:18.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:18.944+0000 7f3117f31640 1 -- 172.21.15.91:0/1201120744 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f311004e850 con 0x7f311014fca0 2023-11-27T18:43:19.256 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.252+0000 7f310e7fc640 1 -- 172.21.15.91:0/1201120744 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f3108003620 con 0x7f311014fca0 2023-11-27T18:43:19.256 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.256+0000 7f310e7fc640 1 --2- 172.21.15.91:0/1201120744 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f30f4066840 0x7f30f4068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:19.257 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.256+0000 7f3115ccd640 1 --2- 172.21.15.91:0/1201120744 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f30f4066840 0x7f30f4068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:19.258 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.256+0000 7f3115ccd640 1 --2- 172.21.15.91:0/1201120744 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f30f4066840 0x7f30f4068d00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3104007dc0 tx=0x7f31040072f0 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:19.262 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.260+0000 7f310e7fc640 1 -- 172.21.15.91:0/1201120744 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f31080efdb0 con 0x7f311014fca0 2023-11-27T18:43:19.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.292+0000 7f310e7fc640 1 -- 172.21.15.91:0/1201120744 <== mon.2 v2:172.21.15.94:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f31080eb9f0 con 0x7f311014fca0 2023-11-27T18:43:19.483 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.480+0000 7f3117f31640 1 -- 172.21.15.91:0/1201120744 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f31101f24e0 con 0x7f311014fca0 2023-11-27T18:43:19.496 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.496+0000 7f310e7fc640 1 -- 172.21.15.91:0/1201120744 <== mon.2 v2:172.21.15.94:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) v1 ==== 93+0+10 (secure 0 0 0) 0x7f31101f24e0 con 0x7f311014fca0 2023-11-27T18:43:19.497 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 1 2023-11-27T18:43:19.499 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.500+0000 7f3117f31640 1 -- 172.21.15.91:0/1201120744 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f30f4066840 msgr2=0x7f30f4068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:19.500 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.500+0000 7f3117f31640 1 --2- 172.21.15.91:0/1201120744 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f30f4066840 0x7f30f4068d00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3104007dc0 tx=0x7f31040072f0 comp rx=0 tx=0).stop 2023-11-27T18:43:19.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.500+0000 7f3117f31640 1 -- 172.21.15.91:0/1201120744 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f311014fca0 msgr2=0x7f31101f2d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:19.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.500+0000 7f3117f31640 1 --2- 172.21.15.91:0/1201120744 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f311014fca0 0x7f31101f2d00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f310801e980 tx=0x7f310801b6e0 comp rx=0 tx=0).stop 2023-11-27T18:43:19.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.500+0000 7f3117f31640 1 -- 172.21.15.91:0/1201120744 shutdown_connections 2023-11-27T18:43:19.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.500+0000 7f3117f31640 1 --2- 172.21.15.91:0/1201120744 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f30f4066840 0x7f30f4068d00 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:19.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.500+0000 7f3117f31640 1 --2- 172.21.15.91:0/1201120744 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f311014fca0 0x7f31101f2d00 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:19.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.500+0000 7f3117f31640 1 --2- 172.21.15.91:0/1201120744 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31100c5d70 0x7f31101f27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:19.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.500+0000 7f3117f31640 1 --2- 172.21.15.91:0/1201120744 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f311006fa40 0x7f311006b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:19.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.500+0000 7f3117f31640 1 -- 172.21.15.91:0/1201120744 >> 172.21.15.91:0/1201120744 conn(0x7f3110071520 msgr2=0x7f31100ca2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:19.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.500+0000 7f3117f31640 1 -- 172.21.15.91:0/1201120744 shutdown_connections 2023-11-27T18:43:19.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.500+0000 7f3117f31640 1 -- 172.21.15.91:0/1201120744 wait complete. 2023-11-27T18:43:19.518 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T18:43:19.644 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.644+0000 7f8f7126a640 1 Processor -- start 2023-11-27T18:43:19.644 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.644+0000 7f8f7126a640 1 -- start start 2023-11-27T18:43:19.645 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.644+0000 7f8f7126a640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8f6c06e760 0x7f8f6c0c1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:19.645 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.644+0000 7f8f7126a640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8f6c0c52d0 0x7f8f6c158f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:19.645 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.644+0000 7f8f7126a640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f6c0c3770 con 0x7f8f6c0728d0 2023-11-27T18:43:19.646 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.644+0000 7f8f7126a640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f6c0c5f30 con 0x7f8f6c0c52d0 2023-11-27T18:43:19.646 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.644+0000 7f8f7126a640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c0c2cd0 con 0x7f8f6c06e760 2023-11-27T18:43:19.646 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.644+0000 7f8f6affd640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8f6c06e760 0x7f8f6c0c1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:19.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.644+0000 7f8f6b7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8f6c0c52d0 0x7f8f6c158f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:19.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.644+0000 7f8f6affd640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8f6c06e760 0x7f8f6c0c1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.91:42478/0 (socket says 172.21.15.91:42478) 2023-11-27T18:43:19.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.644+0000 7f8f6affd640 1 -- 172.21.15.91:0/290048121 learned_addr learned my addr 172.21.15.91:0/290048121 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:19.653 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.652+0000 7f8f6affd640 1 -- 172.21.15.91:0/290048121 >> v2:172.21.15.94:3300/0 conn(0x7f8f6c0c52d0 msgr2=0x7f8f6c158f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:19.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.652+0000 7f8f6affd640 1 --2- 172.21.15.91:0/290048121 >> v2:172.21.15.94:3300/0 conn(0x7f8f6c0c52d0 0x7f8f6c158f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:19.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.652+0000 7f8f6affd640 1 -- 172.21.15.91:0/290048121 >> v1:172.21.15.94:6789/0 conn(0x7f8f6c0728d0 legacy=0x7f8f6c070ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:19.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.652+0000 7f8f6affd640 1 -- 172.21.15.91:0/290048121 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f6c071eb0 con 0x7f8f6c06e760 2023-11-27T18:43:19.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.660+0000 7f8f6affd640 1 --2- 172.21.15.91:0/290048121 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8f6c06e760 0x7f8f6c0c1ed0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c00aa10 tx=0x7f8f5c01d840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e5a9d5524b6a931 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:19.671 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.668+0000 7f8f69ffb640 1 -- 172.21.15.91:0/290048121 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c0a76e0 con 0x7f8f6c06e760 2023-11-27T18:43:19.671 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.668+0000 7f8f69ffb640 1 -- 172.21.15.91:0/290048121 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f5c0a7840 con 0x7f8f6c06e760 2023-11-27T18:43:19.672 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.668+0000 7f8f69ffb640 1 -- 172.21.15.91:0/290048121 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c0a7bd0 con 0x7f8f6c06e760 2023-11-27T18:43:19.672 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.672+0000 7f8f7126a640 1 -- 172.21.15.91:0/290048121 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8f6c06e760 msgr2=0x7f8f6c0c1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:19.673 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.672+0000 7f8f7126a640 1 --2- 172.21.15.91:0/290048121 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8f6c06e760 0x7f8f6c0c1ed0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c00aa10 tx=0x7f8f5c01d840 comp rx=0 tx=0).stop 2023-11-27T18:43:19.673 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.672+0000 7f8f7126a640 1 -- 172.21.15.91:0/290048121 shutdown_connections 2023-11-27T18:43:19.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.672+0000 7f8f7126a640 1 --2- 172.21.15.91:0/290048121 >> v2:172.21.15.94:3300/0 conn(0x7f8f6c0c52d0 0x7f8f6c158f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:19.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.672+0000 7f8f7126a640 1 --2- 172.21.15.91:0/290048121 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8f6c06e760 0x7f8f6c0c1ed0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:19.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.672+0000 7f8f7126a640 1 -- 172.21.15.91:0/290048121 >> 172.21.15.91:0/290048121 conn(0x7f8f6c0ca9d0 msgr2=0x7f8f6c0cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:19.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.672+0000 7f8f7126a640 1 -- 172.21.15.91:0/290048121 shutdown_connections 2023-11-27T18:43:19.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.672+0000 7f8f7126a640 1 -- 172.21.15.91:0/290048121 wait complete. 2023-11-27T18:43:19.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.672+0000 7f8f7126a640 1 Processor -- start 2023-11-27T18:43:19.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.672+0000 7f8f7126a640 1 -- start start 2023-11-27T18:43:19.676 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.672+0000 7f8f7126a640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8f6c06e760 0x7f8f6c0bf840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:19.676 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.672+0000 7f8f7126a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8f6c0c52d0 0x7f8f6c1f2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:19.677 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.672+0000 7f8f7126a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8f6c1f6950 0x7f8f6c1e9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:19.677 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.672+0000 7f8f7126a640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c150f10 con 0x7f8f6c0c52d0 2023-11-27T18:43:19.677 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.672+0000 7f8f7126a640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c150380 con 0x7f8f6c1f6950 2023-11-27T18:43:19.677 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.672+0000 7f8f7126a640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c150b50 con 0x7f8f6c06e760 2023-11-27T18:43:19.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.676+0000 7f8f6a7fc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8f6c0c52d0 0x7f8f6c1f2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:19.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.676+0000 7f8f6a7fc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8f6c0c52d0 0x7f8f6c1f2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:54466/0 (socket says 172.21.15.91:54466) 2023-11-27T18:43:19.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.676+0000 7f8f6a7fc640 1 -- 172.21.15.91:0/353612525 learned_addr learned my addr 172.21.15.91:0/353612525 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:19.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.676+0000 7f8f6affd640 1 --2- 172.21.15.91:0/353612525 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8f6c06e760 0x7f8f6c0bf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:19.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.676+0000 7f8f6b7fe640 1 --2- 172.21.15.91:0/353612525 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8f6c1f6950 0x7f8f6c1e9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:19.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.680+0000 7f8f6a7fc640 1 -- 172.21.15.91:0/353612525 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8f6c06e760 msgr2=0x7f8f6c0bf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:19.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.680+0000 7f8f6a7fc640 1 --2- 172.21.15.91:0/353612525 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8f6c06e760 0x7f8f6c0bf840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:19.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.680+0000 7f8f6a7fc640 1 -- 172.21.15.91:0/353612525 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8f6c1f6950 msgr2=0x7f8f6c1e9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:19.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.680+0000 7f8f6a7fc640 1 --2- 172.21.15.91:0/353612525 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8f6c1f6950 0x7f8f6c1e9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:19.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.680+0000 7f8f6a7fc640 1 -- 172.21.15.91:0/353612525 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f5c00a670 con 0x7f8f6c0c52d0 2023-11-27T18:43:19.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.680+0000 7f8f6a7fc640 1 --2- 172.21.15.91:0/353612525 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8f6c0c52d0 0x7f8f6c1f2760 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8f6000c450 tx=0x7f8f6000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:19.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.684+0000 7f8f537fe640 1 -- 172.21.15.91:0/353612525 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f60012830 con 0x7f8f6c0c52d0 2023-11-27T18:43:19.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.684+0000 7f8f537fe640 1 -- 172.21.15.91:0/353612525 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f600129b0 con 0x7f8f6c0c52d0 2023-11-27T18:43:19.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.684+0000 7f8f537fe640 1 -- 172.21.15.91:0/353612525 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f60012d60 con 0x7f8f6c0c52d0 2023-11-27T18:43:19.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.688+0000 7f8f7126a640 1 -- 172.21.15.91:0/353612525 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f6c150590 con 0x7f8f6c0c52d0 2023-11-27T18:43:19.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.688+0000 7f8f7126a640 1 -- 172.21.15.91:0/353612525 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f6c1f5e70 con 0x7f8f6c0c52d0 2023-11-27T18:43:19.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.688+0000 7f8f7126a640 1 -- 172.21.15.91:0/353612525 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f6c1f5cd0 con 0x7f8f6c0c52d0 2023-11-27T18:43:19.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.964+0000 7f8f537fe640 1 -- 172.21.15.91:0/353612525 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f8f6001c460 con 0x7f8f6c0c52d0 2023-11-27T18:43:19.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.968+0000 7f8f537fe640 1 --2- 172.21.15.91:0/353612525 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f8f58066870 0x7f8f58068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:19.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.968+0000 7f8f6affd640 1 --2- 172.21.15.91:0/353612525 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f8f58066870 0x7f8f58068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:19.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:19.968+0000 7f8f6affd640 1 --2- 172.21.15.91:0/353612525 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f8f58066870 0x7f8f58068d30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c0b0000 tx=0x7f8f5c0a8000 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:20.012 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.012+0000 7f8f537fe640 1 -- 172.21.15.91:0/353612525 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8f60055740 con 0x7f8f6c0c52d0 2023-11-27T18:43:20.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.028+0000 7f8f537fe640 1 -- 172.21.15.91:0/353612525 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f8f60051a80 con 0x7f8f6c0c52d0 2023-11-27T18:43:20.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.200+0000 7f8f7126a640 1 -- 172.21.15.91:0/353612525 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8f6c1f5cd0 con 0x7f8f6c0c52d0 2023-11-27T18:43:20.234 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.232+0000 7f8f537fe640 1 -- 172.21.15.91:0/353612525 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v32) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8f6c1f5cd0 con 0x7f8f6c0c52d0 2023-11-27T18:43:20.234 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T18:43:20.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.236+0000 7f8f7126a640 1 -- 172.21.15.91:0/353612525 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f8f58066870 msgr2=0x7f8f58068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:20.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.236+0000 7f8f7126a640 1 --2- 172.21.15.91:0/353612525 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f8f58066870 0x7f8f58068d30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c0b0000 tx=0x7f8f5c0a8000 comp rx=0 tx=0).stop 2023-11-27T18:43:20.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.236+0000 7f8f7126a640 1 -- 172.21.15.91:0/353612525 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8f6c0c52d0 msgr2=0x7f8f6c1f2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:20.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.236+0000 7f8f7126a640 1 --2- 172.21.15.91:0/353612525 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8f6c0c52d0 0x7f8f6c1f2760 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8f6000c450 tx=0x7f8f6000c910 comp rx=0 tx=0).stop 2023-11-27T18:43:20.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.236+0000 7f8f7126a640 1 -- 172.21.15.91:0/353612525 shutdown_connections 2023-11-27T18:43:20.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.236+0000 7f8f7126a640 1 --2- 172.21.15.91:0/353612525 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f8f58066870 0x7f8f58068d30 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:20.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.236+0000 7f8f7126a640 1 --2- 172.21.15.91:0/353612525 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8f6c1f6950 0x7f8f6c1e9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:20.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.236+0000 7f8f7126a640 1 --2- 172.21.15.91:0/353612525 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8f6c0c52d0 0x7f8f6c1f2760 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:20.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.236+0000 7f8f7126a640 1 --2- 172.21.15.91:0/353612525 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8f6c06e760 0x7f8f6c0bf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:20.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.236+0000 7f8f7126a640 1 -- 172.21.15.91:0/353612525 >> 172.21.15.91:0/353612525 conn(0x7f8f6c0ca9d0 msgr2=0x7f8f6c14da90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:20.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.236+0000 7f8f7126a640 1 -- 172.21.15.91:0/353612525 shutdown_connections 2023-11-27T18:43:20.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.236+0000 7f8f7126a640 1 -- 172.21.15.91:0/353612525 wait complete. 2023-11-27T18:43:20.256 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T18:43:20.376 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.376+0000 7fa6a528a640 1 Processor -- start 2023-11-27T18:43:20.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.376+0000 7fa6a528a640 1 -- start start 2023-11-27T18:43:20.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.376+0000 7fa6a528a640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa6a006f060 0x7fa6a00c6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:20.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.376+0000 7fa6a528a640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa6a006e6c0 0x7fa6a006ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:20.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.376+0000 7fa6a528a640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6a006d6b0 con 0x7fa6a01517e0 2023-11-27T18:43:20.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.376+0000 7fa6a528a640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6a006b170 con 0x7fa6a006f060 2023-11-27T18:43:20.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.376+0000 7fa6a528a640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a0151bc0 con 0x7fa6a006e6c0 2023-11-27T18:43:20.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.484+0000 7fa69e7fc640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa6a006f060 0x7fa6a00c6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:20.487 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.484+0000 7fa69e7fc640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa6a006f060 0x7fa6a00c6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.91:46732/0 (socket says 172.21.15.91:46732) 2023-11-27T18:43:20.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.484+0000 7fa69e7fc640 1 -- 172.21.15.91:0/1893231723 learned_addr learned my addr 172.21.15.91:0/1893231723 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:20.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.488+0000 7fa69f7fe640 1 --2- 172.21.15.91:0/1893231723 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa6a006e6c0 0x7fa6a006ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:20.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.492+0000 7fa69e7fc640 1 -- 172.21.15.91:0/1893231723 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa6a006e6c0 msgr2=0x7fa6a006ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:20.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.492+0000 7fa69e7fc640 1 --2- 172.21.15.91:0/1893231723 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa6a006e6c0 0x7fa6a006ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:20.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.492+0000 7fa69e7fc640 1 -- 172.21.15.91:0/1893231723 >> v1:172.21.15.94:6789/0 conn(0x7fa6a01517e0 legacy=0x7fa6a006a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:20.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.492+0000 7fa69e7fc640 1 -- 172.21.15.91:0/1893231723 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a0158250 con 0x7fa6a006f060 2023-11-27T18:43:20.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.504+0000 7fa69e7fc640 1 --2- 172.21.15.91:0/1893231723 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa6a006f060 0x7fa6a00c6ed0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa694009870 tx=0x7fa69401c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ed4a693fab7ad1f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:20.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.512+0000 7fa69dffb640 1 -- 172.21.15.91:0/1893231723 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6940a9400 con 0x7fa6a006f060 2023-11-27T18:43:20.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.512+0000 7fa69dffb640 1 -- 172.21.15.91:0/1893231723 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6940a9560 con 0x7fa6a006f060 2023-11-27T18:43:20.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.512+0000 7fa69dffb640 1 -- 172.21.15.91:0/1893231723 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6940a98f0 con 0x7fa6a006f060 2023-11-27T18:43:20.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.512+0000 7fa6a528a640 1 -- 172.21.15.91:0/1893231723 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa6a006f060 msgr2=0x7fa6a00c6ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:20.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.512+0000 7fa6a528a640 1 --2- 172.21.15.91:0/1893231723 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa6a006f060 0x7fa6a00c6ed0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa694009870 tx=0x7fa69401c540 comp rx=0 tx=0).stop 2023-11-27T18:43:20.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.512+0000 7fa6a528a640 1 -- 172.21.15.91:0/1893231723 shutdown_connections 2023-11-27T18:43:20.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.512+0000 7fa6a528a640 1 --2- 172.21.15.91:0/1893231723 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa6a006e6c0 0x7fa6a006ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:20.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.512+0000 7fa6a528a640 1 --2- 172.21.15.91:0/1893231723 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa6a006f060 0x7fa6a00c6ed0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:20.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.512+0000 7fa6a528a640 1 -- 172.21.15.91:0/1893231723 >> 172.21.15.91:0/1893231723 conn(0x7fa6a00c8aa0 msgr2=0x7fa6a00c8e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:20.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.512+0000 7fa6a528a640 1 -- 172.21.15.91:0/1893231723 shutdown_connections 2023-11-27T18:43:20.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.512+0000 7fa6a528a640 1 -- 172.21.15.91:0/1893231723 wait complete. 2023-11-27T18:43:20.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.516+0000 7fa6a528a640 1 Processor -- start 2023-11-27T18:43:20.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.516+0000 7fa6a528a640 1 -- start start 2023-11-27T18:43:20.518 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.516+0000 7fa6a528a640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa6a006e6c0 0x7fa6a014e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:20.518 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.516+0000 7fa6a528a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa6a006f060 0x7fa6a00c4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:20.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.516+0000 7fa6a528a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa6a01517e0 0x7fa6a00c4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:20.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.516+0000 7fa6a528a640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a00ca040 con 0x7fa6a006f060 2023-11-27T18:43:20.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.516+0000 7fa6a528a640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a0155ec0 con 0x7fa6a01517e0 2023-11-27T18:43:20.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.516+0000 7fa6a528a640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a0156a20 con 0x7fa6a006e6c0 2023-11-27T18:43:20.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.516+0000 7fa69e7fc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa6a006f060 0x7fa6a00c4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:20.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.516+0000 7fa69effd640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa6a006e6c0 0x7fa6a014e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:20.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.520+0000 7fa69f7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa6a01517e0 0x7fa6a00c4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:20.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.520+0000 7fa69e7fc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa6a006f060 0x7fa6a00c4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:54478/0 (socket says 172.21.15.91:54478) 2023-11-27T18:43:20.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.520+0000 7fa69e7fc640 1 -- 172.21.15.91:0/3154220530 learned_addr learned my addr 172.21.15.91:0/3154220530 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:20.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.524+0000 7fa69e7fc640 1 -- 172.21.15.91:0/3154220530 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa6a006e6c0 msgr2=0x7fa6a014e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:20.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.524+0000 7fa69e7fc640 1 --2- 172.21.15.91:0/3154220530 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa6a006e6c0 0x7fa6a014e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:20.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.524+0000 7fa69e7fc640 1 -- 172.21.15.91:0/3154220530 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa6a01517e0 msgr2=0x7fa6a00c4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:20.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.524+0000 7fa69e7fc640 1 --2- 172.21.15.91:0/3154220530 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa6a01517e0 0x7fa6a00c4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:20.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.524+0000 7fa69e7fc640 1 -- 172.21.15.91:0/3154220530 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6940094d0 con 0x7fa6a006f060 2023-11-27T18:43:20.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.528+0000 7fa69e7fc640 1 --2- 172.21.15.91:0/3154220530 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa6a006f060 0x7fa6a00c4a20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa69401a170 tx=0x7fa69401ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:20.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.536+0000 7fa6877fe640 1 -- 172.21.15.91:0/3154220530 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6940a9400 con 0x7fa6a006f060 2023-11-27T18:43:20.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.536+0000 7fa6877fe640 1 -- 172.21.15.91:0/3154220530 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6940a9e90 con 0x7fa6a006f060 2023-11-27T18:43:20.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.536+0000 7fa6877fe640 1 -- 172.21.15.91:0/3154220530 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6940b1a00 con 0x7fa6a006f060 2023-11-27T18:43:20.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.536+0000 7fa6a528a640 1 -- 172.21.15.91:0/3154220530 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6a0156180 con 0x7fa6a006f060 2023-11-27T18:43:20.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.536+0000 7fa6a528a640 1 -- 172.21.15.91:0/3154220530 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6a0156740 con 0x7fa6a006f060 2023-11-27T18:43:20.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.536+0000 7fa6a528a640 1 -- 172.21.15.91:0/3154220530 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6a004e850 con 0x7fa6a006f060 2023-11-27T18:43:20.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.560+0000 7fa6877fe640 1 -- 172.21.15.91:0/3154220530 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fa6940c5430 con 0x7fa6a006f060 2023-11-27T18:43:20.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.560+0000 7fa6877fe640 1 --2- 172.21.15.91:0/3154220530 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa68c066840 0x7fa68c068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:20.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.560+0000 7fa69effd640 1 --2- 172.21.15.91:0/3154220530 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa68c066840 0x7fa68c068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:20.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.560+0000 7fa69effd640 1 --2- 172.21.15.91:0/3154220530 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa68c066840 0x7fa68c068d00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa698001770 tx=0x7fa698009040 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:20.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.908+0000 7fa6877fe640 1 -- 172.21.15.91:0/3154220530 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa6940ef780 con 0x7fa6a006f060 2023-11-27T18:43:20.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:20.908+0000 7fa6877fe640 1 -- 172.21.15.91:0/3154220530 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fa6940ebac0 con 0x7fa6a006f060 2023-11-27T18:43:21.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.072+0000 7fa6a528a640 1 -- 172.21.15.91:0/3154220530 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa6a0161bf0 con 0x7fa6a006f060 2023-11-27T18:43:21.089 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.088+0000 7fa6877fe640 1 -- 172.21.15.91:0/3154220530 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v32) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa6940c0070 con 0x7fa6a006f060 2023-11-27T18:43:21.089 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-11-27T18:43:21.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.088+0000 7fa6a528a640 1 -- 172.21.15.91:0/3154220530 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa68c066840 msgr2=0x7fa68c068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:21.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.088+0000 7fa6a528a640 1 --2- 172.21.15.91:0/3154220530 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa68c066840 0x7fa68c068d00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa698001770 tx=0x7fa698009040 comp rx=0 tx=0).stop 2023-11-27T18:43:21.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.088+0000 7fa6a528a640 1 -- 172.21.15.91:0/3154220530 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa6a006f060 msgr2=0x7fa6a00c4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:21.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.088+0000 7fa6a528a640 1 --2- 172.21.15.91:0/3154220530 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa6a006f060 0x7fa6a00c4a20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa69401a170 tx=0x7fa69401ad80 comp rx=0 tx=0).stop 2023-11-27T18:43:21.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.088+0000 7fa6a528a640 1 -- 172.21.15.91:0/3154220530 shutdown_connections 2023-11-27T18:43:21.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.088+0000 7fa6a528a640 1 --2- 172.21.15.91:0/3154220530 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fa68c066840 0x7fa68c068d00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:21.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.088+0000 7fa6a528a640 1 --2- 172.21.15.91:0/3154220530 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa6a01517e0 0x7fa6a00c4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:21.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.088+0000 7fa6a528a640 1 --2- 172.21.15.91:0/3154220530 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa6a006f060 0x7fa6a00c4a20 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:21.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.088+0000 7fa6a528a640 1 --2- 172.21.15.91:0/3154220530 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa6a006e6c0 0x7fa6a014e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:21.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.088+0000 7fa6a528a640 1 -- 172.21.15.91:0/3154220530 >> 172.21.15.91:0/3154220530 conn(0x7fa6a00c8aa0 msgr2=0x7fa6a0157750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:21.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.088+0000 7fa6a528a640 1 -- 172.21.15.91:0/3154220530 shutdown_connections 2023-11-27T18:43:21.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.088+0000 7fa6a528a640 1 -- 172.21.15.91:0/3154220530 wait complete. 2023-11-27T18:43:21.109 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-27T18:43:21.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.236+0000 7fe2e657a640 1 Processor -- start 2023-11-27T18:43:21.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.236+0000 7fe2e657a640 1 -- start start 2023-11-27T18:43:21.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.236+0000 7fe2e657a640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fe2e0153c40 0x7fe2e00ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:21.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.236+0000 7fe2e657a640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2e00cd980 con 0x7fe2e0153860 2023-11-27T18:43:21.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.236+0000 7fe2e657a640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2e00c9880 con 0x7fe2e00cc550 2023-11-27T18:43:21.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.236+0000 7fe2e657a640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2e015a650 con 0x7fe2e0153c40 2023-11-27T18:43:21.241 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.240+0000 7fe2e4b17640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fe2e00cc550 0x7fe2e0163f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.91:60200/0 (socket says 172.21.15.91:60200) 2023-11-27T18:43:21.241 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.240+0000 7fe2e4b17640 1 -- 172.21.15.91:0/3205703421 learned_addr learned my addr 172.21.15.91:0/3205703421 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:43:21.255 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.252+0000 7fe2d77fe640 1 --2- 172.21.15.91:0/3205703421 >> v2:172.21.15.91:3300/0 conn(0x7fe2e0153c40 0x7fe2e00ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:21.258 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.256+0000 7fe2d77fe640 1 -- 172.21.15.91:0/3205703421 >> v1:172.21.15.94:6789/0 conn(0x7fe2e00cc550 legacy=0x7fe2e0163f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:21.258 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.256+0000 7fe2d77fe640 1 -- 172.21.15.91:0/3205703421 >> v1:172.21.15.91:6789/0 conn(0x7fe2e0153860 legacy=0x7fe2e0159f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:21.258 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.256+0000 7fe2d77fe640 1 -- 172.21.15.91:0/3205703421 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e00cd6c0 con 0x7fe2e0153c40 2023-11-27T18:43:21.332 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.332+0000 7fe2d77fe640 1 --2- 172.21.15.91:0/3205703421 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe2e0153c40 0x7fe2e00ce0e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe2c80097c0 tx=0x7fe2c801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46a72cb578351c09 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:21.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.336+0000 7fe2df7fe640 1 -- 172.21.15.91:0/3205703421 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c80ab640 con 0x7fe2e0153c40 2023-11-27T18:43:21.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.336+0000 7fe2df7fe640 1 -- 172.21.15.91:0/3205703421 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c80a7070 con 0x7fe2e0153c40 2023-11-27T18:43:21.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.336+0000 7fe2df7fe640 1 -- 172.21.15.91:0/3205703421 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c80ab9c0 con 0x7fe2e0153c40 2023-11-27T18:43:21.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.336+0000 7fe2e657a640 1 -- 172.21.15.91:0/3205703421 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe2e0153c40 msgr2=0x7fe2e00ce0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:21.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.336+0000 7fe2e657a640 1 --2- 172.21.15.91:0/3205703421 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe2e0153c40 0x7fe2e00ce0e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe2c80097c0 tx=0x7fe2c801c440 comp rx=0 tx=0).stop 2023-11-27T18:43:21.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.340+0000 7fe2e657a640 1 -- 172.21.15.91:0/3205703421 shutdown_connections 2023-11-27T18:43:21.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.340+0000 7fe2e657a640 1 --2- 172.21.15.91:0/3205703421 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe2e0153c40 0x7fe2e00ce0e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:21.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.340+0000 7fe2e657a640 1 -- 172.21.15.91:0/3205703421 >> 172.21.15.91:0/3205703421 conn(0x7fe2e00b08e0 msgr2=0x7fe2e00b0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:21.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.340+0000 7fe2e657a640 1 -- 172.21.15.91:0/3205703421 shutdown_connections 2023-11-27T18:43:21.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.340+0000 7fe2e657a640 1 -- 172.21.15.91:0/3205703421 wait complete. 2023-11-27T18:43:21.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.340+0000 7fe2e657a640 1 Processor -- start 2023-11-27T18:43:21.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.340+0000 7fe2e657a640 1 -- start start 2023-11-27T18:43:21.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.340+0000 7fe2e657a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe2e00cc550 0x7fe2e014bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:21.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.340+0000 7fe2e657a640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe2e0153860 0x7fe2e00afb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:21.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.340+0000 7fe2e657a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe2e0153c40 0x7fe2e0151fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:21.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.340+0000 7fe2e657a640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e0149e70 con 0x7fe2e00cc550 2023-11-27T18:43:21.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.340+0000 7fe2e657a640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e00b4a70 con 0x7fe2e0153c40 2023-11-27T18:43:21.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.340+0000 7fe2e657a640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e00b04c0 con 0x7fe2e0153860 2023-11-27T18:43:21.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.344+0000 7fe2dffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe2e00cc550 0x7fe2e014bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:21.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.344+0000 7fe2dffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe2e00cc550 0x7fe2e014bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:54500/0 (socket says 172.21.15.91:54500) 2023-11-27T18:43:21.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.344+0000 7fe2dffff640 1 -- 172.21.15.91:0/2045146210 learned_addr learned my addr 172.21.15.91:0/2045146210 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:21.349 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.348+0000 7fe2dffff640 1 -- 172.21.15.91:0/2045146210 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe2e0153860 msgr2=0x7fe2e00afb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:21.349 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.348+0000 7fe2dffff640 1 --2- 172.21.15.91:0/2045146210 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe2e0153860 0x7fe2e00afb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:21.349 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.348+0000 7fe2dffff640 1 -- 172.21.15.91:0/2045146210 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe2e0153c40 msgr2=0x7fe2e0151fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:21.349 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.348+0000 7fe2dffff640 1 --2- 172.21.15.91:0/2045146210 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe2e0153c40 0x7fe2e0151fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:21.349 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.348+0000 7fe2dffff640 1 -- 172.21.15.91:0/2045146210 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c8009420 con 0x7fe2e00cc550 2023-11-27T18:43:21.352 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.352+0000 7fe2dffff640 1 --2- 172.21.15.91:0/2045146210 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe2e00cc550 0x7fe2e014bdb0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe2d000c450 tx=0x7fe2d000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:21.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.356+0000 7fe2dd7fa640 1 -- 172.21.15.91:0/2045146210 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d0012830 con 0x7fe2e00cc550 2023-11-27T18:43:21.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.356+0000 7fe2dd7fa640 1 -- 172.21.15.91:0/2045146210 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d00129b0 con 0x7fe2e00cc550 2023-11-27T18:43:21.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.356+0000 7fe2dd7fa640 1 -- 172.21.15.91:0/2045146210 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d0012d60 con 0x7fe2e00cc550 2023-11-27T18:43:21.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.356+0000 7fe2e657a640 1 -- 172.21.15.91:0/2045146210 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2e0151230 con 0x7fe2e00cc550 2023-11-27T18:43:21.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.356+0000 7fe2e657a640 1 -- 172.21.15.91:0/2045146210 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2e01f2d20 con 0x7fe2e00cc550 2023-11-27T18:43:21.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.356+0000 7fe2e657a640 1 -- 172.21.15.91:0/2045146210 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2e0074ac0 con 0x7fe2e00cc550 2023-11-27T18:43:21.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.376+0000 7fe2dd7fa640 1 -- 172.21.15.91:0/2045146210 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fe2d001c460 con 0x7fe2e00cc550 2023-11-27T18:43:21.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.376+0000 7fe2dd7fa640 1 --2- 172.21.15.91:0/2045146210 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe2c0066840 0x7fe2c0068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:21.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.376+0000 7fe2d77fe640 1 --2- 172.21.15.91:0/2045146210 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe2c0066840 0x7fe2c0068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:21.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.380+0000 7fe2d77fe640 1 --2- 172.21.15.91:0/2045146210 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe2c0066840 0x7fe2c0068d00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe2c80af000 tx=0x7fe2c8008040 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:21.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.380+0000 7fe2dd7fa640 1 -- 172.21.15.91:0/2045146210 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe2d0056140 con 0x7fe2e00cc550 2023-11-27T18:43:21.642 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.640+0000 7fe2dd7fa640 1 -- 172.21.15.91:0/2045146210 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fe2d0051d80 con 0x7fe2e00cc550 2023-11-27T18:43:21.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.804+0000 7fe2e657a640 1 -- 172.21.15.91:0/2045146210 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe2e0151090 con 0x7fe2e00cc550 2023-11-27T18:43:21.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.808+0000 7fe2dd7fa640 1 -- 172.21.15.91:0/2045146210 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v32) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe2e0151090 con 0x7fe2e00cc550 2023-11-27T18:43:21.812 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T18:43:21.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.812+0000 7fe2e657a640 1 -- 172.21.15.91:0/2045146210 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe2c0066840 msgr2=0x7fe2c0068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:21.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.812+0000 7fe2e657a640 1 --2- 172.21.15.91:0/2045146210 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe2c0066840 0x7fe2c0068d00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe2c80af000 tx=0x7fe2c8008040 comp rx=0 tx=0).stop 2023-11-27T18:43:21.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.812+0000 7fe2e657a640 1 -- 172.21.15.91:0/2045146210 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe2e00cc550 msgr2=0x7fe2e014bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:21.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.812+0000 7fe2e657a640 1 --2- 172.21.15.91:0/2045146210 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe2e00cc550 0x7fe2e014bdb0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe2d000c450 tx=0x7fe2d000c910 comp rx=0 tx=0).stop 2023-11-27T18:43:21.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.812+0000 7fe2e657a640 1 -- 172.21.15.91:0/2045146210 shutdown_connections 2023-11-27T18:43:21.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.812+0000 7fe2e657a640 1 --2- 172.21.15.91:0/2045146210 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe2c0066840 0x7fe2c0068d00 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:21.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.812+0000 7fe2e657a640 1 --2- 172.21.15.91:0/2045146210 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe2e0153860 0x7fe2e00afb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:21.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.812+0000 7fe2e657a640 1 --2- 172.21.15.91:0/2045146210 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe2e0153c40 0x7fe2e0151fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:21.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.812+0000 7fe2e657a640 1 --2- 172.21.15.91:0/2045146210 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe2e00cc550 0x7fe2e014bdb0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:21.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.812+0000 7fe2e657a640 1 -- 172.21.15.91:0/2045146210 >> 172.21.15.91:0/2045146210 conn(0x7fe2e00b08e0 msgr2=0x7fe2e0073720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:21.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.812+0000 7fe2e657a640 1 -- 172.21.15.91:0/2045146210 shutdown_connections 2023-11-27T18:43:21.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.812+0000 7fe2e657a640 1 -- 172.21.15.91:0/2045146210 wait complete. 2023-11-27T18:43:21.833 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-27T18:43:21.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.952+0000 7f792de76640 1 Processor -- start 2023-11-27T18:43:21.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.952+0000 7f792de76640 1 -- start start 2023-11-27T18:43:21.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.952+0000 7f792de76640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f7928157a80 0x7f792815e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:21.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.952+0000 7f792de76640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f792806e760 0x7f792806ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:21.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.952+0000 7f792de76640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7928160eb0 con 0x7f7928072770 2023-11-27T18:43:21.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.952+0000 7f792de76640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79280c2ab0 con 0x7f7928157a80 2023-11-27T18:43:21.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.952+0000 7f792de76640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79280c3a70 con 0x7f792806e760 2023-11-27T18:43:21.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.952+0000 7f791effd640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f7928072770 0x7f79280c3360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:44390/0 (socket says 172.21.15.91:44390) 2023-11-27T18:43:21.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.952+0000 7f791effd640 1 -- 172.21.15.91:0/1614172884 learned_addr learned my addr 172.21.15.91:0/1614172884 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:43:21.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.952+0000 7f7927fff640 1 --2- 172.21.15.91:0/1614172884 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f792806e760 0x7f792806ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:21.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.952+0000 7f79277fe640 1 --2- 172.21.15.91:0/1614172884 >> v2:172.21.15.94:3300/0 conn(0x7f7928157a80 0x7f792815e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:21.957 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.956+0000 7f7926ffd640 1 -- 172.21.15.91:0/1614172884 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1194589763 0 0) 0x7f7928160eb0 con 0x7f7928072770 2023-11-27T18:43:21.957 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.956+0000 7f7926ffd640 1 -- 172.21.15.91:0/1614172884 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7914003530 con 0x7f7928072770 2023-11-27T18:43:21.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.960+0000 7f7926ffd640 1 -- 172.21.15.91:0/1614172884 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1647794977 0 0) 0x7f7914003530 con 0x7f7928072770 2023-11-27T18:43:21.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.960+0000 7f7926ffd640 1 -- 172.21.15.91:0/1614172884 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f792806e760 msgr2=0x7f792806ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:21.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.960+0000 7f7926ffd640 1 --2- 172.21.15.91:0/1614172884 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f792806e760 0x7f792806ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:21.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.960+0000 7f7926ffd640 1 -- 172.21.15.91:0/1614172884 >> v2:172.21.15.94:3300/0 conn(0x7f7928157a80 msgr2=0x7f792815e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:21.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.960+0000 7f7926ffd640 1 --2- 172.21.15.91:0/1614172884 >> v2:172.21.15.94:3300/0 conn(0x7f7928157a80 0x7f792815e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:21.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.960+0000 7f7926ffd640 1 -- 172.21.15.91:0/1614172884 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7928161750 con 0x7f7928072770 2023-11-27T18:43:21.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.960+0000 7f7926ffd640 1 -- 172.21.15.91:0/1614172884 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3378743932 0 0) 0x7f7910001680 con 0x7f7928072770 2023-11-27T18:43:21.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.960+0000 7f7926ffd640 1 -- 172.21.15.91:0/1614172884 >> v1:172.21.15.91:6789/0 conn(0x7f7928072770 legacy=0x7f79280c3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:21.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.960+0000 7f7926ffd640 1 --2- 172.21.15.91:0/1614172884 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f79140039b0 0x7f7914003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:21.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.960+0000 7f7926ffd640 1 --2- 172.21.15.91:0/1614172884 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f792806e760 0x7f79140047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:21.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.960+0000 7f7926ffd640 1 --2- 172.21.15.91:0/1614172884 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7914004d10 0x7f7914005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:21.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.960+0000 7f7926ffd640 1 -- 172.21.15.91:0/1614172884 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79280c2ab0 con 0x7f7914004d10 2023-11-27T18:43:21.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.960+0000 7f7926ffd640 1 -- 172.21.15.91:0/1614172884 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79280c3a70 con 0x7f79140039b0 2023-11-27T18:43:21.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.960+0000 7f7926ffd640 1 -- 172.21.15.91:0/1614172884 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f791400b990 con 0x7f792806e760 2023-11-27T18:43:21.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.960+0000 7f7927fff640 1 --2- 172.21.15.91:0/1614172884 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7914004d10 0x7f7914005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:21.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.964+0000 7f7927fff640 1 -- 172.21.15.91:0/1614172884 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f792806e760 msgr2=0x7f79140047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:21.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.964+0000 7f7927fff640 1 --2- 172.21.15.91:0/1614172884 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f792806e760 0x7f79140047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:21.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.964+0000 7f7927fff640 1 -- 172.21.15.91:0/1614172884 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f79140039b0 msgr2=0x7f7914003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:21.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.964+0000 7f7927fff640 1 --2- 172.21.15.91:0/1614172884 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f79140039b0 0x7f7914003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:21.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.964+0000 7f7927fff640 1 -- 172.21.15.91:0/1614172884 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7914003530 con 0x7f7914004d10 2023-11-27T18:43:21.970 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.968+0000 7f7927fff640 1 --2- 172.21.15.91:0/1614172884 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7914004d10 0x7f7914005190 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f792000e170 tx=0x7f792001cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=685698bcf93290e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:21.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.976+0000 7f7926ffd640 1 -- 172.21.15.91:0/1614172884 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79200a5c90 con 0x7f7914004d10 2023-11-27T18:43:21.978 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.976+0000 7f7926ffd640 1 -- 172.21.15.91:0/1614172884 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f792000f040 con 0x7f7914004d10 2023-11-27T18:43:21.978 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.976+0000 7f7926ffd640 1 -- 172.21.15.91:0/1614172884 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79200ad680 con 0x7f7914004d10 2023-11-27T18:43:21.978 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.976+0000 7f792de76640 1 -- 172.21.15.91:0/1614172884 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7914004d10 msgr2=0x7f7914005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:21.979 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.976+0000 7f792de76640 1 --2- 172.21.15.91:0/1614172884 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7914004d10 0x7f7914005190 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f792000e170 tx=0x7f792001cc80 comp rx=0 tx=0).stop 2023-11-27T18:43:21.979 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.976+0000 7f7927fff640 1 -- 172.21.15.91:0/1614172884 reap_dead start 2023-11-27T18:43:21.979 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.976+0000 7f792de76640 1 -- 172.21.15.91:0/1614172884 shutdown_connections 2023-11-27T18:43:21.979 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.976+0000 7f792de76640 1 -- 172.21.15.91:0/1614172884 >> 172.21.15.91:0/1614172884 conn(0x7f79280ca9d0 msgr2=0x7f79280cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:21.979 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.976+0000 7f792de76640 1 -- 172.21.15.91:0/1614172884 shutdown_connections 2023-11-27T18:43:21.979 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.976+0000 7f792de76640 1 -- 172.21.15.91:0/1614172884 wait complete. 2023-11-27T18:43:21.980 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.980+0000 7f792de76640 1 Processor -- start 2023-11-27T18:43:21.980 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.980+0000 7f792de76640 1 -- start start 2023-11-27T18:43:21.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.980+0000 7f792de76640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7914004d10 0x7f792815dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:21.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.980+0000 7f792de76640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7928158820 0x7f792814e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:21.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.980+0000 7f792de76640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f792814ee80 0x7f792814fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:21.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.980+0000 7f792de76640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792815d160 con 0x7f792814ee80 2023-11-27T18:43:21.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.980+0000 7f792de76640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792814f480 con 0x7f7928158820 2023-11-27T18:43:21.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.980+0000 7f792de76640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f792815b180 con 0x7f7914004d10 2023-11-27T18:43:21.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.980+0000 7f7927fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f792814ee80 0x7f792814fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:21.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.980+0000 7f7927fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f792814ee80 0x7f792814fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:54508/0 (socket says 172.21.15.91:54508) 2023-11-27T18:43:21.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.980+0000 7f7927fff640 1 -- 172.21.15.91:0/3874208120 learned_addr learned my addr 172.21.15.91:0/3874208120 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:21.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.980+0000 7f79277fe640 1 --2- 172.21.15.91:0/3874208120 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7914004d10 0x7f792815dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:21.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.980+0000 7f791effd640 1 --2- 172.21.15.91:0/3874208120 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7928158820 0x7f792814e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:21.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.984+0000 7f7927fff640 1 -- 172.21.15.91:0/3874208120 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7914004d10 msgr2=0x7f792815dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:21.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.984+0000 7f7927fff640 1 --2- 172.21.15.91:0/3874208120 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7914004d10 0x7f792815dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:21.986 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.984+0000 7f7927fff640 1 -- 172.21.15.91:0/3874208120 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7928158820 msgr2=0x7f792814e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:21.986 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.984+0000 7f7927fff640 1 --2- 172.21.15.91:0/3874208120 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7928158820 0x7f792814e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:21.986 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.984+0000 7f7927fff640 1 -- 172.21.15.91:0/3874208120 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f792815c270 con 0x7f792814ee80 2023-11-27T18:43:21.987 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.984+0000 7f7927fff640 1 --2- 172.21.15.91:0/3874208120 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f792814ee80 0x7f792814fa80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f792000e170 tx=0x7f7920009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:21.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.992+0000 7f7924ff9640 1 -- 172.21.15.91:0/3874208120 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79200039a0 con 0x7f792814ee80 2023-11-27T18:43:21.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.992+0000 7f7924ff9640 1 -- 172.21.15.91:0/3874208120 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7920003b20 con 0x7f792814ee80 2023-11-27T18:43:21.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.992+0000 7f792de76640 1 -- 172.21.15.91:0/3874208120 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f792815c550 con 0x7f792814ee80 2023-11-27T18:43:21.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.992+0000 7f7924ff9640 1 -- 172.21.15.91:0/3874208120 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79200ae950 con 0x7f792814ee80 2023-11-27T18:43:21.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.992+0000 7f792de76640 1 -- 172.21.15.91:0/3874208120 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f792815cb10 con 0x7f792814ee80 2023-11-27T18:43:21.993 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:21.992+0000 7f792de76640 1 -- 172.21.15.91:0/3874208120 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f792814f7a0 con 0x7f792814ee80 2023-11-27T18:43:22.271 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:22.268+0000 7f7924ff9640 1 -- 172.21.15.91:0/3874208120 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f79200b4040 con 0x7f792814ee80 2023-11-27T18:43:22.272 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:22.272+0000 7f7924ff9640 1 --2- 172.21.15.91:0/3874208120 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f79080667f0 0x7f7908068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:22.273 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:22.272+0000 7f79277fe640 1 --2- 172.21.15.91:0/3874208120 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f79080667f0 0x7f7908068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:22.273 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:22.272+0000 7f79277fe640 1 --2- 172.21.15.91:0/3874208120 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f79080667f0 0x7f7908068cb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f79180093f0 tx=0x7f79180094c0 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:22.307 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:22.304+0000 7f7924ff9640 1 -- 172.21.15.91:0/3874208120 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f79200ef4c0 con 0x7f792814ee80 2023-11-27T18:43:22.308 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:22.304+0000 7f7924ff9640 1 -- 172.21.15.91:0/3874208120 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f79200eb800 con 0x7f792814ee80 2023-11-27T18:43:22.518 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:22.516+0000 7f792de76640 1 -- 172.21.15.91:0/3874208120 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f792814f780 con 0x7f792814ee80 2023-11-27T18:43:22.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:22.528+0000 7f7924ff9640 1 -- 172.21.15.91:0/3874208120 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v32) v1 ==== 80+0+0 (secure 0 0 0) 0x7f79200b2080 con 0x7f792814ee80 2023-11-27T18:43:22.531 INFO:teuthology.orchestra.run.smithi091.stderr:listed 0 entries 2023-11-27T18:43:22.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:22.532+0000 7f792de76640 1 -- 172.21.15.91:0/3874208120 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f79080667f0 msgr2=0x7f7908068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:22.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:22.532+0000 7f792de76640 1 --2- 172.21.15.91:0/3874208120 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f79080667f0 0x7f7908068cb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f79180093f0 tx=0x7f79180094c0 comp rx=0 tx=0).stop 2023-11-27T18:43:22.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:22.532+0000 7f792de76640 1 -- 172.21.15.91:0/3874208120 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f792814ee80 msgr2=0x7f792814fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:22.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:22.532+0000 7f792de76640 1 --2- 172.21.15.91:0/3874208120 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f792814ee80 0x7f792814fa80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f792000e170 tx=0x7f7920009750 comp rx=0 tx=0).stop 2023-11-27T18:43:22.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:22.532+0000 7f792de76640 1 -- 172.21.15.91:0/3874208120 shutdown_connections 2023-11-27T18:43:22.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:22.532+0000 7f792de76640 1 --2- 172.21.15.91:0/3874208120 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f79080667f0 0x7f7908068cb0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:22.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:22.532+0000 7f792de76640 1 --2- 172.21.15.91:0/3874208120 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f792814ee80 0x7f792814fa80 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:22.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:22.532+0000 7f792de76640 1 --2- 172.21.15.91:0/3874208120 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7928158820 0x7f792814e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:22.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:22.532+0000 7f792de76640 1 --2- 172.21.15.91:0/3874208120 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7914004d10 0x7f792815dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:22.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:22.532+0000 7f792de76640 1 -- 172.21.15.91:0/3874208120 >> 172.21.15.91:0/3874208120 conn(0x7f79280ca9d0 msgr2=0x7f7928155b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:22.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:22.532+0000 7f792de76640 1 -- 172.21.15.91:0/3874208120 shutdown_connections 2023-11-27T18:43:22.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:22.532+0000 7f792de76640 1 -- 172.21.15.91:0/3874208120 wait complete. 2023-11-27T18:43:22.551 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi091.front.sepia.ceph.com... 2023-11-27T18:43:22.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T18:43:22.552 DEBUG:teuthology.orchestra.run.smithi091:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-27T18:43:22.563 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T18:43:22.589 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi091.stderr:ceph-fuse[45187]: fuse finished with error 0 and tester_r 0 2023-11-27T18:43:23.312 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi091.stderr:==00:00:28:52.899 45187== 2023-11-27T18:43:23.313 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi091.stderr:==00:00:28:52.899 45187== Exit program on first error (--exit-on-first-error=yes) 2023-11-27T18:43:23.474 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi091.stderr:daemon-helper: command failed with exit status 42 2023-11-27T18:43:28.664 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-11-27T18:43:28.664 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi091.front.sepia.ceph.com 2023-11-27T18:43:28.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T18:43:28.665 DEBUG:teuthology.orchestra.run.smithi091:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-27T18:43:28.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T18:43:28.673 DEBUG:teuthology.orchestra.run.smithi091:> ip netns list 2023-11-27T18:43:28.722 INFO:teuthology.orchestra.run.smithi091.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-27T18:43:28.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T18:43:28.722 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T18:43:28.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T18:43:28.778 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip link delete ceph-brx 2023-11-27T18:43:28.966 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-27T18:43:28.976 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-27T18:43:28.976 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T18:43:29.115 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.112+0000 7f53573d6640 1 Processor -- start 2023-11-27T18:43:29.115 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.112+0000 7f53573d6640 1 -- start start 2023-11-27T18:43:29.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.116+0000 7f53573d6640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f53500c85c0 0x7f535006cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:29.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.116+0000 7f53573d6640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f53500c5f10 0x7f535006d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:29.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.116+0000 7f53573d6640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5350072b70 con 0x7f5350151820 2023-11-27T18:43:29.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.116+0000 7f53573d6640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53500c2d20 con 0x7f53500c85c0 2023-11-27T18:43:29.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.116+0000 7f53573d6640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53500c6490 con 0x7f53500c5f10 2023-11-27T18:43:29.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.116+0000 7f5354971640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f53500c85c0 0x7f535006cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:29.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.116+0000 7f5354971640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f53500c85c0 0x7f535006cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:34682/0 (socket says 172.21.15.91:34682) 2023-11-27T18:43:29.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.116+0000 7f5354971640 1 -- 172.21.15.91:0/577757676 learned_addr learned my addr 172.21.15.91:0/577757676 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:29.118 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.116+0000 7f5355973640 1 --2- 172.21.15.91:0/577757676 >> v2:172.21.15.94:3300/0 conn(0x7f53500c5f10 0x7f535006d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:29.120 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.116+0000 7f5354971640 1 -- 172.21.15.91:0/577757676 >> v2:172.21.15.94:3300/0 conn(0x7f53500c5f10 msgr2=0x7f535006d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:29.120 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.116+0000 7f5354971640 1 --2- 172.21.15.91:0/577757676 >> v2:172.21.15.94:3300/0 conn(0x7f53500c5f10 0x7f535006d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:29.120 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.116+0000 7f5354971640 1 -- 172.21.15.91:0/577757676 >> v1:172.21.15.94:6789/0 conn(0x7f5350151820 legacy=0x7f5350070e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:29.120 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.116+0000 7f5354971640 1 -- 172.21.15.91:0/577757676 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5350158160 con 0x7f53500c85c0 2023-11-27T18:43:29.123 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.120+0000 7f5354971640 1 --2- 172.21.15.91:0/577757676 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f53500c85c0 0x7f535006cb90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f53500c8d40 tx=0x7f534001ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cae57ab81437fbd server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:29.128 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.128+0000 7f5347fff640 1 -- 172.21.15.91:0/577757676 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53400a89b0 con 0x7f53500c85c0 2023-11-27T18:43:29.128 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.128+0000 7f5347fff640 1 -- 172.21.15.91:0/577757676 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53400a8b10 con 0x7f53500c85c0 2023-11-27T18:43:29.128 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.128+0000 7f5347fff640 1 -- 172.21.15.91:0/577757676 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53400a8ea0 con 0x7f53500c85c0 2023-11-27T18:43:29.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.128+0000 7f53573d6640 1 -- 172.21.15.91:0/577757676 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f53500c85c0 msgr2=0x7f535006cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:29.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.128+0000 7f53573d6640 1 --2- 172.21.15.91:0/577757676 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f53500c85c0 0x7f535006cb90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f53500c8d40 tx=0x7f534001ecb0 comp rx=0 tx=0).stop 2023-11-27T18:43:29.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.128+0000 7f53573d6640 1 -- 172.21.15.91:0/577757676 shutdown_connections 2023-11-27T18:43:29.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.128+0000 7f53573d6640 1 --2- 172.21.15.91:0/577757676 >> v2:172.21.15.94:3300/0 conn(0x7f53500c5f10 0x7f535006d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:29.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.128+0000 7f53573d6640 1 --2- 172.21.15.91:0/577757676 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f53500c85c0 0x7f535006cb90 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:29.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.128+0000 7f53573d6640 1 -- 172.21.15.91:0/577757676 >> 172.21.15.91:0/577757676 conn(0x7f53500c79b0 msgr2=0x7f53500c7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:29.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.128+0000 7f53573d6640 1 -- 172.21.15.91:0/577757676 shutdown_connections 2023-11-27T18:43:29.130 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.128+0000 7f53573d6640 1 -- 172.21.15.91:0/577757676 wait complete. 2023-11-27T18:43:29.130 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.128+0000 7f53573d6640 1 Processor -- start 2023-11-27T18:43:29.130 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.128+0000 7f53573d6640 1 -- start start 2023-11-27T18:43:29.131 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.128+0000 7f53573d6640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f53500c5f10 0x7f5350157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:29.131 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.128+0000 7f53573d6640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f53500c85c0 0x7f535014a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:29.131 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.128+0000 7f53573d6640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5350151820 0x7f5350143c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:29.131 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.128+0000 7f53573d6640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5350148700 con 0x7f53500c5f10 2023-11-27T18:43:29.132 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.128+0000 7f53573d6640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5350152460 con 0x7f5350151820 2023-11-27T18:43:29.132 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.128+0000 7f53573d6640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5350149860 con 0x7f53500c85c0 2023-11-27T18:43:29.132 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.132+0000 7f5355172640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f53500c5f10 0x7f5350157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:29.132 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.132+0000 7f5355172640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f53500c5f10 0x7f5350157620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:34684/0 (socket says 172.21.15.91:34684) 2023-11-27T18:43:29.133 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.132+0000 7f5355172640 1 -- 172.21.15.91:0/2414170446 learned_addr learned my addr 172.21.15.91:0/2414170446 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:29.133 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.132+0000 7f5354971640 1 --2- 172.21.15.91:0/2414170446 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f53500c85c0 0x7f535014a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:29.133 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.132+0000 7f5355973640 1 --2- 172.21.15.91:0/2414170446 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5350151820 0x7f5350143c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:29.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.136+0000 7f5355172640 1 -- 172.21.15.91:0/2414170446 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f53500c85c0 msgr2=0x7f535014a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:29.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.136+0000 7f5355172640 1 --2- 172.21.15.91:0/2414170446 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f53500c85c0 0x7f535014a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:29.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.136+0000 7f5355172640 1 -- 172.21.15.91:0/2414170446 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5350151820 msgr2=0x7f5350143c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:29.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.136+0000 7f5355172640 1 --2- 172.21.15.91:0/2414170446 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5350151820 0x7f5350143c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:29.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.136+0000 7f5355172640 1 -- 172.21.15.91:0/2414170446 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53400094d0 con 0x7f53500c5f10 2023-11-27T18:43:29.138 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.136+0000 7f5355172640 1 --2- 172.21.15.91:0/2414170446 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f53500c5f10 0x7f5350157620 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f534c00b440 tx=0x7f534c00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:29.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.140+0000 7f5345ffb640 1 -- 172.21.15.91:0/2414170446 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c011890 con 0x7f53500c5f10 2023-11-27T18:43:29.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.140+0000 7f5345ffb640 1 -- 172.21.15.91:0/2414170446 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f534c0119f0 con 0x7f53500c5f10 2023-11-27T18:43:29.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.140+0000 7f5345ffb640 1 -- 172.21.15.91:0/2414170446 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c011da0 con 0x7f53500c5f10 2023-11-27T18:43:29.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.140+0000 7f53573d6640 1 -- 172.21.15.91:0/2414170446 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f535014f310 con 0x7f53500c5f10 2023-11-27T18:43:29.142 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.140+0000 7f53573d6640 1 -- 172.21.15.91:0/2414170446 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5350149ad0 con 0x7f53500c5f10 2023-11-27T18:43:29.142 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.140+0000 7f53573d6640 1 -- 172.21.15.91:0/2414170446 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5350067150 con 0x7f53500c5f10 2023-11-27T18:43:29.162 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.160+0000 7f5345ffb640 1 -- 172.21.15.91:0/2414170446 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f534c004020 con 0x7f53500c5f10 2023-11-27T18:43:29.162 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.160+0000 7f5345ffb640 1 --2- 172.21.15.91:0/2414170446 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f5334066840 0x7f5334068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:29.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.160+0000 7f5354971640 1 --2- 172.21.15.91:0/2414170446 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f5334066840 0x7f5334068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:29.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.160+0000 7f5354971640 1 --2- 172.21.15.91:0/2414170446 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f5334066840 0x7f5334068d00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f53400b2000 tx=0x7f5340009040 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:29.433 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.432+0000 7f5345ffb640 1 -- 172.21.15.91:0/2414170446 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f534c0554d0 con 0x7f53500c5f10 2023-11-27T18:43:29.433 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.432+0000 7f5345ffb640 1 -- 172.21.15.91:0/2414170446 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f534c051810 con 0x7f53500c5f10 2023-11-27T18:43:29.595 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.592+0000 7f53573d6640 1 -- 172.21.15.91:0/2414170446 --> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f53500c6cf0 con 0x7f5334066840 2023-11-27T18:43:29.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.612+0000 7f5345ffb640 1 -- 172.21.15.91:0/2414170446 <== mgr.4136 v2:172.21.15.91:6800/2814827118 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+369723 (secure 0 0 0) 0x7f53400b0540 con 0x7f5334066840 2023-11-27T18:43:29.621 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:43:29.625 INFO:teuthology.orchestra.run.smithi091.stderr:dumped all 2023-11-27T18:43:29.626 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.620+0000 7f53573d6640 1 -- 172.21.15.91:0/2414170446 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f5334066840 msgr2=0x7f5334068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:29.626 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.620+0000 7f53573d6640 1 --2- 172.21.15.91:0/2414170446 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f5334066840 0x7f5334068d00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f53400b2000 tx=0x7f5340009040 comp rx=0 tx=0).stop 2023-11-27T18:43:29.626 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.620+0000 7f53573d6640 1 -- 172.21.15.91:0/2414170446 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f53500c5f10 msgr2=0x7f5350157620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:29.626 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.620+0000 7f53573d6640 1 --2- 172.21.15.91:0/2414170446 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f53500c5f10 0x7f5350157620 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f534c00b440 tx=0x7f534c00b900 comp rx=0 tx=0).stop 2023-11-27T18:43:29.626 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.620+0000 7f53573d6640 1 -- 172.21.15.91:0/2414170446 shutdown_connections 2023-11-27T18:43:29.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.620+0000 7f53573d6640 1 --2- 172.21.15.91:0/2414170446 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f5334066840 0x7f5334068d00 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:29.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.620+0000 7f53573d6640 1 --2- 172.21.15.91:0/2414170446 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f53500c85c0 0x7f535014a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:29.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.620+0000 7f53573d6640 1 --2- 172.21.15.91:0/2414170446 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5350151820 0x7f5350143c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:29.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.620+0000 7f53573d6640 1 --2- 172.21.15.91:0/2414170446 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f53500c5f10 0x7f5350157620 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:29.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.620+0000 7f53573d6640 1 -- 172.21.15.91:0/2414170446 >> 172.21.15.91:0/2414170446 conn(0x7f53500c79b0 msgr2=0x7f53500c35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:29.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.620+0000 7f53573d6640 1 -- 172.21.15.91:0/2414170446 shutdown_connections 2023-11-27T18:43:29.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.620+0000 7f53573d6640 1 -- 172.21.15.91:0/2414170446 wait complete. 2023-11-27T18:43:29.642 INFO:teuthology.orchestra.run.smithi091.stdout:{"pg_ready":true,"pg_map":{"version":953,"stamp":"2023-11-27T18:43:27.890996+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":24697659,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":665,"num_read_kb":681,"num_write":8239,"num_write_kb":284305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9503,"ondisk_log_size":9503,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":332868,"kb_used_data":34884,"kb_used_omap":12,"kb_used_meta":297907,"kb_avail":754641852,"statfs":{"total":773094113280,"available":772753256448,"internally_reserved":0,"allocated":35721216,"data_stored":50501075,"data_compressed":4804134,"data_compressed_allocated":7446528,"data_compressed_original":23904256,"omap_allocated":12751,"internal_metadata":305057329},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":11715,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":16,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005235"},"pg_stats":[{"pgid":"2.1f","version":"32'712","reported_seq":747,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:28.043175+0000","last_change":"2023-11-27T18:13:12.298503+0000","last_active":"2023-11-27T18:42:28.043175+0000","last_peered":"2023-11-27T18:42:28.043175+0000","last_clean":"2023-11-27T18:42:28.043175+0000","last_became_active":"2023-11-27T18:13:12.298140+0000","last_became_peered":"2023-11-27T18:13:12.298140+0000","last_unstale":"2023-11-27T18:42:28.043175+0000","last_undegraded":"2023-11-27T18:42:28.043175+0000","last_fullsized":"2023-11-27T18:42:28.043175+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":712,"log_dups_size":0,"ondisk_log_size":712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:04:02.661989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":710,"num_write_kb":4473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"32'16","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.084791+0000","last_change":"2023-11-27T18:13:14.416681+0000","last_active":"2023-11-27T18:43:23.084791+0000","last_peered":"2023-11-27T18:43:23.084791+0000","last_clean":"2023-11-27T18:43:23.084791+0000","last_became_active":"2023-11-27T18:13:14.416401+0000","last_became_peered":"2023-11-27T18:13:14.416401+0000","last_unstale":"2023-11-27T18:43:23.084791+0000","last_undegraded":"2023-11-27T18:43:23.084791+0000","last_fullsized":"2023-11-27T18:43:23.084791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:02:14.142363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"32'75","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:20.602326+0000","last_change":"2023-11-27T18:13:20.916435+0000","last_active":"2023-11-27T18:42:20.602326+0000","last_peered":"2023-11-27T18:42:20.602326+0000","last_clean":"2023-11-27T18:42:20.602326+0000","last_became_active":"2023-11-27T18:13:20.915358+0000","last_became_peered":"2023-11-27T18:13:20.915358+0000","last_unstale":"2023-11-27T18:42:20.602326+0000","last_undegraded":"2023-11-27T18:42:20.602326+0000","last_fullsized":"2023-11-27T18:42:20.602326+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:55:46.903556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":3642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"32'324","reported_seq":359,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:22.643669+0000","last_change":"2023-11-27T18:13:12.305296+0000","last_active":"2023-11-27T18:43:22.643669+0000","last_peered":"2023-11-27T18:43:22.643669+0000","last_clean":"2023-11-27T18:43:22.643669+0000","last_became_active":"2023-11-27T18:13:12.304981+0000","last_became_peered":"2023-11-27T18:13:12.304981+0000","last_unstale":"2023-11-27T18:43:22.643669+0000","last_undegraded":"2023-11-27T18:43:22.643669+0000","last_fullsized":"2023-11-27T18:43:22.643669+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:04:30.721243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3006109,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":322,"num_write_kb":3093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"32'24","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.088010+0000","last_change":"2023-11-27T18:13:14.366102+0000","last_active":"2023-11-27T18:43:23.088010+0000","last_peered":"2023-11-27T18:43:23.088010+0000","last_clean":"2023-11-27T18:43:23.088010+0000","last_became_active":"2023-11-27T18:13:14.365787+0000","last_became_peered":"2023-11-27T18:13:14.365787+0000","last_unstale":"2023-11-27T18:43:23.088010+0000","last_undegraded":"2023-11-27T18:43:23.088010+0000","last_fullsized":"2023-11-27T18:43:23.088010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:39:34.589545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"32'88","reported_seq":117,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:22.952283+0000","last_change":"2023-11-27T18:13:20.915811+0000","last_active":"2023-11-27T18:42:22.952283+0000","last_peered":"2023-11-27T18:42:22.952283+0000","last_clean":"2023-11-27T18:42:22.952283+0000","last_became_active":"2023-11-27T18:13:20.914864+0000","last_became_peered":"2023-11-27T18:13:20.914864+0000","last_unstale":"2023-11-27T18:42:22.952283+0000","last_undegraded":"2023-11-27T18:42:22.952283+0000","last_fullsized":"2023-11-27T18:42:22.952283+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:22:21.572863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":6140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"32'9","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:14.217989+0000","last_change":"2023-11-27T18:13:12.272691+0000","last_active":"2023-11-27T18:43:14.217989+0000","last_peered":"2023-11-27T18:43:14.217989+0000","last_clean":"2023-11-27T18:43:14.217989+0000","last_became_active":"2023-11-27T18:13:12.272343+0000","last_became_peered":"2023-11-27T18:13:12.272343+0000","last_unstale":"2023-11-27T18:43:14.217989+0000","last_undegraded":"2023-11-27T18:43:14.217989+0000","last_fullsized":"2023-11-27T18:43:14.217989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:23:55.280753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"32'21","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.112985+0000","last_change":"2023-11-27T18:13:15.804199+0000","last_active":"2023-11-27T18:43:23.112985+0000","last_peered":"2023-11-27T18:43:23.112985+0000","last_clean":"2023-11-27T18:43:23.112985+0000","last_became_active":"2023-11-27T18:13:15.803248+0000","last_became_peered":"2023-11-27T18:13:15.803248+0000","last_unstale":"2023-11-27T18:43:23.112985+0000","last_undegraded":"2023-11-27T18:43:23.112985+0000","last_fullsized":"2023-11-27T18:43:23.112985+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:39:31.246554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"32'82","reported_seq":111,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:22.954321+0000","last_change":"2023-11-27T18:13:20.909371+0000","last_active":"2023-11-27T18:42:22.954321+0000","last_peered":"2023-11-27T18:42:22.954321+0000","last_clean":"2023-11-27T18:42:22.954321+0000","last_became_active":"2023-11-27T18:13:20.908285+0000","last_became_peered":"2023-11-27T18:13:20.908285+0000","last_unstale":"2023-11-27T18:42:22.954321+0000","last_undegraded":"2023-11-27T18:42:22.954321+0000","last_fullsized":"2023-11-27T18:42:22.954321+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:40:20.210205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":10516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"32'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:57.518824+0000","last_change":"2023-11-27T18:13:12.274531+0000","last_active":"2023-11-27T18:42:57.518824+0000","last_peered":"2023-11-27T18:42:57.518824+0000","last_clean":"2023-11-27T18:42:57.518824+0000","last_became_active":"2023-11-27T18:13:12.274275+0000","last_became_peered":"2023-11-27T18:13:12.274275+0000","last_unstale":"2023-11-27T18:42:57.518824+0000","last_undegraded":"2023-11-27T18:42:57.518824+0000","last_fullsized":"2023-11-27T18:42:57.518824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:02:12.938184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"32'37","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.017775+0000","last_change":"2023-11-27T18:13:14.422531+0000","last_active":"2023-11-27T18:43:23.017775+0000","last_peered":"2023-11-27T18:43:23.017775+0000","last_clean":"2023-11-27T18:43:23.017775+0000","last_became_active":"2023-11-27T18:13:14.421811+0000","last_became_peered":"2023-11-27T18:13:14.421811+0000","last_unstale":"2023-11-27T18:43:23.017775+0000","last_undegraded":"2023-11-27T18:43:23.017775+0000","last_fullsized":"2023-11-27T18:43:23.017775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:17:17.491694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"32'74","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:20.604964+0000","last_change":"2023-11-27T18:13:20.907358+0000","last_active":"2023-11-27T18:42:20.604964+0000","last_peered":"2023-11-27T18:42:20.604964+0000","last_clean":"2023-11-27T18:42:20.604964+0000","last_became_active":"2023-11-27T18:13:20.906418+0000","last_became_peered":"2023-11-27T18:13:20.906418+0000","last_unstale":"2023-11-27T18:42:20.604964+0000","last_undegraded":"2023-11-27T18:42:20.604964+0000","last_fullsized":"2023-11-27T18:42:20.604964+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:26:43.789814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":5836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"32'20","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.022483+0000","last_change":"2023-11-27T18:13:14.421453+0000","last_active":"2023-11-27T18:43:23.022483+0000","last_peered":"2023-11-27T18:43:23.022483+0000","last_clean":"2023-11-27T18:43:23.022483+0000","last_became_active":"2023-11-27T18:13:14.418640+0000","last_became_peered":"2023-11-27T18:13:14.418640+0000","last_unstale":"2023-11-27T18:43:23.022483+0000","last_undegraded":"2023-11-27T18:43:23.022483+0000","last_fullsized":"2023-11-27T18:43:23.022483+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:38:18.655528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"32'688","reported_seq":722,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:01.836826+0000","last_change":"2023-11-27T18:13:12.306690+0000","last_active":"2023-11-27T18:43:01.836826+0000","last_peered":"2023-11-27T18:43:01.836826+0000","last_clean":"2023-11-27T18:43:01.836826+0000","last_became_active":"2023-11-27T18:13:12.306331+0000","last_became_peered":"2023-11-27T18:13:12.306331+0000","last_unstale":"2023-11-27T18:43:01.836826+0000","last_undegraded":"2023-11-27T18:43:01.836826+0000","last_fullsized":"2023-11-27T18:43:01.836826+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:39:32.646368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":683,"num_write_kb":4455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'77","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:18.875569+0000","last_change":"2023-11-27T18:14:22.718298+0000","last_active":"2023-11-27T18:42:18.875569+0000","last_peered":"2023-11-27T18:42:18.875569+0000","last_clean":"2023-11-27T18:42:18.875569+0000","last_became_active":"2023-11-27T18:14:22.717105+0000","last_became_peered":"2023-11-27T18:14:22.717105+0000","last_unstale":"2023-11-27T18:42:18.875569+0000","last_undegraded":"2023-11-27T18:42:18.875569+0000","last_fullsized":"2023-11-27T18:42:18.875569+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:59:59.108869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":10073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7,5],"acting":[0,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"32'22","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:22.927135+0000","last_change":"2023-11-27T18:13:14.368428+0000","last_active":"2023-11-27T18:43:22.927135+0000","last_peered":"2023-11-27T18:43:22.927135+0000","last_clean":"2023-11-27T18:43:22.927135+0000","last_became_active":"2023-11-27T18:13:14.368117+0000","last_became_peered":"2023-11-27T18:13:14.368117+0000","last_unstale":"2023-11-27T18:43:22.927135+0000","last_undegraded":"2023-11-27T18:43:22.927135+0000","last_fullsized":"2023-11-27T18:43:22.927135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:24:45.528760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"32'2","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:32.409623+0000","last_change":"2023-11-27T18:13:12.306963+0000","last_active":"2023-11-27T18:42:32.409623+0000","last_peered":"2023-11-27T18:42:32.409623+0000","last_clean":"2023-11-27T18:42:32.409623+0000","last_became_active":"2023-11-27T18:13:12.306644+0000","last_became_peered":"2023-11-27T18:13:12.306644+0000","last_unstale":"2023-11-27T18:42:32.409623+0000","last_undegraded":"2023-11-27T18:42:32.409623+0000","last_fullsized":"2023-11-27T18:42:32.409623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:55:43.829654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"32'100","reported_seq":130,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:18.407017+0000","last_change":"2023-11-27T18:13:20.930173+0000","last_active":"2023-11-27T18:42:18.407017+0000","last_peered":"2023-11-27T18:42:18.407017+0000","last_clean":"2023-11-27T18:42:18.407017+0000","last_became_active":"2023-11-27T18:13:20.928830+0000","last_became_peered":"2023-11-27T18:13:20.928830+0000","last_unstale":"2023-11-27T18:42:18.407017+0000","last_undegraded":"2023-11-27T18:42:18.407017+0000","last_fullsized":"2023-11-27T18:42:18.407017+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:38:26.343953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":7369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"32'24","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.122496+0000","last_change":"2023-11-27T18:13:14.378647+0000","last_active":"2023-11-27T18:43:23.122496+0000","last_peered":"2023-11-27T18:43:23.122496+0000","last_clean":"2023-11-27T18:43:23.122496+0000","last_became_active":"2023-11-27T18:13:14.378391+0000","last_became_peered":"2023-11-27T18:13:14.378391+0000","last_unstale":"2023-11-27T18:43:23.122496+0000","last_undegraded":"2023-11-27T18:43:23.122496+0000","last_fullsized":"2023-11-27T18:43:23.122496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:02:22.189845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"32'4","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:09.152903+0000","last_change":"2023-11-27T18:13:12.270283+0000","last_active":"2023-11-27T18:43:09.152903+0000","last_peered":"2023-11-27T18:43:09.152903+0000","last_clean":"2023-11-27T18:43:09.152903+0000","last_became_active":"2023-11-27T18:13:12.269795+0000","last_became_peered":"2023-11-27T18:13:12.269795+0000","last_unstale":"2023-11-27T18:43:09.152903+0000","last_undegraded":"2023-11-27T18:43:09.152903+0000","last_fullsized":"2023-11-27T18:43:09.152903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:06:24.103678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'67","reported_seq":97,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:23.879026+0000","last_change":"2023-11-27T18:13:20.907340+0000","last_active":"2023-11-27T18:42:23.879026+0000","last_peered":"2023-11-27T18:42:23.879026+0000","last_clean":"2023-11-27T18:42:23.879026+0000","last_became_active":"2023-11-27T18:13:20.906609+0000","last_became_peered":"2023-11-27T18:13:20.906609+0000","last_unstale":"2023-11-27T18:42:23.879026+0000","last_undegraded":"2023-11-27T18:42:23.879026+0000","last_fullsized":"2023-11-27T18:42:23.879026+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:19:00.295457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":7315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"32'21","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:20.596382+0000","last_change":"2023-11-27T18:13:14.415177+0000","last_active":"2023-11-27T18:42:20.596382+0000","last_peered":"2023-11-27T18:42:20.596382+0000","last_clean":"2023-11-27T18:42:20.596382+0000","last_became_active":"2023-11-27T18:13:14.414888+0000","last_became_peered":"2023-11-27T18:13:14.414888+0000","last_unstale":"2023-11-27T18:42:20.596382+0000","last_undegraded":"2023-11-27T18:42:20.596382+0000","last_fullsized":"2023-11-27T18:42:20.596382+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:41:49.599901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"32'5","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:06.932839+0000","last_change":"2023-11-27T18:13:12.273724+0000","last_active":"2023-11-27T18:43:06.932839+0000","last_peered":"2023-11-27T18:43:06.932839+0000","last_clean":"2023-11-27T18:43:06.932839+0000","last_became_active":"2023-11-27T18:13:12.273356+0000","last_became_peered":"2023-11-27T18:13:12.273356+0000","last_unstale":"2023-11-27T18:43:06.932839+0000","last_undegraded":"2023-11-27T18:43:06.932839+0000","last_fullsized":"2023-11-27T18:43:06.932839+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:15:14.235633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'85","reported_seq":115,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:22.954332+0000","last_change":"2023-11-27T18:13:20.935910+0000","last_active":"2023-11-27T18:42:22.954332+0000","last_peered":"2023-11-27T18:42:22.954332+0000","last_clean":"2023-11-27T18:42:22.954332+0000","last_became_active":"2023-11-27T18:13:20.934797+0000","last_became_peered":"2023-11-27T18:13:20.934797+0000","last_unstale":"2023-11-27T18:42:22.954332+0000","last_undegraded":"2023-11-27T18:42:22.954332+0000","last_fullsized":"2023-11-27T18:42:22.954332+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:00:35.425015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":5270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'29","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.122735+0000","last_change":"2023-11-27T18:13:14.376557+0000","last_active":"2023-11-27T18:43:23.122735+0000","last_peered":"2023-11-27T18:43:23.122735+0000","last_clean":"2023-11-27T18:43:23.122735+0000","last_became_active":"2023-11-27T18:13:14.376304+0000","last_became_peered":"2023-11-27T18:13:14.376304+0000","last_unstale":"2023-11-27T18:43:23.122735+0000","last_undegraded":"2023-11-27T18:43:23.122735+0000","last_fullsized":"2023-11-27T18:43:23.122735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:37:22.787246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"32'7","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:12.260010+0000","last_change":"2023-11-27T18:13:12.307806+0000","last_active":"2023-11-27T18:43:12.260010+0000","last_peered":"2023-11-27T18:43:12.260010+0000","last_clean":"2023-11-27T18:43:12.260010+0000","last_became_active":"2023-11-27T18:13:12.307492+0000","last_became_peered":"2023-11-27T18:13:12.307492+0000","last_unstale":"2023-11-27T18:43:12.260010+0000","last_undegraded":"2023-11-27T18:43:12.260010+0000","last_fullsized":"2023-11-27T18:43:12.260010+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:34:06.981997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"32'53","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:18.915333+0000","last_change":"2023-11-27T18:13:20.918671+0000","last_active":"2023-11-27T18:42:18.915333+0000","last_peered":"2023-11-27T18:42:18.915333+0000","last_clean":"2023-11-27T18:42:18.915333+0000","last_became_active":"2023-11-27T18:13:20.917507+0000","last_became_peered":"2023-11-27T18:13:20.917507+0000","last_unstale":"2023-11-27T18:42:18.915333+0000","last_undegraded":"2023-11-27T18:42:18.915333+0000","last_fullsized":"2023-11-27T18:42:18.915333+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:00:52.213234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":7028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"32'21","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.125660+0000","last_change":"2023-11-27T18:13:14.377644+0000","last_active":"2023-11-27T18:43:23.125660+0000","last_peered":"2023-11-27T18:43:23.125660+0000","last_clean":"2023-11-27T18:43:23.125660+0000","last_became_active":"2023-11-27T18:13:14.377289+0000","last_became_peered":"2023-11-27T18:13:14.377289+0000","last_unstale":"2023-11-27T18:43:23.125660+0000","last_undegraded":"2023-11-27T18:43:23.125660+0000","last_fullsized":"2023-11-27T18:43:23.125660+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:55:42.641433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"32'327","reported_seq":361,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:15.373897+0000","last_change":"2023-11-27T18:13:12.267960+0000","last_active":"2023-11-27T18:43:15.373897+0000","last_peered":"2023-11-27T18:43:15.373897+0000","last_clean":"2023-11-27T18:43:15.373897+0000","last_became_active":"2023-11-27T18:13:12.267552+0000","last_became_peered":"2023-11-27T18:13:12.267552+0000","last_unstale":"2023-11-27T18:43:15.373897+0000","last_undegraded":"2023-11-27T18:43:15.373897+0000","last_fullsized":"2023-11-27T18:43:15.373897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:26:13.819717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"32'94","reported_seq":125,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:20.600411+0000","last_change":"2023-11-27T18:13:20.929780+0000","last_active":"2023-11-27T18:42:20.600411+0000","last_peered":"2023-11-27T18:42:20.600411+0000","last_clean":"2023-11-27T18:42:20.600411+0000","last_became_active":"2023-11-27T18:13:20.929370+0000","last_became_peered":"2023-11-27T18:13:20.929370+0000","last_unstale":"2023-11-27T18:42:20.600411+0000","last_undegraded":"2023-11-27T18:42:20.600411+0000","last_fullsized":"2023-11-27T18:42:20.600411+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:04:33.249483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":11915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"32'22","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.010619+0000","last_change":"2023-11-27T18:13:14.369764+0000","last_active":"2023-11-27T18:43:23.010619+0000","last_peered":"2023-11-27T18:43:23.010619+0000","last_clean":"2023-11-27T18:43:23.010619+0000","last_became_active":"2023-11-27T18:13:14.369472+0000","last_became_peered":"2023-11-27T18:13:14.369472+0000","last_unstale":"2023-11-27T18:43:23.010619+0000","last_undegraded":"2023-11-27T18:43:23.010619+0000","last_fullsized":"2023-11-27T18:43:23.010619+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:35:38.706782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"32'2","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:34.424366+0000","last_change":"2023-11-27T18:13:12.310761+0000","last_active":"2023-11-27T18:42:34.424366+0000","last_peered":"2023-11-27T18:42:34.424366+0000","last_clean":"2023-11-27T18:42:34.424366+0000","last_became_active":"2023-11-27T18:13:12.310495+0000","last_became_peered":"2023-11-27T18:13:12.310495+0000","last_unstale":"2023-11-27T18:42:34.424366+0000","last_undegraded":"2023-11-27T18:42:34.424366+0000","last_fullsized":"2023-11-27T18:42:34.424366+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:48:59.333816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"32'62","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:23.008415+0000","last_change":"2023-11-27T18:13:20.907638+0000","last_active":"2023-11-27T18:42:23.008415+0000","last_peered":"2023-11-27T18:42:23.008415+0000","last_clean":"2023-11-27T18:42:23.008415+0000","last_became_active":"2023-11-27T18:13:20.907229+0000","last_became_peered":"2023-11-27T18:13:20.907229+0000","last_unstale":"2023-11-27T18:42:23.008415+0000","last_undegraded":"2023-11-27T18:42:23.008415+0000","last_fullsized":"2023-11-27T18:42:23.008415+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:49:08.226420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":7408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"32'20","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.088550+0000","last_change":"2023-11-27T18:13:15.851127+0000","last_active":"2023-11-27T18:43:23.088550+0000","last_peered":"2023-11-27T18:43:23.088550+0000","last_clean":"2023-11-27T18:43:23.088550+0000","last_became_active":"2023-11-27T18:13:15.850263+0000","last_became_peered":"2023-11-27T18:13:15.850263+0000","last_unstale":"2023-11-27T18:43:23.088550+0000","last_undegraded":"2023-11-27T18:43:23.088550+0000","last_fullsized":"2023-11-27T18:43:23.088550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:48:39.587974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"32'4","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:54.428331+0000","last_change":"2023-11-27T18:13:12.310451+0000","last_active":"2023-11-27T18:42:54.428331+0000","last_peered":"2023-11-27T18:42:54.428331+0000","last_clean":"2023-11-27T18:42:54.428331+0000","last_became_active":"2023-11-27T18:13:12.310138+0000","last_became_peered":"2023-11-27T18:13:12.310138+0000","last_unstale":"2023-11-27T18:42:54.428331+0000","last_undegraded":"2023-11-27T18:42:54.428331+0000","last_fullsized":"2023-11-27T18:42:54.428331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:03:09.046171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"32'81","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:23.006317+0000","last_change":"2023-11-27T18:13:20.896960+0000","last_active":"2023-11-27T18:42:23.006317+0000","last_peered":"2023-11-27T18:42:23.006317+0000","last_clean":"2023-11-27T18:42:23.006317+0000","last_became_active":"2023-11-27T18:13:20.896156+0000","last_became_peered":"2023-11-27T18:13:20.896156+0000","last_unstale":"2023-11-27T18:42:23.006317+0000","last_undegraded":"2023-11-27T18:42:23.006317+0000","last_fullsized":"2023-11-27T18:42:23.006317+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:00:52.213234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":6173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"32'22","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.058711+0000","last_change":"2023-11-27T18:13:14.421498+0000","last_active":"2023-11-27T18:43:23.058711+0000","last_peered":"2023-11-27T18:43:23.058711+0000","last_clean":"2023-11-27T18:43:23.058711+0000","last_became_active":"2023-11-27T18:13:14.421125+0000","last_became_peered":"2023-11-27T18:13:14.421125+0000","last_unstale":"2023-11-27T18:43:23.058711+0000","last_undegraded":"2023-11-27T18:43:23.058711+0000","last_fullsized":"2023-11-27T18:43:23.058711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:52:30.225572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"32'5","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:01.836305+0000","last_change":"2023-11-27T18:13:12.301922+0000","last_active":"2023-11-27T18:43:01.836305+0000","last_peered":"2023-11-27T18:43:01.836305+0000","last_clean":"2023-11-27T18:43:01.836305+0000","last_became_active":"2023-11-27T18:13:12.301617+0000","last_became_peered":"2023-11-27T18:13:12.301617+0000","last_unstale":"2023-11-27T18:43:01.836305+0000","last_undegraded":"2023-11-27T18:43:01.836305+0000","last_fullsized":"2023-11-27T18:43:01.836305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:00:43.320630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'68","reported_seq":99,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:22.894328+0000","last_change":"2023-11-27T18:13:20.905013+0000","last_active":"2023-11-27T18:42:22.894328+0000","last_peered":"2023-11-27T18:42:22.894328+0000","last_clean":"2023-11-27T18:42:22.894328+0000","last_became_active":"2023-11-27T18:13:20.903019+0000","last_became_peered":"2023-11-27T18:13:20.903019+0000","last_unstale":"2023-11-27T18:42:22.894328+0000","last_undegraded":"2023-11-27T18:42:22.894328+0000","last_fullsized":"2023-11-27T18:42:22.894328+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:34:15.874601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":4275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"32'26","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.089801+0000","last_change":"2023-11-27T18:13:14.378913+0000","last_active":"2023-11-27T18:43:23.089801+0000","last_peered":"2023-11-27T18:43:23.089801+0000","last_clean":"2023-11-27T18:43:23.089801+0000","last_became_active":"2023-11-27T18:13:14.378644+0000","last_became_peered":"2023-11-27T18:13:14.378644+0000","last_unstale":"2023-11-27T18:43:23.089801+0000","last_undegraded":"2023-11-27T18:43:23.089801+0000","last_fullsized":"2023-11-27T18:43:23.089801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:19:02.523860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"32'556","reported_seq":1140,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:18.258483+0000","last_change":"2023-11-27T18:13:12.305733+0000","last_active":"2023-11-27T18:43:18.258483+0000","last_peered":"2023-11-27T18:43:18.258483+0000","last_clean":"2023-11-27T18:43:18.258483+0000","last_became_active":"2023-11-27T18:13:12.305380+0000","last_became_peered":"2023-11-27T18:13:12.305380+0000","last_unstale":"2023-11-27T18:43:18.258483+0000","last_undegraded":"2023-11-27T18:43:18.258483+0000","last_fullsized":"2023-11-27T18:43:18.258483+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:34:46.886091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128192,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":549,"num_read_kb":581,"num_write":552,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"32'76","reported_seq":106,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:20.596319+0000","last_change":"2023-11-27T18:13:20.913672+0000","last_active":"2023-11-27T18:42:20.596319+0000","last_peered":"2023-11-27T18:42:20.596319+0000","last_clean":"2023-11-27T18:42:20.596319+0000","last_became_active":"2023-11-27T18:13:20.913137+0000","last_became_peered":"2023-11-27T18:13:20.913137+0000","last_unstale":"2023-11-27T18:42:20.596319+0000","last_undegraded":"2023-11-27T18:42:20.596319+0000","last_fullsized":"2023-11-27T18:42:20.596319+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:40:20.210205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":7407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"32'15","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.001180+0000","last_change":"2023-11-27T18:13:14.413781+0000","last_active":"2023-11-27T18:43:23.001180+0000","last_peered":"2023-11-27T18:43:23.001180+0000","last_clean":"2023-11-27T18:43:23.001180+0000","last_became_active":"2023-11-27T18:13:14.413413+0000","last_became_peered":"2023-11-27T18:13:14.413413+0000","last_unstale":"2023-11-27T18:43:23.001180+0000","last_undegraded":"2023-11-27T18:43:23.001180+0000","last_fullsized":"2023-11-27T18:43:23.001180+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:04:03.068428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"32'6","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:09.156568+0000","last_change":"2023-11-27T18:13:12.315822+0000","last_active":"2023-11-27T18:43:09.156568+0000","last_peered":"2023-11-27T18:43:09.156568+0000","last_clean":"2023-11-27T18:43:09.156568+0000","last_became_active":"2023-11-27T18:13:12.315610+0000","last_became_peered":"2023-11-27T18:13:12.315610+0000","last_unstale":"2023-11-27T18:43:09.156568+0000","last_undegraded":"2023-11-27T18:43:09.156568+0000","last_fullsized":"2023-11-27T18:43:09.156568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:39:33.385367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"32'85","reported_seq":115,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:18.954256+0000","last_change":"2023-11-27T18:13:20.912891+0000","last_active":"2023-11-27T18:42:18.954256+0000","last_peered":"2023-11-27T18:42:18.954256+0000","last_clean":"2023-11-27T18:42:18.954256+0000","last_became_active":"2023-11-27T18:13:20.912453+0000","last_became_peered":"2023-11-27T18:13:20.912453+0000","last_unstale":"2023-11-27T18:42:18.954256+0000","last_undegraded":"2023-11-27T18:42:18.954256+0000","last_fullsized":"2023-11-27T18:42:18.954256+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:35:44.943527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":10738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"32'21","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.122497+0000","last_change":"2023-11-27T18:13:14.414468+0000","last_active":"2023-11-27T18:43:23.122497+0000","last_peered":"2023-11-27T18:43:23.122497+0000","last_clean":"2023-11-27T18:43:23.122497+0000","last_became_active":"2023-11-27T18:13:14.414156+0000","last_became_peered":"2023-11-27T18:13:14.414156+0000","last_unstale":"2023-11-27T18:43:23.122497+0000","last_undegraded":"2023-11-27T18:43:23.122497+0000","last_fullsized":"2023-11-27T18:43:23.122497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:46:11.500006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"32'3","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:58.521863+0000","last_change":"2023-11-27T18:13:12.308337+0000","last_active":"2023-11-27T18:42:58.521863+0000","last_peered":"2023-11-27T18:42:58.521863+0000","last_clean":"2023-11-27T18:42:58.521863+0000","last_became_active":"2023-11-27T18:13:12.308050+0000","last_became_peered":"2023-11-27T18:13:12.308050+0000","last_unstale":"2023-11-27T18:42:58.521863+0000","last_undegraded":"2023-11-27T18:42:58.521863+0000","last_fullsized":"2023-11-27T18:42:58.521863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:14:09.398956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"20'117","reported_seq":187,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:40:44.472943+0000","last_change":"2023-11-27T18:12:38.371836+0000","last_active":"2023-11-27T18:40:44.472943+0000","last_peered":"2023-11-27T18:40:44.472943+0000","last_clean":"2023-11-27T18:40:44.472943+0000","last_became_active":"2023-11-27T18:12:38.370748+0000","last_became_peered":"2023-11-27T18:12:38.370748+0000","last_unstale":"2023-11-27T18:40:44.472943+0000","last_undegraded":"2023-11-27T18:40:44.472943+0000","last_fullsized":"2023-11-27T18:40:44.472943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:12:36.259476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:12:36.259476+0000","last_clean_scrub_stamp":"2023-11-27T18:12:36.259476+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:25:36.712765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'86","reported_seq":117,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:22.984570+0000","last_change":"2023-11-27T18:13:20.928359+0000","last_active":"2023-11-27T18:42:22.984570+0000","last_peered":"2023-11-27T18:42:22.984570+0000","last_clean":"2023-11-27T18:42:22.984570+0000","last_became_active":"2023-11-27T18:13:20.926559+0000","last_became_peered":"2023-11-27T18:13:20.926559+0000","last_unstale":"2023-11-27T18:42:22.984570+0000","last_undegraded":"2023-11-27T18:42:22.984570+0000","last_fullsized":"2023-11-27T18:42:22.984570+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:47:06.255647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":7930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"32'24","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.017254+0000","last_change":"2023-11-27T18:13:14.422275+0000","last_active":"2023-11-27T18:43:23.017254+0000","last_peered":"2023-11-27T18:43:23.017254+0000","last_clean":"2023-11-27T18:43:23.017254+0000","last_became_active":"2023-11-27T18:13:14.419636+0000","last_became_peered":"2023-11-27T18:13:14.419636+0000","last_unstale":"2023-11-27T18:43:23.017254+0000","last_undegraded":"2023-11-27T18:43:23.017254+0000","last_fullsized":"2023-11-27T18:43:23.017254+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:29:10.027795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"32'2","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:44.034879+0000","last_change":"2023-11-27T18:13:12.268222+0000","last_active":"2023-11-27T18:42:44.034879+0000","last_peered":"2023-11-27T18:42:44.034879+0000","last_clean":"2023-11-27T18:42:44.034879+0000","last_became_active":"2023-11-27T18:13:12.267764+0000","last_became_peered":"2023-11-27T18:13:12.267764+0000","last_unstale":"2023-11-27T18:42:44.034879+0000","last_undegraded":"2023-11-27T18:42:44.034879+0000","last_fullsized":"2023-11-27T18:42:44.034879+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:48:38.383796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"32'73","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:13.789980+0000","last_change":"2023-11-27T18:13:20.917055+0000","last_active":"2023-11-27T18:42:13.789980+0000","last_peered":"2023-11-27T18:42:13.789980+0000","last_clean":"2023-11-27T18:42:13.789980+0000","last_became_active":"2023-11-27T18:13:20.914157+0000","last_became_peered":"2023-11-27T18:13:20.914157+0000","last_unstale":"2023-11-27T18:42:13.789980+0000","last_undegraded":"2023-11-27T18:42:13.789980+0000","last_fullsized":"2023-11-27T18:42:13.789980+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:34:15.874601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":5275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'24","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.065908+0000","last_change":"2023-11-27T18:13:14.363559+0000","last_active":"2023-11-27T18:43:23.065908+0000","last_peered":"2023-11-27T18:43:23.065908+0000","last_clean":"2023-11-27T18:43:23.065908+0000","last_became_active":"2023-11-27T18:13:14.363285+0000","last_became_peered":"2023-11-27T18:13:14.363285+0000","last_unstale":"2023-11-27T18:43:23.065908+0000","last_undegraded":"2023-11-27T18:43:23.065908+0000","last_fullsized":"2023-11-27T18:43:23.065908+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:00:44.524809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"32'3","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:30.492175+0000","last_change":"2023-11-27T18:13:12.312477+0000","last_active":"2023-11-27T18:42:30.492175+0000","last_peered":"2023-11-27T18:42:30.492175+0000","last_clean":"2023-11-27T18:42:30.492175+0000","last_became_active":"2023-11-27T18:13:12.312038+0000","last_became_peered":"2023-11-27T18:13:12.312038+0000","last_unstale":"2023-11-27T18:42:30.492175+0000","last_undegraded":"2023-11-27T18:42:30.492175+0000","last_fullsized":"2023-11-27T18:42:30.492175+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:35:37.502604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"32'90","reported_seq":120,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:20.599466+0000","last_change":"2023-11-27T18:13:20.913830+0000","last_active":"2023-11-27T18:42:20.599466+0000","last_peered":"2023-11-27T18:42:20.599466+0000","last_clean":"2023-11-27T18:42:20.599466+0000","last_became_active":"2023-11-27T18:13:20.912734+0000","last_became_peered":"2023-11-27T18:13:20.912734+0000","last_unstale":"2023-11-27T18:42:20.599466+0000","last_undegraded":"2023-11-27T18:42:20.599466+0000","last_fullsized":"2023-11-27T18:42:20.599466+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:35:39.280506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":13642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"32'25","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.093855+0000","last_change":"2023-11-27T18:13:14.364027+0000","last_active":"2023-11-27T18:43:23.093855+0000","last_peered":"2023-11-27T18:43:23.093855+0000","last_clean":"2023-11-27T18:43:23.093855+0000","last_became_active":"2023-11-27T18:13:14.363772+0000","last_became_peered":"2023-11-27T18:13:14.363772+0000","last_unstale":"2023-11-27T18:43:23.093855+0000","last_undegraded":"2023-11-27T18:43:23.093855+0000","last_fullsized":"2023-11-27T18:43:23.093855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:40:12.521779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"32'4","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:58.522360+0000","last_change":"2023-11-27T18:13:12.304785+0000","last_active":"2023-11-27T18:42:58.522360+0000","last_peered":"2023-11-27T18:42:58.522360+0000","last_clean":"2023-11-27T18:42:58.522360+0000","last_became_active":"2023-11-27T18:13:12.304400+0000","last_became_peered":"2023-11-27T18:13:12.304400+0000","last_unstale":"2023-11-27T18:42:58.522360+0000","last_undegraded":"2023-11-27T18:42:58.522360+0000","last_fullsized":"2023-11-27T18:42:58.522360+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:37:52.292054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"32'60","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:17.887775+0000","last_change":"2023-11-27T18:13:20.922959+0000","last_active":"2023-11-27T18:42:17.887775+0000","last_peered":"2023-11-27T18:42:17.887775+0000","last_clean":"2023-11-27T18:42:17.887775+0000","last_became_active":"2023-11-27T18:13:20.918984+0000","last_became_peered":"2023-11-27T18:13:20.918984+0000","last_unstale":"2023-11-27T18:42:17.887775+0000","last_undegraded":"2023-11-27T18:42:17.887775+0000","last_fullsized":"2023-11-27T18:42:17.887775+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:59:33.426999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":5801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"32'17","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.089097+0000","last_change":"2023-11-27T18:13:15.852939+0000","last_active":"2023-11-27T18:43:23.089097+0000","last_peered":"2023-11-27T18:43:23.089097+0000","last_clean":"2023-11-27T18:43:23.089097+0000","last_became_active":"2023-11-27T18:13:15.852339+0000","last_became_peered":"2023-11-27T18:13:15.852339+0000","last_unstale":"2023-11-27T18:43:23.089097+0000","last_undegraded":"2023-11-27T18:43:23.089097+0000","last_fullsized":"2023-11-27T18:43:23.089097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:31:25.796567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"32'7","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:44.051058+0000","last_change":"2023-11-27T18:13:12.311109+0000","last_active":"2023-11-27T18:42:44.051058+0000","last_peered":"2023-11-27T18:42:44.051058+0000","last_clean":"2023-11-27T18:42:44.051058+0000","last_became_active":"2023-11-27T18:13:12.310921+0000","last_became_peered":"2023-11-27T18:13:12.310921+0000","last_unstale":"2023-11-27T18:42:44.051058+0000","last_undegraded":"2023-11-27T18:42:44.051058+0000","last_fullsized":"2023-11-27T18:42:44.051058+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:05:04.546929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"32'108","reported_seq":138,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:20.603467+0000","last_change":"2023-11-27T18:13:20.925265+0000","last_active":"2023-11-27T18:42:20.603467+0000","last_peered":"2023-11-27T18:42:20.603467+0000","last_clean":"2023-11-27T18:42:20.603467+0000","last_became_active":"2023-11-27T18:13:20.924209+0000","last_became_peered":"2023-11-27T18:13:20.924209+0000","last_unstale":"2023-11-27T18:42:20.603467+0000","last_undegraded":"2023-11-27T18:42:20.603467+0000","last_fullsized":"2023-11-27T18:42:20.603467+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:31:33.484992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":10743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"32'21","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:22.999427+0000","last_change":"2023-11-27T18:13:14.421768+0000","last_active":"2023-11-27T18:43:22.999427+0000","last_peered":"2023-11-27T18:43:22.999427+0000","last_clean":"2023-11-27T18:43:22.999427+0000","last_became_active":"2023-11-27T18:13:14.421377+0000","last_became_peered":"2023-11-27T18:13:14.421377+0000","last_unstale":"2023-11-27T18:43:22.999427+0000","last_undegraded":"2023-11-27T18:43:22.999427+0000","last_fullsized":"2023-11-27T18:43:22.999427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:00:27.736589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"32'12","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:12.261402+0000","last_change":"2023-11-27T18:13:12.178547+0000","last_active":"2023-11-27T18:43:12.261402+0000","last_peered":"2023-11-27T18:43:12.261402+0000","last_clean":"2023-11-27T18:43:12.261402+0000","last_became_active":"2023-11-27T18:13:12.177997+0000","last_became_peered":"2023-11-27T18:13:12.177997+0000","last_unstale":"2023-11-27T18:43:12.261402+0000","last_undegraded":"2023-11-27T18:43:12.261402+0000","last_fullsized":"2023-11-27T18:43:12.261402+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:29:10.535816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"32'95","reported_seq":124,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:20.353428+0000","last_change":"2023-11-27T18:13:20.914541+0000","last_active":"2023-11-27T18:42:20.353428+0000","last_peered":"2023-11-27T18:42:20.353428+0000","last_clean":"2023-11-27T18:42:20.353428+0000","last_became_active":"2023-11-27T18:13:20.914144+0000","last_became_peered":"2023-11-27T18:13:20.914144+0000","last_unstale":"2023-11-27T18:42:20.353428+0000","last_undegraded":"2023-11-27T18:42:20.353428+0000","last_fullsized":"2023-11-27T18:42:20.353428+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:29:17.716220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":5846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"32'23","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.104070+0000","last_change":"2023-11-27T18:13:15.802553+0000","last_active":"2023-11-27T18:43:23.104070+0000","last_peered":"2023-11-27T18:43:23.104070+0000","last_clean":"2023-11-27T18:43:23.104070+0000","last_became_active":"2023-11-27T18:13:15.801804+0000","last_became_peered":"2023-11-27T18:13:15.801804+0000","last_unstale":"2023-11-27T18:43:23.104070+0000","last_undegraded":"2023-11-27T18:43:23.104070+0000","last_fullsized":"2023-11-27T18:43:23.104070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:50:47.259554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"32'5","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:48.122380+0000","last_change":"2023-11-27T18:13:12.300863+0000","last_active":"2023-11-27T18:42:48.122380+0000","last_peered":"2023-11-27T18:42:48.122380+0000","last_clean":"2023-11-27T18:42:48.122380+0000","last_became_active":"2023-11-27T18:13:12.300585+0000","last_became_peered":"2023-11-27T18:13:12.300585+0000","last_unstale":"2023-11-27T18:42:48.122380+0000","last_undegraded":"2023-11-27T18:42:48.122380+0000","last_fullsized":"2023-11-27T18:42:48.122380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:27:04.532776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"32'85","reported_seq":114,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:20.600878+0000","last_change":"2023-11-27T18:13:20.915245+0000","last_active":"2023-11-27T18:42:20.600878+0000","last_peered":"2023-11-27T18:42:20.600878+0000","last_clean":"2023-11-27T18:42:20.600878+0000","last_became_active":"2023-11-27T18:13:20.914216+0000","last_became_peered":"2023-11-27T18:13:20.914216+0000","last_unstale":"2023-11-27T18:42:20.600878+0000","last_undegraded":"2023-11-27T18:42:20.600878+0000","last_fullsized":"2023-11-27T18:42:20.600878+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:56:44.418239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":6050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"32'39","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.020938+0000","last_change":"2023-11-27T18:14:22.518196+0000","last_active":"2023-11-27T18:43:23.020938+0000","last_peered":"2023-11-27T18:43:23.020938+0000","last_clean":"2023-11-27T18:43:23.020938+0000","last_became_active":"2023-11-27T18:14:22.517527+0000","last_became_peered":"2023-11-27T18:14:22.517527+0000","last_unstale":"2023-11-27T18:43:23.020938+0000","last_undegraded":"2023-11-27T18:43:23.020938+0000","last_fullsized":"2023-11-27T18:43:23.020938+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:35:43.631863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"32'5","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:06.997466+0000","last_change":"2023-11-27T18:13:12.305081+0000","last_active":"2023-11-27T18:43:06.997466+0000","last_peered":"2023-11-27T18:43:06.997466+0000","last_clean":"2023-11-27T18:43:06.997466+0000","last_became_active":"2023-11-27T18:13:12.304777+0000","last_became_peered":"2023-11-27T18:13:12.304777+0000","last_unstale":"2023-11-27T18:43:06.997466+0000","last_undegraded":"2023-11-27T18:43:06.997466+0000","last_fullsized":"2023-11-27T18:43:06.997466+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:22:12.680259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"32'64","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:18.594470+0000","last_change":"2023-11-27T18:13:20.904088+0000","last_active":"2023-11-27T18:42:18.594470+0000","last_peered":"2023-11-27T18:42:18.594470+0000","last_clean":"2023-11-27T18:42:18.594470+0000","last_became_active":"2023-11-27T18:13:20.902282+0000","last_became_peered":"2023-11-27T18:13:20.902282+0000","last_unstale":"2023-11-27T18:42:18.594470+0000","last_undegraded":"2023-11-27T18:42:18.594470+0000","last_fullsized":"2023-11-27T18:42:18.594470+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:26:43.789814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":6349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"32'27","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.012251+0000","last_change":"2023-11-27T18:13:14.415302+0000","last_active":"2023-11-27T18:43:23.012251+0000","last_peered":"2023-11-27T18:43:23.012251+0000","last_clean":"2023-11-27T18:43:23.012251+0000","last_became_active":"2023-11-27T18:13:14.415004+0000","last_became_peered":"2023-11-27T18:13:14.415004+0000","last_unstale":"2023-11-27T18:43:23.012251+0000","last_undegraded":"2023-11-27T18:43:23.012251+0000","last_fullsized":"2023-11-27T18:43:23.012251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:34:11.170873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"32'5","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:06.982823+0000","last_change":"2023-11-27T18:13:12.268542+0000","last_active":"2023-11-27T18:43:06.982823+0000","last_peered":"2023-11-27T18:43:06.982823+0000","last_clean":"2023-11-27T18:43:06.982823+0000","last_became_active":"2023-11-27T18:13:12.268237+0000","last_became_peered":"2023-11-27T18:13:12.268237+0000","last_unstale":"2023-11-27T18:43:06.982823+0000","last_undegraded":"2023-11-27T18:43:06.982823+0000","last_fullsized":"2023-11-27T18:43:06.982823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:15:07.514381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"32'82","reported_seq":111,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:22.983811+0000","last_change":"2023-11-27T18:13:20.900393+0000","last_active":"2023-11-27T18:42:22.983811+0000","last_peered":"2023-11-27T18:42:22.983811+0000","last_clean":"2023-11-27T18:42:22.983811+0000","last_became_active":"2023-11-27T18:13:20.899358+0000","last_became_peered":"2023-11-27T18:13:20.899358+0000","last_unstale":"2023-11-27T18:42:22.983811+0000","last_undegraded":"2023-11-27T18:42:22.983811+0000","last_fullsized":"2023-11-27T18:42:22.983811+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:27:58.837417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":8446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"32'23","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.066215+0000","last_change":"2023-11-27T18:13:14.371842+0000","last_active":"2023-11-27T18:43:23.066215+0000","last_peered":"2023-11-27T18:43:23.066215+0000","last_clean":"2023-11-27T18:43:23.066215+0000","last_became_active":"2023-11-27T18:13:14.371637+0000","last_became_peered":"2023-11-27T18:13:14.371637+0000","last_unstale":"2023-11-27T18:43:23.066215+0000","last_undegraded":"2023-11-27T18:43:23.066215+0000","last_fullsized":"2023-11-27T18:43:23.066215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:22:13.884437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"32'871","reported_seq":904,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:09.052491+0000","last_change":"2023-11-27T18:13:12.248404+0000","last_active":"2023-11-27T18:43:09.052491+0000","last_peered":"2023-11-27T18:43:09.052491+0000","last_clean":"2023-11-27T18:43:09.052491+0000","last_became_active":"2023-11-27T18:13:12.248077+0000","last_became_peered":"2023-11-27T18:13:12.248077+0000","last_unstale":"2023-11-27T18:43:09.052491+0000","last_undegraded":"2023-11-27T18:43:09.052491+0000","last_fullsized":"2023-11-27T18:43:09.052491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":871,"log_dups_size":0,"ondisk_log_size":871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:34:21.166265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":867,"num_write_kb":4596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"32'83","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:18.926289+0000","last_change":"2023-11-27T18:13:20.919046+0000","last_active":"2023-11-27T18:42:18.926289+0000","last_peered":"2023-11-27T18:42:18.926289+0000","last_clean":"2023-11-27T18:42:18.926289+0000","last_became_active":"2023-11-27T18:13:20.918381+0000","last_became_peered":"2023-11-27T18:13:20.918381+0000","last_unstale":"2023-11-27T18:42:18.926289+0000","last_undegraded":"2023-11-27T18:42:18.926289+0000","last_fullsized":"2023-11-27T18:42:18.926289+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:17:07.092549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":11273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"32'25","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.022858+0000","last_change":"2023-11-27T18:13:14.415453+0000","last_active":"2023-11-27T18:43:23.022858+0000","last_peered":"2023-11-27T18:43:23.022858+0000","last_clean":"2023-11-27T18:43:23.022858+0000","last_became_active":"2023-11-27T18:13:14.415026+0000","last_became_peered":"2023-11-27T18:13:14.415026+0000","last_unstale":"2023-11-27T18:43:23.022858+0000","last_undegraded":"2023-11-27T18:43:23.022858+0000","last_fullsized":"2023-11-27T18:43:23.022858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:35:37.255102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"32'400","reported_seq":433,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:15.251117+0000","last_change":"2023-11-27T18:13:12.180737+0000","last_active":"2023-11-27T18:43:15.251117+0000","last_peered":"2023-11-27T18:43:15.251117+0000","last_clean":"2023-11-27T18:43:15.251117+0000","last_became_active":"2023-11-27T18:13:12.180112+0000","last_became_peered":"2023-11-27T18:13:12.180112+0000","last_unstale":"2023-11-27T18:43:15.251117+0000","last_undegraded":"2023-11-27T18:43:15.251117+0000","last_fullsized":"2023-11-27T18:43:15.251117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:24:22.455257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":397,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"32'109","reported_seq":138,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:20.603364+0000","last_change":"2023-11-27T18:13:20.925012+0000","last_active":"2023-11-27T18:42:20.603364+0000","last_peered":"2023-11-27T18:42:20.603364+0000","last_clean":"2023-11-27T18:42:20.603364+0000","last_became_active":"2023-11-27T18:13:20.921675+0000","last_became_peered":"2023-11-27T18:13:20.921675+0000","last_unstale":"2023-11-27T18:42:20.603364+0000","last_undegraded":"2023-11-27T18:42:20.603364+0000","last_fullsized":"2023-11-27T18:42:20.603364+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:49:08.226420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":15987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"32'29","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.087895+0000","last_change":"2023-11-27T18:13:14.415432+0000","last_active":"2023-11-27T18:43:23.087895+0000","last_peered":"2023-11-27T18:43:23.087895+0000","last_clean":"2023-11-27T18:43:23.087895+0000","last_became_active":"2023-11-27T18:13:14.415142+0000","last_became_peered":"2023-11-27T18:13:14.415142+0000","last_unstale":"2023-11-27T18:43:23.087895+0000","last_undegraded":"2023-11-27T18:43:23.087895+0000","last_fullsized":"2023-11-27T18:43:23.087895+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:39:33.850547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:44.050672+0000","last_change":"2023-11-27T18:13:12.273729+0000","last_active":"2023-11-27T18:42:44.050672+0000","last_peered":"2023-11-27T18:42:44.050672+0000","last_clean":"2023-11-27T18:42:44.050672+0000","last_became_active":"2023-11-27T18:13:12.273400+0000","last_became_peered":"2023-11-27T18:13:12.273400+0000","last_unstale":"2023-11-27T18:42:44.050672+0000","last_undegraded":"2023-11-27T18:42:44.050672+0000","last_fullsized":"2023-11-27T18:42:44.050672+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:31:10.508092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"32'83","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:18.001546+0000","last_change":"2023-11-27T18:13:20.912482+0000","last_active":"2023-11-27T18:42:18.001546+0000","last_peered":"2023-11-27T18:42:18.001546+0000","last_clean":"2023-11-27T18:42:18.001546+0000","last_became_active":"2023-11-27T18:13:20.912063+0000","last_became_peered":"2023-11-27T18:13:20.912063+0000","last_unstale":"2023-11-27T18:42:18.001546+0000","last_undegraded":"2023-11-27T18:42:18.001546+0000","last_fullsized":"2023-11-27T18:42:18.001546+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:11:56.997205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":11074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"32'29","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.090872+0000","last_change":"2023-11-27T18:13:15.911622+0000","last_active":"2023-11-27T18:43:23.090872+0000","last_peered":"2023-11-27T18:43:23.090872+0000","last_clean":"2023-11-27T18:43:23.090872+0000","last_became_active":"2023-11-27T18:13:15.911255+0000","last_became_peered":"2023-11-27T18:13:15.911255+0000","last_unstale":"2023-11-27T18:43:23.090872+0000","last_undegraded":"2023-11-27T18:43:23.090872+0000","last_fullsized":"2023-11-27T18:43:23.090872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:04:03.068428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"32'6","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:53.405822+0000","last_change":"2023-11-27T18:13:12.168028+0000","last_active":"2023-11-27T18:42:53.405822+0000","last_peered":"2023-11-27T18:42:53.405822+0000","last_clean":"2023-11-27T18:42:53.405822+0000","last_became_active":"2023-11-27T18:13:12.167740+0000","last_became_peered":"2023-11-27T18:13:12.167740+0000","last_unstale":"2023-11-27T18:42:53.405822+0000","last_undegraded":"2023-11-27T18:42:53.405822+0000","last_fullsized":"2023-11-27T18:42:53.405822+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:34:21.166265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"32'75","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:13.791640+0000","last_change":"2023-11-27T18:13:20.915480+0000","last_active":"2023-11-27T18:42:13.791640+0000","last_peered":"2023-11-27T18:42:13.791640+0000","last_clean":"2023-11-27T18:42:13.791640+0000","last_became_active":"2023-11-27T18:13:20.914607+0000","last_became_peered":"2023-11-27T18:13:20.914607+0000","last_unstale":"2023-11-27T18:42:13.791640+0000","last_undegraded":"2023-11-27T18:42:13.791640+0000","last_fullsized":"2023-11-27T18:42:13.791640+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:07:38.034431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":8428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"32'67","reported_seq":98,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:14.803902+0000","last_change":"2023-11-27T18:13:20.930508+0000","last_active":"2023-11-27T18:42:14.803902+0000","last_peered":"2023-11-27T18:42:14.803902+0000","last_clean":"2023-11-27T18:42:14.803902+0000","last_became_active":"2023-11-27T18:13:20.930060+0000","last_became_peered":"2023-11-27T18:13:20.930060+0000","last_unstale":"2023-11-27T18:42:14.803902+0000","last_undegraded":"2023-11-27T18:42:14.803902+0000","last_fullsized":"2023-11-27T18:42:14.803902+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:43:18.464867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":4718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"32'28","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.125938+0000","last_change":"2023-11-27T18:13:14.380263+0000","last_active":"2023-11-27T18:43:23.125938+0000","last_peered":"2023-11-27T18:43:23.125938+0000","last_clean":"2023-11-27T18:43:23.125938+0000","last_became_active":"2023-11-27T18:13:14.379936+0000","last_became_peered":"2023-11-27T18:13:14.379936+0000","last_unstale":"2023-11-27T18:43:23.125938+0000","last_undegraded":"2023-11-27T18:43:23.125938+0000","last_fullsized":"2023-11-27T18:43:23.125938+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:50:34.713768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"32'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:53.354565+0000","last_change":"2023-11-27T18:13:12.300977+0000","last_active":"2023-11-27T18:42:53.354565+0000","last_peered":"2023-11-27T18:42:53.354565+0000","last_clean":"2023-11-27T18:42:53.354565+0000","last_became_active":"2023-11-27T18:13:12.300624+0000","last_became_peered":"2023-11-27T18:13:12.300624+0000","last_unstale":"2023-11-27T18:42:53.354565+0000","last_undegraded":"2023-11-27T18:42:53.354565+0000","last_fullsized":"2023-11-27T18:42:53.354565+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:52:29.021393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"32'93","reported_seq":124,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:22.982291+0000","last_change":"2023-11-27T18:13:20.919870+0000","last_active":"2023-11-27T18:42:22.982291+0000","last_peered":"2023-11-27T18:42:22.982291+0000","last_clean":"2023-11-27T18:42:22.982291+0000","last_became_active":"2023-11-27T18:13:20.918816+0000","last_became_peered":"2023-11-27T18:13:20.918816+0000","last_unstale":"2023-11-27T18:42:22.982291+0000","last_undegraded":"2023-11-27T18:42:22.982291+0000","last_fullsized":"2023-11-27T18:42:22.982291+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:41:38.778382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":12357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'29","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.089906+0000","last_change":"2023-11-27T18:13:14.369562+0000","last_active":"2023-11-27T18:43:23.089906+0000","last_peered":"2023-11-27T18:43:23.089906+0000","last_clean":"2023-11-27T18:43:23.089906+0000","last_became_active":"2023-11-27T18:13:14.368880+0000","last_became_peered":"2023-11-27T18:13:14.368880+0000","last_unstale":"2023-11-27T18:43:23.089906+0000","last_undegraded":"2023-11-27T18:43:23.089906+0000","last_fullsized":"2023-11-27T18:43:23.089906+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:22:13.884437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:37.590691+0000","last_change":"2023-11-27T18:13:12.270113+0000","last_active":"2023-11-27T18:42:37.590691+0000","last_peered":"2023-11-27T18:42:37.590691+0000","last_clean":"2023-11-27T18:42:37.590691+0000","last_became_active":"2023-11-27T18:13:12.269755+0000","last_became_peered":"2023-11-27T18:13:12.269755+0000","last_unstale":"2023-11-27T18:42:37.590691+0000","last_undegraded":"2023-11-27T18:42:37.590691+0000","last_fullsized":"2023-11-27T18:42:37.590691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:51:01.410940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"32'663","reported_seq":696,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:49.086954+0000","last_change":"2023-11-27T18:13:12.307568+0000","last_active":"2023-11-27T18:42:49.086954+0000","last_peered":"2023-11-27T18:42:49.086954+0000","last_clean":"2023-11-27T18:42:49.086954+0000","last_became_active":"2023-11-27T18:13:12.307299+0000","last_became_peered":"2023-11-27T18:13:12.307299+0000","last_unstale":"2023-11-27T18:42:49.086954+0000","last_undegraded":"2023-11-27T18:42:49.086954+0000","last_fullsized":"2023-11-27T18:42:49.086954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":663,"log_dups_size":0,"ondisk_log_size":663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:19:01.319681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":658,"num_write_kb":4457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"32'24","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.124787+0000","last_change":"2023-11-27T18:13:14.378937+0000","last_active":"2023-11-27T18:43:23.124787+0000","last_peered":"2023-11-27T18:43:23.124787+0000","last_clean":"2023-11-27T18:43:23.124787+0000","last_became_active":"2023-11-27T18:13:14.378635+0000","last_became_peered":"2023-11-27T18:13:14.378635+0000","last_unstale":"2023-11-27T18:43:23.124787+0000","last_undegraded":"2023-11-27T18:43:23.124787+0000","last_fullsized":"2023-11-27T18:43:23.124787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:06:40.533610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"32'56","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:20.778247+0000","last_change":"2023-11-27T18:13:20.903249+0000","last_active":"2023-11-27T18:42:20.778247+0000","last_peered":"2023-11-27T18:42:20.778247+0000","last_clean":"2023-11-27T18:42:20.778247+0000","last_became_active":"2023-11-27T18:13:20.902571+0000","last_became_peered":"2023-11-27T18:13:20.902571+0000","last_unstale":"2023-11-27T18:42:20.778247+0000","last_undegraded":"2023-11-27T18:42:20.778247+0000","last_fullsized":"2023-11-27T18:42:20.778247+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:41:48.892641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":3581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"32'592","reported_seq":624,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:01.804907+0000","last_change":"2023-11-27T18:13:12.304324+0000","last_active":"2023-11-27T18:43:01.804907+0000","last_peered":"2023-11-27T18:43:01.804907+0000","last_clean":"2023-11-27T18:43:01.804907+0000","last_became_active":"2023-11-27T18:13:12.303988+0000","last_became_peered":"2023-11-27T18:13:12.303988+0000","last_unstale":"2023-11-27T18:43:01.804907+0000","last_undegraded":"2023-11-27T18:43:01.804907+0000","last_fullsized":"2023-11-27T18:43:01.804907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:47:59.518332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":588,"num_write_kb":4406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"32'22","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.112292+0000","last_change":"2023-11-27T18:13:15.803183+0000","last_active":"2023-11-27T18:43:23.112292+0000","last_peered":"2023-11-27T18:43:23.112292+0000","last_clean":"2023-11-27T18:43:23.112292+0000","last_became_active":"2023-11-27T18:13:15.802420+0000","last_became_peered":"2023-11-27T18:13:15.802420+0000","last_unstale":"2023-11-27T18:43:23.112292+0000","last_undegraded":"2023-11-27T18:43:23.112292+0000","last_fullsized":"2023-11-27T18:43:23.112292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:51:02.615119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"32'93","reported_seq":116,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:20.605149+0000","last_change":"2023-11-27T18:14:22.716310+0000","last_active":"2023-11-27T18:42:20.605149+0000","last_peered":"2023-11-27T18:42:20.605149+0000","last_clean":"2023-11-27T18:42:20.605149+0000","last_became_active":"2023-11-27T18:14:22.715684+0000","last_became_peered":"2023-11-27T18:14:22.715684+0000","last_unstale":"2023-11-27T18:42:20.605149+0000","last_undegraded":"2023-11-27T18:42:20.605149+0000","last_fullsized":"2023-11-27T18:42:20.605149+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:33:36.215484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":6465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,0],"acting":[2,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"32'34","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.088789+0000","last_change":"2023-11-27T18:13:15.849183+0000","last_active":"2023-11-27T18:43:23.088789+0000","last_peered":"2023-11-27T18:43:23.088789+0000","last_clean":"2023-11-27T18:43:23.088789+0000","last_became_active":"2023-11-27T18:13:15.848503+0000","last_became_peered":"2023-11-27T18:13:15.848503+0000","last_unstale":"2023-11-27T18:43:23.088789+0000","last_undegraded":"2023-11-27T18:43:23.088789+0000","last_fullsized":"2023-11-27T18:43:23.088789+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:14:48.774302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"32'28","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:22.930797+0000","last_change":"2023-11-27T18:13:14.336349+0000","last_active":"2023-11-27T18:43:22.930797+0000","last_peered":"2023-11-27T18:43:22.930797+0000","last_clean":"2023-11-27T18:43:22.930797+0000","last_became_active":"2023-11-27T18:13:14.336072+0000","last_became_peered":"2023-11-27T18:13:14.336072+0000","last_unstale":"2023-11-27T18:43:22.930797+0000","last_undegraded":"2023-11-27T18:43:22.930797+0000","last_fullsized":"2023-11-27T18:43:22.930797+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:54:58.777656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"32'27","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.008110+0000","last_change":"2023-11-27T18:13:14.421713+0000","last_active":"2023-11-27T18:43:23.008110+0000","last_peered":"2023-11-27T18:43:23.008110+0000","last_clean":"2023-11-27T18:43:23.008110+0000","last_became_active":"2023-11-27T18:13:14.418679+0000","last_became_peered":"2023-11-27T18:13:14.418679+0000","last_unstale":"2023-11-27T18:43:23.008110+0000","last_undegraded":"2023-11-27T18:43:23.008110+0000","last_fullsized":"2023-11-27T18:43:23.008110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:53:03.917430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"32'22","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.087244+0000","last_change":"2023-11-27T18:13:14.376601+0000","last_active":"2023-11-27T18:43:23.087244+0000","last_peered":"2023-11-27T18:43:23.087244+0000","last_clean":"2023-11-27T18:43:23.087244+0000","last_became_active":"2023-11-27T18:13:14.376292+0000","last_became_peered":"2023-11-27T18:13:14.376292+0000","last_unstale":"2023-11-27T18:43:23.087244+0000","last_undegraded":"2023-11-27T18:43:23.087244+0000","last_fullsized":"2023-11-27T18:43:23.087244+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:52:30.225572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"32'16","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.007978+0000","last_change":"2023-11-27T18:13:14.367285+0000","last_active":"2023-11-27T18:43:23.007978+0000","last_peered":"2023-11-27T18:43:23.007978+0000","last_clean":"2023-11-27T18:43:23.007978+0000","last_became_active":"2023-11-27T18:13:14.366983+0000","last_became_peered":"2023-11-27T18:13:14.366983+0000","last_unstale":"2023-11-27T18:43:23.007978+0000","last_undegraded":"2023-11-27T18:43:23.007978+0000","last_fullsized":"2023-11-27T18:43:23.007978+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:04:31.925421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"32'22","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.008178+0000","last_change":"2023-11-27T18:13:14.375744+0000","last_active":"2023-11-27T18:43:23.008178+0000","last_peered":"2023-11-27T18:43:23.008178+0000","last_clean":"2023-11-27T18:43:23.008178+0000","last_became_active":"2023-11-27T18:13:14.375466+0000","last_became_peered":"2023-11-27T18:13:14.375466+0000","last_unstale":"2023-11-27T18:43:23.008178+0000","last_undegraded":"2023-11-27T18:43:23.008178+0000","last_fullsized":"2023-11-27T18:43:23.008178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:03:10.250350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"32'33","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.089376+0000","last_change":"2023-11-27T18:13:15.911021+0000","last_active":"2023-11-27T18:43:23.089376+0000","last_peered":"2023-11-27T18:43:23.089376+0000","last_clean":"2023-11-27T18:43:23.089376+0000","last_became_active":"2023-11-27T18:13:15.910418+0000","last_became_peered":"2023-11-27T18:13:15.910418+0000","last_unstale":"2023-11-27T18:43:23.089376+0000","last_undegraded":"2023-11-27T18:43:23.089376+0000","last_fullsized":"2023-11-27T18:43:23.089376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:55:45.033833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"32'19","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.087549+0000","last_change":"2023-11-27T18:13:14.368483+0000","last_active":"2023-11-27T18:43:23.087549+0000","last_peered":"2023-11-27T18:43:23.087549+0000","last_clean":"2023-11-27T18:43:23.087549+0000","last_became_active":"2023-11-27T18:13:14.366249+0000","last_became_peered":"2023-11-27T18:13:14.366249+0000","last_unstale":"2023-11-27T18:43:23.087549+0000","last_undegraded":"2023-11-27T18:43:23.087549+0000","last_fullsized":"2023-11-27T18:43:23.087549+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:52:43.071209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"32'19","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.009319+0000","last_change":"2023-11-27T18:13:14.415379+0000","last_active":"2023-11-27T18:43:23.009319+0000","last_peered":"2023-11-27T18:43:23.009319+0000","last_clean":"2023-11-27T18:43:23.009319+0000","last_became_active":"2023-11-27T18:13:14.414873+0000","last_became_peered":"2023-11-27T18:13:14.414873+0000","last_unstale":"2023-11-27T18:43:23.009319+0000","last_undegraded":"2023-11-27T18:43:23.009319+0000","last_fullsized":"2023-11-27T18:43:23.009319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:40:12.521779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'30","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.090541+0000","last_change":"2023-11-27T18:13:14.416351+0000","last_active":"2023-11-27T18:43:23.090541+0000","last_peered":"2023-11-27T18:43:23.090541+0000","last_clean":"2023-11-27T18:43:23.090541+0000","last_became_active":"2023-11-27T18:13:14.416072+0000","last_became_peered":"2023-11-27T18:13:14.416072+0000","last_unstale":"2023-11-27T18:43:23.090541+0000","last_undegraded":"2023-11-27T18:43:23.090541+0000","last_fullsized":"2023-11-27T18:43:23.090541+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:31:11.712270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"32'25","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.112998+0000","last_change":"2023-11-27T18:13:15.801534+0000","last_active":"2023-11-27T18:43:23.112998+0000","last_peered":"2023-11-27T18:43:23.112998+0000","last_clean":"2023-11-27T18:43:23.112998+0000","last_became_active":"2023-11-27T18:13:15.800699+0000","last_became_peered":"2023-11-27T18:13:15.800699+0000","last_unstale":"2023-11-27T18:43:23.112998+0000","last_undegraded":"2023-11-27T18:43:23.112998+0000","last_fullsized":"2023-11-27T18:43:23.112998+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:39:39.512202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"32'35","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.124464+0000","last_change":"2023-11-27T18:13:14.413935+0000","last_active":"2023-11-27T18:43:23.124464+0000","last_peered":"2023-11-27T18:43:23.124464+0000","last_clean":"2023-11-27T18:43:23.124464+0000","last_became_active":"2023-11-27T18:13:14.413567+0000","last_became_peered":"2023-11-27T18:13:14.413567+0000","last_unstale":"2023-11-27T18:43:23.124464+0000","last_undegraded":"2023-11-27T18:43:23.124464+0000","last_fullsized":"2023-11-27T18:43:23.124464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:51:07.667299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"32'26","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.090895+0000","last_change":"2023-11-27T18:13:14.363105+0000","last_active":"2023-11-27T18:43:23.090895+0000","last_peered":"2023-11-27T18:43:23.090895+0000","last_clean":"2023-11-27T18:43:23.090895+0000","last_became_active":"2023-11-27T18:13:14.362805+0000","last_became_peered":"2023-11-27T18:13:14.362805+0000","last_unstale":"2023-11-27T18:43:23.090895+0000","last_undegraded":"2023-11-27T18:43:23.090895+0000","last_fullsized":"2023-11-27T18:43:23.090895+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:19:02.523860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"32'25","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:22.999913+0000","last_change":"2023-11-27T18:13:14.416119+0000","last_active":"2023-11-27T18:43:22.999913+0000","last_peered":"2023-11-27T18:43:22.999913+0000","last_clean":"2023-11-27T18:43:22.999913+0000","last_became_active":"2023-11-27T18:13:14.415661+0000","last_became_peered":"2023-11-27T18:13:14.415661+0000","last_unstale":"2023-11-27T18:43:22.999913+0000","last_undegraded":"2023-11-27T18:43:22.999913+0000","last_fullsized":"2023-11-27T18:43:22.999913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:56:36.729814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"32'35","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:22.929454+0000","last_change":"2023-11-27T18:13:14.413859+0000","last_active":"2023-11-27T18:43:22.929454+0000","last_peered":"2023-11-27T18:43:22.929454+0000","last_clean":"2023-11-27T18:43:22.929454+0000","last_became_active":"2023-11-27T18:13:14.413542+0000","last_became_peered":"2023-11-27T18:13:14.413542+0000","last_unstale":"2023-11-27T18:43:22.929454+0000","last_undegraded":"2023-11-27T18:43:22.929454+0000","last_fullsized":"2023-11-27T18:43:22.929454+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:24:16.125984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"32'23","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.004112+0000","last_change":"2023-11-27T18:13:14.417018+0000","last_active":"2023-11-27T18:43:23.004112+0000","last_peered":"2023-11-27T18:43:23.004112+0000","last_clean":"2023-11-27T18:43:23.004112+0000","last_became_active":"2023-11-27T18:13:14.416556+0000","last_became_peered":"2023-11-27T18:13:14.416556+0000","last_unstale":"2023-11-27T18:43:23.004112+0000","last_undegraded":"2023-11-27T18:43:23.004112+0000","last_fullsized":"2023-11-27T18:43:23.004112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:03:59.054125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"32'28","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.011337+0000","last_change":"2023-11-27T18:13:14.419437+0000","last_active":"2023-11-27T18:43:23.011337+0000","last_peered":"2023-11-27T18:43:23.011337+0000","last_clean":"2023-11-27T18:43:23.011337+0000","last_became_active":"2023-11-27T18:13:14.418823+0000","last_became_peered":"2023-11-27T18:13:14.418823+0000","last_unstale":"2023-11-27T18:43:23.011337+0000","last_undegraded":"2023-11-27T18:43:23.011337+0000","last_fullsized":"2023-11-27T18:43:23.011337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:26:36.101388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"32'26","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.087519+0000","last_change":"2023-11-27T18:13:14.368373+0000","last_active":"2023-11-27T18:43:23.087519+0000","last_peered":"2023-11-27T18:43:23.087519+0000","last_clean":"2023-11-27T18:43:23.087519+0000","last_became_active":"2023-11-27T18:13:14.368100+0000","last_became_peered":"2023-11-27T18:13:14.368100+0000","last_unstale":"2023-11-27T18:43:23.087519+0000","last_undegraded":"2023-11-27T18:43:23.087519+0000","last_fullsized":"2023-11-27T18:43:23.087519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:27:05.736955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"32'26","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.008498+0000","last_change":"2023-11-27T18:13:14.376812+0000","last_active":"2023-11-27T18:43:23.008498+0000","last_peered":"2023-11-27T18:43:23.008498+0000","last_clean":"2023-11-27T18:43:23.008498+0000","last_became_active":"2023-11-27T18:13:14.376559+0000","last_became_peered":"2023-11-27T18:13:14.376559+0000","last_unstale":"2023-11-27T18:43:23.008498+0000","last_undegraded":"2023-11-27T18:43:23.008498+0000","last_fullsized":"2023-11-27T18:43:23.008498+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:31:25.796567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"32'32","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.008507+0000","last_change":"2023-11-27T18:13:14.367518+0000","last_active":"2023-11-27T18:43:23.008507+0000","last_peered":"2023-11-27T18:43:23.008507+0000","last_clean":"2023-11-27T18:43:23.008507+0000","last_became_active":"2023-11-27T18:13:14.367298+0000","last_became_peered":"2023-11-27T18:13:14.367298+0000","last_unstale":"2023-11-27T18:43:23.008507+0000","last_undegraded":"2023-11-27T18:43:23.008507+0000","last_fullsized":"2023-11-27T18:43:23.008507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:48:00.722511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"32'17","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.094029+0000","last_change":"2023-11-27T18:13:14.364130+0000","last_active":"2023-11-27T18:43:23.094029+0000","last_peered":"2023-11-27T18:43:23.094029+0000","last_clean":"2023-11-27T18:43:23.094029+0000","last_became_active":"2023-11-27T18:13:14.363776+0000","last_became_peered":"2023-11-27T18:13:14.363776+0000","last_unstale":"2023-11-27T18:43:23.094029+0000","last_undegraded":"2023-11-27T18:43:23.094029+0000","last_fullsized":"2023-11-27T18:43:23.094029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:14:10.603135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"32'24","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.069330+0000","last_change":"2023-11-27T18:13:14.423459+0000","last_active":"2023-11-27T18:43:23.069330+0000","last_peered":"2023-11-27T18:43:23.069330+0000","last_clean":"2023-11-27T18:43:23.069330+0000","last_became_active":"2023-11-27T18:13:14.423099+0000","last_became_peered":"2023-11-27T18:13:14.423099+0000","last_unstale":"2023-11-27T18:43:23.069330+0000","last_undegraded":"2023-11-27T18:43:23.069330+0000","last_fullsized":"2023-11-27T18:43:23.069330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:39:33.850547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"32'32","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.094039+0000","last_change":"2023-11-27T18:13:14.420348+0000","last_active":"2023-11-27T18:43:23.094039+0000","last_peered":"2023-11-27T18:43:23.094039+0000","last_clean":"2023-11-27T18:43:23.094039+0000","last_became_active":"2023-11-27T18:13:14.419780+0000","last_became_peered":"2023-11-27T18:13:14.419780+0000","last_unstale":"2023-11-27T18:43:23.094039+0000","last_undegraded":"2023-11-27T18:43:23.094039+0000","last_fullsized":"2023-11-27T18:43:23.094039+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:49:00.537995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"32'29","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.112441+0000","last_change":"2023-11-27T18:13:15.910347+0000","last_active":"2023-11-27T18:43:23.112441+0000","last_peered":"2023-11-27T18:43:23.112441+0000","last_clean":"2023-11-27T18:43:23.112441+0000","last_became_active":"2023-11-27T18:13:15.909918+0000","last_became_peered":"2023-11-27T18:13:15.909918+0000","last_unstale":"2023-11-27T18:43:23.112441+0000","last_undegraded":"2023-11-27T18:43:23.112441+0000","last_fullsized":"2023-11-27T18:43:23.112441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:14:48.774302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"32'19","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.095169+0000","last_change":"2023-11-27T18:13:14.369974+0000","last_active":"2023-11-27T18:43:23.095169+0000","last_peered":"2023-11-27T18:43:23.095169+0000","last_clean":"2023-11-27T18:43:23.095169+0000","last_became_active":"2023-11-27T18:13:14.369285+0000","last_became_peered":"2023-11-27T18:13:14.369285+0000","last_unstale":"2023-11-27T18:43:23.095169+0000","last_undegraded":"2023-11-27T18:43:23.095169+0000","last_fullsized":"2023-11-27T18:43:23.095169+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:23:56.484932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"32'20","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.056701+0000","last_change":"2023-11-27T18:13:14.385745+0000","last_active":"2023-11-27T18:43:23.056701+0000","last_peered":"2023-11-27T18:43:23.056701+0000","last_clean":"2023-11-27T18:43:23.056701+0000","last_became_active":"2023-11-27T18:13:14.385566+0000","last_became_peered":"2023-11-27T18:13:14.385566+0000","last_unstale":"2023-11-27T18:43:23.056701+0000","last_undegraded":"2023-11-27T18:43:23.056701+0000","last_fullsized":"2023-11-27T18:43:23.056701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:52:43.071209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"32'26","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.088701+0000","last_change":"2023-11-27T18:13:15.848952+0000","last_active":"2023-11-27T18:43:23.088701+0000","last_peered":"2023-11-27T18:43:23.088701+0000","last_clean":"2023-11-27T18:43:23.088701+0000","last_became_active":"2023-11-27T18:13:15.848237+0000","last_became_peered":"2023-11-27T18:13:15.848237+0000","last_unstale":"2023-11-27T18:43:23.088701+0000","last_undegraded":"2023-11-27T18:43:23.088701+0000","last_fullsized":"2023-11-27T18:43:23.088701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:39:39.512202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"32'23","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.087188+0000","last_change":"2023-11-27T18:13:14.373247+0000","last_active":"2023-11-27T18:43:23.087188+0000","last_peered":"2023-11-27T18:43:23.087188+0000","last_clean":"2023-11-27T18:43:23.087188+0000","last_became_active":"2023-11-27T18:13:14.372974+0000","last_became_peered":"2023-11-27T18:13:14.372974+0000","last_unstale":"2023-11-27T18:43:23.087188+0000","last_undegraded":"2023-11-27T18:43:23.087188+0000","last_fullsized":"2023-11-27T18:43:23.087188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:39:34.589545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"32'18","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.091049+0000","last_change":"2023-11-27T18:13:15.851685+0000","last_active":"2023-11-27T18:43:23.091049+0000","last_peered":"2023-11-27T18:43:23.091049+0000","last_clean":"2023-11-27T18:43:23.091049+0000","last_became_active":"2023-11-27T18:13:15.850353+0000","last_became_peered":"2023-11-27T18:13:15.850353+0000","last_unstale":"2023-11-27T18:43:23.091049+0000","last_undegraded":"2023-11-27T18:43:23.091049+0000","last_fullsized":"2023-11-27T18:43:23.091049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:51:02.615119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"32'25","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.085199+0000","last_change":"2023-11-27T18:13:14.381126+0000","last_active":"2023-11-27T18:43:23.085199+0000","last_peered":"2023-11-27T18:43:23.085199+0000","last_clean":"2023-11-27T18:43:23.085199+0000","last_became_active":"2023-11-27T18:13:14.380714+0000","last_became_peered":"2023-11-27T18:13:14.380714+0000","last_unstale":"2023-11-27T18:43:23.085199+0000","last_undegraded":"2023-11-27T18:43:23.085199+0000","last_fullsized":"2023-11-27T18:43:23.085199+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:14:10.603135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"32'19","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.084889+0000","last_change":"2023-11-27T18:13:14.368254+0000","last_active":"2023-11-27T18:43:23.084889+0000","last_peered":"2023-11-27T18:43:23.084889+0000","last_clean":"2023-11-27T18:43:23.084889+0000","last_became_active":"2023-11-27T18:13:14.367978+0000","last_became_peered":"2023-11-27T18:13:14.367978+0000","last_unstale":"2023-11-27T18:43:23.084889+0000","last_undegraded":"2023-11-27T18:43:23.084889+0000","last_fullsized":"2023-11-27T18:43:23.084889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:05:05.751108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"32'23","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.067010+0000","last_change":"2023-11-27T18:13:14.419332+0000","last_active":"2023-11-27T18:43:23.067010+0000","last_peered":"2023-11-27T18:43:23.067010+0000","last_clean":"2023-11-27T18:43:23.067010+0000","last_became_active":"2023-11-27T18:13:14.418928+0000","last_became_peered":"2023-11-27T18:13:14.418928+0000","last_unstale":"2023-11-27T18:43:23.067010+0000","last_undegraded":"2023-11-27T18:43:23.067010+0000","last_fullsized":"2023-11-27T18:43:23.067010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:34:08.186176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2386,"num_write_kb":255070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2569,"ondisk_log_size":2569,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1576,"ondisk_log_size":1576,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":24107291,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":549,"num_read_kb":581,"num_write":5694,"num_write_kb":26819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32874496,"data_stored":48214582,"data_compressed":4737124,"data_compressed_allocated":7356416,"data_compressed_original":22757376,"omap_allocated":0,"internal_metadata":0},"log_size":5241,"ondisk_log_size":5241,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67010,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719477110,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36008,"kb_used_data":4832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335832,"statfs":{"total":96636764160,"available":96599891968,"internally_reserved":0,"allocated":4947968,"data_stored":8056568,"data_compressed":850146,"data_compressed_allocated":1241088,"data_compressed_original":4562944,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.874,"15min":0.85699999999999998},"min":{"1min":0.64000000000000001,"5min":0.5,"15min":0.45400000000000001},"max":{"1min":1.262,"5min":1.288,"15min":1.4730000000000001},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.93799999999999994,"15min":0.93300000000000005},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.46000000000000002},"max":{"1min":1.258,"5min":1.377,"15min":1.49},"last":1.002}]},{"osd":1,"last update":"Mon Nov 27 18:42:37 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.998,"15min":0.96599999999999997},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.57199999999999995},"max":{"1min":1.319,"5min":1.51,"15min":1.51},"last":1.161},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.95099999999999996,"15min":0.93200000000000005},"min":{"1min":0.65400000000000003,"5min":0.55100000000000005,"15min":0.45900000000000002},"max":{"1min":1.3460000000000001,"5min":1.361,"15min":1.482},"last":1.052}]},{"osd":2,"last update":"Mon Nov 27 18:42:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":0.99199999999999999,"15min":0.97799999999999998},"min":{"1min":0.628,"5min":0.59899999999999998,"15min":0.53900000000000003},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.603},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.92800000000000005,"15min":0.93300000000000005},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.52700000000000002},"max":{"1min":1.2110000000000001,"5min":1.389,"15min":1.389},"last":1.087}]},{"osd":3,"last update":"Mon Nov 27 18:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.99099999999999999,"15min":0.97799999999999998},"min":{"1min":0.67900000000000005,"5min":0.64500000000000002,"15min":0.63300000000000001},"max":{"1min":1.244,"5min":1.3859999999999999,"15min":1.472},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.073,"5min":1.0589999999999999,"15min":1.0429999999999999},"min":{"1min":0.77100000000000002,"5min":0.64800000000000002,"15min":0.61399999999999999},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":1.3049999999999999}]},{"osd":4,"last update":"Mon Nov 27 18:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90800000000000003,"15min":0.90200000000000002},"min":{"1min":0.496,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.194,"5min":1.397,"15min":1.4470000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.03,"5min":1.0349999999999999,"15min":1.0049999999999999},"min":{"1min":0.56799999999999995,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.3120000000000001,"5min":1.6020000000000001,"15min":1.6379999999999999},"last":1.2809999999999999}]},{"osd":6,"last update":"Mon Nov 27 18:42:37 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.0189999999999999,"15min":1.0109999999999999},"min":{"1min":0.66400000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.4019999999999999,"5min":1.466,"15min":1.49},"last":1.2470000000000001},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0429999999999999,"15min":1.034},"min":{"1min":0.71599999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.2969999999999999,"5min":1.5049999999999999,"15min":1.605},"last":1.1899999999999999}]},{"osd":7,"last update":"Mon Nov 27 18:42:37 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.1679999999999999,"15min":1.125},"min":{"1min":0.65000000000000002,"5min":0.49299999999999999,"15min":0.47999999999999998},"max":{"1min":1.4910000000000001,"5min":1.6930000000000001,"15min":1.831},"last":1.327},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.2,"15min":1.181},"min":{"1min":0.76900000000000002,"5min":0.52400000000000002,"15min":0.48099999999999998},"max":{"1min":1.6639999999999999,"5min":1.768,"15min":1.768},"last":1.131}]}]},{"osd":7,"up_from":16,"seq":68719477110,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33280,"kb_used_data":2104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338560,"statfs":{"total":96636764160,"available":96602685440,"internally_reserved":0,"allocated":2154496,"data_stored":3272747,"data_compressed":386056,"data_compressed_allocated":532480,"data_compressed_original":1863680,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.88200000000000001,"15min":0.879},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.49399999999999999},"max":{"1min":1.2589999999999999,"5min":1.4199999999999999,"15min":1.448},"last":1.2010000000000001},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.95599999999999996,"15min":0.93500000000000005},"min":{"1min":0.59099999999999997,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.411,"5min":1.411,"15min":1.7110000000000001},"last":0.84699999999999998}]},{"osd":1,"last update":"Mon Nov 27 18:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.91900000000000004,"15min":0.92300000000000004},"min":{"1min":0.58599999999999997,"5min":0.54600000000000004,"15min":0.47999999999999998},"max":{"1min":1.0549999999999999,"5min":1.379,"15min":1.379},"last":0.875},{"interface":"front","average":{"1min":1.0469999999999999,"5min":0.997,"15min":0.97999999999999998},"min":{"1min":0.78300000000000003,"5min":0.63100000000000001,"15min":0.46400000000000002},"max":{"1min":1.302,"5min":1.4450000000000001,"15min":1.768},"last":0.70499999999999996}]},{"osd":2,"last update":"Mon Nov 27 18:42:22 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.0209999999999999,"15min":0.997},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.52000000000000002},"max":{"1min":1.3740000000000001,"5min":1.3999999999999999,"15min":1.6870000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.96099999999999997,"15min":0.94499999999999995},"min":{"1min":0.60599999999999998,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.363,"5min":1.363,"15min":1.415},"last":1.115}]},{"osd":3,"last update":"Mon Nov 27 18:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.99099999999999999,"15min":0.97499999999999998},"min":{"1min":0.56599999999999995,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.2649999999999999,"5min":1.4370000000000001,"15min":1.4550000000000001},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1140000000000001,"15min":1.0720000000000001},"min":{"1min":0.82699999999999996,"5min":0.64100000000000001,"15min":0.5},"max":{"1min":1.452,"5min":1.5820000000000001,"15min":1.655},"last":0.57299999999999995}]},{"osd":4,"last update":"Mon Nov 27 18:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":1.002,"15min":0.92400000000000004},"min":{"1min":0.50700000000000001,"5min":0.46000000000000002,"15min":0.28899999999999998},"max":{"1min":1.3280000000000001,"5min":6.6539999999999999,"15min":6.6539999999999999},"last":1.274},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.99399999999999999,"15min":1.004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.38800000000000001},"max":{"1min":1.2350000000000001,"5min":1.5469999999999999,"15min":2.0649999999999999},"last":1.073}]},{"osd":5,"last update":"Mon Nov 27 18:42:22 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.099,"15min":1.04},"min":{"1min":0.624,"5min":0.44500000000000001,"15min":0.35199999999999998},"max":{"1min":1.825,"5min":1.825,"15min":1.825},"last":1.163},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0409999999999999,"15min":1.034},"min":{"1min":0.58099999999999996,"5min":0.53200000000000003,"15min":0.36699999999999999},"max":{"1min":1.5569999999999999,"5min":1.679,"15min":1.679},"last":1.361}]},{"osd":6,"last update":"Mon Nov 27 18:42:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.111,"15min":1.085},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.41499999999999998},"max":{"1min":1.462,"5min":1.732,"15min":1.956},"last":1.431},{"interface":"front","average":{"1min":1.129,"5min":1.151,"15min":1.1499999999999999},"min":{"1min":0.53900000000000003,"5min":0.39500000000000002,"15min":0.32900000000000001},"max":{"1min":1.4390000000000001,"5min":1.7170000000000001,"15min":1.8839999999999999},"last":1.6479999999999999}]}]},{"osd":6,"up_from":16,"seq":68719477110,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30016,"kb_used_data":3000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341824,"statfs":{"total":96636764160,"available":96606027776,"internally_reserved":0,"allocated":3072000,"data_stored":4332626,"data_compressed":430585,"data_compressed_allocated":663552,"data_compressed_original":2125824,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.93999999999999995,"15min":0.93600000000000005},"min":{"1min":0.64600000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.2290000000000001,"5min":1.375,"15min":1.956},"last":1.129},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0609999999999999,"15min":1.04},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.534,"5min":1.5429999999999999,"15min":1.5629999999999999},"last":1.0089999999999999}]},{"osd":1,"last update":"Mon Nov 27 18:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.879,"15min":0.89300000000000002},"min":{"1min":0.58099999999999996,"5min":0.56599999999999995,"15min":0.51200000000000001},"max":{"1min":1.1679999999999999,"5min":1.4179999999999999,"15min":1.5229999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.93799999999999994,"15min":0.93400000000000005},"min":{"1min":0.63100000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3819999999999999,"5min":1.512,"15min":2.2519999999999998},"last":1.1599999999999999}]},{"osd":2,"last update":"Mon Nov 27 18:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.95899999999999996,"15min":0.95999999999999996},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.2949999999999999,"5min":2.2349999999999999,"15min":2.2349999999999999},"last":1.208},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.071,"15min":1.0580000000000001},"min":{"1min":0.76100000000000001,"5min":0.63400000000000001,"15min":0.52900000000000003},"max":{"1min":1.3819999999999999,"5min":3.6549999999999998,"15min":3.6549999999999998},"last":1.1850000000000001}]},{"osd":3,"last update":"Mon Nov 27 18:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0429999999999999,"15min":1.0389999999999999},"min":{"1min":0.75800000000000001,"5min":0.64800000000000002,"15min":0.52800000000000002},"max":{"1min":1.3420000000000001,"5min":1.7949999999999999,"15min":2.3050000000000002},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.026,"5min":1.081,"15min":1.069},"min":{"1min":0.73999999999999999,"5min":0.67300000000000004,"15min":0.57699999999999996},"max":{"1min":1.3500000000000001,"5min":2.0750000000000002,"15min":2.097},"last":0.81599999999999995}]},{"osd":4,"last update":"Mon Nov 27 18:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.95499999999999996,"15min":0.97499999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.712},"last":0.70999999999999996},{"interface":"front","average":{"1min":1.079,"5min":1.0860000000000001,"15min":1.0640000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.607,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.871}]},{"osd":5,"last update":"Mon Nov 27 18:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":1.016,"15min":0.99299999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.2909999999999999,"5min":1.879,"15min":2.173},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.075,"5min":1.133,"15min":1.1439999999999999},"min":{"1min":0.59399999999999997,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.4790000000000001,"5min":3.7509999999999999,"15min":3.7509999999999999},"last":1.0369999999999999}]},{"osd":7,"last update":"Mon Nov 27 18:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.1459999999999999,"15min":1.157},"min":{"1min":0.55300000000000005,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.4910000000000001,"5min":1.962,"15min":2.351},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.163,"15min":1.1579999999999999},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.499},"max":{"1min":1.6990000000000001,"5min":2.1150000000000002,"15min":2.2250000000000001},"last":1.0940000000000001}]}]},{"osd":3,"up_from":16,"seq":68719477108,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58052,"kb_used_data":8828,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94313788,"statfs":{"total":96636764160,"available":96577318912,"internally_reserved":0,"allocated":9039872,"data_stored":12721816,"data_compressed":1205599,"data_compressed_allocated":1880064,"data_compressed_original":5767168,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.70399999999999996,"15min":0.72299999999999998},"min":{"1min":0.497,"5min":0.40100000000000002,"15min":0.29799999999999999},"max":{"1min":1.077,"5min":1.077,"15min":1.456},"last":1.101},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.79700000000000004,"15min":0.78700000000000003},"min":{"1min":0.55800000000000005,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.006,"5min":1.387,"15min":1.4750000000000001},"last":0.93600000000000005}]},{"osd":1,"last update":"Mon Nov 27 18:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.79000000000000004,"15min":0.78700000000000003},"min":{"1min":0.54700000000000004,"5min":0.434,"15min":0.38900000000000001},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.75},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.88200000000000001,"15min":0.90300000000000002},"min":{"1min":0.64000000000000001,"5min":0.39200000000000002,"15min":0.36799999999999999},"max":{"1min":1.0880000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.0229999999999999}]},{"osd":2,"last update":"Mon Nov 27 18:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.94799999999999995,"15min":0.92400000000000004},"min":{"1min":0.67200000000000004,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.3420000000000001,"5min":1.631,"15min":1.631},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.93600000000000005,"15min":0.94999999999999996},"min":{"1min":0.61299999999999999,"5min":0.441,"15min":0.39000000000000001},"max":{"1min":1.115,"5min":1.375,"15min":1.375},"last":1.3260000000000001}]},{"osd":4,"last update":"Mon Nov 27 18:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":1.0149999999999999,"15min":0.98899999999999999},"min":{"1min":0.65700000000000003,"5min":0.57699999999999996,"15min":0.56799999999999995},"max":{"1min":1.3380000000000001,"5min":1.573,"15min":1.6439999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0289999999999999,"15min":1.0589999999999999},"min":{"1min":0.76900000000000002,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.3320000000000001,"5min":1.4950000000000001,"15min":1.605},"last":0.89600000000000002}]},{"osd":5,"last update":"Mon Nov 27 18:42:37 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.077,"15min":1.087},"min":{"1min":0.82499999999999996,"5min":0.69899999999999995,"15min":0.59799999999999998},"max":{"1min":1.409,"5min":1.6120000000000001,"15min":1.766},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.1899999999999999,"15min":1.1839999999999999},"min":{"1min":0.90500000000000003,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.536,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.179}]},{"osd":6,"last update":"Mon Nov 27 18:42:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1319999999999999,"15min":1.099},"min":{"1min":0.88800000000000001,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.597,"5min":1.607,"15min":1.8720000000000001},"last":0.85799999999999998},{"interface":"front","average":{"1min":1.141,"5min":1.171,"15min":1.1819999999999999},"min":{"1min":0.86599999999999999,"5min":0.73799999999999999,"15min":0.63300000000000001},"max":{"1min":1.504,"5min":1.7050000000000001,"15min":1.7270000000000001},"last":0.67500000000000004}]},{"osd":7,"last update":"Mon Nov 27 18:42:37 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.2490000000000001,"15min":1.2470000000000001},"min":{"1min":0.94299999999999995,"5min":0.88800000000000001,"15min":0.61299999999999999},"max":{"1min":1.4770000000000001,"5min":1.915,"15min":1.915},"last":1.254},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1990000000000001,"15min":1.1699999999999999},"min":{"1min":1.014,"5min":0.496,"15min":0.496},"max":{"1min":1.5389999999999999,"5min":1.6839999999999999,"15min":1.9339999999999999},"last":1.0069999999999999}]}]},{"osd":2,"up_from":16,"seq":68719477109,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33272,"kb_used_data":6256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94338568,"statfs":{"total":96636764160,"available":96602693632,"internally_reserved":0,"allocated":6406144,"data_stored":8527602,"data_compressed":750925,"data_compressed_allocated":1228800,"data_compressed_original":3559424,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:42:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.71699999999999997,"15min":0.72199999999999998},"min":{"1min":0.49099999999999999,"5min":0.47699999999999998,"15min":0.41599999999999998},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2869999999999999},"last":0.371},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.80400000000000005,"15min":0.82199999999999995},"min":{"1min":0.51700000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.3899999999999999,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":0.47699999999999998}]},{"osd":1,"last update":"Mon Nov 27 18:42:43 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.83699999999999997,"15min":0.85399999999999998},"min":{"1min":0.61799999999999999,"5min":0.56799999999999995,"15min":0.38500000000000001},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.89000000000000001,"15min":0.88900000000000001},"min":{"1min":0.54700000000000004,"5min":0.49399999999999999,"15min":0.48499999999999999},"max":{"1min":1.0269999999999999,"5min":2.6400000000000001,"15min":2.6400000000000001},"last":0.52700000000000002}]},{"osd":3,"last update":"Mon Nov 27 18:42:43 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84499999999999997,"15min":0.82899999999999996},"min":{"1min":0.436,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.3799999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.432},{"interface":"front","average":{"1min":1.002,"5min":0.96599999999999997,"15min":0.97399999999999998},"min":{"1min":0.72399999999999998,"5min":0.46100000000000002,"15min":0.40200000000000002},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":0.45500000000000002}]},{"osd":4,"last update":"Mon Nov 27 18:42:43 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.0309999999999999,"15min":1.044},"min":{"1min":0.871,"5min":0.71799999999999997,"15min":0.56599999999999995},"max":{"1min":1.4339999999999999,"5min":1.49,"15min":1.7090000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.028,"5min":1.0329999999999999,"15min":1.05},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.57799999999999996},"max":{"1min":1.4179999999999999,"5min":1.861,"15min":1.861},"last":0.71799999999999997}]},{"osd":5,"last update":"Mon Nov 27 18:42:43 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.0820000000000001,"15min":1.089},"min":{"1min":0.68700000000000006,"5min":0.68300000000000005,"15min":0.628},"max":{"1min":1.4650000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":0.878},{"interface":"front","average":{"1min":1.012,"5min":1.0649999999999999,"15min":1.0509999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.53000000000000003},"max":{"1min":1.3180000000000001,"5min":1.5800000000000001,"15min":1.6859999999999999},"last":0.68300000000000005}]},{"osd":6,"last update":"Mon Nov 27 18:42:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.1180000000000001,"15min":1.1080000000000001},"min":{"1min":0.58999999999999997,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.3169999999999999,"5min":1.6339999999999999,"15min":1.7490000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.1890000000000001,"15min":1.1870000000000001},"min":{"1min":0.93000000000000005,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.786,"5min":1.786,"15min":1.958},"last":0.66400000000000003}]},{"osd":7,"last update":"Mon Nov 27 18:42:43 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.194,"15min":1.1950000000000001},"min":{"1min":0.89200000000000002,"5min":0.88400000000000001,"15min":0.625},"max":{"1min":1.54,"5min":1.7869999999999999,"15min":1.8799999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.204,"15min":1.1830000000000001},"min":{"1min":0.61099999999999999,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.389,"5min":3.4289999999999998,"15min":3.4289999999999998},"last":0.70299999999999996}]}]},{"osd":1,"up_from":16,"seq":68719477109,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44056,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327784,"statfs":{"total":96636764160,"available":96591650816,"internally_reserved":0,"allocated":409600,"data_stored":728760,"data_compressed":33505,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:42:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.69899999999999995,"15min":0.71899999999999997},"min":{"1min":0.495,"5min":0.44700000000000001,"15min":0.41499999999999998},"max":{"1min":1.0209999999999999,"5min":1.1080000000000001,"15min":1.2969999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.80600000000000005,"15min":0.82899999999999996},"min":{"1min":0.54600000000000004,"5min":0.54300000000000004,"15min":0.34499999999999997},"max":{"1min":1.0629999999999999,"5min":1.306,"15min":1.397},"last":0.72699999999999998}]},{"osd":2,"last update":"Mon Nov 27 18:42:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.74099999999999999,"15min":0.74399999999999999},"min":{"1min":0.58599999999999997,"5min":0.40400000000000003,"15min":0.36299999999999999},"max":{"1min":1.0640000000000001,"5min":1.274,"15min":1.3480000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84699999999999998,"15min":0.89000000000000001},"min":{"1min":0.65400000000000003,"5min":0.48899999999999999,"15min":0.38500000000000001},"max":{"1min":1.1930000000000001,"5min":1.4359999999999999,"15min":1.9610000000000001},"last":0.84999999999999998}]},{"osd":3,"last update":"Mon Nov 27 18:42:34 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.95899999999999996,"15min":0.98199999999999998},"min":{"1min":0.52600000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.296,"5min":1.3520000000000001,"15min":1.8009999999999999},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.90300000000000002,"15min":0.91000000000000003},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.40699999999999997},"max":{"1min":1.462,"5min":1.462,"15min":2.0960000000000001},"last":0.98499999999999999}]},{"osd":4,"last update":"Mon Nov 27 18:42:34 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.97499999999999998,"15min":0.95299999999999996},"min":{"1min":0.70399999999999996,"5min":0.67800000000000005,"15min":0.51800000000000002},"max":{"1min":1.2170000000000001,"5min":1.4370000000000001,"15min":1.4970000000000001},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.087,"15min":1.099},"min":{"1min":0.75900000000000001,"5min":0.66900000000000004,"15min":0.61399999999999999},"max":{"1min":1.478,"5min":1.593,"15min":2.496},"last":1.0720000000000001}]},{"osd":5,"last update":"Mon Nov 27 18:42:34 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.073,"15min":1.0940000000000001},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.51500000000000001},"max":{"1min":1.4990000000000001,"5min":1.534,"15min":2.1970000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0660000000000001,"15min":1.0620000000000001},"min":{"1min":0.82699999999999996,"5min":0.73399999999999999,"15min":0.60599999999999998},"max":{"1min":1.573,"5min":1.605,"15min":1.7529999999999999},"last":1.3700000000000001}]},{"osd":6,"last update":"Mon Nov 27 18:42:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1830000000000001,"15min":1.2},"min":{"1min":0.83099999999999996,"5min":0.77100000000000002,"15min":0.503},"max":{"1min":1.6060000000000001,"5min":1.6879999999999999,"15min":2.4319999999999999},"last":1.3089999999999999},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.175,"15min":1.1859999999999999},"min":{"1min":0.94899999999999995,"5min":0.77800000000000002,"15min":0.52600000000000002},"max":{"1min":1.5660000000000001,"5min":1.7569999999999999,"15min":2.3700000000000001},"last":1.054}]},{"osd":7,"last update":"Mon Nov 27 18:42:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.1919999999999999,"15min":1.2190000000000001},"min":{"1min":0.99299999999999999,"5min":0.79900000000000004,"15min":0.55200000000000005},"max":{"1min":1.6160000000000001,"5min":1.6990000000000001,"15min":2.2879999999999998},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1799999999999999,"15min":1.1659999999999999},"min":{"1min":0.90700000000000003,"5min":0.79000000000000004,"15min":0.72999999999999998},"max":{"1min":1.4399999999999999,"5min":1.7070000000000001,"15min":1.7170000000000001},"last":1.2669999999999999}]}]},{"osd":0,"up_from":16,"seq":68719477110,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42672,"kb_used_data":3176,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329168,"statfs":{"total":96636764160,"available":96593068032,"internally_reserved":0,"allocated":3252224,"data_stored":4332682,"data_compressed":397480,"data_compressed_allocated":610304,"data_compressed_original":1900544,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 27 18:42:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.73799999999999999,"15min":0.72599999999999998},"min":{"1min":0.499,"5min":0.45100000000000001,"15min":0.441},"max":{"1min":1.2070000000000001,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.82599999999999996,"15min":0.83799999999999997},"min":{"1min":0.47499999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1120000000000001,"5min":1.391,"15min":1.391},"last":0.96299999999999997}]},{"osd":2,"last update":"Mon Nov 27 18:42:36 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.83399999999999996,"15min":0.86199999999999999},"min":{"1min":0.58299999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.127,"5min":1.3799999999999999,"15min":1.405},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.86099999999999999,"15min":0.86499999999999999},"min":{"1min":0.54600000000000004,"5min":0.52400000000000002,"15min":0.51900000000000002},"max":{"1min":1.1459999999999999,"5min":1.4730000000000001,"15min":1.5629999999999999},"last":0.80000000000000004}]},{"osd":3,"last update":"Mon Nov 27 18:42:36 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.88700000000000001,"15min":0.86899999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.42099999999999999},"max":{"1min":1.2410000000000001,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.96099999999999997,"15min":0.96799999999999997},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.29,"5min":1.421,"15min":2.073},"last":1.0609999999999999}]},{"osd":4,"last update":"Mon Nov 27 18:42:36 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.97799999999999998,"15min":0.97599999999999998},"min":{"1min":0.72399999999999998,"5min":0.63400000000000001,"15min":0.57099999999999995},"max":{"1min":1.2250000000000001,"5min":1.73,"15min":1.897},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.038,"5min":1.042,"15min":1.081},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.59399999999999997},"max":{"1min":1.3899999999999999,"5min":1.4059999999999999,"15min":2.1899999999999999},"last":0.77500000000000002}]},{"osd":5,"last update":"Mon Nov 27 18:42:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.089,"15min":1.0920000000000001},"min":{"1min":0.77800000000000002,"5min":0.70199999999999996,"15min":0.56899999999999995},"max":{"1min":1.3520000000000001,"5min":1.5369999999999999,"15min":2.0270000000000001},"last":1.3380000000000001},{"interface":"front","average":{"1min":0.997,"5min":1.042,"15min":1.048},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.624},"max":{"1min":1.2509999999999999,"5min":1.855,"15min":2.1480000000000001},"last":1.0149999999999999}]},{"osd":6,"last update":"Mon Nov 27 18:42:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.149,"15min":1.1679999999999999},"min":{"1min":0.73699999999999999,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.3440000000000001,"5min":1.6399999999999999,"15min":2.254},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1579999999999999,"15min":1.1779999999999999},"min":{"1min":0.874,"5min":0.83299999999999996,"15min":0.745},"max":{"1min":1.5029999999999999,"5min":1.5800000000000001,"15min":1.8440000000000001},"last":1.399}]},{"osd":7,"last update":"Mon Nov 27 18:42:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1910000000000001,"15min":1.2070000000000001},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.60799999999999998},"max":{"1min":1.556,"5min":1.591,"15min":2.1600000000000001},"last":1.454},{"interface":"front","average":{"1min":1.153,"5min":1.169,"15min":1.1619999999999999},"min":{"1min":0.93700000000000006,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.349,"5min":1.7849999999999999,"15min":2.117},"last":1.1970000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509815,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55512,"kb_used_data":6288,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94316328,"statfs":{"total":96636764160,"available":96579919872,"internally_reserved":0,"allocated":6438912,"data_stored":8528274,"data_compressed":749838,"data_compressed_allocated":1245184,"data_compressed_original":3551232,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:42:36 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.92900000000000005,"15min":0.88500000000000001},"min":{"1min":0.63600000000000001,"5min":0.47099999999999997,"15min":0.46300000000000002},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.675},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.91500000000000004,"15min":0.91400000000000003},"min":{"1min":0.55300000000000005,"5min":0.373,"15min":0.373},"max":{"1min":1.298,"5min":1.504,"15min":1.5449999999999999},"last":0.90500000000000003}]},{"osd":1,"last update":"Mon Nov 27 18:42:36 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.93899999999999995,"15min":0.93500000000000005},"min":{"1min":0.71899999999999997,"5min":0.55100000000000005,"15min":0.46100000000000002},"max":{"1min":1.4199999999999999,"5min":1.4790000000000001,"15min":2.2759999999999998},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.95899999999999996,"15min":0.95299999999999996},"min":{"1min":0.73599999999999999,"5min":0.58899999999999997,"15min":0.49399999999999999},"max":{"1min":1.3080000000000001,"5min":1.371,"15min":1.569},"last":1.105}]},{"osd":2,"last update":"Mon Nov 27 18:42:36 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.98699999999999999,"15min":0.96599999999999997},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":2.3730000000000002},"last":0.996},{"interface":"front","average":{"1min":1.012,"5min":0.99099999999999999,"15min":0.999},"min":{"1min":0.52200000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.3129999999999999,"5min":1.4770000000000001,"15min":1.7729999999999999},"last":1.264}]},{"osd":3,"last update":"Mon Nov 27 18:42:36 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":0.97599999999999998,"15min":0.95899999999999996},"min":{"1min":0.77400000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.8300000000000001},"last":1.077},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0349999999999999,"15min":1.048},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.496,"5min":1.5169999999999999,"15min":2.2069999999999999},"last":1.0529999999999999}]},{"osd":5,"last update":"Mon Nov 27 18:42:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93899999999999995,"15min":0.96699999999999997},"min":{"1min":0.59899999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.2210000000000001,"5min":1.4410000000000001,"15min":1.7290000000000001},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.083,"5min":0.96199999999999997,"15min":0.96899999999999997},"min":{"1min":0.69099999999999995,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.355,"5min":1.597,"15min":1.7150000000000001},"last":0.80600000000000005}]},{"osd":6,"last update":"Mon Nov 27 18:42:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.0569999999999999,"15min":1.038},"min":{"1min":0.72099999999999997,"5min":0.52200000000000002,"15min":0.48299999999999998},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":2.4199999999999999},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.21,"5min":1.153,"15min":1.1399999999999999},"min":{"1min":0.79100000000000004,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.4510000000000001,"5min":1.591,"15min":1.8140000000000001},"last":1.1950000000000001}]},{"osd":7,"last update":"Mon Nov 27 18:42:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.089,"15min":1.073},"min":{"1min":0.504,"5min":0.46100000000000002,"15min":0.40400000000000003},"max":{"1min":1.623,"5min":1.6859999999999999,"15min":2.0419999999999998},"last":1.028},{"interface":"front","average":{"1min":1.196,"5min":1.1599999999999999,"15min":1.165},"min":{"1min":0.53200000000000003,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.736,"5min":1.736,"15min":2.3279999999999998},"last":1.145}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33505,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33505,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2912256,"data_stored":4194360,"data_compressed":397480,"data_compressed_allocated":610304,"data_compressed_original":1900544,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6066176,"data_stored":8389280,"data_compressed":750925,"data_compressed_allocated":1228800,"data_compressed_original":3559424,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8699904,"data_stored":12583494,"data_compressed":1205599,"data_compressed_allocated":1880064,"data_compressed_original":5767168,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6098944,"data_stored":8389952,"data_compressed":749838,"data_compressed_allocated":1245184,"data_compressed_original":3551232,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4546560,"data_stored":7328697,"data_compressed":816641,"data_compressed_allocated":1196032,"data_compressed_original":3989504,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":2732032,"data_stored":4194304,"data_compressed":430585,"data_compressed_allocated":663552,"data_compressed_original":2125824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1814528,"data_stored":3134425,"data_compressed":386056,"data_compressed_allocated":532480,"data_compressed_original":1863680,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T18:43:29.650 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T18:43:29.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.804+0000 7f0023d51640 1 Processor -- start 2023-11-27T18:43:29.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.804+0000 7f0023d51640 1 -- start start 2023-11-27T18:43:29.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.808+0000 7f0023d51640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f001c0c9f60 0x7f001c0c3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:29.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.808+0000 7f0023d51640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f001c0c4330 0x7f001c0cbb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:29.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.808+0000 7f0023d51640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f001c159860 con 0x7f001c153940 2023-11-27T18:43:29.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.808+0000 7f0023d51640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f001c153d20 con 0x7f001c0c9f60 2023-11-27T18:43:29.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.808+0000 7f0023d51640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f001c159b40 con 0x7f001c0c4330 2023-11-27T18:43:29.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.808+0000 7f00212ec640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f001c0c9f60 0x7f001c0c3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:29.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.808+0000 7f00222ee640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f001c0c4330 0x7f001c0cbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:29.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.808+0000 7f00222ee640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f001c0c4330 0x7f001c0cbb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.91:35580/0 (socket says 172.21.15.91:35580) 2023-11-27T18:43:29.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.808+0000 7f00222ee640 1 -- 172.21.15.91:0/570746177 learned_addr learned my addr 172.21.15.91:0/570746177 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:29.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.816+0000 7f00222ee640 1 -- 172.21.15.91:0/570746177 >> v2:172.21.15.94:3300/0 conn(0x7f001c0c9f60 msgr2=0x7f001c0c3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:29.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.816+0000 7f00222ee640 1 --2- 172.21.15.91:0/570746177 >> v2:172.21.15.94:3300/0 conn(0x7f001c0c9f60 0x7f001c0c3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:29.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.816+0000 7f00222ee640 1 -- 172.21.15.91:0/570746177 >> v1:172.21.15.94:6789/0 conn(0x7f001c153940 legacy=0x7f001c0cafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:29.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.816+0000 7f00222ee640 1 -- 172.21.15.91:0/570746177 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f001c159e20 con 0x7f001c0c4330 2023-11-27T18:43:29.823 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.820+0000 7f00222ee640 1 --2- 172.21.15.91:0/570746177 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f001c0c4330 0x7f001c0cbb60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0018009870 tx=0x7f001801c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72b37adb7fc193d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:29.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.832+0000 7f0020aeb640 1 -- 172.21.15.91:0/570746177 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00180ab610 con 0x7f001c0c4330 2023-11-27T18:43:29.835 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.832+0000 7f0020aeb640 1 -- 172.21.15.91:0/570746177 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00180ab770 con 0x7f001c0c4330 2023-11-27T18:43:29.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.832+0000 7f0020aeb640 1 -- 172.21.15.91:0/570746177 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00180abb00 con 0x7f001c0c4330 2023-11-27T18:43:29.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.832+0000 7f0023d51640 1 -- 172.21.15.91:0/570746177 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f001c0c4330 msgr2=0x7f001c0cbb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:29.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.832+0000 7f0023d51640 1 --2- 172.21.15.91:0/570746177 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f001c0c4330 0x7f001c0cbb60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0018009870 tx=0x7f001801c540 comp rx=0 tx=0).stop 2023-11-27T18:43:29.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.832+0000 7f0023d51640 1 -- 172.21.15.91:0/570746177 shutdown_connections 2023-11-27T18:43:29.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.832+0000 7f0023d51640 1 --2- 172.21.15.91:0/570746177 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f001c0c4330 0x7f001c0cbb60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:29.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.832+0000 7f0023d51640 1 --2- 172.21.15.91:0/570746177 >> v2:172.21.15.94:3300/0 conn(0x7f001c0c9f60 0x7f001c0c3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:29.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.832+0000 7f0023d51640 1 -- 172.21.15.91:0/570746177 >> 172.21.15.91:0/570746177 conn(0x7f001c06b8f0 msgr2=0x7f001c06bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:29.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.832+0000 7f0023d51640 1 -- 172.21.15.91:0/570746177 shutdown_connections 2023-11-27T18:43:29.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.832+0000 7f0023d51640 1 -- 172.21.15.91:0/570746177 wait complete. 2023-11-27T18:43:29.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.832+0000 7f0023d51640 1 Processor -- start 2023-11-27T18:43:29.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.832+0000 7f0023d51640 1 -- start start 2023-11-27T18:43:29.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.832+0000 7f0023d51640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f001c0c4330 0x7f001c145c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:29.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.832+0000 7f0023d51640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f001c0c9f60 0x7f001c1461d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:29.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.832+0000 7f0023d51640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f001c153940 0x7f001c143d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:29.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.832+0000 7f0023d51640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f001c1639f0 con 0x7f001c0c9f60 2023-11-27T18:43:29.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.832+0000 7f0023d51640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f001c0c6e10 con 0x7f001c0c4330 2023-11-27T18:43:29.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.832+0000 7f0023d51640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f001c143400 con 0x7f001c153940 2023-11-27T18:43:29.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.836+0000 7f00212ec640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f001c0c9f60 0x7f001c1461d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:29.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.836+0000 7f00212ec640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f001c0c9f60 0x7f001c1461d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:34694/0 (socket says 172.21.15.91:34694) 2023-11-27T18:43:29.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.836+0000 7f00212ec640 1 -- 172.21.15.91:0/4119544687 learned_addr learned my addr 172.21.15.91:0/4119544687 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:29.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.836+0000 7f0021aed640 1 --2- 172.21.15.91:0/4119544687 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f001c0c4330 0x7f001c145c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:29.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.836+0000 7f00222ee640 1 --2- 172.21.15.91:0/4119544687 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f001c153940 0x7f001c143d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:29.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.840+0000 7f00212ec640 1 -- 172.21.15.91:0/4119544687 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f001c153940 msgr2=0x7f001c143d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:29.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.840+0000 7f00212ec640 1 --2- 172.21.15.91:0/4119544687 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f001c153940 0x7f001c143d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:29.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.840+0000 7f00212ec640 1 -- 172.21.15.91:0/4119544687 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f001c0c4330 msgr2=0x7f001c145c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:29.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.840+0000 7f00212ec640 1 --2- 172.21.15.91:0/4119544687 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f001c0c4330 0x7f001c145c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:29.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.840+0000 7f00212ec640 1 -- 172.21.15.91:0/4119544687 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00180094d0 con 0x7f001c0c9f60 2023-11-27T18:43:29.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.840+0000 7f00212ec640 1 --2- 172.21.15.91:0/4119544687 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f001c0c9f60 0x7f001c1461d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f000c00e930 tx=0x7f000c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:29.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.844+0000 7f00127fc640 1 -- 172.21.15.91:0/4119544687 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000c009690 con 0x7f001c0c9f60 2023-11-27T18:43:29.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.844+0000 7f00127fc640 1 -- 172.21.15.91:0/4119544687 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f000c00ca00 con 0x7f001c0c9f60 2023-11-27T18:43:29.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.844+0000 7f00127fc640 1 -- 172.21.15.91:0/4119544687 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000c00cd70 con 0x7f001c0c9f60 2023-11-27T18:43:29.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.844+0000 7f0023d51640 1 -- 172.21.15.91:0/4119544687 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f001c0ce920 con 0x7f001c0c9f60 2023-11-27T18:43:29.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.844+0000 7f0023d51640 1 -- 172.21.15.91:0/4119544687 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f001c0ceec0 con 0x7f001c0c9f60 2023-11-27T18:43:29.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:29.848+0000 7f0023d51640 1 -- 172.21.15.91:0/4119544687 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f001c0b4e20 con 0x7f001c0c9f60 2023-11-27T18:43:30.128 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.124+0000 7f00127fc640 1 -- 172.21.15.91:0/4119544687 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f000c013470 con 0x7f001c0c9f60 2023-11-27T18:43:30.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.128+0000 7f00127fc640 1 --2- 172.21.15.91:0/4119544687 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f0000066870 0x7f0000068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:30.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.128+0000 7f0021aed640 1 --2- 172.21.15.91:0/4119544687 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f0000066870 0x7f0000068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:30.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.128+0000 7f0021aed640 1 --2- 172.21.15.91:0/4119544687 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f0000066870 0x7f0000068d30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f00140012f0 tx=0x7f0014009040 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:30.168 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.168+0000 7f00127fc640 1 -- 172.21.15.91:0/4119544687 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f000c055b00 con 0x7f001c0c9f60 2023-11-27T18:43:30.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.184+0000 7f00127fc640 1 -- 172.21.15.91:0/4119544687 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f000c051e40 con 0x7f001c0c9f60 2023-11-27T18:43:30.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.352+0000 7f0023d51640 1 -- 172.21.15.91:0/4119544687 --> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f001c0c9b30 con 0x7f0000066870 2023-11-27T18:43:30.376 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.376+0000 7f00127fc640 1 -- 172.21.15.91:0/4119544687 <== mgr.4136 v2:172.21.15.91:6800/2814827118 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+369649 (secure 0 0 0) 0x7f001c0c9b30 con 0x7f0000066870 2023-11-27T18:43:30.380 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:43:30.382 INFO:teuthology.orchestra.run.smithi091.stderr:dumped all 2023-11-27T18:43:30.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.380+0000 7f0023d51640 1 -- 172.21.15.91:0/4119544687 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f0000066870 msgr2=0x7f0000068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:30.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.380+0000 7f0023d51640 1 --2- 172.21.15.91:0/4119544687 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f0000066870 0x7f0000068d30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f00140012f0 tx=0x7f0014009040 comp rx=0 tx=0).stop 2023-11-27T18:43:30.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.380+0000 7f0023d51640 1 -- 172.21.15.91:0/4119544687 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f001c0c9f60 msgr2=0x7f001c1461d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:30.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.380+0000 7f0023d51640 1 --2- 172.21.15.91:0/4119544687 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f001c0c9f60 0x7f001c1461d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f000c00e930 tx=0x7f000c00edf0 comp rx=0 tx=0).stop 2023-11-27T18:43:30.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.380+0000 7f0023d51640 1 -- 172.21.15.91:0/4119544687 shutdown_connections 2023-11-27T18:43:30.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.380+0000 7f0023d51640 1 --2- 172.21.15.91:0/4119544687 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f0000066870 0x7f0000068d30 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:30.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.380+0000 7f0023d51640 1 --2- 172.21.15.91:0/4119544687 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f001c153940 0x7f001c143d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:30.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.380+0000 7f0023d51640 1 --2- 172.21.15.91:0/4119544687 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f001c0c9f60 0x7f001c1461d0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:30.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.380+0000 7f0023d51640 1 --2- 172.21.15.91:0/4119544687 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f001c0c4330 0x7f001c145c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:30.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.380+0000 7f0023d51640 1 -- 172.21.15.91:0/4119544687 >> 172.21.15.91:0/4119544687 conn(0x7f001c06b8f0 msgr2=0x7f001c151c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:30.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.380+0000 7f0023d51640 1 -- 172.21.15.91:0/4119544687 shutdown_connections 2023-11-27T18:43:30.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.380+0000 7f0023d51640 1 -- 172.21.15.91:0/4119544687 wait complete. 2023-11-27T18:43:30.399 INFO:teuthology.orchestra.run.smithi091.stdout:{"pg_ready":true,"pg_map":{"version":954,"stamp":"2023-11-27T18:43:29.891689+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":24697659,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":665,"num_read_kb":681,"num_write":8239,"num_write_kb":284305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9503,"ondisk_log_size":9503,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":332868,"kb_used_data":34884,"kb_used_omap":12,"kb_used_meta":297907,"kb_avail":754641852,"statfs":{"total":773094113280,"available":772753256448,"internally_reserved":0,"allocated":35721216,"data_stored":50501075,"data_compressed":4804134,"data_compressed_allocated":7446528,"data_compressed_original":23904256,"omap_allocated":12751,"internal_metadata":305057329},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":11715,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":13,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004750"},"pg_stats":[{"pgid":"2.1f","version":"32'712","reported_seq":747,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:28.043175+0000","last_change":"2023-11-27T18:13:12.298503+0000","last_active":"2023-11-27T18:42:28.043175+0000","last_peered":"2023-11-27T18:42:28.043175+0000","last_clean":"2023-11-27T18:42:28.043175+0000","last_became_active":"2023-11-27T18:13:12.298140+0000","last_became_peered":"2023-11-27T18:13:12.298140+0000","last_unstale":"2023-11-27T18:42:28.043175+0000","last_undegraded":"2023-11-27T18:42:28.043175+0000","last_fullsized":"2023-11-27T18:42:28.043175+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":712,"log_dups_size":0,"ondisk_log_size":712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:04:02.661989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":710,"num_write_kb":4473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"32'16","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.084791+0000","last_change":"2023-11-27T18:13:14.416681+0000","last_active":"2023-11-27T18:43:23.084791+0000","last_peered":"2023-11-27T18:43:23.084791+0000","last_clean":"2023-11-27T18:43:23.084791+0000","last_became_active":"2023-11-27T18:13:14.416401+0000","last_became_peered":"2023-11-27T18:13:14.416401+0000","last_unstale":"2023-11-27T18:43:23.084791+0000","last_undegraded":"2023-11-27T18:43:23.084791+0000","last_fullsized":"2023-11-27T18:43:23.084791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:02:14.142363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"32'75","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:20.602326+0000","last_change":"2023-11-27T18:13:20.916435+0000","last_active":"2023-11-27T18:42:20.602326+0000","last_peered":"2023-11-27T18:42:20.602326+0000","last_clean":"2023-11-27T18:42:20.602326+0000","last_became_active":"2023-11-27T18:13:20.915358+0000","last_became_peered":"2023-11-27T18:13:20.915358+0000","last_unstale":"2023-11-27T18:42:20.602326+0000","last_undegraded":"2023-11-27T18:42:20.602326+0000","last_fullsized":"2023-11-27T18:42:20.602326+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:55:46.903556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":3642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"32'324","reported_seq":359,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:22.643669+0000","last_change":"2023-11-27T18:13:12.305296+0000","last_active":"2023-11-27T18:43:22.643669+0000","last_peered":"2023-11-27T18:43:22.643669+0000","last_clean":"2023-11-27T18:43:22.643669+0000","last_became_active":"2023-11-27T18:13:12.304981+0000","last_became_peered":"2023-11-27T18:13:12.304981+0000","last_unstale":"2023-11-27T18:43:22.643669+0000","last_undegraded":"2023-11-27T18:43:22.643669+0000","last_fullsized":"2023-11-27T18:43:22.643669+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:04:30.721243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3006109,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":322,"num_write_kb":3093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"32'24","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.088010+0000","last_change":"2023-11-27T18:13:14.366102+0000","last_active":"2023-11-27T18:43:23.088010+0000","last_peered":"2023-11-27T18:43:23.088010+0000","last_clean":"2023-11-27T18:43:23.088010+0000","last_became_active":"2023-11-27T18:13:14.365787+0000","last_became_peered":"2023-11-27T18:13:14.365787+0000","last_unstale":"2023-11-27T18:43:23.088010+0000","last_undegraded":"2023-11-27T18:43:23.088010+0000","last_fullsized":"2023-11-27T18:43:23.088010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:39:34.589545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"32'88","reported_seq":117,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:22.952283+0000","last_change":"2023-11-27T18:13:20.915811+0000","last_active":"2023-11-27T18:42:22.952283+0000","last_peered":"2023-11-27T18:42:22.952283+0000","last_clean":"2023-11-27T18:42:22.952283+0000","last_became_active":"2023-11-27T18:13:20.914864+0000","last_became_peered":"2023-11-27T18:13:20.914864+0000","last_unstale":"2023-11-27T18:42:22.952283+0000","last_undegraded":"2023-11-27T18:42:22.952283+0000","last_fullsized":"2023-11-27T18:42:22.952283+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:22:21.572863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":6140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"32'9","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:14.217989+0000","last_change":"2023-11-27T18:13:12.272691+0000","last_active":"2023-11-27T18:43:14.217989+0000","last_peered":"2023-11-27T18:43:14.217989+0000","last_clean":"2023-11-27T18:43:14.217989+0000","last_became_active":"2023-11-27T18:13:12.272343+0000","last_became_peered":"2023-11-27T18:13:12.272343+0000","last_unstale":"2023-11-27T18:43:14.217989+0000","last_undegraded":"2023-11-27T18:43:14.217989+0000","last_fullsized":"2023-11-27T18:43:14.217989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:23:55.280753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"32'21","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.112985+0000","last_change":"2023-11-27T18:13:15.804199+0000","last_active":"2023-11-27T18:43:23.112985+0000","last_peered":"2023-11-27T18:43:23.112985+0000","last_clean":"2023-11-27T18:43:23.112985+0000","last_became_active":"2023-11-27T18:13:15.803248+0000","last_became_peered":"2023-11-27T18:13:15.803248+0000","last_unstale":"2023-11-27T18:43:23.112985+0000","last_undegraded":"2023-11-27T18:43:23.112985+0000","last_fullsized":"2023-11-27T18:43:23.112985+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:39:31.246554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"32'82","reported_seq":111,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:22.954321+0000","last_change":"2023-11-27T18:13:20.909371+0000","last_active":"2023-11-27T18:42:22.954321+0000","last_peered":"2023-11-27T18:42:22.954321+0000","last_clean":"2023-11-27T18:42:22.954321+0000","last_became_active":"2023-11-27T18:13:20.908285+0000","last_became_peered":"2023-11-27T18:13:20.908285+0000","last_unstale":"2023-11-27T18:42:22.954321+0000","last_undegraded":"2023-11-27T18:42:22.954321+0000","last_fullsized":"2023-11-27T18:42:22.954321+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:40:20.210205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":10516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"32'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:57.518824+0000","last_change":"2023-11-27T18:13:12.274531+0000","last_active":"2023-11-27T18:42:57.518824+0000","last_peered":"2023-11-27T18:42:57.518824+0000","last_clean":"2023-11-27T18:42:57.518824+0000","last_became_active":"2023-11-27T18:13:12.274275+0000","last_became_peered":"2023-11-27T18:13:12.274275+0000","last_unstale":"2023-11-27T18:42:57.518824+0000","last_undegraded":"2023-11-27T18:42:57.518824+0000","last_fullsized":"2023-11-27T18:42:57.518824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:02:12.938184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"32'37","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.017775+0000","last_change":"2023-11-27T18:13:14.422531+0000","last_active":"2023-11-27T18:43:23.017775+0000","last_peered":"2023-11-27T18:43:23.017775+0000","last_clean":"2023-11-27T18:43:23.017775+0000","last_became_active":"2023-11-27T18:13:14.421811+0000","last_became_peered":"2023-11-27T18:13:14.421811+0000","last_unstale":"2023-11-27T18:43:23.017775+0000","last_undegraded":"2023-11-27T18:43:23.017775+0000","last_fullsized":"2023-11-27T18:43:23.017775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:17:17.491694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"32'74","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:20.604964+0000","last_change":"2023-11-27T18:13:20.907358+0000","last_active":"2023-11-27T18:42:20.604964+0000","last_peered":"2023-11-27T18:42:20.604964+0000","last_clean":"2023-11-27T18:42:20.604964+0000","last_became_active":"2023-11-27T18:13:20.906418+0000","last_became_peered":"2023-11-27T18:13:20.906418+0000","last_unstale":"2023-11-27T18:42:20.604964+0000","last_undegraded":"2023-11-27T18:42:20.604964+0000","last_fullsized":"2023-11-27T18:42:20.604964+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:26:43.789814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":5836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"32'20","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.022483+0000","last_change":"2023-11-27T18:13:14.421453+0000","last_active":"2023-11-27T18:43:23.022483+0000","last_peered":"2023-11-27T18:43:23.022483+0000","last_clean":"2023-11-27T18:43:23.022483+0000","last_became_active":"2023-11-27T18:13:14.418640+0000","last_became_peered":"2023-11-27T18:13:14.418640+0000","last_unstale":"2023-11-27T18:43:23.022483+0000","last_undegraded":"2023-11-27T18:43:23.022483+0000","last_fullsized":"2023-11-27T18:43:23.022483+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:38:18.655528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"32'688","reported_seq":722,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:01.836826+0000","last_change":"2023-11-27T18:13:12.306690+0000","last_active":"2023-11-27T18:43:01.836826+0000","last_peered":"2023-11-27T18:43:01.836826+0000","last_clean":"2023-11-27T18:43:01.836826+0000","last_became_active":"2023-11-27T18:13:12.306331+0000","last_became_peered":"2023-11-27T18:13:12.306331+0000","last_unstale":"2023-11-27T18:43:01.836826+0000","last_undegraded":"2023-11-27T18:43:01.836826+0000","last_fullsized":"2023-11-27T18:43:01.836826+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:39:32.646368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":683,"num_write_kb":4455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'77","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:18.875569+0000","last_change":"2023-11-27T18:14:22.718298+0000","last_active":"2023-11-27T18:42:18.875569+0000","last_peered":"2023-11-27T18:42:18.875569+0000","last_clean":"2023-11-27T18:42:18.875569+0000","last_became_active":"2023-11-27T18:14:22.717105+0000","last_became_peered":"2023-11-27T18:14:22.717105+0000","last_unstale":"2023-11-27T18:42:18.875569+0000","last_undegraded":"2023-11-27T18:42:18.875569+0000","last_fullsized":"2023-11-27T18:42:18.875569+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:59:59.108869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":10073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7,5],"acting":[0,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"32'22","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:22.927135+0000","last_change":"2023-11-27T18:13:14.368428+0000","last_active":"2023-11-27T18:43:22.927135+0000","last_peered":"2023-11-27T18:43:22.927135+0000","last_clean":"2023-11-27T18:43:22.927135+0000","last_became_active":"2023-11-27T18:13:14.368117+0000","last_became_peered":"2023-11-27T18:13:14.368117+0000","last_unstale":"2023-11-27T18:43:22.927135+0000","last_undegraded":"2023-11-27T18:43:22.927135+0000","last_fullsized":"2023-11-27T18:43:22.927135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:24:45.528760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"32'2","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:32.409623+0000","last_change":"2023-11-27T18:13:12.306963+0000","last_active":"2023-11-27T18:42:32.409623+0000","last_peered":"2023-11-27T18:42:32.409623+0000","last_clean":"2023-11-27T18:42:32.409623+0000","last_became_active":"2023-11-27T18:13:12.306644+0000","last_became_peered":"2023-11-27T18:13:12.306644+0000","last_unstale":"2023-11-27T18:42:32.409623+0000","last_undegraded":"2023-11-27T18:42:32.409623+0000","last_fullsized":"2023-11-27T18:42:32.409623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:55:43.829654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"32'100","reported_seq":130,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:18.407017+0000","last_change":"2023-11-27T18:13:20.930173+0000","last_active":"2023-11-27T18:42:18.407017+0000","last_peered":"2023-11-27T18:42:18.407017+0000","last_clean":"2023-11-27T18:42:18.407017+0000","last_became_active":"2023-11-27T18:13:20.928830+0000","last_became_peered":"2023-11-27T18:13:20.928830+0000","last_unstale":"2023-11-27T18:42:18.407017+0000","last_undegraded":"2023-11-27T18:42:18.407017+0000","last_fullsized":"2023-11-27T18:42:18.407017+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:38:26.343953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":7369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"32'24","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.122496+0000","last_change":"2023-11-27T18:13:14.378647+0000","last_active":"2023-11-27T18:43:23.122496+0000","last_peered":"2023-11-27T18:43:23.122496+0000","last_clean":"2023-11-27T18:43:23.122496+0000","last_became_active":"2023-11-27T18:13:14.378391+0000","last_became_peered":"2023-11-27T18:13:14.378391+0000","last_unstale":"2023-11-27T18:43:23.122496+0000","last_undegraded":"2023-11-27T18:43:23.122496+0000","last_fullsized":"2023-11-27T18:43:23.122496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:02:22.189845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"32'4","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:09.152903+0000","last_change":"2023-11-27T18:13:12.270283+0000","last_active":"2023-11-27T18:43:09.152903+0000","last_peered":"2023-11-27T18:43:09.152903+0000","last_clean":"2023-11-27T18:43:09.152903+0000","last_became_active":"2023-11-27T18:13:12.269795+0000","last_became_peered":"2023-11-27T18:13:12.269795+0000","last_unstale":"2023-11-27T18:43:09.152903+0000","last_undegraded":"2023-11-27T18:43:09.152903+0000","last_fullsized":"2023-11-27T18:43:09.152903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:06:24.103678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'67","reported_seq":97,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:23.879026+0000","last_change":"2023-11-27T18:13:20.907340+0000","last_active":"2023-11-27T18:42:23.879026+0000","last_peered":"2023-11-27T18:42:23.879026+0000","last_clean":"2023-11-27T18:42:23.879026+0000","last_became_active":"2023-11-27T18:13:20.906609+0000","last_became_peered":"2023-11-27T18:13:20.906609+0000","last_unstale":"2023-11-27T18:42:23.879026+0000","last_undegraded":"2023-11-27T18:42:23.879026+0000","last_fullsized":"2023-11-27T18:42:23.879026+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:19:00.295457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":7315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"32'21","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:20.596382+0000","last_change":"2023-11-27T18:13:14.415177+0000","last_active":"2023-11-27T18:42:20.596382+0000","last_peered":"2023-11-27T18:42:20.596382+0000","last_clean":"2023-11-27T18:42:20.596382+0000","last_became_active":"2023-11-27T18:13:14.414888+0000","last_became_peered":"2023-11-27T18:13:14.414888+0000","last_unstale":"2023-11-27T18:42:20.596382+0000","last_undegraded":"2023-11-27T18:42:20.596382+0000","last_fullsized":"2023-11-27T18:42:20.596382+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:41:49.599901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"32'5","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:06.932839+0000","last_change":"2023-11-27T18:13:12.273724+0000","last_active":"2023-11-27T18:43:06.932839+0000","last_peered":"2023-11-27T18:43:06.932839+0000","last_clean":"2023-11-27T18:43:06.932839+0000","last_became_active":"2023-11-27T18:13:12.273356+0000","last_became_peered":"2023-11-27T18:13:12.273356+0000","last_unstale":"2023-11-27T18:43:06.932839+0000","last_undegraded":"2023-11-27T18:43:06.932839+0000","last_fullsized":"2023-11-27T18:43:06.932839+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:15:14.235633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'85","reported_seq":115,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:22.954332+0000","last_change":"2023-11-27T18:13:20.935910+0000","last_active":"2023-11-27T18:42:22.954332+0000","last_peered":"2023-11-27T18:42:22.954332+0000","last_clean":"2023-11-27T18:42:22.954332+0000","last_became_active":"2023-11-27T18:13:20.934797+0000","last_became_peered":"2023-11-27T18:13:20.934797+0000","last_unstale":"2023-11-27T18:42:22.954332+0000","last_undegraded":"2023-11-27T18:42:22.954332+0000","last_fullsized":"2023-11-27T18:42:22.954332+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:00:35.425015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":5270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'29","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.122735+0000","last_change":"2023-11-27T18:13:14.376557+0000","last_active":"2023-11-27T18:43:23.122735+0000","last_peered":"2023-11-27T18:43:23.122735+0000","last_clean":"2023-11-27T18:43:23.122735+0000","last_became_active":"2023-11-27T18:13:14.376304+0000","last_became_peered":"2023-11-27T18:13:14.376304+0000","last_unstale":"2023-11-27T18:43:23.122735+0000","last_undegraded":"2023-11-27T18:43:23.122735+0000","last_fullsized":"2023-11-27T18:43:23.122735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:37:22.787246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"32'7","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:12.260010+0000","last_change":"2023-11-27T18:13:12.307806+0000","last_active":"2023-11-27T18:43:12.260010+0000","last_peered":"2023-11-27T18:43:12.260010+0000","last_clean":"2023-11-27T18:43:12.260010+0000","last_became_active":"2023-11-27T18:13:12.307492+0000","last_became_peered":"2023-11-27T18:13:12.307492+0000","last_unstale":"2023-11-27T18:43:12.260010+0000","last_undegraded":"2023-11-27T18:43:12.260010+0000","last_fullsized":"2023-11-27T18:43:12.260010+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:34:06.981997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"32'53","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:18.915333+0000","last_change":"2023-11-27T18:13:20.918671+0000","last_active":"2023-11-27T18:42:18.915333+0000","last_peered":"2023-11-27T18:42:18.915333+0000","last_clean":"2023-11-27T18:42:18.915333+0000","last_became_active":"2023-11-27T18:13:20.917507+0000","last_became_peered":"2023-11-27T18:13:20.917507+0000","last_unstale":"2023-11-27T18:42:18.915333+0000","last_undegraded":"2023-11-27T18:42:18.915333+0000","last_fullsized":"2023-11-27T18:42:18.915333+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:00:52.213234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":7028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"32'21","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.125660+0000","last_change":"2023-11-27T18:13:14.377644+0000","last_active":"2023-11-27T18:43:23.125660+0000","last_peered":"2023-11-27T18:43:23.125660+0000","last_clean":"2023-11-27T18:43:23.125660+0000","last_became_active":"2023-11-27T18:13:14.377289+0000","last_became_peered":"2023-11-27T18:13:14.377289+0000","last_unstale":"2023-11-27T18:43:23.125660+0000","last_undegraded":"2023-11-27T18:43:23.125660+0000","last_fullsized":"2023-11-27T18:43:23.125660+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:55:42.641433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"32'327","reported_seq":361,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:15.373897+0000","last_change":"2023-11-27T18:13:12.267960+0000","last_active":"2023-11-27T18:43:15.373897+0000","last_peered":"2023-11-27T18:43:15.373897+0000","last_clean":"2023-11-27T18:43:15.373897+0000","last_became_active":"2023-11-27T18:13:12.267552+0000","last_became_peered":"2023-11-27T18:13:12.267552+0000","last_unstale":"2023-11-27T18:43:15.373897+0000","last_undegraded":"2023-11-27T18:43:15.373897+0000","last_fullsized":"2023-11-27T18:43:15.373897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:26:13.819717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"32'94","reported_seq":125,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:20.600411+0000","last_change":"2023-11-27T18:13:20.929780+0000","last_active":"2023-11-27T18:42:20.600411+0000","last_peered":"2023-11-27T18:42:20.600411+0000","last_clean":"2023-11-27T18:42:20.600411+0000","last_became_active":"2023-11-27T18:13:20.929370+0000","last_became_peered":"2023-11-27T18:13:20.929370+0000","last_unstale":"2023-11-27T18:42:20.600411+0000","last_undegraded":"2023-11-27T18:42:20.600411+0000","last_fullsized":"2023-11-27T18:42:20.600411+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:04:33.249483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":11915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"32'22","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.010619+0000","last_change":"2023-11-27T18:13:14.369764+0000","last_active":"2023-11-27T18:43:23.010619+0000","last_peered":"2023-11-27T18:43:23.010619+0000","last_clean":"2023-11-27T18:43:23.010619+0000","last_became_active":"2023-11-27T18:13:14.369472+0000","last_became_peered":"2023-11-27T18:13:14.369472+0000","last_unstale":"2023-11-27T18:43:23.010619+0000","last_undegraded":"2023-11-27T18:43:23.010619+0000","last_fullsized":"2023-11-27T18:43:23.010619+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:35:38.706782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"32'2","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:34.424366+0000","last_change":"2023-11-27T18:13:12.310761+0000","last_active":"2023-11-27T18:42:34.424366+0000","last_peered":"2023-11-27T18:42:34.424366+0000","last_clean":"2023-11-27T18:42:34.424366+0000","last_became_active":"2023-11-27T18:13:12.310495+0000","last_became_peered":"2023-11-27T18:13:12.310495+0000","last_unstale":"2023-11-27T18:42:34.424366+0000","last_undegraded":"2023-11-27T18:42:34.424366+0000","last_fullsized":"2023-11-27T18:42:34.424366+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:48:59.333816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"32'62","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:23.008415+0000","last_change":"2023-11-27T18:13:20.907638+0000","last_active":"2023-11-27T18:42:23.008415+0000","last_peered":"2023-11-27T18:42:23.008415+0000","last_clean":"2023-11-27T18:42:23.008415+0000","last_became_active":"2023-11-27T18:13:20.907229+0000","last_became_peered":"2023-11-27T18:13:20.907229+0000","last_unstale":"2023-11-27T18:42:23.008415+0000","last_undegraded":"2023-11-27T18:42:23.008415+0000","last_fullsized":"2023-11-27T18:42:23.008415+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:49:08.226420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":7408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"32'20","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.088550+0000","last_change":"2023-11-27T18:13:15.851127+0000","last_active":"2023-11-27T18:43:23.088550+0000","last_peered":"2023-11-27T18:43:23.088550+0000","last_clean":"2023-11-27T18:43:23.088550+0000","last_became_active":"2023-11-27T18:13:15.850263+0000","last_became_peered":"2023-11-27T18:13:15.850263+0000","last_unstale":"2023-11-27T18:43:23.088550+0000","last_undegraded":"2023-11-27T18:43:23.088550+0000","last_fullsized":"2023-11-27T18:43:23.088550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:48:39.587974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"32'4","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:54.428331+0000","last_change":"2023-11-27T18:13:12.310451+0000","last_active":"2023-11-27T18:42:54.428331+0000","last_peered":"2023-11-27T18:42:54.428331+0000","last_clean":"2023-11-27T18:42:54.428331+0000","last_became_active":"2023-11-27T18:13:12.310138+0000","last_became_peered":"2023-11-27T18:13:12.310138+0000","last_unstale":"2023-11-27T18:42:54.428331+0000","last_undegraded":"2023-11-27T18:42:54.428331+0000","last_fullsized":"2023-11-27T18:42:54.428331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:03:09.046171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"32'81","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:23.006317+0000","last_change":"2023-11-27T18:13:20.896960+0000","last_active":"2023-11-27T18:42:23.006317+0000","last_peered":"2023-11-27T18:42:23.006317+0000","last_clean":"2023-11-27T18:42:23.006317+0000","last_became_active":"2023-11-27T18:13:20.896156+0000","last_became_peered":"2023-11-27T18:13:20.896156+0000","last_unstale":"2023-11-27T18:42:23.006317+0000","last_undegraded":"2023-11-27T18:42:23.006317+0000","last_fullsized":"2023-11-27T18:42:23.006317+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:00:52.213234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":6173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"32'22","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.058711+0000","last_change":"2023-11-27T18:13:14.421498+0000","last_active":"2023-11-27T18:43:23.058711+0000","last_peered":"2023-11-27T18:43:23.058711+0000","last_clean":"2023-11-27T18:43:23.058711+0000","last_became_active":"2023-11-27T18:13:14.421125+0000","last_became_peered":"2023-11-27T18:13:14.421125+0000","last_unstale":"2023-11-27T18:43:23.058711+0000","last_undegraded":"2023-11-27T18:43:23.058711+0000","last_fullsized":"2023-11-27T18:43:23.058711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:52:30.225572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"32'5","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:01.836305+0000","last_change":"2023-11-27T18:13:12.301922+0000","last_active":"2023-11-27T18:43:01.836305+0000","last_peered":"2023-11-27T18:43:01.836305+0000","last_clean":"2023-11-27T18:43:01.836305+0000","last_became_active":"2023-11-27T18:13:12.301617+0000","last_became_peered":"2023-11-27T18:13:12.301617+0000","last_unstale":"2023-11-27T18:43:01.836305+0000","last_undegraded":"2023-11-27T18:43:01.836305+0000","last_fullsized":"2023-11-27T18:43:01.836305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:00:43.320630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'68","reported_seq":99,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:22.894328+0000","last_change":"2023-11-27T18:13:20.905013+0000","last_active":"2023-11-27T18:42:22.894328+0000","last_peered":"2023-11-27T18:42:22.894328+0000","last_clean":"2023-11-27T18:42:22.894328+0000","last_became_active":"2023-11-27T18:13:20.903019+0000","last_became_peered":"2023-11-27T18:13:20.903019+0000","last_unstale":"2023-11-27T18:42:22.894328+0000","last_undegraded":"2023-11-27T18:42:22.894328+0000","last_fullsized":"2023-11-27T18:42:22.894328+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:34:15.874601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":4275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"32'26","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.089801+0000","last_change":"2023-11-27T18:13:14.378913+0000","last_active":"2023-11-27T18:43:23.089801+0000","last_peered":"2023-11-27T18:43:23.089801+0000","last_clean":"2023-11-27T18:43:23.089801+0000","last_became_active":"2023-11-27T18:13:14.378644+0000","last_became_peered":"2023-11-27T18:13:14.378644+0000","last_unstale":"2023-11-27T18:43:23.089801+0000","last_undegraded":"2023-11-27T18:43:23.089801+0000","last_fullsized":"2023-11-27T18:43:23.089801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:19:02.523860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"32'556","reported_seq":1140,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:18.258483+0000","last_change":"2023-11-27T18:13:12.305733+0000","last_active":"2023-11-27T18:43:18.258483+0000","last_peered":"2023-11-27T18:43:18.258483+0000","last_clean":"2023-11-27T18:43:18.258483+0000","last_became_active":"2023-11-27T18:13:12.305380+0000","last_became_peered":"2023-11-27T18:13:12.305380+0000","last_unstale":"2023-11-27T18:43:18.258483+0000","last_undegraded":"2023-11-27T18:43:18.258483+0000","last_fullsized":"2023-11-27T18:43:18.258483+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:34:46.886091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128192,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":549,"num_read_kb":581,"num_write":552,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"32'76","reported_seq":106,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:20.596319+0000","last_change":"2023-11-27T18:13:20.913672+0000","last_active":"2023-11-27T18:42:20.596319+0000","last_peered":"2023-11-27T18:42:20.596319+0000","last_clean":"2023-11-27T18:42:20.596319+0000","last_became_active":"2023-11-27T18:13:20.913137+0000","last_became_peered":"2023-11-27T18:13:20.913137+0000","last_unstale":"2023-11-27T18:42:20.596319+0000","last_undegraded":"2023-11-27T18:42:20.596319+0000","last_fullsized":"2023-11-27T18:42:20.596319+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:40:20.210205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":7407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"32'15","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.001180+0000","last_change":"2023-11-27T18:13:14.413781+0000","last_active":"2023-11-27T18:43:23.001180+0000","last_peered":"2023-11-27T18:43:23.001180+0000","last_clean":"2023-11-27T18:43:23.001180+0000","last_became_active":"2023-11-27T18:13:14.413413+0000","last_became_peered":"2023-11-27T18:13:14.413413+0000","last_unstale":"2023-11-27T18:43:23.001180+0000","last_undegraded":"2023-11-27T18:43:23.001180+0000","last_fullsized":"2023-11-27T18:43:23.001180+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:04:03.068428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"32'6","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:09.156568+0000","last_change":"2023-11-27T18:13:12.315822+0000","last_active":"2023-11-27T18:43:09.156568+0000","last_peered":"2023-11-27T18:43:09.156568+0000","last_clean":"2023-11-27T18:43:09.156568+0000","last_became_active":"2023-11-27T18:13:12.315610+0000","last_became_peered":"2023-11-27T18:13:12.315610+0000","last_unstale":"2023-11-27T18:43:09.156568+0000","last_undegraded":"2023-11-27T18:43:09.156568+0000","last_fullsized":"2023-11-27T18:43:09.156568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:39:33.385367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"32'85","reported_seq":115,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:18.954256+0000","last_change":"2023-11-27T18:13:20.912891+0000","last_active":"2023-11-27T18:42:18.954256+0000","last_peered":"2023-11-27T18:42:18.954256+0000","last_clean":"2023-11-27T18:42:18.954256+0000","last_became_active":"2023-11-27T18:13:20.912453+0000","last_became_peered":"2023-11-27T18:13:20.912453+0000","last_unstale":"2023-11-27T18:42:18.954256+0000","last_undegraded":"2023-11-27T18:42:18.954256+0000","last_fullsized":"2023-11-27T18:42:18.954256+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:35:44.943527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":10738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"32'21","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.122497+0000","last_change":"2023-11-27T18:13:14.414468+0000","last_active":"2023-11-27T18:43:23.122497+0000","last_peered":"2023-11-27T18:43:23.122497+0000","last_clean":"2023-11-27T18:43:23.122497+0000","last_became_active":"2023-11-27T18:13:14.414156+0000","last_became_peered":"2023-11-27T18:13:14.414156+0000","last_unstale":"2023-11-27T18:43:23.122497+0000","last_undegraded":"2023-11-27T18:43:23.122497+0000","last_fullsized":"2023-11-27T18:43:23.122497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:46:11.500006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"32'3","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:58.521863+0000","last_change":"2023-11-27T18:13:12.308337+0000","last_active":"2023-11-27T18:42:58.521863+0000","last_peered":"2023-11-27T18:42:58.521863+0000","last_clean":"2023-11-27T18:42:58.521863+0000","last_became_active":"2023-11-27T18:13:12.308050+0000","last_became_peered":"2023-11-27T18:13:12.308050+0000","last_unstale":"2023-11-27T18:42:58.521863+0000","last_undegraded":"2023-11-27T18:42:58.521863+0000","last_fullsized":"2023-11-27T18:42:58.521863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:14:09.398956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"20'117","reported_seq":187,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:40:44.472943+0000","last_change":"2023-11-27T18:12:38.371836+0000","last_active":"2023-11-27T18:40:44.472943+0000","last_peered":"2023-11-27T18:40:44.472943+0000","last_clean":"2023-11-27T18:40:44.472943+0000","last_became_active":"2023-11-27T18:12:38.370748+0000","last_became_peered":"2023-11-27T18:12:38.370748+0000","last_unstale":"2023-11-27T18:40:44.472943+0000","last_undegraded":"2023-11-27T18:40:44.472943+0000","last_fullsized":"2023-11-27T18:40:44.472943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:12:36.259476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:12:36.259476+0000","last_clean_scrub_stamp":"2023-11-27T18:12:36.259476+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:25:36.712765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'86","reported_seq":117,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:22.984570+0000","last_change":"2023-11-27T18:13:20.928359+0000","last_active":"2023-11-27T18:42:22.984570+0000","last_peered":"2023-11-27T18:42:22.984570+0000","last_clean":"2023-11-27T18:42:22.984570+0000","last_became_active":"2023-11-27T18:13:20.926559+0000","last_became_peered":"2023-11-27T18:13:20.926559+0000","last_unstale":"2023-11-27T18:42:22.984570+0000","last_undegraded":"2023-11-27T18:42:22.984570+0000","last_fullsized":"2023-11-27T18:42:22.984570+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:47:06.255647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":7930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"32'24","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.017254+0000","last_change":"2023-11-27T18:13:14.422275+0000","last_active":"2023-11-27T18:43:23.017254+0000","last_peered":"2023-11-27T18:43:23.017254+0000","last_clean":"2023-11-27T18:43:23.017254+0000","last_became_active":"2023-11-27T18:13:14.419636+0000","last_became_peered":"2023-11-27T18:13:14.419636+0000","last_unstale":"2023-11-27T18:43:23.017254+0000","last_undegraded":"2023-11-27T18:43:23.017254+0000","last_fullsized":"2023-11-27T18:43:23.017254+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:29:10.027795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"32'2","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:44.034879+0000","last_change":"2023-11-27T18:13:12.268222+0000","last_active":"2023-11-27T18:42:44.034879+0000","last_peered":"2023-11-27T18:42:44.034879+0000","last_clean":"2023-11-27T18:42:44.034879+0000","last_became_active":"2023-11-27T18:13:12.267764+0000","last_became_peered":"2023-11-27T18:13:12.267764+0000","last_unstale":"2023-11-27T18:42:44.034879+0000","last_undegraded":"2023-11-27T18:42:44.034879+0000","last_fullsized":"2023-11-27T18:42:44.034879+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:48:38.383796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"32'73","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:13.789980+0000","last_change":"2023-11-27T18:13:20.917055+0000","last_active":"2023-11-27T18:42:13.789980+0000","last_peered":"2023-11-27T18:42:13.789980+0000","last_clean":"2023-11-27T18:42:13.789980+0000","last_became_active":"2023-11-27T18:13:20.914157+0000","last_became_peered":"2023-11-27T18:13:20.914157+0000","last_unstale":"2023-11-27T18:42:13.789980+0000","last_undegraded":"2023-11-27T18:42:13.789980+0000","last_fullsized":"2023-11-27T18:42:13.789980+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:34:15.874601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":5275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'24","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.065908+0000","last_change":"2023-11-27T18:13:14.363559+0000","last_active":"2023-11-27T18:43:23.065908+0000","last_peered":"2023-11-27T18:43:23.065908+0000","last_clean":"2023-11-27T18:43:23.065908+0000","last_became_active":"2023-11-27T18:13:14.363285+0000","last_became_peered":"2023-11-27T18:13:14.363285+0000","last_unstale":"2023-11-27T18:43:23.065908+0000","last_undegraded":"2023-11-27T18:43:23.065908+0000","last_fullsized":"2023-11-27T18:43:23.065908+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:00:44.524809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"32'3","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:30.492175+0000","last_change":"2023-11-27T18:13:12.312477+0000","last_active":"2023-11-27T18:42:30.492175+0000","last_peered":"2023-11-27T18:42:30.492175+0000","last_clean":"2023-11-27T18:42:30.492175+0000","last_became_active":"2023-11-27T18:13:12.312038+0000","last_became_peered":"2023-11-27T18:13:12.312038+0000","last_unstale":"2023-11-27T18:42:30.492175+0000","last_undegraded":"2023-11-27T18:42:30.492175+0000","last_fullsized":"2023-11-27T18:42:30.492175+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:35:37.502604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"32'90","reported_seq":120,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:20.599466+0000","last_change":"2023-11-27T18:13:20.913830+0000","last_active":"2023-11-27T18:42:20.599466+0000","last_peered":"2023-11-27T18:42:20.599466+0000","last_clean":"2023-11-27T18:42:20.599466+0000","last_became_active":"2023-11-27T18:13:20.912734+0000","last_became_peered":"2023-11-27T18:13:20.912734+0000","last_unstale":"2023-11-27T18:42:20.599466+0000","last_undegraded":"2023-11-27T18:42:20.599466+0000","last_fullsized":"2023-11-27T18:42:20.599466+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:35:39.280506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":13642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"32'25","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.093855+0000","last_change":"2023-11-27T18:13:14.364027+0000","last_active":"2023-11-27T18:43:23.093855+0000","last_peered":"2023-11-27T18:43:23.093855+0000","last_clean":"2023-11-27T18:43:23.093855+0000","last_became_active":"2023-11-27T18:13:14.363772+0000","last_became_peered":"2023-11-27T18:13:14.363772+0000","last_unstale":"2023-11-27T18:43:23.093855+0000","last_undegraded":"2023-11-27T18:43:23.093855+0000","last_fullsized":"2023-11-27T18:43:23.093855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:40:12.521779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"32'4","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:58.522360+0000","last_change":"2023-11-27T18:13:12.304785+0000","last_active":"2023-11-27T18:42:58.522360+0000","last_peered":"2023-11-27T18:42:58.522360+0000","last_clean":"2023-11-27T18:42:58.522360+0000","last_became_active":"2023-11-27T18:13:12.304400+0000","last_became_peered":"2023-11-27T18:13:12.304400+0000","last_unstale":"2023-11-27T18:42:58.522360+0000","last_undegraded":"2023-11-27T18:42:58.522360+0000","last_fullsized":"2023-11-27T18:42:58.522360+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:37:52.292054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"32'60","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:17.887775+0000","last_change":"2023-11-27T18:13:20.922959+0000","last_active":"2023-11-27T18:42:17.887775+0000","last_peered":"2023-11-27T18:42:17.887775+0000","last_clean":"2023-11-27T18:42:17.887775+0000","last_became_active":"2023-11-27T18:13:20.918984+0000","last_became_peered":"2023-11-27T18:13:20.918984+0000","last_unstale":"2023-11-27T18:42:17.887775+0000","last_undegraded":"2023-11-27T18:42:17.887775+0000","last_fullsized":"2023-11-27T18:42:17.887775+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:59:33.426999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":5801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"32'17","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.089097+0000","last_change":"2023-11-27T18:13:15.852939+0000","last_active":"2023-11-27T18:43:23.089097+0000","last_peered":"2023-11-27T18:43:23.089097+0000","last_clean":"2023-11-27T18:43:23.089097+0000","last_became_active":"2023-11-27T18:13:15.852339+0000","last_became_peered":"2023-11-27T18:13:15.852339+0000","last_unstale":"2023-11-27T18:43:23.089097+0000","last_undegraded":"2023-11-27T18:43:23.089097+0000","last_fullsized":"2023-11-27T18:43:23.089097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:31:25.796567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"32'7","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:44.051058+0000","last_change":"2023-11-27T18:13:12.311109+0000","last_active":"2023-11-27T18:42:44.051058+0000","last_peered":"2023-11-27T18:42:44.051058+0000","last_clean":"2023-11-27T18:42:44.051058+0000","last_became_active":"2023-11-27T18:13:12.310921+0000","last_became_peered":"2023-11-27T18:13:12.310921+0000","last_unstale":"2023-11-27T18:42:44.051058+0000","last_undegraded":"2023-11-27T18:42:44.051058+0000","last_fullsized":"2023-11-27T18:42:44.051058+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:05:04.546929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"32'108","reported_seq":138,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:20.603467+0000","last_change":"2023-11-27T18:13:20.925265+0000","last_active":"2023-11-27T18:42:20.603467+0000","last_peered":"2023-11-27T18:42:20.603467+0000","last_clean":"2023-11-27T18:42:20.603467+0000","last_became_active":"2023-11-27T18:13:20.924209+0000","last_became_peered":"2023-11-27T18:13:20.924209+0000","last_unstale":"2023-11-27T18:42:20.603467+0000","last_undegraded":"2023-11-27T18:42:20.603467+0000","last_fullsized":"2023-11-27T18:42:20.603467+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:31:33.484992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":10743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"32'21","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:22.999427+0000","last_change":"2023-11-27T18:13:14.421768+0000","last_active":"2023-11-27T18:43:22.999427+0000","last_peered":"2023-11-27T18:43:22.999427+0000","last_clean":"2023-11-27T18:43:22.999427+0000","last_became_active":"2023-11-27T18:13:14.421377+0000","last_became_peered":"2023-11-27T18:13:14.421377+0000","last_unstale":"2023-11-27T18:43:22.999427+0000","last_undegraded":"2023-11-27T18:43:22.999427+0000","last_fullsized":"2023-11-27T18:43:22.999427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:00:27.736589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"32'12","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:12.261402+0000","last_change":"2023-11-27T18:13:12.178547+0000","last_active":"2023-11-27T18:43:12.261402+0000","last_peered":"2023-11-27T18:43:12.261402+0000","last_clean":"2023-11-27T18:43:12.261402+0000","last_became_active":"2023-11-27T18:13:12.177997+0000","last_became_peered":"2023-11-27T18:13:12.177997+0000","last_unstale":"2023-11-27T18:43:12.261402+0000","last_undegraded":"2023-11-27T18:43:12.261402+0000","last_fullsized":"2023-11-27T18:43:12.261402+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:29:10.535816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"32'95","reported_seq":124,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:20.353428+0000","last_change":"2023-11-27T18:13:20.914541+0000","last_active":"2023-11-27T18:42:20.353428+0000","last_peered":"2023-11-27T18:42:20.353428+0000","last_clean":"2023-11-27T18:42:20.353428+0000","last_became_active":"2023-11-27T18:13:20.914144+0000","last_became_peered":"2023-11-27T18:13:20.914144+0000","last_unstale":"2023-11-27T18:42:20.353428+0000","last_undegraded":"2023-11-27T18:42:20.353428+0000","last_fullsized":"2023-11-27T18:42:20.353428+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:29:17.716220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":5846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"32'23","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.104070+0000","last_change":"2023-11-27T18:13:15.802553+0000","last_active":"2023-11-27T18:43:23.104070+0000","last_peered":"2023-11-27T18:43:23.104070+0000","last_clean":"2023-11-27T18:43:23.104070+0000","last_became_active":"2023-11-27T18:13:15.801804+0000","last_became_peered":"2023-11-27T18:13:15.801804+0000","last_unstale":"2023-11-27T18:43:23.104070+0000","last_undegraded":"2023-11-27T18:43:23.104070+0000","last_fullsized":"2023-11-27T18:43:23.104070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:50:47.259554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"32'5","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:48.122380+0000","last_change":"2023-11-27T18:13:12.300863+0000","last_active":"2023-11-27T18:42:48.122380+0000","last_peered":"2023-11-27T18:42:48.122380+0000","last_clean":"2023-11-27T18:42:48.122380+0000","last_became_active":"2023-11-27T18:13:12.300585+0000","last_became_peered":"2023-11-27T18:13:12.300585+0000","last_unstale":"2023-11-27T18:42:48.122380+0000","last_undegraded":"2023-11-27T18:42:48.122380+0000","last_fullsized":"2023-11-27T18:42:48.122380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:27:04.532776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"32'85","reported_seq":114,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:20.600878+0000","last_change":"2023-11-27T18:13:20.915245+0000","last_active":"2023-11-27T18:42:20.600878+0000","last_peered":"2023-11-27T18:42:20.600878+0000","last_clean":"2023-11-27T18:42:20.600878+0000","last_became_active":"2023-11-27T18:13:20.914216+0000","last_became_peered":"2023-11-27T18:13:20.914216+0000","last_unstale":"2023-11-27T18:42:20.600878+0000","last_undegraded":"2023-11-27T18:42:20.600878+0000","last_fullsized":"2023-11-27T18:42:20.600878+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:56:44.418239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":6050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"32'39","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.020938+0000","last_change":"2023-11-27T18:14:22.518196+0000","last_active":"2023-11-27T18:43:23.020938+0000","last_peered":"2023-11-27T18:43:23.020938+0000","last_clean":"2023-11-27T18:43:23.020938+0000","last_became_active":"2023-11-27T18:14:22.517527+0000","last_became_peered":"2023-11-27T18:14:22.517527+0000","last_unstale":"2023-11-27T18:43:23.020938+0000","last_undegraded":"2023-11-27T18:43:23.020938+0000","last_fullsized":"2023-11-27T18:43:23.020938+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:35:43.631863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"32'5","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:06.997466+0000","last_change":"2023-11-27T18:13:12.305081+0000","last_active":"2023-11-27T18:43:06.997466+0000","last_peered":"2023-11-27T18:43:06.997466+0000","last_clean":"2023-11-27T18:43:06.997466+0000","last_became_active":"2023-11-27T18:13:12.304777+0000","last_became_peered":"2023-11-27T18:13:12.304777+0000","last_unstale":"2023-11-27T18:43:06.997466+0000","last_undegraded":"2023-11-27T18:43:06.997466+0000","last_fullsized":"2023-11-27T18:43:06.997466+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:22:12.680259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"32'64","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:18.594470+0000","last_change":"2023-11-27T18:13:20.904088+0000","last_active":"2023-11-27T18:42:18.594470+0000","last_peered":"2023-11-27T18:42:18.594470+0000","last_clean":"2023-11-27T18:42:18.594470+0000","last_became_active":"2023-11-27T18:13:20.902282+0000","last_became_peered":"2023-11-27T18:13:20.902282+0000","last_unstale":"2023-11-27T18:42:18.594470+0000","last_undegraded":"2023-11-27T18:42:18.594470+0000","last_fullsized":"2023-11-27T18:42:18.594470+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:26:43.789814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":6349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"32'27","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.012251+0000","last_change":"2023-11-27T18:13:14.415302+0000","last_active":"2023-11-27T18:43:23.012251+0000","last_peered":"2023-11-27T18:43:23.012251+0000","last_clean":"2023-11-27T18:43:23.012251+0000","last_became_active":"2023-11-27T18:13:14.415004+0000","last_became_peered":"2023-11-27T18:13:14.415004+0000","last_unstale":"2023-11-27T18:43:23.012251+0000","last_undegraded":"2023-11-27T18:43:23.012251+0000","last_fullsized":"2023-11-27T18:43:23.012251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:34:11.170873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"32'5","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:06.982823+0000","last_change":"2023-11-27T18:13:12.268542+0000","last_active":"2023-11-27T18:43:06.982823+0000","last_peered":"2023-11-27T18:43:06.982823+0000","last_clean":"2023-11-27T18:43:06.982823+0000","last_became_active":"2023-11-27T18:13:12.268237+0000","last_became_peered":"2023-11-27T18:13:12.268237+0000","last_unstale":"2023-11-27T18:43:06.982823+0000","last_undegraded":"2023-11-27T18:43:06.982823+0000","last_fullsized":"2023-11-27T18:43:06.982823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:15:07.514381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"32'82","reported_seq":111,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:22.983811+0000","last_change":"2023-11-27T18:13:20.900393+0000","last_active":"2023-11-27T18:42:22.983811+0000","last_peered":"2023-11-27T18:42:22.983811+0000","last_clean":"2023-11-27T18:42:22.983811+0000","last_became_active":"2023-11-27T18:13:20.899358+0000","last_became_peered":"2023-11-27T18:13:20.899358+0000","last_unstale":"2023-11-27T18:42:22.983811+0000","last_undegraded":"2023-11-27T18:42:22.983811+0000","last_fullsized":"2023-11-27T18:42:22.983811+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:27:58.837417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":8446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"32'23","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.066215+0000","last_change":"2023-11-27T18:13:14.371842+0000","last_active":"2023-11-27T18:43:23.066215+0000","last_peered":"2023-11-27T18:43:23.066215+0000","last_clean":"2023-11-27T18:43:23.066215+0000","last_became_active":"2023-11-27T18:13:14.371637+0000","last_became_peered":"2023-11-27T18:13:14.371637+0000","last_unstale":"2023-11-27T18:43:23.066215+0000","last_undegraded":"2023-11-27T18:43:23.066215+0000","last_fullsized":"2023-11-27T18:43:23.066215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:22:13.884437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"32'871","reported_seq":904,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:09.052491+0000","last_change":"2023-11-27T18:13:12.248404+0000","last_active":"2023-11-27T18:43:09.052491+0000","last_peered":"2023-11-27T18:43:09.052491+0000","last_clean":"2023-11-27T18:43:09.052491+0000","last_became_active":"2023-11-27T18:13:12.248077+0000","last_became_peered":"2023-11-27T18:13:12.248077+0000","last_unstale":"2023-11-27T18:43:09.052491+0000","last_undegraded":"2023-11-27T18:43:09.052491+0000","last_fullsized":"2023-11-27T18:43:09.052491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":871,"log_dups_size":0,"ondisk_log_size":871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:34:21.166265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":867,"num_write_kb":4596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"32'83","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:18.926289+0000","last_change":"2023-11-27T18:13:20.919046+0000","last_active":"2023-11-27T18:42:18.926289+0000","last_peered":"2023-11-27T18:42:18.926289+0000","last_clean":"2023-11-27T18:42:18.926289+0000","last_became_active":"2023-11-27T18:13:20.918381+0000","last_became_peered":"2023-11-27T18:13:20.918381+0000","last_unstale":"2023-11-27T18:42:18.926289+0000","last_undegraded":"2023-11-27T18:42:18.926289+0000","last_fullsized":"2023-11-27T18:42:18.926289+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:17:07.092549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":11273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"32'25","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.022858+0000","last_change":"2023-11-27T18:13:14.415453+0000","last_active":"2023-11-27T18:43:23.022858+0000","last_peered":"2023-11-27T18:43:23.022858+0000","last_clean":"2023-11-27T18:43:23.022858+0000","last_became_active":"2023-11-27T18:13:14.415026+0000","last_became_peered":"2023-11-27T18:13:14.415026+0000","last_unstale":"2023-11-27T18:43:23.022858+0000","last_undegraded":"2023-11-27T18:43:23.022858+0000","last_fullsized":"2023-11-27T18:43:23.022858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:35:37.255102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"32'400","reported_seq":433,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:15.251117+0000","last_change":"2023-11-27T18:13:12.180737+0000","last_active":"2023-11-27T18:43:15.251117+0000","last_peered":"2023-11-27T18:43:15.251117+0000","last_clean":"2023-11-27T18:43:15.251117+0000","last_became_active":"2023-11-27T18:13:12.180112+0000","last_became_peered":"2023-11-27T18:13:12.180112+0000","last_unstale":"2023-11-27T18:43:15.251117+0000","last_undegraded":"2023-11-27T18:43:15.251117+0000","last_fullsized":"2023-11-27T18:43:15.251117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:24:22.455257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":397,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"32'109","reported_seq":138,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:20.603364+0000","last_change":"2023-11-27T18:13:20.925012+0000","last_active":"2023-11-27T18:42:20.603364+0000","last_peered":"2023-11-27T18:42:20.603364+0000","last_clean":"2023-11-27T18:42:20.603364+0000","last_became_active":"2023-11-27T18:13:20.921675+0000","last_became_peered":"2023-11-27T18:13:20.921675+0000","last_unstale":"2023-11-27T18:42:20.603364+0000","last_undegraded":"2023-11-27T18:42:20.603364+0000","last_fullsized":"2023-11-27T18:42:20.603364+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:49:08.226420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":15987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"32'29","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.087895+0000","last_change":"2023-11-27T18:13:14.415432+0000","last_active":"2023-11-27T18:43:23.087895+0000","last_peered":"2023-11-27T18:43:23.087895+0000","last_clean":"2023-11-27T18:43:23.087895+0000","last_became_active":"2023-11-27T18:13:14.415142+0000","last_became_peered":"2023-11-27T18:13:14.415142+0000","last_unstale":"2023-11-27T18:43:23.087895+0000","last_undegraded":"2023-11-27T18:43:23.087895+0000","last_fullsized":"2023-11-27T18:43:23.087895+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:39:33.850547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:44.050672+0000","last_change":"2023-11-27T18:13:12.273729+0000","last_active":"2023-11-27T18:42:44.050672+0000","last_peered":"2023-11-27T18:42:44.050672+0000","last_clean":"2023-11-27T18:42:44.050672+0000","last_became_active":"2023-11-27T18:13:12.273400+0000","last_became_peered":"2023-11-27T18:13:12.273400+0000","last_unstale":"2023-11-27T18:42:44.050672+0000","last_undegraded":"2023-11-27T18:42:44.050672+0000","last_fullsized":"2023-11-27T18:42:44.050672+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:31:10.508092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"32'83","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:18.001546+0000","last_change":"2023-11-27T18:13:20.912482+0000","last_active":"2023-11-27T18:42:18.001546+0000","last_peered":"2023-11-27T18:42:18.001546+0000","last_clean":"2023-11-27T18:42:18.001546+0000","last_became_active":"2023-11-27T18:13:20.912063+0000","last_became_peered":"2023-11-27T18:13:20.912063+0000","last_unstale":"2023-11-27T18:42:18.001546+0000","last_undegraded":"2023-11-27T18:42:18.001546+0000","last_fullsized":"2023-11-27T18:42:18.001546+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:11:56.997205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":11074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"32'29","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.090872+0000","last_change":"2023-11-27T18:13:15.911622+0000","last_active":"2023-11-27T18:43:23.090872+0000","last_peered":"2023-11-27T18:43:23.090872+0000","last_clean":"2023-11-27T18:43:23.090872+0000","last_became_active":"2023-11-27T18:13:15.911255+0000","last_became_peered":"2023-11-27T18:13:15.911255+0000","last_unstale":"2023-11-27T18:43:23.090872+0000","last_undegraded":"2023-11-27T18:43:23.090872+0000","last_fullsized":"2023-11-27T18:43:23.090872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:04:03.068428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"32'6","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:53.405822+0000","last_change":"2023-11-27T18:13:12.168028+0000","last_active":"2023-11-27T18:42:53.405822+0000","last_peered":"2023-11-27T18:42:53.405822+0000","last_clean":"2023-11-27T18:42:53.405822+0000","last_became_active":"2023-11-27T18:13:12.167740+0000","last_became_peered":"2023-11-27T18:13:12.167740+0000","last_unstale":"2023-11-27T18:42:53.405822+0000","last_undegraded":"2023-11-27T18:42:53.405822+0000","last_fullsized":"2023-11-27T18:42:53.405822+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:34:21.166265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"32'75","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:13.791640+0000","last_change":"2023-11-27T18:13:20.915480+0000","last_active":"2023-11-27T18:42:13.791640+0000","last_peered":"2023-11-27T18:42:13.791640+0000","last_clean":"2023-11-27T18:42:13.791640+0000","last_became_active":"2023-11-27T18:13:20.914607+0000","last_became_peered":"2023-11-27T18:13:20.914607+0000","last_unstale":"2023-11-27T18:42:13.791640+0000","last_undegraded":"2023-11-27T18:42:13.791640+0000","last_fullsized":"2023-11-27T18:42:13.791640+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:07:38.034431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":8428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"32'67","reported_seq":98,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:14.803902+0000","last_change":"2023-11-27T18:13:20.930508+0000","last_active":"2023-11-27T18:42:14.803902+0000","last_peered":"2023-11-27T18:42:14.803902+0000","last_clean":"2023-11-27T18:42:14.803902+0000","last_became_active":"2023-11-27T18:13:20.930060+0000","last_became_peered":"2023-11-27T18:13:20.930060+0000","last_unstale":"2023-11-27T18:42:14.803902+0000","last_undegraded":"2023-11-27T18:42:14.803902+0000","last_fullsized":"2023-11-27T18:42:14.803902+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:43:18.464867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":4718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"32'28","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.125938+0000","last_change":"2023-11-27T18:13:14.380263+0000","last_active":"2023-11-27T18:43:23.125938+0000","last_peered":"2023-11-27T18:43:23.125938+0000","last_clean":"2023-11-27T18:43:23.125938+0000","last_became_active":"2023-11-27T18:13:14.379936+0000","last_became_peered":"2023-11-27T18:13:14.379936+0000","last_unstale":"2023-11-27T18:43:23.125938+0000","last_undegraded":"2023-11-27T18:43:23.125938+0000","last_fullsized":"2023-11-27T18:43:23.125938+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:50:34.713768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"32'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:53.354565+0000","last_change":"2023-11-27T18:13:12.300977+0000","last_active":"2023-11-27T18:42:53.354565+0000","last_peered":"2023-11-27T18:42:53.354565+0000","last_clean":"2023-11-27T18:42:53.354565+0000","last_became_active":"2023-11-27T18:13:12.300624+0000","last_became_peered":"2023-11-27T18:13:12.300624+0000","last_unstale":"2023-11-27T18:42:53.354565+0000","last_undegraded":"2023-11-27T18:42:53.354565+0000","last_fullsized":"2023-11-27T18:42:53.354565+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:52:29.021393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"32'93","reported_seq":124,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:22.982291+0000","last_change":"2023-11-27T18:13:20.919870+0000","last_active":"2023-11-27T18:42:22.982291+0000","last_peered":"2023-11-27T18:42:22.982291+0000","last_clean":"2023-11-27T18:42:22.982291+0000","last_became_active":"2023-11-27T18:13:20.918816+0000","last_became_peered":"2023-11-27T18:13:20.918816+0000","last_unstale":"2023-11-27T18:42:22.982291+0000","last_undegraded":"2023-11-27T18:42:22.982291+0000","last_fullsized":"2023-11-27T18:42:22.982291+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:41:38.778382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":12357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'29","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.089906+0000","last_change":"2023-11-27T18:13:14.369562+0000","last_active":"2023-11-27T18:43:23.089906+0000","last_peered":"2023-11-27T18:43:23.089906+0000","last_clean":"2023-11-27T18:43:23.089906+0000","last_became_active":"2023-11-27T18:13:14.368880+0000","last_became_peered":"2023-11-27T18:13:14.368880+0000","last_unstale":"2023-11-27T18:43:23.089906+0000","last_undegraded":"2023-11-27T18:43:23.089906+0000","last_fullsized":"2023-11-27T18:43:23.089906+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:22:13.884437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:37.590691+0000","last_change":"2023-11-27T18:13:12.270113+0000","last_active":"2023-11-27T18:42:37.590691+0000","last_peered":"2023-11-27T18:42:37.590691+0000","last_clean":"2023-11-27T18:42:37.590691+0000","last_became_active":"2023-11-27T18:13:12.269755+0000","last_became_peered":"2023-11-27T18:13:12.269755+0000","last_unstale":"2023-11-27T18:42:37.590691+0000","last_undegraded":"2023-11-27T18:42:37.590691+0000","last_fullsized":"2023-11-27T18:42:37.590691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:51:01.410940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"32'663","reported_seq":696,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:49.086954+0000","last_change":"2023-11-27T18:13:12.307568+0000","last_active":"2023-11-27T18:42:49.086954+0000","last_peered":"2023-11-27T18:42:49.086954+0000","last_clean":"2023-11-27T18:42:49.086954+0000","last_became_active":"2023-11-27T18:13:12.307299+0000","last_became_peered":"2023-11-27T18:13:12.307299+0000","last_unstale":"2023-11-27T18:42:49.086954+0000","last_undegraded":"2023-11-27T18:42:49.086954+0000","last_fullsized":"2023-11-27T18:42:49.086954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":663,"log_dups_size":0,"ondisk_log_size":663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:19:01.319681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":658,"num_write_kb":4457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"32'24","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.124787+0000","last_change":"2023-11-27T18:13:14.378937+0000","last_active":"2023-11-27T18:43:23.124787+0000","last_peered":"2023-11-27T18:43:23.124787+0000","last_clean":"2023-11-27T18:43:23.124787+0000","last_became_active":"2023-11-27T18:13:14.378635+0000","last_became_peered":"2023-11-27T18:13:14.378635+0000","last_unstale":"2023-11-27T18:43:23.124787+0000","last_undegraded":"2023-11-27T18:43:23.124787+0000","last_fullsized":"2023-11-27T18:43:23.124787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:06:40.533610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"32'56","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:20.778247+0000","last_change":"2023-11-27T18:13:20.903249+0000","last_active":"2023-11-27T18:42:20.778247+0000","last_peered":"2023-11-27T18:42:20.778247+0000","last_clean":"2023-11-27T18:42:20.778247+0000","last_became_active":"2023-11-27T18:13:20.902571+0000","last_became_peered":"2023-11-27T18:13:20.902571+0000","last_unstale":"2023-11-27T18:42:20.778247+0000","last_undegraded":"2023-11-27T18:42:20.778247+0000","last_fullsized":"2023-11-27T18:42:20.778247+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:41:48.892641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":3581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"32'592","reported_seq":624,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:01.804907+0000","last_change":"2023-11-27T18:13:12.304324+0000","last_active":"2023-11-27T18:43:01.804907+0000","last_peered":"2023-11-27T18:43:01.804907+0000","last_clean":"2023-11-27T18:43:01.804907+0000","last_became_active":"2023-11-27T18:13:12.303988+0000","last_became_peered":"2023-11-27T18:13:12.303988+0000","last_unstale":"2023-11-27T18:43:01.804907+0000","last_undegraded":"2023-11-27T18:43:01.804907+0000","last_fullsized":"2023-11-27T18:43:01.804907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:47:59.518332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":588,"num_write_kb":4406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"32'22","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.112292+0000","last_change":"2023-11-27T18:13:15.803183+0000","last_active":"2023-11-27T18:43:23.112292+0000","last_peered":"2023-11-27T18:43:23.112292+0000","last_clean":"2023-11-27T18:43:23.112292+0000","last_became_active":"2023-11-27T18:13:15.802420+0000","last_became_peered":"2023-11-27T18:13:15.802420+0000","last_unstale":"2023-11-27T18:43:23.112292+0000","last_undegraded":"2023-11-27T18:43:23.112292+0000","last_fullsized":"2023-11-27T18:43:23.112292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:51:02.615119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"32'93","reported_seq":116,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:20.605149+0000","last_change":"2023-11-27T18:14:22.716310+0000","last_active":"2023-11-27T18:42:20.605149+0000","last_peered":"2023-11-27T18:42:20.605149+0000","last_clean":"2023-11-27T18:42:20.605149+0000","last_became_active":"2023-11-27T18:14:22.715684+0000","last_became_peered":"2023-11-27T18:14:22.715684+0000","last_unstale":"2023-11-27T18:42:20.605149+0000","last_undegraded":"2023-11-27T18:42:20.605149+0000","last_fullsized":"2023-11-27T18:42:20.605149+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:33:36.215484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":6465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,0],"acting":[2,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"32'34","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.088789+0000","last_change":"2023-11-27T18:13:15.849183+0000","last_active":"2023-11-27T18:43:23.088789+0000","last_peered":"2023-11-27T18:43:23.088789+0000","last_clean":"2023-11-27T18:43:23.088789+0000","last_became_active":"2023-11-27T18:13:15.848503+0000","last_became_peered":"2023-11-27T18:13:15.848503+0000","last_unstale":"2023-11-27T18:43:23.088789+0000","last_undegraded":"2023-11-27T18:43:23.088789+0000","last_fullsized":"2023-11-27T18:43:23.088789+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:14:48.774302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"32'28","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:22.930797+0000","last_change":"2023-11-27T18:13:14.336349+0000","last_active":"2023-11-27T18:43:22.930797+0000","last_peered":"2023-11-27T18:43:22.930797+0000","last_clean":"2023-11-27T18:43:22.930797+0000","last_became_active":"2023-11-27T18:13:14.336072+0000","last_became_peered":"2023-11-27T18:13:14.336072+0000","last_unstale":"2023-11-27T18:43:22.930797+0000","last_undegraded":"2023-11-27T18:43:22.930797+0000","last_fullsized":"2023-11-27T18:43:22.930797+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:54:58.777656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"32'27","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.008110+0000","last_change":"2023-11-27T18:13:14.421713+0000","last_active":"2023-11-27T18:43:23.008110+0000","last_peered":"2023-11-27T18:43:23.008110+0000","last_clean":"2023-11-27T18:43:23.008110+0000","last_became_active":"2023-11-27T18:13:14.418679+0000","last_became_peered":"2023-11-27T18:13:14.418679+0000","last_unstale":"2023-11-27T18:43:23.008110+0000","last_undegraded":"2023-11-27T18:43:23.008110+0000","last_fullsized":"2023-11-27T18:43:23.008110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:53:03.917430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"32'22","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.087244+0000","last_change":"2023-11-27T18:13:14.376601+0000","last_active":"2023-11-27T18:43:23.087244+0000","last_peered":"2023-11-27T18:43:23.087244+0000","last_clean":"2023-11-27T18:43:23.087244+0000","last_became_active":"2023-11-27T18:13:14.376292+0000","last_became_peered":"2023-11-27T18:13:14.376292+0000","last_unstale":"2023-11-27T18:43:23.087244+0000","last_undegraded":"2023-11-27T18:43:23.087244+0000","last_fullsized":"2023-11-27T18:43:23.087244+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:52:30.225572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"32'16","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.007978+0000","last_change":"2023-11-27T18:13:14.367285+0000","last_active":"2023-11-27T18:43:23.007978+0000","last_peered":"2023-11-27T18:43:23.007978+0000","last_clean":"2023-11-27T18:43:23.007978+0000","last_became_active":"2023-11-27T18:13:14.366983+0000","last_became_peered":"2023-11-27T18:13:14.366983+0000","last_unstale":"2023-11-27T18:43:23.007978+0000","last_undegraded":"2023-11-27T18:43:23.007978+0000","last_fullsized":"2023-11-27T18:43:23.007978+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:04:31.925421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"32'22","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.008178+0000","last_change":"2023-11-27T18:13:14.375744+0000","last_active":"2023-11-27T18:43:23.008178+0000","last_peered":"2023-11-27T18:43:23.008178+0000","last_clean":"2023-11-27T18:43:23.008178+0000","last_became_active":"2023-11-27T18:13:14.375466+0000","last_became_peered":"2023-11-27T18:13:14.375466+0000","last_unstale":"2023-11-27T18:43:23.008178+0000","last_undegraded":"2023-11-27T18:43:23.008178+0000","last_fullsized":"2023-11-27T18:43:23.008178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:03:10.250350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"32'33","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.089376+0000","last_change":"2023-11-27T18:13:15.911021+0000","last_active":"2023-11-27T18:43:23.089376+0000","last_peered":"2023-11-27T18:43:23.089376+0000","last_clean":"2023-11-27T18:43:23.089376+0000","last_became_active":"2023-11-27T18:13:15.910418+0000","last_became_peered":"2023-11-27T18:13:15.910418+0000","last_unstale":"2023-11-27T18:43:23.089376+0000","last_undegraded":"2023-11-27T18:43:23.089376+0000","last_fullsized":"2023-11-27T18:43:23.089376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:55:45.033833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"32'19","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.087549+0000","last_change":"2023-11-27T18:13:14.368483+0000","last_active":"2023-11-27T18:43:23.087549+0000","last_peered":"2023-11-27T18:43:23.087549+0000","last_clean":"2023-11-27T18:43:23.087549+0000","last_became_active":"2023-11-27T18:13:14.366249+0000","last_became_peered":"2023-11-27T18:13:14.366249+0000","last_unstale":"2023-11-27T18:43:23.087549+0000","last_undegraded":"2023-11-27T18:43:23.087549+0000","last_fullsized":"2023-11-27T18:43:23.087549+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:52:43.071209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"32'19","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.009319+0000","last_change":"2023-11-27T18:13:14.415379+0000","last_active":"2023-11-27T18:43:23.009319+0000","last_peered":"2023-11-27T18:43:23.009319+0000","last_clean":"2023-11-27T18:43:23.009319+0000","last_became_active":"2023-11-27T18:13:14.414873+0000","last_became_peered":"2023-11-27T18:13:14.414873+0000","last_unstale":"2023-11-27T18:43:23.009319+0000","last_undegraded":"2023-11-27T18:43:23.009319+0000","last_fullsized":"2023-11-27T18:43:23.009319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:40:12.521779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'30","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.090541+0000","last_change":"2023-11-27T18:13:14.416351+0000","last_active":"2023-11-27T18:43:23.090541+0000","last_peered":"2023-11-27T18:43:23.090541+0000","last_clean":"2023-11-27T18:43:23.090541+0000","last_became_active":"2023-11-27T18:13:14.416072+0000","last_became_peered":"2023-11-27T18:13:14.416072+0000","last_unstale":"2023-11-27T18:43:23.090541+0000","last_undegraded":"2023-11-27T18:43:23.090541+0000","last_fullsized":"2023-11-27T18:43:23.090541+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:31:11.712270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"32'25","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.112998+0000","last_change":"2023-11-27T18:13:15.801534+0000","last_active":"2023-11-27T18:43:23.112998+0000","last_peered":"2023-11-27T18:43:23.112998+0000","last_clean":"2023-11-27T18:43:23.112998+0000","last_became_active":"2023-11-27T18:13:15.800699+0000","last_became_peered":"2023-11-27T18:13:15.800699+0000","last_unstale":"2023-11-27T18:43:23.112998+0000","last_undegraded":"2023-11-27T18:43:23.112998+0000","last_fullsized":"2023-11-27T18:43:23.112998+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:39:39.512202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"32'35","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.124464+0000","last_change":"2023-11-27T18:13:14.413935+0000","last_active":"2023-11-27T18:43:23.124464+0000","last_peered":"2023-11-27T18:43:23.124464+0000","last_clean":"2023-11-27T18:43:23.124464+0000","last_became_active":"2023-11-27T18:13:14.413567+0000","last_became_peered":"2023-11-27T18:13:14.413567+0000","last_unstale":"2023-11-27T18:43:23.124464+0000","last_undegraded":"2023-11-27T18:43:23.124464+0000","last_fullsized":"2023-11-27T18:43:23.124464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:51:07.667299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"32'26","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.090895+0000","last_change":"2023-11-27T18:13:14.363105+0000","last_active":"2023-11-27T18:43:23.090895+0000","last_peered":"2023-11-27T18:43:23.090895+0000","last_clean":"2023-11-27T18:43:23.090895+0000","last_became_active":"2023-11-27T18:13:14.362805+0000","last_became_peered":"2023-11-27T18:13:14.362805+0000","last_unstale":"2023-11-27T18:43:23.090895+0000","last_undegraded":"2023-11-27T18:43:23.090895+0000","last_fullsized":"2023-11-27T18:43:23.090895+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:19:02.523860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"32'25","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:22.999913+0000","last_change":"2023-11-27T18:13:14.416119+0000","last_active":"2023-11-27T18:43:22.999913+0000","last_peered":"2023-11-27T18:43:22.999913+0000","last_clean":"2023-11-27T18:43:22.999913+0000","last_became_active":"2023-11-27T18:13:14.415661+0000","last_became_peered":"2023-11-27T18:13:14.415661+0000","last_unstale":"2023-11-27T18:43:22.999913+0000","last_undegraded":"2023-11-27T18:43:22.999913+0000","last_fullsized":"2023-11-27T18:43:22.999913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:56:36.729814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"32'35","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:22.929454+0000","last_change":"2023-11-27T18:13:14.413859+0000","last_active":"2023-11-27T18:43:22.929454+0000","last_peered":"2023-11-27T18:43:22.929454+0000","last_clean":"2023-11-27T18:43:22.929454+0000","last_became_active":"2023-11-27T18:13:14.413542+0000","last_became_peered":"2023-11-27T18:13:14.413542+0000","last_unstale":"2023-11-27T18:43:22.929454+0000","last_undegraded":"2023-11-27T18:43:22.929454+0000","last_fullsized":"2023-11-27T18:43:22.929454+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:24:16.125984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"32'23","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.004112+0000","last_change":"2023-11-27T18:13:14.417018+0000","last_active":"2023-11-27T18:43:23.004112+0000","last_peered":"2023-11-27T18:43:23.004112+0000","last_clean":"2023-11-27T18:43:23.004112+0000","last_became_active":"2023-11-27T18:13:14.416556+0000","last_became_peered":"2023-11-27T18:13:14.416556+0000","last_unstale":"2023-11-27T18:43:23.004112+0000","last_undegraded":"2023-11-27T18:43:23.004112+0000","last_fullsized":"2023-11-27T18:43:23.004112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:03:59.054125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"32'28","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.011337+0000","last_change":"2023-11-27T18:13:14.419437+0000","last_active":"2023-11-27T18:43:23.011337+0000","last_peered":"2023-11-27T18:43:23.011337+0000","last_clean":"2023-11-27T18:43:23.011337+0000","last_became_active":"2023-11-27T18:13:14.418823+0000","last_became_peered":"2023-11-27T18:13:14.418823+0000","last_unstale":"2023-11-27T18:43:23.011337+0000","last_undegraded":"2023-11-27T18:43:23.011337+0000","last_fullsized":"2023-11-27T18:43:23.011337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:26:36.101388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"32'26","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.087519+0000","last_change":"2023-11-27T18:13:14.368373+0000","last_active":"2023-11-27T18:43:23.087519+0000","last_peered":"2023-11-27T18:43:23.087519+0000","last_clean":"2023-11-27T18:43:23.087519+0000","last_became_active":"2023-11-27T18:13:14.368100+0000","last_became_peered":"2023-11-27T18:13:14.368100+0000","last_unstale":"2023-11-27T18:43:23.087519+0000","last_undegraded":"2023-11-27T18:43:23.087519+0000","last_fullsized":"2023-11-27T18:43:23.087519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:27:05.736955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"32'26","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.008498+0000","last_change":"2023-11-27T18:13:14.376812+0000","last_active":"2023-11-27T18:43:23.008498+0000","last_peered":"2023-11-27T18:43:23.008498+0000","last_clean":"2023-11-27T18:43:23.008498+0000","last_became_active":"2023-11-27T18:13:14.376559+0000","last_became_peered":"2023-11-27T18:13:14.376559+0000","last_unstale":"2023-11-27T18:43:23.008498+0000","last_undegraded":"2023-11-27T18:43:23.008498+0000","last_fullsized":"2023-11-27T18:43:23.008498+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:31:25.796567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"32'32","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.008507+0000","last_change":"2023-11-27T18:13:14.367518+0000","last_active":"2023-11-27T18:43:23.008507+0000","last_peered":"2023-11-27T18:43:23.008507+0000","last_clean":"2023-11-27T18:43:23.008507+0000","last_became_active":"2023-11-27T18:13:14.367298+0000","last_became_peered":"2023-11-27T18:13:14.367298+0000","last_unstale":"2023-11-27T18:43:23.008507+0000","last_undegraded":"2023-11-27T18:43:23.008507+0000","last_fullsized":"2023-11-27T18:43:23.008507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:48:00.722511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"32'17","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.094029+0000","last_change":"2023-11-27T18:13:14.364130+0000","last_active":"2023-11-27T18:43:23.094029+0000","last_peered":"2023-11-27T18:43:23.094029+0000","last_clean":"2023-11-27T18:43:23.094029+0000","last_became_active":"2023-11-27T18:13:14.363776+0000","last_became_peered":"2023-11-27T18:13:14.363776+0000","last_unstale":"2023-11-27T18:43:23.094029+0000","last_undegraded":"2023-11-27T18:43:23.094029+0000","last_fullsized":"2023-11-27T18:43:23.094029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:14:10.603135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"32'24","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.069330+0000","last_change":"2023-11-27T18:13:14.423459+0000","last_active":"2023-11-27T18:43:23.069330+0000","last_peered":"2023-11-27T18:43:23.069330+0000","last_clean":"2023-11-27T18:43:23.069330+0000","last_became_active":"2023-11-27T18:13:14.423099+0000","last_became_peered":"2023-11-27T18:13:14.423099+0000","last_unstale":"2023-11-27T18:43:23.069330+0000","last_undegraded":"2023-11-27T18:43:23.069330+0000","last_fullsized":"2023-11-27T18:43:23.069330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:39:33.850547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"32'32","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.094039+0000","last_change":"2023-11-27T18:13:14.420348+0000","last_active":"2023-11-27T18:43:23.094039+0000","last_peered":"2023-11-27T18:43:23.094039+0000","last_clean":"2023-11-27T18:43:23.094039+0000","last_became_active":"2023-11-27T18:13:14.419780+0000","last_became_peered":"2023-11-27T18:13:14.419780+0000","last_unstale":"2023-11-27T18:43:23.094039+0000","last_undegraded":"2023-11-27T18:43:23.094039+0000","last_fullsized":"2023-11-27T18:43:23.094039+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:49:00.537995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"32'29","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.112441+0000","last_change":"2023-11-27T18:13:15.910347+0000","last_active":"2023-11-27T18:43:23.112441+0000","last_peered":"2023-11-27T18:43:23.112441+0000","last_clean":"2023-11-27T18:43:23.112441+0000","last_became_active":"2023-11-27T18:13:15.909918+0000","last_became_peered":"2023-11-27T18:13:15.909918+0000","last_unstale":"2023-11-27T18:43:23.112441+0000","last_undegraded":"2023-11-27T18:43:23.112441+0000","last_fullsized":"2023-11-27T18:43:23.112441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:14:48.774302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"32'19","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.095169+0000","last_change":"2023-11-27T18:13:14.369974+0000","last_active":"2023-11-27T18:43:23.095169+0000","last_peered":"2023-11-27T18:43:23.095169+0000","last_clean":"2023-11-27T18:43:23.095169+0000","last_became_active":"2023-11-27T18:13:14.369285+0000","last_became_peered":"2023-11-27T18:13:14.369285+0000","last_unstale":"2023-11-27T18:43:23.095169+0000","last_undegraded":"2023-11-27T18:43:23.095169+0000","last_fullsized":"2023-11-27T18:43:23.095169+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:23:56.484932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"32'20","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.056701+0000","last_change":"2023-11-27T18:13:14.385745+0000","last_active":"2023-11-27T18:43:23.056701+0000","last_peered":"2023-11-27T18:43:23.056701+0000","last_clean":"2023-11-27T18:43:23.056701+0000","last_became_active":"2023-11-27T18:13:14.385566+0000","last_became_peered":"2023-11-27T18:13:14.385566+0000","last_unstale":"2023-11-27T18:43:23.056701+0000","last_undegraded":"2023-11-27T18:43:23.056701+0000","last_fullsized":"2023-11-27T18:43:23.056701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:52:43.071209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"32'26","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.088701+0000","last_change":"2023-11-27T18:13:15.848952+0000","last_active":"2023-11-27T18:43:23.088701+0000","last_peered":"2023-11-27T18:43:23.088701+0000","last_clean":"2023-11-27T18:43:23.088701+0000","last_became_active":"2023-11-27T18:13:15.848237+0000","last_became_peered":"2023-11-27T18:13:15.848237+0000","last_unstale":"2023-11-27T18:43:23.088701+0000","last_undegraded":"2023-11-27T18:43:23.088701+0000","last_fullsized":"2023-11-27T18:43:23.088701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:39:39.512202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"32'23","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.087188+0000","last_change":"2023-11-27T18:13:14.373247+0000","last_active":"2023-11-27T18:43:23.087188+0000","last_peered":"2023-11-27T18:43:23.087188+0000","last_clean":"2023-11-27T18:43:23.087188+0000","last_became_active":"2023-11-27T18:13:14.372974+0000","last_became_peered":"2023-11-27T18:13:14.372974+0000","last_unstale":"2023-11-27T18:43:23.087188+0000","last_undegraded":"2023-11-27T18:43:23.087188+0000","last_fullsized":"2023-11-27T18:43:23.087188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:39:34.589545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"32'18","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.091049+0000","last_change":"2023-11-27T18:13:15.851685+0000","last_active":"2023-11-27T18:43:23.091049+0000","last_peered":"2023-11-27T18:43:23.091049+0000","last_clean":"2023-11-27T18:43:23.091049+0000","last_became_active":"2023-11-27T18:13:15.850353+0000","last_became_peered":"2023-11-27T18:13:15.850353+0000","last_unstale":"2023-11-27T18:43:23.091049+0000","last_undegraded":"2023-11-27T18:43:23.091049+0000","last_fullsized":"2023-11-27T18:43:23.091049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:51:02.615119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"32'25","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.085199+0000","last_change":"2023-11-27T18:13:14.381126+0000","last_active":"2023-11-27T18:43:23.085199+0000","last_peered":"2023-11-27T18:43:23.085199+0000","last_clean":"2023-11-27T18:43:23.085199+0000","last_became_active":"2023-11-27T18:13:14.380714+0000","last_became_peered":"2023-11-27T18:13:14.380714+0000","last_unstale":"2023-11-27T18:43:23.085199+0000","last_undegraded":"2023-11-27T18:43:23.085199+0000","last_fullsized":"2023-11-27T18:43:23.085199+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:14:10.603135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"32'19","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.084889+0000","last_change":"2023-11-27T18:13:14.368254+0000","last_active":"2023-11-27T18:43:23.084889+0000","last_peered":"2023-11-27T18:43:23.084889+0000","last_clean":"2023-11-27T18:43:23.084889+0000","last_became_active":"2023-11-27T18:13:14.367978+0000","last_became_peered":"2023-11-27T18:13:14.367978+0000","last_unstale":"2023-11-27T18:43:23.084889+0000","last_undegraded":"2023-11-27T18:43:23.084889+0000","last_fullsized":"2023-11-27T18:43:23.084889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:05:05.751108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"32'23","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.067010+0000","last_change":"2023-11-27T18:13:14.419332+0000","last_active":"2023-11-27T18:43:23.067010+0000","last_peered":"2023-11-27T18:43:23.067010+0000","last_clean":"2023-11-27T18:43:23.067010+0000","last_became_active":"2023-11-27T18:13:14.418928+0000","last_became_peered":"2023-11-27T18:13:14.418928+0000","last_unstale":"2023-11-27T18:43:23.067010+0000","last_undegraded":"2023-11-27T18:43:23.067010+0000","last_fullsized":"2023-11-27T18:43:23.067010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:34:08.186176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2386,"num_write_kb":255070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2569,"ondisk_log_size":2569,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1576,"ondisk_log_size":1576,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":24107291,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":549,"num_read_kb":581,"num_write":5694,"num_write_kb":26819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32874496,"data_stored":48214582,"data_compressed":4737124,"data_compressed_allocated":7356416,"data_compressed_original":22757376,"omap_allocated":0,"internal_metadata":0},"log_size":5241,"ondisk_log_size":5241,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67010,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719477110,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36008,"kb_used_data":4832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335832,"statfs":{"total":96636764160,"available":96599891968,"internally_reserved":0,"allocated":4947968,"data_stored":8056568,"data_compressed":850146,"data_compressed_allocated":1241088,"data_compressed_original":4562944,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.874,"15min":0.85699999999999998},"min":{"1min":0.64000000000000001,"5min":0.5,"15min":0.45400000000000001},"max":{"1min":1.262,"5min":1.288,"15min":1.4730000000000001},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.93799999999999994,"15min":0.93300000000000005},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.46000000000000002},"max":{"1min":1.258,"5min":1.377,"15min":1.49},"last":1.002}]},{"osd":1,"last update":"Mon Nov 27 18:42:37 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.998,"15min":0.96599999999999997},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.57199999999999995},"max":{"1min":1.319,"5min":1.51,"15min":1.51},"last":1.161},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.95099999999999996,"15min":0.93200000000000005},"min":{"1min":0.65400000000000003,"5min":0.55100000000000005,"15min":0.45900000000000002},"max":{"1min":1.3460000000000001,"5min":1.361,"15min":1.482},"last":1.052}]},{"osd":2,"last update":"Mon Nov 27 18:42:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":0.99199999999999999,"15min":0.97799999999999998},"min":{"1min":0.628,"5min":0.59899999999999998,"15min":0.53900000000000003},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.603},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.92800000000000005,"15min":0.93300000000000005},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.52700000000000002},"max":{"1min":1.2110000000000001,"5min":1.389,"15min":1.389},"last":1.087}]},{"osd":3,"last update":"Mon Nov 27 18:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.99099999999999999,"15min":0.97799999999999998},"min":{"1min":0.67900000000000005,"5min":0.64500000000000002,"15min":0.63300000000000001},"max":{"1min":1.244,"5min":1.3859999999999999,"15min":1.472},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.073,"5min":1.0589999999999999,"15min":1.0429999999999999},"min":{"1min":0.77100000000000002,"5min":0.64800000000000002,"15min":0.61399999999999999},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":1.3049999999999999}]},{"osd":4,"last update":"Mon Nov 27 18:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90800000000000003,"15min":0.90200000000000002},"min":{"1min":0.496,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.194,"5min":1.397,"15min":1.4470000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.03,"5min":1.0349999999999999,"15min":1.0049999999999999},"min":{"1min":0.56799999999999995,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.3120000000000001,"5min":1.6020000000000001,"15min":1.6379999999999999},"last":1.2809999999999999}]},{"osd":6,"last update":"Mon Nov 27 18:42:37 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.0189999999999999,"15min":1.0109999999999999},"min":{"1min":0.66400000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.4019999999999999,"5min":1.466,"15min":1.49},"last":1.2470000000000001},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0429999999999999,"15min":1.034},"min":{"1min":0.71599999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.2969999999999999,"5min":1.5049999999999999,"15min":1.605},"last":1.1899999999999999}]},{"osd":7,"last update":"Mon Nov 27 18:42:37 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.1679999999999999,"15min":1.125},"min":{"1min":0.65000000000000002,"5min":0.49299999999999999,"15min":0.47999999999999998},"max":{"1min":1.4910000000000001,"5min":1.6930000000000001,"15min":1.831},"last":1.327},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.2,"15min":1.181},"min":{"1min":0.76900000000000002,"5min":0.52400000000000002,"15min":0.48099999999999998},"max":{"1min":1.6639999999999999,"5min":1.768,"15min":1.768},"last":1.131}]}]},{"osd":7,"up_from":16,"seq":68719477111,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33280,"kb_used_data":2104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338560,"statfs":{"total":96636764160,"available":96602685440,"internally_reserved":0,"allocated":2154496,"data_stored":3272747,"data_compressed":386056,"data_compressed_allocated":532480,"data_compressed_original":1863680,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.88500000000000001,"15min":0.88},"min":{"1min":0.56899999999999995,"5min":0.54000000000000004,"15min":0.49399999999999999},"max":{"1min":1.3009999999999999,"5min":1.357,"15min":1.448},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.96799999999999997,"15min":0.93700000000000006},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.49299999999999999},"max":{"1min":1.2909999999999999,"5min":1.411,"15min":1.7110000000000001},"last":0.93799999999999994}]},{"osd":1,"last update":"Mon Nov 27 18:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.91900000000000004,"15min":0.92600000000000005},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.343,"5min":1.379,"15min":1.379},"last":1.081},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1,"15min":0.97799999999999998},"min":{"1min":0.65600000000000003,"5min":0.63100000000000001,"15min":0.54800000000000004},"max":{"1min":1.4259999999999999,"5min":1.4450000000000001,"15min":1.768},"last":1.2410000000000001}]},{"osd":2,"last update":"Mon Nov 27 18:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":1.0089999999999999,"15min":0.997},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.52000000000000002},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.6870000000000001},"last":1.327},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.95399999999999996,"15min":0.93999999999999995},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.204,"5min":1.363,"15min":1.415},"last":0.76900000000000002}]},{"osd":3,"last update":"Mon Nov 27 18:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.99099999999999999,"15min":0.97699999999999998},"min":{"1min":0.61899999999999999,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.2370000000000001,"5min":1.4370000000000001,"15min":1.4550000000000001},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.103,"15min":1.073},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.51300000000000001},"max":{"1min":1.4990000000000001,"5min":1.5649999999999999,"15min":1.5820000000000001},"last":0.85599999999999998}]},{"osd":4,"last update":"Mon Nov 27 18:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":1.006,"15min":0.92900000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.4610000000000001,"5min":6.6539999999999999,"15min":6.6539999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.996,"15min":1},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.3240000000000001,"5min":1.5469999999999999,"15min":2.0649999999999999},"last":1.2709999999999999}]},{"osd":5,"last update":"Mon Nov 27 18:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.099,"15min":1.0389999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35199999999999998},"max":{"1min":1.569,"5min":1.825,"15min":1.825},"last":1.115},{"interface":"front","average":{"1min":1.052,"5min":1.0449999999999999,"15min":1.0369999999999999},"min":{"1min":0.55900000000000005,"5min":0.53200000000000003,"15min":0.39200000000000002},"max":{"1min":1.361,"5min":1.679,"15min":1.679},"last":1.0409999999999999}]},{"osd":6,"last update":"Mon Nov 27 18:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.1120000000000001,"15min":1.0900000000000001},"min":{"1min":0.73999999999999999,"5min":0.45300000000000001,"15min":0.43099999999999999},"max":{"1min":1.431,"5min":1.732,"15min":1.956},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.159,"15min":1.149},"min":{"1min":0.48999999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.6479999999999999,"5min":1.7170000000000001,"15min":1.8839999999999999},"last":1.1559999999999999}]}]},{"osd":6,"up_from":16,"seq":68719477111,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30016,"kb_used_data":3000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341824,"statfs":{"total":96636764160,"available":96606027776,"internally_reserved":0,"allocated":3072000,"data_stored":4332626,"data_compressed":430585,"data_compressed_allocated":663552,"data_compressed_original":2125824,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.93999999999999995,"15min":0.93600000000000005},"min":{"1min":0.64600000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.2290000000000001,"5min":1.375,"15min":1.956},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0609999999999999,"15min":1.04},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.534,"5min":1.5429999999999999,"15min":1.5629999999999999},"last":1.1830000000000001}]},{"osd":1,"last update":"Mon Nov 27 18:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.879,"15min":0.89300000000000002},"min":{"1min":0.58099999999999996,"5min":0.56599999999999995,"15min":0.51200000000000001},"max":{"1min":1.1679999999999999,"5min":1.4179999999999999,"15min":1.5229999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.93799999999999994,"15min":0.93400000000000005},"min":{"1min":0.63100000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3819999999999999,"5min":1.512,"15min":2.2519999999999998},"last":0.96699999999999997}]},{"osd":2,"last update":"Mon Nov 27 18:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.95899999999999996,"15min":0.95999999999999996},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.2949999999999999,"5min":2.2349999999999999,"15min":2.2349999999999999},"last":1.012},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.071,"15min":1.0580000000000001},"min":{"1min":0.76100000000000001,"5min":0.63400000000000001,"15min":0.52900000000000003},"max":{"1min":1.3819999999999999,"5min":3.6549999999999998,"15min":3.6549999999999998},"last":1.0469999999999999}]},{"osd":3,"last update":"Mon Nov 27 18:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0429999999999999,"15min":1.0389999999999999},"min":{"1min":0.75800000000000001,"5min":0.64800000000000002,"15min":0.52800000000000002},"max":{"1min":1.3420000000000001,"5min":1.7949999999999999,"15min":2.3050000000000002},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.026,"5min":1.081,"15min":1.069},"min":{"1min":0.73999999999999999,"5min":0.67300000000000004,"15min":0.57699999999999996},"max":{"1min":1.3500000000000001,"5min":2.0750000000000002,"15min":2.097},"last":0.90900000000000003}]},{"osd":4,"last update":"Mon Nov 27 18:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.95499999999999996,"15min":0.97499999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.712},"last":0.67800000000000005},{"interface":"front","average":{"1min":1.079,"5min":1.0860000000000001,"15min":1.0640000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.607,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.61699999999999999}]},{"osd":5,"last update":"Mon Nov 27 18:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":1.016,"15min":0.99299999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.2909999999999999,"5min":1.879,"15min":2.173},"last":0.78700000000000003},{"interface":"front","average":{"1min":1.075,"5min":1.133,"15min":1.1439999999999999},"min":{"1min":0.59399999999999997,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.4790000000000001,"5min":3.7509999999999999,"15min":3.7509999999999999},"last":1.157}]},{"osd":7,"last update":"Mon Nov 27 18:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.1459999999999999,"15min":1.157},"min":{"1min":0.55300000000000005,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.4910000000000001,"5min":1.962,"15min":2.351},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.163,"15min":1.1579999999999999},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.499},"max":{"1min":1.6990000000000001,"5min":2.1150000000000002,"15min":2.2250000000000001},"last":1.115}]}]},{"osd":3,"up_from":16,"seq":68719477109,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58052,"kb_used_data":8828,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94313788,"statfs":{"total":96636764160,"available":96577318912,"internally_reserved":0,"allocated":9039872,"data_stored":12721816,"data_compressed":1205599,"data_compressed_allocated":1880064,"data_compressed_original":5767168,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.70399999999999996,"15min":0.72299999999999998},"min":{"1min":0.497,"5min":0.40100000000000002,"15min":0.29799999999999999},"max":{"1min":1.077,"5min":1.077,"15min":1.456},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.79700000000000004,"15min":0.78700000000000003},"min":{"1min":0.55800000000000005,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.006,"5min":1.387,"15min":1.4750000000000001},"last":0.77500000000000002}]},{"osd":1,"last update":"Mon Nov 27 18:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.79000000000000004,"15min":0.78700000000000003},"min":{"1min":0.54700000000000004,"5min":0.434,"15min":0.38900000000000001},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.88200000000000001,"15min":0.90300000000000002},"min":{"1min":0.64000000000000001,"5min":0.39200000000000002,"15min":0.36799999999999999},"max":{"1min":1.0880000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.878}]},{"osd":2,"last update":"Mon Nov 27 18:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.94799999999999995,"15min":0.92400000000000004},"min":{"1min":0.67200000000000004,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.3420000000000001,"5min":1.631,"15min":1.631},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.93600000000000005,"15min":0.94999999999999996},"min":{"1min":0.61299999999999999,"5min":0.441,"15min":0.39000000000000001},"max":{"1min":1.115,"5min":1.375,"15min":1.375},"last":1.081}]},{"osd":4,"last update":"Mon Nov 27 18:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":1.0149999999999999,"15min":0.98899999999999999},"min":{"1min":0.65700000000000003,"5min":0.57699999999999996,"15min":0.56799999999999995},"max":{"1min":1.3380000000000001,"5min":1.573,"15min":1.6439999999999999},"last":1.115},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0289999999999999,"15min":1.0589999999999999},"min":{"1min":0.76900000000000002,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.3320000000000001,"5min":1.4950000000000001,"15min":1.605},"last":1.048}]},{"osd":5,"last update":"Mon Nov 27 18:42:37 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.077,"15min":1.087},"min":{"1min":0.82499999999999996,"5min":0.69899999999999995,"15min":0.59799999999999998},"max":{"1min":1.409,"5min":1.6120000000000001,"15min":1.766},"last":1.167},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.1899999999999999,"15min":1.1839999999999999},"min":{"1min":0.90500000000000003,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.536,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.294}]},{"osd":6,"last update":"Mon Nov 27 18:42:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1319999999999999,"15min":1.099},"min":{"1min":0.88800000000000001,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.597,"5min":1.607,"15min":1.8720000000000001},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.141,"5min":1.171,"15min":1.1819999999999999},"min":{"1min":0.86599999999999999,"5min":0.73799999999999999,"15min":0.63300000000000001},"max":{"1min":1.504,"5min":1.7050000000000001,"15min":1.7270000000000001},"last":1.2629999999999999}]},{"osd":7,"last update":"Mon Nov 27 18:42:37 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.2490000000000001,"15min":1.2470000000000001},"min":{"1min":0.94299999999999995,"5min":0.88800000000000001,"15min":0.61299999999999999},"max":{"1min":1.4770000000000001,"5min":1.915,"15min":1.915},"last":1.401},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1990000000000001,"15min":1.1699999999999999},"min":{"1min":1.014,"5min":0.496,"15min":0.496},"max":{"1min":1.5389999999999999,"5min":1.6839999999999999,"15min":1.9339999999999999},"last":1.3600000000000001}]}]},{"osd":2,"up_from":16,"seq":68719477110,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33272,"kb_used_data":6256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94338568,"statfs":{"total":96636764160,"available":96602693632,"internally_reserved":0,"allocated":6406144,"data_stored":8527602,"data_compressed":750925,"data_compressed_allocated":1228800,"data_compressed_original":3559424,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:42:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.71699999999999997,"15min":0.72199999999999998},"min":{"1min":0.49099999999999999,"5min":0.47699999999999998,"15min":0.41599999999999998},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2869999999999999},"last":0.63},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.80400000000000005,"15min":0.82199999999999995},"min":{"1min":0.51700000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.3899999999999999,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":0.998}]},{"osd":1,"last update":"Mon Nov 27 18:42:43 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.83699999999999997,"15min":0.85399999999999998},"min":{"1min":0.61799999999999999,"5min":0.56799999999999995,"15min":0.38500000000000001},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.89000000000000001,"15min":0.88900000000000001},"min":{"1min":0.54700000000000004,"5min":0.49399999999999999,"15min":0.48499999999999999},"max":{"1min":1.0269999999999999,"5min":2.6400000000000001,"15min":2.6400000000000001},"last":0.72699999999999998}]},{"osd":3,"last update":"Mon Nov 27 18:42:43 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84499999999999997,"15min":0.82899999999999996},"min":{"1min":0.436,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.3799999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":1.002,"5min":0.96599999999999997,"15min":0.97399999999999998},"min":{"1min":0.72399999999999998,"5min":0.46100000000000002,"15min":0.40200000000000002},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":1.034}]},{"osd":4,"last update":"Mon Nov 27 18:42:43 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.0309999999999999,"15min":1.044},"min":{"1min":0.871,"5min":0.71799999999999997,"15min":0.56599999999999995},"max":{"1min":1.4339999999999999,"5min":1.49,"15min":1.7090000000000001},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.028,"5min":1.0329999999999999,"15min":1.05},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.57799999999999996},"max":{"1min":1.4179999999999999,"5min":1.861,"15min":1.861},"last":0.88}]},{"osd":5,"last update":"Mon Nov 27 18:42:43 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.0820000000000001,"15min":1.089},"min":{"1min":0.68700000000000006,"5min":0.68300000000000005,"15min":0.628},"max":{"1min":1.4650000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.012,"5min":1.0649999999999999,"15min":1.0509999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.53000000000000003},"max":{"1min":1.3180000000000001,"5min":1.5800000000000001,"15min":1.6859999999999999},"last":0.77300000000000002}]},{"osd":6,"last update":"Mon Nov 27 18:42:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.1180000000000001,"15min":1.1080000000000001},"min":{"1min":0.58999999999999997,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.3169999999999999,"5min":1.6339999999999999,"15min":1.7490000000000001},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.1890000000000001,"15min":1.1870000000000001},"min":{"1min":0.93000000000000005,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.786,"5min":1.786,"15min":1.958},"last":1.087}]},{"osd":7,"last update":"Mon Nov 27 18:42:43 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.194,"15min":1.1950000000000001},"min":{"1min":0.89200000000000002,"5min":0.88400000000000001,"15min":0.625},"max":{"1min":1.54,"5min":1.7869999999999999,"15min":1.8799999999999999},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.204,"15min":1.1830000000000001},"min":{"1min":0.61099999999999999,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.389,"5min":3.4289999999999998,"15min":3.4289999999999998},"last":0.92000000000000004}]}]},{"osd":1,"up_from":16,"seq":68719477110,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44056,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327784,"statfs":{"total":96636764160,"available":96591650816,"internally_reserved":0,"allocated":409600,"data_stored":728760,"data_compressed":33505,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:42:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.69899999999999995,"15min":0.71899999999999997},"min":{"1min":0.495,"5min":0.44700000000000001,"15min":0.41499999999999998},"max":{"1min":1.0209999999999999,"5min":1.1080000000000001,"15min":1.2969999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.80600000000000005,"15min":0.82899999999999996},"min":{"1min":0.54600000000000004,"5min":0.54300000000000004,"15min":0.34499999999999997},"max":{"1min":1.0629999999999999,"5min":1.306,"15min":1.397},"last":0.81599999999999995}]},{"osd":2,"last update":"Mon Nov 27 18:42:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.74099999999999999,"15min":0.74399999999999999},"min":{"1min":0.58599999999999997,"5min":0.40400000000000003,"15min":0.36299999999999999},"max":{"1min":1.0640000000000001,"5min":1.274,"15min":1.3480000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84699999999999998,"15min":0.89000000000000001},"min":{"1min":0.65400000000000003,"5min":0.48899999999999999,"15min":0.38500000000000001},"max":{"1min":1.1930000000000001,"5min":1.4359999999999999,"15min":1.9610000000000001},"last":0.93300000000000005}]},{"osd":3,"last update":"Mon Nov 27 18:42:34 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.95899999999999996,"15min":0.98199999999999998},"min":{"1min":0.52600000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.296,"5min":1.3520000000000001,"15min":1.8009999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.90300000000000002,"15min":0.91000000000000003},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.40699999999999997},"max":{"1min":1.462,"5min":1.462,"15min":2.0960000000000001},"last":1.2310000000000001}]},{"osd":4,"last update":"Mon Nov 27 18:42:34 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.97499999999999998,"15min":0.95299999999999996},"min":{"1min":0.70399999999999996,"5min":0.67800000000000005,"15min":0.51800000000000002},"max":{"1min":1.2170000000000001,"5min":1.4370000000000001,"15min":1.4970000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.087,"15min":1.099},"min":{"1min":0.75900000000000001,"5min":0.66900000000000004,"15min":0.61399999999999999},"max":{"1min":1.478,"5min":1.593,"15min":2.496},"last":1.056}]},{"osd":5,"last update":"Mon Nov 27 18:42:34 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.073,"15min":1.0940000000000001},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.51500000000000001},"max":{"1min":1.4990000000000001,"5min":1.534,"15min":2.1970000000000001},"last":0.996},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0660000000000001,"15min":1.0620000000000001},"min":{"1min":0.82699999999999996,"5min":0.73399999999999999,"15min":0.60599999999999998},"max":{"1min":1.573,"5min":1.605,"15min":1.7529999999999999},"last":0.96899999999999997}]},{"osd":6,"last update":"Mon Nov 27 18:42:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1830000000000001,"15min":1.2},"min":{"1min":0.83099999999999996,"5min":0.77100000000000002,"15min":0.503},"max":{"1min":1.6060000000000001,"5min":1.6879999999999999,"15min":2.4319999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.175,"15min":1.1859999999999999},"min":{"1min":0.94899999999999995,"5min":0.77800000000000002,"15min":0.52600000000000002},"max":{"1min":1.5660000000000001,"5min":1.7569999999999999,"15min":2.3700000000000001},"last":1.1850000000000001}]},{"osd":7,"last update":"Mon Nov 27 18:42:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.1919999999999999,"15min":1.2190000000000001},"min":{"1min":0.99299999999999999,"5min":0.79900000000000004,"15min":0.55200000000000005},"max":{"1min":1.6160000000000001,"5min":1.6990000000000001,"15min":2.2879999999999998},"last":1.127},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1799999999999999,"15min":1.1659999999999999},"min":{"1min":0.90700000000000003,"5min":0.79000000000000004,"15min":0.72999999999999998},"max":{"1min":1.4399999999999999,"5min":1.7070000000000001,"15min":1.7170000000000001},"last":1.1000000000000001}]}]},{"osd":0,"up_from":16,"seq":68719477111,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42672,"kb_used_data":3176,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329168,"statfs":{"total":96636764160,"available":96593068032,"internally_reserved":0,"allocated":3252224,"data_stored":4332682,"data_compressed":397480,"data_compressed_allocated":610304,"data_compressed_original":1900544,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 27 18:42:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.73799999999999999,"15min":0.72599999999999998},"min":{"1min":0.499,"5min":0.45100000000000001,"15min":0.441},"max":{"1min":1.2070000000000001,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.82599999999999996,"15min":0.83799999999999997},"min":{"1min":0.47499999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1120000000000001,"5min":1.391,"15min":1.391},"last":0.56799999999999995}]},{"osd":2,"last update":"Mon Nov 27 18:42:36 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.83399999999999996,"15min":0.86199999999999999},"min":{"1min":0.58299999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.127,"5min":1.3799999999999999,"15min":1.405},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.86099999999999999,"15min":0.86499999999999999},"min":{"1min":0.54600000000000004,"5min":0.52400000000000002,"15min":0.51900000000000002},"max":{"1min":1.1459999999999999,"5min":1.4730000000000001,"15min":1.5629999999999999},"last":0.82399999999999995}]},{"osd":3,"last update":"Mon Nov 27 18:42:36 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.88700000000000001,"15min":0.86899999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.42099999999999999},"max":{"1min":1.2410000000000001,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.96099999999999997,"15min":0.96799999999999997},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.29,"5min":1.421,"15min":2.073},"last":0.75700000000000001}]},{"osd":4,"last update":"Mon Nov 27 18:42:36 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.97799999999999998,"15min":0.97599999999999998},"min":{"1min":0.72399999999999998,"5min":0.63400000000000001,"15min":0.57099999999999995},"max":{"1min":1.2250000000000001,"5min":1.73,"15min":1.897},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.038,"5min":1.042,"15min":1.081},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.59399999999999997},"max":{"1min":1.3899999999999999,"5min":1.4059999999999999,"15min":2.1899999999999999},"last":0.93600000000000005}]},{"osd":5,"last update":"Mon Nov 27 18:42:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.089,"15min":1.0920000000000001},"min":{"1min":0.77800000000000002,"5min":0.70199999999999996,"15min":0.56899999999999995},"max":{"1min":1.3520000000000001,"5min":1.5369999999999999,"15min":2.0270000000000001},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.997,"5min":1.042,"15min":1.048},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.624},"max":{"1min":1.2509999999999999,"5min":1.855,"15min":2.1480000000000001},"last":1.248}]},{"osd":6,"last update":"Mon Nov 27 18:42:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.149,"15min":1.1679999999999999},"min":{"1min":0.73699999999999999,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.3440000000000001,"5min":1.6399999999999999,"15min":2.254},"last":1.163},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1579999999999999,"15min":1.1779999999999999},"min":{"1min":0.874,"5min":0.83299999999999996,"15min":0.745},"max":{"1min":1.5029999999999999,"5min":1.5800000000000001,"15min":1.8440000000000001},"last":1.046}]},{"osd":7,"last update":"Mon Nov 27 18:42:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1910000000000001,"15min":1.2070000000000001},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.60799999999999998},"max":{"1min":1.556,"5min":1.591,"15min":2.1600000000000001},"last":1.125},{"interface":"front","average":{"1min":1.153,"5min":1.169,"15min":1.1619999999999999},"min":{"1min":0.93700000000000006,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.349,"5min":1.7849999999999999,"15min":2.117},"last":1.081}]}]},{"osd":4,"up_from":15,"seq":64424509815,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55512,"kb_used_data":6288,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94316328,"statfs":{"total":96636764160,"available":96579919872,"internally_reserved":0,"allocated":6438912,"data_stored":8528274,"data_compressed":749838,"data_compressed_allocated":1245184,"data_compressed_original":3551232,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:42:36 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.92900000000000005,"15min":0.88500000000000001},"min":{"1min":0.63600000000000001,"5min":0.47099999999999997,"15min":0.46300000000000002},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.675},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.91500000000000004,"15min":0.91400000000000003},"min":{"1min":0.55300000000000005,"5min":0.373,"15min":0.373},"max":{"1min":1.298,"5min":1.504,"15min":1.5449999999999999},"last":0.90500000000000003}]},{"osd":1,"last update":"Mon Nov 27 18:42:36 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.93899999999999995,"15min":0.93500000000000005},"min":{"1min":0.71899999999999997,"5min":0.55100000000000005,"15min":0.46100000000000002},"max":{"1min":1.4199999999999999,"5min":1.4790000000000001,"15min":2.2759999999999998},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.95899999999999996,"15min":0.95299999999999996},"min":{"1min":0.73599999999999999,"5min":0.58899999999999997,"15min":0.49399999999999999},"max":{"1min":1.3080000000000001,"5min":1.371,"15min":1.569},"last":1.105}]},{"osd":2,"last update":"Mon Nov 27 18:42:36 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.98699999999999999,"15min":0.96599999999999997},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":2.3730000000000002},"last":0.996},{"interface":"front","average":{"1min":1.012,"5min":0.99099999999999999,"15min":0.999},"min":{"1min":0.52200000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.3129999999999999,"5min":1.4770000000000001,"15min":1.7729999999999999},"last":1.264}]},{"osd":3,"last update":"Mon Nov 27 18:42:36 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":0.97599999999999998,"15min":0.95899999999999996},"min":{"1min":0.77400000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.8300000000000001},"last":1.077},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0349999999999999,"15min":1.048},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.496,"5min":1.5169999999999999,"15min":2.2069999999999999},"last":1.0529999999999999}]},{"osd":5,"last update":"Mon Nov 27 18:42:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93899999999999995,"15min":0.96699999999999997},"min":{"1min":0.59899999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.2210000000000001,"5min":1.4410000000000001,"15min":1.7290000000000001},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.083,"5min":0.96199999999999997,"15min":0.96899999999999997},"min":{"1min":0.69099999999999995,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.355,"5min":1.597,"15min":1.7150000000000001},"last":0.80600000000000005}]},{"osd":6,"last update":"Mon Nov 27 18:42:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.0569999999999999,"15min":1.038},"min":{"1min":0.72099999999999997,"5min":0.52200000000000002,"15min":0.48299999999999998},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":2.4199999999999999},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.21,"5min":1.153,"15min":1.1399999999999999},"min":{"1min":0.79100000000000004,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.4510000000000001,"5min":1.591,"15min":1.8140000000000001},"last":1.1950000000000001}]},{"osd":7,"last update":"Mon Nov 27 18:42:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.089,"15min":1.073},"min":{"1min":0.504,"5min":0.46100000000000002,"15min":0.40400000000000003},"max":{"1min":1.623,"5min":1.6859999999999999,"15min":2.0419999999999998},"last":1.028},{"interface":"front","average":{"1min":1.196,"5min":1.1599999999999999,"15min":1.165},"min":{"1min":0.53200000000000003,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.736,"5min":1.736,"15min":2.3279999999999998},"last":1.145}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33505,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33505,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2912256,"data_stored":4194360,"data_compressed":397480,"data_compressed_allocated":610304,"data_compressed_original":1900544,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6066176,"data_stored":8389280,"data_compressed":750925,"data_compressed_allocated":1228800,"data_compressed_original":3559424,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8699904,"data_stored":12583494,"data_compressed":1205599,"data_compressed_allocated":1880064,"data_compressed_original":5767168,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6098944,"data_stored":8389952,"data_compressed":749838,"data_compressed_allocated":1245184,"data_compressed_original":3551232,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4546560,"data_stored":7328697,"data_compressed":816641,"data_compressed_allocated":1196032,"data_compressed_original":3989504,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":2732032,"data_stored":4194304,"data_compressed":430585,"data_compressed_allocated":663552,"data_compressed_original":2125824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1814528,"data_stored":3134425,"data_compressed":386056,"data_compressed_allocated":532480,"data_compressed_original":1863680,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T18:43:30.405 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-27T18:43:30.405 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T18:43:30.566 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.560+0000 7fbc76dd4640 1 Processor -- start 2023-11-27T18:43:30.566 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.564+0000 7fbc76dd4640 1 -- start start 2023-11-27T18:43:30.566 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.564+0000 7fbc76dd4640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbc70070cf0 0x7fbc7015b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:30.566 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.564+0000 7fbc76dd4640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fbc700710d0 0x7fbc70151140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:30.566 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.564+0000 7fbc76dd4640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fbc700ccc20 0x7fbc70151680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:30.566 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.564+0000 7fbc76dd4640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc700cdbd0 con 0x7fbc700ccc20 2023-11-27T18:43:30.566 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.564+0000 7fbc76dd4640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc70158370 con 0x7fbc700710d0 2023-11-27T18:43:30.566 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.564+0000 7fbc76dd4640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7015b8f0 con 0x7fbc70070cf0 2023-11-27T18:43:30.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.568+0000 7fbc74b70640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbc70070cf0 0x7fbc7015b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:30.571 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.568+0000 7fbc67fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fbc700710d0 0x7fbc70151140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:30.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.572+0000 7fbc67fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fbc700710d0 0x7fbc70151140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.91:50954/0 (socket says 172.21.15.91:50954) 2023-11-27T18:43:30.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.572+0000 7fbc67fff640 1 -- 172.21.15.91:0/1679669508 learned_addr learned my addr 172.21.15.91:0/1679669508 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:30.625 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.624+0000 7fbc75371640 1 --2- 172.21.15.91:0/1679669508 >> v2:172.21.15.91:3300/0 conn(0x7fbc700ccc20 0x7fbc70151680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:30.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.628+0000 7fbc75371640 1 -- 172.21.15.91:0/1679669508 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbc70070cf0 msgr2=0x7fbc7015b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:30.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.628+0000 7fbc75371640 1 --2- 172.21.15.91:0/1679669508 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbc70070cf0 0x7fbc7015b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:30.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.628+0000 7fbc75371640 1 -- 172.21.15.91:0/1679669508 >> v2:172.21.15.94:3300/0 conn(0x7fbc700710d0 msgr2=0x7fbc70151140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:30.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.628+0000 7fbc75371640 1 --2- 172.21.15.91:0/1679669508 >> v2:172.21.15.94:3300/0 conn(0x7fbc700710d0 0x7fbc70151140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:30.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.628+0000 7fbc75371640 1 -- 172.21.15.91:0/1679669508 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc701577f0 con 0x7fbc700ccc20 2023-11-27T18:43:30.638 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.636+0000 7fbc75371640 1 --2- 172.21.15.91:0/1679669508 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbc700ccc20 0x7fbc70151680 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbc7006fb30 tx=0x7fbc6801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31b0e15f6075ba60 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:30.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.644+0000 7fbc677fe640 1 -- 172.21.15.91:0/1679669508 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc680a5960 con 0x7fbc700ccc20 2023-11-27T18:43:30.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.644+0000 7fbc677fe640 1 -- 172.21.15.91:0/1679669508 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc680a5ac0 con 0x7fbc700ccc20 2023-11-27T18:43:30.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.644+0000 7fbc677fe640 1 -- 172.21.15.91:0/1679669508 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc680a5e50 con 0x7fbc700ccc20 2023-11-27T18:43:30.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.648+0000 7fbc76dd4640 1 -- 172.21.15.91:0/1679669508 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbc700ccc20 msgr2=0x7fbc70151680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:30.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.648+0000 7fbc76dd4640 1 --2- 172.21.15.91:0/1679669508 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbc700ccc20 0x7fbc70151680 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbc7006fb30 tx=0x7fbc6801c8e0 comp rx=0 tx=0).stop 2023-11-27T18:43:30.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.648+0000 7fbc76dd4640 1 -- 172.21.15.91:0/1679669508 shutdown_connections 2023-11-27T18:43:30.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.648+0000 7fbc76dd4640 1 --2- 172.21.15.91:0/1679669508 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbc700ccc20 0x7fbc70151680 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:30.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.648+0000 7fbc76dd4640 1 --2- 172.21.15.91:0/1679669508 >> v2:172.21.15.94:3300/0 conn(0x7fbc700710d0 0x7fbc70151140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:30.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.648+0000 7fbc76dd4640 1 --2- 172.21.15.91:0/1679669508 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbc70070cf0 0x7fbc7015b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:30.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.648+0000 7fbc76dd4640 1 -- 172.21.15.91:0/1679669508 >> 172.21.15.91:0/1679669508 conn(0x7fbc700669c0 msgr2=0x7fbc7006ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:30.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.648+0000 7fbc76dd4640 1 -- 172.21.15.91:0/1679669508 shutdown_connections 2023-11-27T18:43:30.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.648+0000 7fbc76dd4640 1 -- 172.21.15.91:0/1679669508 wait complete. 2023-11-27T18:43:30.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.648+0000 7fbc76dd4640 1 Processor -- start 2023-11-27T18:43:30.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.648+0000 7fbc76dd4640 1 -- start start 2023-11-27T18:43:30.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.648+0000 7fbc76dd4640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbc70070cf0 0x7fbc7015a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:30.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.648+0000 7fbc76dd4640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbc700710d0 0x7fbc70158570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:30.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.648+0000 7fbc76dd4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbc700ccc20 0x7fbc7014b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:30.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.648+0000 7fbc76dd4640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc70161590 con 0x7fbc70070cf0 2023-11-27T18:43:30.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.648+0000 7fbc76dd4640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7015adf0 con 0x7fbc700ccc20 2023-11-27T18:43:30.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.648+0000 7fbc76dd4640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7015bc90 con 0x7fbc700710d0 2023-11-27T18:43:30.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.652+0000 7fbc74b70640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbc70070cf0 0x7fbc7015a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:30.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.652+0000 7fbc74b70640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbc70070cf0 0x7fbc7015a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:34720/0 (socket says 172.21.15.91:34720) 2023-11-27T18:43:30.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.652+0000 7fbc74b70640 1 -- 172.21.15.91:0/4285274276 learned_addr learned my addr 172.21.15.91:0/4285274276 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:30.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.656+0000 7fbc74b70640 1 -- 172.21.15.91:0/4285274276 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbc700710d0 msgr2=0x7fbc70158570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:30.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.656+0000 7fbc74b70640 1 --2- 172.21.15.91:0/4285274276 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbc700710d0 0x7fbc70158570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:30.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.656+0000 7fbc74b70640 1 -- 172.21.15.91:0/4285274276 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbc700ccc20 msgr2=0x7fbc7014b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:30.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.656+0000 7fbc74b70640 1 --2- 172.21.15.91:0/4285274276 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbc700ccc20 0x7fbc7014b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:30.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.656+0000 7fbc74b70640 1 -- 172.21.15.91:0/4285274276 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc68009a70 con 0x7fbc70070cf0 2023-11-27T18:43:30.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.656+0000 7fbc74b70640 1 --2- 172.21.15.91:0/4285274276 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbc70070cf0 0x7fbc7015a8b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c00c5c0 tx=0x7fbc6c00ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:30.662 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.660+0000 7fbc657fa640 1 -- 172.21.15.91:0/4285274276 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c011800 con 0x7fbc70070cf0 2023-11-27T18:43:30.662 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.660+0000 7fbc76dd4640 1 -- 172.21.15.91:0/4285274276 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc7015bf70 con 0x7fbc70070cf0 2023-11-27T18:43:30.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.660+0000 7fbc657fa640 1 -- 172.21.15.91:0/4285274276 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc6c011960 con 0x7fbc70070cf0 2023-11-27T18:43:30.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.660+0000 7fbc657fa640 1 -- 172.21.15.91:0/4285274276 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c011cf0 con 0x7fbc70070cf0 2023-11-27T18:43:30.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.660+0000 7fbc76dd4640 1 -- 172.21.15.91:0/4285274276 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc70160ed0 con 0x7fbc70070cf0 2023-11-27T18:43:30.664 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.664+0000 7fbc76dd4640 1 -- 172.21.15.91:0/4285274276 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc701616d0 con 0x7fbc70070cf0 2023-11-27T18:43:30.949 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.947+0000 7fbc657fa640 1 -- 172.21.15.91:0/4285274276 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fbc6c024480 con 0x7fbc70070cf0 2023-11-27T18:43:30.950 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.947+0000 7fbc657fa640 1 --2- 172.21.15.91:0/4285274276 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fbc5c066840 0x7fbc5c068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:30.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.947+0000 7fbc67fff640 1 --2- 172.21.15.91:0/4285274276 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fbc5c066840 0x7fbc5c068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:30.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.947+0000 7fbc67fff640 1 --2- 172.21.15.91:0/4285274276 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fbc5c066840 0x7fbc5c068d00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbc60006f50 tx=0x7fbc60006ea0 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:30.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.983+0000 7fbc657fa640 1 -- 172.21.15.91:0/4285274276 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fbc6c0558d0 con 0x7fbc70070cf0 2023-11-27T18:43:30.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:30.983+0000 7fbc657fa640 1 -- 172.21.15.91:0/4285274276 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fbc6c051510 con 0x7fbc70070cf0 2023-11-27T18:43:31.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.171+0000 7fbc76dd4640 1 -- 172.21.15.91:0/4285274276 --> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbc70073720 con 0x7fbc5c066840 2023-11-27T18:43:31.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.195+0000 7fbc657fa640 1 -- 172.21.15.91:0/4285274276 <== mgr.4136 v2:172.21.15.91:6800/2814827118 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+369649 (secure 0 0 0) 0x7fbc70073720 con 0x7fbc5c066840 2023-11-27T18:43:31.205 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:43:31.208 INFO:teuthology.orchestra.run.smithi091.stderr:dumped all 2023-11-27T18:43:31.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.203+0000 7fbc76dd4640 1 -- 172.21.15.91:0/4285274276 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fbc5c066840 msgr2=0x7fbc5c068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:31.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.203+0000 7fbc76dd4640 1 --2- 172.21.15.91:0/4285274276 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fbc5c066840 0x7fbc5c068d00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbc60006f50 tx=0x7fbc60006ea0 comp rx=0 tx=0).stop 2023-11-27T18:43:31.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.203+0000 7fbc76dd4640 1 -- 172.21.15.91:0/4285274276 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbc70070cf0 msgr2=0x7fbc7015a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:31.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.203+0000 7fbc76dd4640 1 --2- 172.21.15.91:0/4285274276 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbc70070cf0 0x7fbc7015a8b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c00c5c0 tx=0x7fbc6c00ca80 comp rx=0 tx=0).stop 2023-11-27T18:43:31.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.203+0000 7fbc76dd4640 1 -- 172.21.15.91:0/4285274276 shutdown_connections 2023-11-27T18:43:31.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.203+0000 7fbc76dd4640 1 --2- 172.21.15.91:0/4285274276 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fbc5c066840 0x7fbc5c068d00 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:31.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.203+0000 7fbc76dd4640 1 --2- 172.21.15.91:0/4285274276 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbc700710d0 0x7fbc70158570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:31.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.203+0000 7fbc76dd4640 1 --2- 172.21.15.91:0/4285274276 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbc700ccc20 0x7fbc7014b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:31.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.203+0000 7fbc76dd4640 1 --2- 172.21.15.91:0/4285274276 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbc70070cf0 0x7fbc7015a8b0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:31.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.203+0000 7fbc76dd4640 1 -- 172.21.15.91:0/4285274276 >> 172.21.15.91:0/4285274276 conn(0x7fbc700669c0 msgr2=0x7fbc7014cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:31.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.203+0000 7fbc76dd4640 1 -- 172.21.15.91:0/4285274276 shutdown_connections 2023-11-27T18:43:31.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.203+0000 7fbc76dd4640 1 -- 172.21.15.91:0/4285274276 wait complete. 2023-11-27T18:43:31.227 INFO:teuthology.orchestra.run.smithi091.stdout:{"pg_ready":true,"pg_map":{"version":954,"stamp":"2023-11-27T18:43:29.891689+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":24697659,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":665,"num_read_kb":681,"num_write":8239,"num_write_kb":284305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9503,"ondisk_log_size":9503,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":332868,"kb_used_data":34884,"kb_used_omap":12,"kb_used_meta":297907,"kb_avail":754641852,"statfs":{"total":773094113280,"available":772753256448,"internally_reserved":0,"allocated":35721216,"data_stored":50501075,"data_compressed":4804134,"data_compressed_allocated":7446528,"data_compressed_original":23904256,"omap_allocated":12751,"internal_metadata":305057329},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":11715,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":13,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004750"},"pg_stats":[{"pgid":"2.1f","version":"32'712","reported_seq":747,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:28.043175+0000","last_change":"2023-11-27T18:13:12.298503+0000","last_active":"2023-11-27T18:42:28.043175+0000","last_peered":"2023-11-27T18:42:28.043175+0000","last_clean":"2023-11-27T18:42:28.043175+0000","last_became_active":"2023-11-27T18:13:12.298140+0000","last_became_peered":"2023-11-27T18:13:12.298140+0000","last_unstale":"2023-11-27T18:42:28.043175+0000","last_undegraded":"2023-11-27T18:42:28.043175+0000","last_fullsized":"2023-11-27T18:42:28.043175+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":712,"log_dups_size":0,"ondisk_log_size":712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:04:02.661989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":710,"num_write_kb":4473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"32'16","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.084791+0000","last_change":"2023-11-27T18:13:14.416681+0000","last_active":"2023-11-27T18:43:23.084791+0000","last_peered":"2023-11-27T18:43:23.084791+0000","last_clean":"2023-11-27T18:43:23.084791+0000","last_became_active":"2023-11-27T18:13:14.416401+0000","last_became_peered":"2023-11-27T18:13:14.416401+0000","last_unstale":"2023-11-27T18:43:23.084791+0000","last_undegraded":"2023-11-27T18:43:23.084791+0000","last_fullsized":"2023-11-27T18:43:23.084791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:02:14.142363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"32'75","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:20.602326+0000","last_change":"2023-11-27T18:13:20.916435+0000","last_active":"2023-11-27T18:42:20.602326+0000","last_peered":"2023-11-27T18:42:20.602326+0000","last_clean":"2023-11-27T18:42:20.602326+0000","last_became_active":"2023-11-27T18:13:20.915358+0000","last_became_peered":"2023-11-27T18:13:20.915358+0000","last_unstale":"2023-11-27T18:42:20.602326+0000","last_undegraded":"2023-11-27T18:42:20.602326+0000","last_fullsized":"2023-11-27T18:42:20.602326+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:55:46.903556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":3642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"32'324","reported_seq":359,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:22.643669+0000","last_change":"2023-11-27T18:13:12.305296+0000","last_active":"2023-11-27T18:43:22.643669+0000","last_peered":"2023-11-27T18:43:22.643669+0000","last_clean":"2023-11-27T18:43:22.643669+0000","last_became_active":"2023-11-27T18:13:12.304981+0000","last_became_peered":"2023-11-27T18:13:12.304981+0000","last_unstale":"2023-11-27T18:43:22.643669+0000","last_undegraded":"2023-11-27T18:43:22.643669+0000","last_fullsized":"2023-11-27T18:43:22.643669+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:04:30.721243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3006109,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":322,"num_write_kb":3093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"32'24","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.088010+0000","last_change":"2023-11-27T18:13:14.366102+0000","last_active":"2023-11-27T18:43:23.088010+0000","last_peered":"2023-11-27T18:43:23.088010+0000","last_clean":"2023-11-27T18:43:23.088010+0000","last_became_active":"2023-11-27T18:13:14.365787+0000","last_became_peered":"2023-11-27T18:13:14.365787+0000","last_unstale":"2023-11-27T18:43:23.088010+0000","last_undegraded":"2023-11-27T18:43:23.088010+0000","last_fullsized":"2023-11-27T18:43:23.088010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:39:34.589545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"32'88","reported_seq":117,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:22.952283+0000","last_change":"2023-11-27T18:13:20.915811+0000","last_active":"2023-11-27T18:42:22.952283+0000","last_peered":"2023-11-27T18:42:22.952283+0000","last_clean":"2023-11-27T18:42:22.952283+0000","last_became_active":"2023-11-27T18:13:20.914864+0000","last_became_peered":"2023-11-27T18:13:20.914864+0000","last_unstale":"2023-11-27T18:42:22.952283+0000","last_undegraded":"2023-11-27T18:42:22.952283+0000","last_fullsized":"2023-11-27T18:42:22.952283+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:22:21.572863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":6140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"32'9","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:14.217989+0000","last_change":"2023-11-27T18:13:12.272691+0000","last_active":"2023-11-27T18:43:14.217989+0000","last_peered":"2023-11-27T18:43:14.217989+0000","last_clean":"2023-11-27T18:43:14.217989+0000","last_became_active":"2023-11-27T18:13:12.272343+0000","last_became_peered":"2023-11-27T18:13:12.272343+0000","last_unstale":"2023-11-27T18:43:14.217989+0000","last_undegraded":"2023-11-27T18:43:14.217989+0000","last_fullsized":"2023-11-27T18:43:14.217989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:23:55.280753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"32'21","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.112985+0000","last_change":"2023-11-27T18:13:15.804199+0000","last_active":"2023-11-27T18:43:23.112985+0000","last_peered":"2023-11-27T18:43:23.112985+0000","last_clean":"2023-11-27T18:43:23.112985+0000","last_became_active":"2023-11-27T18:13:15.803248+0000","last_became_peered":"2023-11-27T18:13:15.803248+0000","last_unstale":"2023-11-27T18:43:23.112985+0000","last_undegraded":"2023-11-27T18:43:23.112985+0000","last_fullsized":"2023-11-27T18:43:23.112985+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:39:31.246554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"32'82","reported_seq":111,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:22.954321+0000","last_change":"2023-11-27T18:13:20.909371+0000","last_active":"2023-11-27T18:42:22.954321+0000","last_peered":"2023-11-27T18:42:22.954321+0000","last_clean":"2023-11-27T18:42:22.954321+0000","last_became_active":"2023-11-27T18:13:20.908285+0000","last_became_peered":"2023-11-27T18:13:20.908285+0000","last_unstale":"2023-11-27T18:42:22.954321+0000","last_undegraded":"2023-11-27T18:42:22.954321+0000","last_fullsized":"2023-11-27T18:42:22.954321+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:40:20.210205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":10516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"32'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:57.518824+0000","last_change":"2023-11-27T18:13:12.274531+0000","last_active":"2023-11-27T18:42:57.518824+0000","last_peered":"2023-11-27T18:42:57.518824+0000","last_clean":"2023-11-27T18:42:57.518824+0000","last_became_active":"2023-11-27T18:13:12.274275+0000","last_became_peered":"2023-11-27T18:13:12.274275+0000","last_unstale":"2023-11-27T18:42:57.518824+0000","last_undegraded":"2023-11-27T18:42:57.518824+0000","last_fullsized":"2023-11-27T18:42:57.518824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:02:12.938184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"32'37","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.017775+0000","last_change":"2023-11-27T18:13:14.422531+0000","last_active":"2023-11-27T18:43:23.017775+0000","last_peered":"2023-11-27T18:43:23.017775+0000","last_clean":"2023-11-27T18:43:23.017775+0000","last_became_active":"2023-11-27T18:13:14.421811+0000","last_became_peered":"2023-11-27T18:13:14.421811+0000","last_unstale":"2023-11-27T18:43:23.017775+0000","last_undegraded":"2023-11-27T18:43:23.017775+0000","last_fullsized":"2023-11-27T18:43:23.017775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:17:17.491694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"32'74","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:20.604964+0000","last_change":"2023-11-27T18:13:20.907358+0000","last_active":"2023-11-27T18:42:20.604964+0000","last_peered":"2023-11-27T18:42:20.604964+0000","last_clean":"2023-11-27T18:42:20.604964+0000","last_became_active":"2023-11-27T18:13:20.906418+0000","last_became_peered":"2023-11-27T18:13:20.906418+0000","last_unstale":"2023-11-27T18:42:20.604964+0000","last_undegraded":"2023-11-27T18:42:20.604964+0000","last_fullsized":"2023-11-27T18:42:20.604964+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:26:43.789814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":5836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"32'20","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.022483+0000","last_change":"2023-11-27T18:13:14.421453+0000","last_active":"2023-11-27T18:43:23.022483+0000","last_peered":"2023-11-27T18:43:23.022483+0000","last_clean":"2023-11-27T18:43:23.022483+0000","last_became_active":"2023-11-27T18:13:14.418640+0000","last_became_peered":"2023-11-27T18:13:14.418640+0000","last_unstale":"2023-11-27T18:43:23.022483+0000","last_undegraded":"2023-11-27T18:43:23.022483+0000","last_fullsized":"2023-11-27T18:43:23.022483+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:38:18.655528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"32'688","reported_seq":722,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:01.836826+0000","last_change":"2023-11-27T18:13:12.306690+0000","last_active":"2023-11-27T18:43:01.836826+0000","last_peered":"2023-11-27T18:43:01.836826+0000","last_clean":"2023-11-27T18:43:01.836826+0000","last_became_active":"2023-11-27T18:13:12.306331+0000","last_became_peered":"2023-11-27T18:13:12.306331+0000","last_unstale":"2023-11-27T18:43:01.836826+0000","last_undegraded":"2023-11-27T18:43:01.836826+0000","last_fullsized":"2023-11-27T18:43:01.836826+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:39:32.646368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":683,"num_write_kb":4455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'77","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:18.875569+0000","last_change":"2023-11-27T18:14:22.718298+0000","last_active":"2023-11-27T18:42:18.875569+0000","last_peered":"2023-11-27T18:42:18.875569+0000","last_clean":"2023-11-27T18:42:18.875569+0000","last_became_active":"2023-11-27T18:14:22.717105+0000","last_became_peered":"2023-11-27T18:14:22.717105+0000","last_unstale":"2023-11-27T18:42:18.875569+0000","last_undegraded":"2023-11-27T18:42:18.875569+0000","last_fullsized":"2023-11-27T18:42:18.875569+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:59:59.108869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":10073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7,5],"acting":[0,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"32'22","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:22.927135+0000","last_change":"2023-11-27T18:13:14.368428+0000","last_active":"2023-11-27T18:43:22.927135+0000","last_peered":"2023-11-27T18:43:22.927135+0000","last_clean":"2023-11-27T18:43:22.927135+0000","last_became_active":"2023-11-27T18:13:14.368117+0000","last_became_peered":"2023-11-27T18:13:14.368117+0000","last_unstale":"2023-11-27T18:43:22.927135+0000","last_undegraded":"2023-11-27T18:43:22.927135+0000","last_fullsized":"2023-11-27T18:43:22.927135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:24:45.528760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"32'2","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:32.409623+0000","last_change":"2023-11-27T18:13:12.306963+0000","last_active":"2023-11-27T18:42:32.409623+0000","last_peered":"2023-11-27T18:42:32.409623+0000","last_clean":"2023-11-27T18:42:32.409623+0000","last_became_active":"2023-11-27T18:13:12.306644+0000","last_became_peered":"2023-11-27T18:13:12.306644+0000","last_unstale":"2023-11-27T18:42:32.409623+0000","last_undegraded":"2023-11-27T18:42:32.409623+0000","last_fullsized":"2023-11-27T18:42:32.409623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:55:43.829654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"32'100","reported_seq":130,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:18.407017+0000","last_change":"2023-11-27T18:13:20.930173+0000","last_active":"2023-11-27T18:42:18.407017+0000","last_peered":"2023-11-27T18:42:18.407017+0000","last_clean":"2023-11-27T18:42:18.407017+0000","last_became_active":"2023-11-27T18:13:20.928830+0000","last_became_peered":"2023-11-27T18:13:20.928830+0000","last_unstale":"2023-11-27T18:42:18.407017+0000","last_undegraded":"2023-11-27T18:42:18.407017+0000","last_fullsized":"2023-11-27T18:42:18.407017+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:38:26.343953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":7369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"32'24","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.122496+0000","last_change":"2023-11-27T18:13:14.378647+0000","last_active":"2023-11-27T18:43:23.122496+0000","last_peered":"2023-11-27T18:43:23.122496+0000","last_clean":"2023-11-27T18:43:23.122496+0000","last_became_active":"2023-11-27T18:13:14.378391+0000","last_became_peered":"2023-11-27T18:13:14.378391+0000","last_unstale":"2023-11-27T18:43:23.122496+0000","last_undegraded":"2023-11-27T18:43:23.122496+0000","last_fullsized":"2023-11-27T18:43:23.122496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:02:22.189845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"32'4","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:09.152903+0000","last_change":"2023-11-27T18:13:12.270283+0000","last_active":"2023-11-27T18:43:09.152903+0000","last_peered":"2023-11-27T18:43:09.152903+0000","last_clean":"2023-11-27T18:43:09.152903+0000","last_became_active":"2023-11-27T18:13:12.269795+0000","last_became_peered":"2023-11-27T18:13:12.269795+0000","last_unstale":"2023-11-27T18:43:09.152903+0000","last_undegraded":"2023-11-27T18:43:09.152903+0000","last_fullsized":"2023-11-27T18:43:09.152903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:06:24.103678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'67","reported_seq":97,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:23.879026+0000","last_change":"2023-11-27T18:13:20.907340+0000","last_active":"2023-11-27T18:42:23.879026+0000","last_peered":"2023-11-27T18:42:23.879026+0000","last_clean":"2023-11-27T18:42:23.879026+0000","last_became_active":"2023-11-27T18:13:20.906609+0000","last_became_peered":"2023-11-27T18:13:20.906609+0000","last_unstale":"2023-11-27T18:42:23.879026+0000","last_undegraded":"2023-11-27T18:42:23.879026+0000","last_fullsized":"2023-11-27T18:42:23.879026+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:19:00.295457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":7315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"32'21","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:20.596382+0000","last_change":"2023-11-27T18:13:14.415177+0000","last_active":"2023-11-27T18:42:20.596382+0000","last_peered":"2023-11-27T18:42:20.596382+0000","last_clean":"2023-11-27T18:42:20.596382+0000","last_became_active":"2023-11-27T18:13:14.414888+0000","last_became_peered":"2023-11-27T18:13:14.414888+0000","last_unstale":"2023-11-27T18:42:20.596382+0000","last_undegraded":"2023-11-27T18:42:20.596382+0000","last_fullsized":"2023-11-27T18:42:20.596382+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:41:49.599901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"32'5","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:06.932839+0000","last_change":"2023-11-27T18:13:12.273724+0000","last_active":"2023-11-27T18:43:06.932839+0000","last_peered":"2023-11-27T18:43:06.932839+0000","last_clean":"2023-11-27T18:43:06.932839+0000","last_became_active":"2023-11-27T18:13:12.273356+0000","last_became_peered":"2023-11-27T18:13:12.273356+0000","last_unstale":"2023-11-27T18:43:06.932839+0000","last_undegraded":"2023-11-27T18:43:06.932839+0000","last_fullsized":"2023-11-27T18:43:06.932839+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:15:14.235633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'85","reported_seq":115,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:22.954332+0000","last_change":"2023-11-27T18:13:20.935910+0000","last_active":"2023-11-27T18:42:22.954332+0000","last_peered":"2023-11-27T18:42:22.954332+0000","last_clean":"2023-11-27T18:42:22.954332+0000","last_became_active":"2023-11-27T18:13:20.934797+0000","last_became_peered":"2023-11-27T18:13:20.934797+0000","last_unstale":"2023-11-27T18:42:22.954332+0000","last_undegraded":"2023-11-27T18:42:22.954332+0000","last_fullsized":"2023-11-27T18:42:22.954332+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:00:35.425015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":5270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'29","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.122735+0000","last_change":"2023-11-27T18:13:14.376557+0000","last_active":"2023-11-27T18:43:23.122735+0000","last_peered":"2023-11-27T18:43:23.122735+0000","last_clean":"2023-11-27T18:43:23.122735+0000","last_became_active":"2023-11-27T18:13:14.376304+0000","last_became_peered":"2023-11-27T18:13:14.376304+0000","last_unstale":"2023-11-27T18:43:23.122735+0000","last_undegraded":"2023-11-27T18:43:23.122735+0000","last_fullsized":"2023-11-27T18:43:23.122735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:37:22.787246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"32'7","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:12.260010+0000","last_change":"2023-11-27T18:13:12.307806+0000","last_active":"2023-11-27T18:43:12.260010+0000","last_peered":"2023-11-27T18:43:12.260010+0000","last_clean":"2023-11-27T18:43:12.260010+0000","last_became_active":"2023-11-27T18:13:12.307492+0000","last_became_peered":"2023-11-27T18:13:12.307492+0000","last_unstale":"2023-11-27T18:43:12.260010+0000","last_undegraded":"2023-11-27T18:43:12.260010+0000","last_fullsized":"2023-11-27T18:43:12.260010+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:34:06.981997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"32'53","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:18.915333+0000","last_change":"2023-11-27T18:13:20.918671+0000","last_active":"2023-11-27T18:42:18.915333+0000","last_peered":"2023-11-27T18:42:18.915333+0000","last_clean":"2023-11-27T18:42:18.915333+0000","last_became_active":"2023-11-27T18:13:20.917507+0000","last_became_peered":"2023-11-27T18:13:20.917507+0000","last_unstale":"2023-11-27T18:42:18.915333+0000","last_undegraded":"2023-11-27T18:42:18.915333+0000","last_fullsized":"2023-11-27T18:42:18.915333+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:00:52.213234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":7028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"32'21","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.125660+0000","last_change":"2023-11-27T18:13:14.377644+0000","last_active":"2023-11-27T18:43:23.125660+0000","last_peered":"2023-11-27T18:43:23.125660+0000","last_clean":"2023-11-27T18:43:23.125660+0000","last_became_active":"2023-11-27T18:13:14.377289+0000","last_became_peered":"2023-11-27T18:13:14.377289+0000","last_unstale":"2023-11-27T18:43:23.125660+0000","last_undegraded":"2023-11-27T18:43:23.125660+0000","last_fullsized":"2023-11-27T18:43:23.125660+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:55:42.641433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"32'327","reported_seq":361,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:15.373897+0000","last_change":"2023-11-27T18:13:12.267960+0000","last_active":"2023-11-27T18:43:15.373897+0000","last_peered":"2023-11-27T18:43:15.373897+0000","last_clean":"2023-11-27T18:43:15.373897+0000","last_became_active":"2023-11-27T18:13:12.267552+0000","last_became_peered":"2023-11-27T18:13:12.267552+0000","last_unstale":"2023-11-27T18:43:15.373897+0000","last_undegraded":"2023-11-27T18:43:15.373897+0000","last_fullsized":"2023-11-27T18:43:15.373897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:26:13.819717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"32'94","reported_seq":125,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:20.600411+0000","last_change":"2023-11-27T18:13:20.929780+0000","last_active":"2023-11-27T18:42:20.600411+0000","last_peered":"2023-11-27T18:42:20.600411+0000","last_clean":"2023-11-27T18:42:20.600411+0000","last_became_active":"2023-11-27T18:13:20.929370+0000","last_became_peered":"2023-11-27T18:13:20.929370+0000","last_unstale":"2023-11-27T18:42:20.600411+0000","last_undegraded":"2023-11-27T18:42:20.600411+0000","last_fullsized":"2023-11-27T18:42:20.600411+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:04:33.249483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":11915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"32'22","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.010619+0000","last_change":"2023-11-27T18:13:14.369764+0000","last_active":"2023-11-27T18:43:23.010619+0000","last_peered":"2023-11-27T18:43:23.010619+0000","last_clean":"2023-11-27T18:43:23.010619+0000","last_became_active":"2023-11-27T18:13:14.369472+0000","last_became_peered":"2023-11-27T18:13:14.369472+0000","last_unstale":"2023-11-27T18:43:23.010619+0000","last_undegraded":"2023-11-27T18:43:23.010619+0000","last_fullsized":"2023-11-27T18:43:23.010619+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:35:38.706782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"32'2","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:34.424366+0000","last_change":"2023-11-27T18:13:12.310761+0000","last_active":"2023-11-27T18:42:34.424366+0000","last_peered":"2023-11-27T18:42:34.424366+0000","last_clean":"2023-11-27T18:42:34.424366+0000","last_became_active":"2023-11-27T18:13:12.310495+0000","last_became_peered":"2023-11-27T18:13:12.310495+0000","last_unstale":"2023-11-27T18:42:34.424366+0000","last_undegraded":"2023-11-27T18:42:34.424366+0000","last_fullsized":"2023-11-27T18:42:34.424366+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:48:59.333816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"32'62","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:23.008415+0000","last_change":"2023-11-27T18:13:20.907638+0000","last_active":"2023-11-27T18:42:23.008415+0000","last_peered":"2023-11-27T18:42:23.008415+0000","last_clean":"2023-11-27T18:42:23.008415+0000","last_became_active":"2023-11-27T18:13:20.907229+0000","last_became_peered":"2023-11-27T18:13:20.907229+0000","last_unstale":"2023-11-27T18:42:23.008415+0000","last_undegraded":"2023-11-27T18:42:23.008415+0000","last_fullsized":"2023-11-27T18:42:23.008415+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:49:08.226420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":7408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"32'20","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.088550+0000","last_change":"2023-11-27T18:13:15.851127+0000","last_active":"2023-11-27T18:43:23.088550+0000","last_peered":"2023-11-27T18:43:23.088550+0000","last_clean":"2023-11-27T18:43:23.088550+0000","last_became_active":"2023-11-27T18:13:15.850263+0000","last_became_peered":"2023-11-27T18:13:15.850263+0000","last_unstale":"2023-11-27T18:43:23.088550+0000","last_undegraded":"2023-11-27T18:43:23.088550+0000","last_fullsized":"2023-11-27T18:43:23.088550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:48:39.587974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"32'4","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:54.428331+0000","last_change":"2023-11-27T18:13:12.310451+0000","last_active":"2023-11-27T18:42:54.428331+0000","last_peered":"2023-11-27T18:42:54.428331+0000","last_clean":"2023-11-27T18:42:54.428331+0000","last_became_active":"2023-11-27T18:13:12.310138+0000","last_became_peered":"2023-11-27T18:13:12.310138+0000","last_unstale":"2023-11-27T18:42:54.428331+0000","last_undegraded":"2023-11-27T18:42:54.428331+0000","last_fullsized":"2023-11-27T18:42:54.428331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:03:09.046171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"32'81","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:23.006317+0000","last_change":"2023-11-27T18:13:20.896960+0000","last_active":"2023-11-27T18:42:23.006317+0000","last_peered":"2023-11-27T18:42:23.006317+0000","last_clean":"2023-11-27T18:42:23.006317+0000","last_became_active":"2023-11-27T18:13:20.896156+0000","last_became_peered":"2023-11-27T18:13:20.896156+0000","last_unstale":"2023-11-27T18:42:23.006317+0000","last_undegraded":"2023-11-27T18:42:23.006317+0000","last_fullsized":"2023-11-27T18:42:23.006317+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:00:52.213234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":6173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"32'22","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.058711+0000","last_change":"2023-11-27T18:13:14.421498+0000","last_active":"2023-11-27T18:43:23.058711+0000","last_peered":"2023-11-27T18:43:23.058711+0000","last_clean":"2023-11-27T18:43:23.058711+0000","last_became_active":"2023-11-27T18:13:14.421125+0000","last_became_peered":"2023-11-27T18:13:14.421125+0000","last_unstale":"2023-11-27T18:43:23.058711+0000","last_undegraded":"2023-11-27T18:43:23.058711+0000","last_fullsized":"2023-11-27T18:43:23.058711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:52:30.225572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"32'5","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:01.836305+0000","last_change":"2023-11-27T18:13:12.301922+0000","last_active":"2023-11-27T18:43:01.836305+0000","last_peered":"2023-11-27T18:43:01.836305+0000","last_clean":"2023-11-27T18:43:01.836305+0000","last_became_active":"2023-11-27T18:13:12.301617+0000","last_became_peered":"2023-11-27T18:13:12.301617+0000","last_unstale":"2023-11-27T18:43:01.836305+0000","last_undegraded":"2023-11-27T18:43:01.836305+0000","last_fullsized":"2023-11-27T18:43:01.836305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:00:43.320630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'68","reported_seq":99,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:22.894328+0000","last_change":"2023-11-27T18:13:20.905013+0000","last_active":"2023-11-27T18:42:22.894328+0000","last_peered":"2023-11-27T18:42:22.894328+0000","last_clean":"2023-11-27T18:42:22.894328+0000","last_became_active":"2023-11-27T18:13:20.903019+0000","last_became_peered":"2023-11-27T18:13:20.903019+0000","last_unstale":"2023-11-27T18:42:22.894328+0000","last_undegraded":"2023-11-27T18:42:22.894328+0000","last_fullsized":"2023-11-27T18:42:22.894328+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:34:15.874601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":4275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"32'26","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.089801+0000","last_change":"2023-11-27T18:13:14.378913+0000","last_active":"2023-11-27T18:43:23.089801+0000","last_peered":"2023-11-27T18:43:23.089801+0000","last_clean":"2023-11-27T18:43:23.089801+0000","last_became_active":"2023-11-27T18:13:14.378644+0000","last_became_peered":"2023-11-27T18:13:14.378644+0000","last_unstale":"2023-11-27T18:43:23.089801+0000","last_undegraded":"2023-11-27T18:43:23.089801+0000","last_fullsized":"2023-11-27T18:43:23.089801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:19:02.523860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"32'556","reported_seq":1140,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:18.258483+0000","last_change":"2023-11-27T18:13:12.305733+0000","last_active":"2023-11-27T18:43:18.258483+0000","last_peered":"2023-11-27T18:43:18.258483+0000","last_clean":"2023-11-27T18:43:18.258483+0000","last_became_active":"2023-11-27T18:13:12.305380+0000","last_became_peered":"2023-11-27T18:13:12.305380+0000","last_unstale":"2023-11-27T18:43:18.258483+0000","last_undegraded":"2023-11-27T18:43:18.258483+0000","last_fullsized":"2023-11-27T18:43:18.258483+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:34:46.886091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128192,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":549,"num_read_kb":581,"num_write":552,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"32'76","reported_seq":106,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:20.596319+0000","last_change":"2023-11-27T18:13:20.913672+0000","last_active":"2023-11-27T18:42:20.596319+0000","last_peered":"2023-11-27T18:42:20.596319+0000","last_clean":"2023-11-27T18:42:20.596319+0000","last_became_active":"2023-11-27T18:13:20.913137+0000","last_became_peered":"2023-11-27T18:13:20.913137+0000","last_unstale":"2023-11-27T18:42:20.596319+0000","last_undegraded":"2023-11-27T18:42:20.596319+0000","last_fullsized":"2023-11-27T18:42:20.596319+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:40:20.210205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":7407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"32'15","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.001180+0000","last_change":"2023-11-27T18:13:14.413781+0000","last_active":"2023-11-27T18:43:23.001180+0000","last_peered":"2023-11-27T18:43:23.001180+0000","last_clean":"2023-11-27T18:43:23.001180+0000","last_became_active":"2023-11-27T18:13:14.413413+0000","last_became_peered":"2023-11-27T18:13:14.413413+0000","last_unstale":"2023-11-27T18:43:23.001180+0000","last_undegraded":"2023-11-27T18:43:23.001180+0000","last_fullsized":"2023-11-27T18:43:23.001180+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:04:03.068428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"32'6","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:09.156568+0000","last_change":"2023-11-27T18:13:12.315822+0000","last_active":"2023-11-27T18:43:09.156568+0000","last_peered":"2023-11-27T18:43:09.156568+0000","last_clean":"2023-11-27T18:43:09.156568+0000","last_became_active":"2023-11-27T18:13:12.315610+0000","last_became_peered":"2023-11-27T18:13:12.315610+0000","last_unstale":"2023-11-27T18:43:09.156568+0000","last_undegraded":"2023-11-27T18:43:09.156568+0000","last_fullsized":"2023-11-27T18:43:09.156568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:39:33.385367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"32'85","reported_seq":115,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:18.954256+0000","last_change":"2023-11-27T18:13:20.912891+0000","last_active":"2023-11-27T18:42:18.954256+0000","last_peered":"2023-11-27T18:42:18.954256+0000","last_clean":"2023-11-27T18:42:18.954256+0000","last_became_active":"2023-11-27T18:13:20.912453+0000","last_became_peered":"2023-11-27T18:13:20.912453+0000","last_unstale":"2023-11-27T18:42:18.954256+0000","last_undegraded":"2023-11-27T18:42:18.954256+0000","last_fullsized":"2023-11-27T18:42:18.954256+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:35:44.943527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":10738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"32'21","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.122497+0000","last_change":"2023-11-27T18:13:14.414468+0000","last_active":"2023-11-27T18:43:23.122497+0000","last_peered":"2023-11-27T18:43:23.122497+0000","last_clean":"2023-11-27T18:43:23.122497+0000","last_became_active":"2023-11-27T18:13:14.414156+0000","last_became_peered":"2023-11-27T18:13:14.414156+0000","last_unstale":"2023-11-27T18:43:23.122497+0000","last_undegraded":"2023-11-27T18:43:23.122497+0000","last_fullsized":"2023-11-27T18:43:23.122497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:46:11.500006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"32'3","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:58.521863+0000","last_change":"2023-11-27T18:13:12.308337+0000","last_active":"2023-11-27T18:42:58.521863+0000","last_peered":"2023-11-27T18:42:58.521863+0000","last_clean":"2023-11-27T18:42:58.521863+0000","last_became_active":"2023-11-27T18:13:12.308050+0000","last_became_peered":"2023-11-27T18:13:12.308050+0000","last_unstale":"2023-11-27T18:42:58.521863+0000","last_undegraded":"2023-11-27T18:42:58.521863+0000","last_fullsized":"2023-11-27T18:42:58.521863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:14:09.398956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"20'117","reported_seq":187,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:40:44.472943+0000","last_change":"2023-11-27T18:12:38.371836+0000","last_active":"2023-11-27T18:40:44.472943+0000","last_peered":"2023-11-27T18:40:44.472943+0000","last_clean":"2023-11-27T18:40:44.472943+0000","last_became_active":"2023-11-27T18:12:38.370748+0000","last_became_peered":"2023-11-27T18:12:38.370748+0000","last_unstale":"2023-11-27T18:40:44.472943+0000","last_undegraded":"2023-11-27T18:40:44.472943+0000","last_fullsized":"2023-11-27T18:40:44.472943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:12:36.259476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:12:36.259476+0000","last_clean_scrub_stamp":"2023-11-27T18:12:36.259476+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:25:36.712765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'86","reported_seq":117,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:22.984570+0000","last_change":"2023-11-27T18:13:20.928359+0000","last_active":"2023-11-27T18:42:22.984570+0000","last_peered":"2023-11-27T18:42:22.984570+0000","last_clean":"2023-11-27T18:42:22.984570+0000","last_became_active":"2023-11-27T18:13:20.926559+0000","last_became_peered":"2023-11-27T18:13:20.926559+0000","last_unstale":"2023-11-27T18:42:22.984570+0000","last_undegraded":"2023-11-27T18:42:22.984570+0000","last_fullsized":"2023-11-27T18:42:22.984570+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:47:06.255647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":7930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"32'24","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.017254+0000","last_change":"2023-11-27T18:13:14.422275+0000","last_active":"2023-11-27T18:43:23.017254+0000","last_peered":"2023-11-27T18:43:23.017254+0000","last_clean":"2023-11-27T18:43:23.017254+0000","last_became_active":"2023-11-27T18:13:14.419636+0000","last_became_peered":"2023-11-27T18:13:14.419636+0000","last_unstale":"2023-11-27T18:43:23.017254+0000","last_undegraded":"2023-11-27T18:43:23.017254+0000","last_fullsized":"2023-11-27T18:43:23.017254+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:29:10.027795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"32'2","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:44.034879+0000","last_change":"2023-11-27T18:13:12.268222+0000","last_active":"2023-11-27T18:42:44.034879+0000","last_peered":"2023-11-27T18:42:44.034879+0000","last_clean":"2023-11-27T18:42:44.034879+0000","last_became_active":"2023-11-27T18:13:12.267764+0000","last_became_peered":"2023-11-27T18:13:12.267764+0000","last_unstale":"2023-11-27T18:42:44.034879+0000","last_undegraded":"2023-11-27T18:42:44.034879+0000","last_fullsized":"2023-11-27T18:42:44.034879+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:48:38.383796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"32'73","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:13.789980+0000","last_change":"2023-11-27T18:13:20.917055+0000","last_active":"2023-11-27T18:42:13.789980+0000","last_peered":"2023-11-27T18:42:13.789980+0000","last_clean":"2023-11-27T18:42:13.789980+0000","last_became_active":"2023-11-27T18:13:20.914157+0000","last_became_peered":"2023-11-27T18:13:20.914157+0000","last_unstale":"2023-11-27T18:42:13.789980+0000","last_undegraded":"2023-11-27T18:42:13.789980+0000","last_fullsized":"2023-11-27T18:42:13.789980+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:34:15.874601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":5275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'24","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.065908+0000","last_change":"2023-11-27T18:13:14.363559+0000","last_active":"2023-11-27T18:43:23.065908+0000","last_peered":"2023-11-27T18:43:23.065908+0000","last_clean":"2023-11-27T18:43:23.065908+0000","last_became_active":"2023-11-27T18:13:14.363285+0000","last_became_peered":"2023-11-27T18:13:14.363285+0000","last_unstale":"2023-11-27T18:43:23.065908+0000","last_undegraded":"2023-11-27T18:43:23.065908+0000","last_fullsized":"2023-11-27T18:43:23.065908+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:00:44.524809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"32'3","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:30.492175+0000","last_change":"2023-11-27T18:13:12.312477+0000","last_active":"2023-11-27T18:42:30.492175+0000","last_peered":"2023-11-27T18:42:30.492175+0000","last_clean":"2023-11-27T18:42:30.492175+0000","last_became_active":"2023-11-27T18:13:12.312038+0000","last_became_peered":"2023-11-27T18:13:12.312038+0000","last_unstale":"2023-11-27T18:42:30.492175+0000","last_undegraded":"2023-11-27T18:42:30.492175+0000","last_fullsized":"2023-11-27T18:42:30.492175+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:35:37.502604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"32'90","reported_seq":120,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:20.599466+0000","last_change":"2023-11-27T18:13:20.913830+0000","last_active":"2023-11-27T18:42:20.599466+0000","last_peered":"2023-11-27T18:42:20.599466+0000","last_clean":"2023-11-27T18:42:20.599466+0000","last_became_active":"2023-11-27T18:13:20.912734+0000","last_became_peered":"2023-11-27T18:13:20.912734+0000","last_unstale":"2023-11-27T18:42:20.599466+0000","last_undegraded":"2023-11-27T18:42:20.599466+0000","last_fullsized":"2023-11-27T18:42:20.599466+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:35:39.280506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":13642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"32'25","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.093855+0000","last_change":"2023-11-27T18:13:14.364027+0000","last_active":"2023-11-27T18:43:23.093855+0000","last_peered":"2023-11-27T18:43:23.093855+0000","last_clean":"2023-11-27T18:43:23.093855+0000","last_became_active":"2023-11-27T18:13:14.363772+0000","last_became_peered":"2023-11-27T18:13:14.363772+0000","last_unstale":"2023-11-27T18:43:23.093855+0000","last_undegraded":"2023-11-27T18:43:23.093855+0000","last_fullsized":"2023-11-27T18:43:23.093855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:40:12.521779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"32'4","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:58.522360+0000","last_change":"2023-11-27T18:13:12.304785+0000","last_active":"2023-11-27T18:42:58.522360+0000","last_peered":"2023-11-27T18:42:58.522360+0000","last_clean":"2023-11-27T18:42:58.522360+0000","last_became_active":"2023-11-27T18:13:12.304400+0000","last_became_peered":"2023-11-27T18:13:12.304400+0000","last_unstale":"2023-11-27T18:42:58.522360+0000","last_undegraded":"2023-11-27T18:42:58.522360+0000","last_fullsized":"2023-11-27T18:42:58.522360+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:37:52.292054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"32'60","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:17.887775+0000","last_change":"2023-11-27T18:13:20.922959+0000","last_active":"2023-11-27T18:42:17.887775+0000","last_peered":"2023-11-27T18:42:17.887775+0000","last_clean":"2023-11-27T18:42:17.887775+0000","last_became_active":"2023-11-27T18:13:20.918984+0000","last_became_peered":"2023-11-27T18:13:20.918984+0000","last_unstale":"2023-11-27T18:42:17.887775+0000","last_undegraded":"2023-11-27T18:42:17.887775+0000","last_fullsized":"2023-11-27T18:42:17.887775+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:59:33.426999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":5801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"32'17","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.089097+0000","last_change":"2023-11-27T18:13:15.852939+0000","last_active":"2023-11-27T18:43:23.089097+0000","last_peered":"2023-11-27T18:43:23.089097+0000","last_clean":"2023-11-27T18:43:23.089097+0000","last_became_active":"2023-11-27T18:13:15.852339+0000","last_became_peered":"2023-11-27T18:13:15.852339+0000","last_unstale":"2023-11-27T18:43:23.089097+0000","last_undegraded":"2023-11-27T18:43:23.089097+0000","last_fullsized":"2023-11-27T18:43:23.089097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:31:25.796567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"32'7","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:44.051058+0000","last_change":"2023-11-27T18:13:12.311109+0000","last_active":"2023-11-27T18:42:44.051058+0000","last_peered":"2023-11-27T18:42:44.051058+0000","last_clean":"2023-11-27T18:42:44.051058+0000","last_became_active":"2023-11-27T18:13:12.310921+0000","last_became_peered":"2023-11-27T18:13:12.310921+0000","last_unstale":"2023-11-27T18:42:44.051058+0000","last_undegraded":"2023-11-27T18:42:44.051058+0000","last_fullsized":"2023-11-27T18:42:44.051058+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:05:04.546929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"32'108","reported_seq":138,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:20.603467+0000","last_change":"2023-11-27T18:13:20.925265+0000","last_active":"2023-11-27T18:42:20.603467+0000","last_peered":"2023-11-27T18:42:20.603467+0000","last_clean":"2023-11-27T18:42:20.603467+0000","last_became_active":"2023-11-27T18:13:20.924209+0000","last_became_peered":"2023-11-27T18:13:20.924209+0000","last_unstale":"2023-11-27T18:42:20.603467+0000","last_undegraded":"2023-11-27T18:42:20.603467+0000","last_fullsized":"2023-11-27T18:42:20.603467+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:31:33.484992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":10743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"32'21","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:22.999427+0000","last_change":"2023-11-27T18:13:14.421768+0000","last_active":"2023-11-27T18:43:22.999427+0000","last_peered":"2023-11-27T18:43:22.999427+0000","last_clean":"2023-11-27T18:43:22.999427+0000","last_became_active":"2023-11-27T18:13:14.421377+0000","last_became_peered":"2023-11-27T18:13:14.421377+0000","last_unstale":"2023-11-27T18:43:22.999427+0000","last_undegraded":"2023-11-27T18:43:22.999427+0000","last_fullsized":"2023-11-27T18:43:22.999427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:00:27.736589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"32'12","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:12.261402+0000","last_change":"2023-11-27T18:13:12.178547+0000","last_active":"2023-11-27T18:43:12.261402+0000","last_peered":"2023-11-27T18:43:12.261402+0000","last_clean":"2023-11-27T18:43:12.261402+0000","last_became_active":"2023-11-27T18:13:12.177997+0000","last_became_peered":"2023-11-27T18:13:12.177997+0000","last_unstale":"2023-11-27T18:43:12.261402+0000","last_undegraded":"2023-11-27T18:43:12.261402+0000","last_fullsized":"2023-11-27T18:43:12.261402+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:29:10.535816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"32'95","reported_seq":124,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:20.353428+0000","last_change":"2023-11-27T18:13:20.914541+0000","last_active":"2023-11-27T18:42:20.353428+0000","last_peered":"2023-11-27T18:42:20.353428+0000","last_clean":"2023-11-27T18:42:20.353428+0000","last_became_active":"2023-11-27T18:13:20.914144+0000","last_became_peered":"2023-11-27T18:13:20.914144+0000","last_unstale":"2023-11-27T18:42:20.353428+0000","last_undegraded":"2023-11-27T18:42:20.353428+0000","last_fullsized":"2023-11-27T18:42:20.353428+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:29:17.716220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":5846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"32'23","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.104070+0000","last_change":"2023-11-27T18:13:15.802553+0000","last_active":"2023-11-27T18:43:23.104070+0000","last_peered":"2023-11-27T18:43:23.104070+0000","last_clean":"2023-11-27T18:43:23.104070+0000","last_became_active":"2023-11-27T18:13:15.801804+0000","last_became_peered":"2023-11-27T18:13:15.801804+0000","last_unstale":"2023-11-27T18:43:23.104070+0000","last_undegraded":"2023-11-27T18:43:23.104070+0000","last_fullsized":"2023-11-27T18:43:23.104070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:50:47.259554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"32'5","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:48.122380+0000","last_change":"2023-11-27T18:13:12.300863+0000","last_active":"2023-11-27T18:42:48.122380+0000","last_peered":"2023-11-27T18:42:48.122380+0000","last_clean":"2023-11-27T18:42:48.122380+0000","last_became_active":"2023-11-27T18:13:12.300585+0000","last_became_peered":"2023-11-27T18:13:12.300585+0000","last_unstale":"2023-11-27T18:42:48.122380+0000","last_undegraded":"2023-11-27T18:42:48.122380+0000","last_fullsized":"2023-11-27T18:42:48.122380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:27:04.532776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"32'85","reported_seq":114,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:20.600878+0000","last_change":"2023-11-27T18:13:20.915245+0000","last_active":"2023-11-27T18:42:20.600878+0000","last_peered":"2023-11-27T18:42:20.600878+0000","last_clean":"2023-11-27T18:42:20.600878+0000","last_became_active":"2023-11-27T18:13:20.914216+0000","last_became_peered":"2023-11-27T18:13:20.914216+0000","last_unstale":"2023-11-27T18:42:20.600878+0000","last_undegraded":"2023-11-27T18:42:20.600878+0000","last_fullsized":"2023-11-27T18:42:20.600878+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:56:44.418239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":6050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"32'39","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.020938+0000","last_change":"2023-11-27T18:14:22.518196+0000","last_active":"2023-11-27T18:43:23.020938+0000","last_peered":"2023-11-27T18:43:23.020938+0000","last_clean":"2023-11-27T18:43:23.020938+0000","last_became_active":"2023-11-27T18:14:22.517527+0000","last_became_peered":"2023-11-27T18:14:22.517527+0000","last_unstale":"2023-11-27T18:43:23.020938+0000","last_undegraded":"2023-11-27T18:43:23.020938+0000","last_fullsized":"2023-11-27T18:43:23.020938+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:35:43.631863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"32'5","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:06.997466+0000","last_change":"2023-11-27T18:13:12.305081+0000","last_active":"2023-11-27T18:43:06.997466+0000","last_peered":"2023-11-27T18:43:06.997466+0000","last_clean":"2023-11-27T18:43:06.997466+0000","last_became_active":"2023-11-27T18:13:12.304777+0000","last_became_peered":"2023-11-27T18:13:12.304777+0000","last_unstale":"2023-11-27T18:43:06.997466+0000","last_undegraded":"2023-11-27T18:43:06.997466+0000","last_fullsized":"2023-11-27T18:43:06.997466+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:22:12.680259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"32'64","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:18.594470+0000","last_change":"2023-11-27T18:13:20.904088+0000","last_active":"2023-11-27T18:42:18.594470+0000","last_peered":"2023-11-27T18:42:18.594470+0000","last_clean":"2023-11-27T18:42:18.594470+0000","last_became_active":"2023-11-27T18:13:20.902282+0000","last_became_peered":"2023-11-27T18:13:20.902282+0000","last_unstale":"2023-11-27T18:42:18.594470+0000","last_undegraded":"2023-11-27T18:42:18.594470+0000","last_fullsized":"2023-11-27T18:42:18.594470+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:26:43.789814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":6349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"32'27","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.012251+0000","last_change":"2023-11-27T18:13:14.415302+0000","last_active":"2023-11-27T18:43:23.012251+0000","last_peered":"2023-11-27T18:43:23.012251+0000","last_clean":"2023-11-27T18:43:23.012251+0000","last_became_active":"2023-11-27T18:13:14.415004+0000","last_became_peered":"2023-11-27T18:13:14.415004+0000","last_unstale":"2023-11-27T18:43:23.012251+0000","last_undegraded":"2023-11-27T18:43:23.012251+0000","last_fullsized":"2023-11-27T18:43:23.012251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:34:11.170873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"32'5","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:06.982823+0000","last_change":"2023-11-27T18:13:12.268542+0000","last_active":"2023-11-27T18:43:06.982823+0000","last_peered":"2023-11-27T18:43:06.982823+0000","last_clean":"2023-11-27T18:43:06.982823+0000","last_became_active":"2023-11-27T18:13:12.268237+0000","last_became_peered":"2023-11-27T18:13:12.268237+0000","last_unstale":"2023-11-27T18:43:06.982823+0000","last_undegraded":"2023-11-27T18:43:06.982823+0000","last_fullsized":"2023-11-27T18:43:06.982823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:15:07.514381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"32'82","reported_seq":111,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:22.983811+0000","last_change":"2023-11-27T18:13:20.900393+0000","last_active":"2023-11-27T18:42:22.983811+0000","last_peered":"2023-11-27T18:42:22.983811+0000","last_clean":"2023-11-27T18:42:22.983811+0000","last_became_active":"2023-11-27T18:13:20.899358+0000","last_became_peered":"2023-11-27T18:13:20.899358+0000","last_unstale":"2023-11-27T18:42:22.983811+0000","last_undegraded":"2023-11-27T18:42:22.983811+0000","last_fullsized":"2023-11-27T18:42:22.983811+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:27:58.837417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":8446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"32'23","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.066215+0000","last_change":"2023-11-27T18:13:14.371842+0000","last_active":"2023-11-27T18:43:23.066215+0000","last_peered":"2023-11-27T18:43:23.066215+0000","last_clean":"2023-11-27T18:43:23.066215+0000","last_became_active":"2023-11-27T18:13:14.371637+0000","last_became_peered":"2023-11-27T18:13:14.371637+0000","last_unstale":"2023-11-27T18:43:23.066215+0000","last_undegraded":"2023-11-27T18:43:23.066215+0000","last_fullsized":"2023-11-27T18:43:23.066215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:22:13.884437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"32'871","reported_seq":904,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:09.052491+0000","last_change":"2023-11-27T18:13:12.248404+0000","last_active":"2023-11-27T18:43:09.052491+0000","last_peered":"2023-11-27T18:43:09.052491+0000","last_clean":"2023-11-27T18:43:09.052491+0000","last_became_active":"2023-11-27T18:13:12.248077+0000","last_became_peered":"2023-11-27T18:13:12.248077+0000","last_unstale":"2023-11-27T18:43:09.052491+0000","last_undegraded":"2023-11-27T18:43:09.052491+0000","last_fullsized":"2023-11-27T18:43:09.052491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":871,"log_dups_size":0,"ondisk_log_size":871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:34:21.166265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":867,"num_write_kb":4596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"32'83","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:18.926289+0000","last_change":"2023-11-27T18:13:20.919046+0000","last_active":"2023-11-27T18:42:18.926289+0000","last_peered":"2023-11-27T18:42:18.926289+0000","last_clean":"2023-11-27T18:42:18.926289+0000","last_became_active":"2023-11-27T18:13:20.918381+0000","last_became_peered":"2023-11-27T18:13:20.918381+0000","last_unstale":"2023-11-27T18:42:18.926289+0000","last_undegraded":"2023-11-27T18:42:18.926289+0000","last_fullsized":"2023-11-27T18:42:18.926289+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:17:07.092549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":11273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"32'25","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.022858+0000","last_change":"2023-11-27T18:13:14.415453+0000","last_active":"2023-11-27T18:43:23.022858+0000","last_peered":"2023-11-27T18:43:23.022858+0000","last_clean":"2023-11-27T18:43:23.022858+0000","last_became_active":"2023-11-27T18:13:14.415026+0000","last_became_peered":"2023-11-27T18:13:14.415026+0000","last_unstale":"2023-11-27T18:43:23.022858+0000","last_undegraded":"2023-11-27T18:43:23.022858+0000","last_fullsized":"2023-11-27T18:43:23.022858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:35:37.255102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"32'400","reported_seq":433,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:15.251117+0000","last_change":"2023-11-27T18:13:12.180737+0000","last_active":"2023-11-27T18:43:15.251117+0000","last_peered":"2023-11-27T18:43:15.251117+0000","last_clean":"2023-11-27T18:43:15.251117+0000","last_became_active":"2023-11-27T18:13:12.180112+0000","last_became_peered":"2023-11-27T18:13:12.180112+0000","last_unstale":"2023-11-27T18:43:15.251117+0000","last_undegraded":"2023-11-27T18:43:15.251117+0000","last_fullsized":"2023-11-27T18:43:15.251117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:24:22.455257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":397,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"32'109","reported_seq":138,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:20.603364+0000","last_change":"2023-11-27T18:13:20.925012+0000","last_active":"2023-11-27T18:42:20.603364+0000","last_peered":"2023-11-27T18:42:20.603364+0000","last_clean":"2023-11-27T18:42:20.603364+0000","last_became_active":"2023-11-27T18:13:20.921675+0000","last_became_peered":"2023-11-27T18:13:20.921675+0000","last_unstale":"2023-11-27T18:42:20.603364+0000","last_undegraded":"2023-11-27T18:42:20.603364+0000","last_fullsized":"2023-11-27T18:42:20.603364+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:49:08.226420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":15987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"32'29","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.087895+0000","last_change":"2023-11-27T18:13:14.415432+0000","last_active":"2023-11-27T18:43:23.087895+0000","last_peered":"2023-11-27T18:43:23.087895+0000","last_clean":"2023-11-27T18:43:23.087895+0000","last_became_active":"2023-11-27T18:13:14.415142+0000","last_became_peered":"2023-11-27T18:13:14.415142+0000","last_unstale":"2023-11-27T18:43:23.087895+0000","last_undegraded":"2023-11-27T18:43:23.087895+0000","last_fullsized":"2023-11-27T18:43:23.087895+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:39:33.850547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:44.050672+0000","last_change":"2023-11-27T18:13:12.273729+0000","last_active":"2023-11-27T18:42:44.050672+0000","last_peered":"2023-11-27T18:42:44.050672+0000","last_clean":"2023-11-27T18:42:44.050672+0000","last_became_active":"2023-11-27T18:13:12.273400+0000","last_became_peered":"2023-11-27T18:13:12.273400+0000","last_unstale":"2023-11-27T18:42:44.050672+0000","last_undegraded":"2023-11-27T18:42:44.050672+0000","last_fullsized":"2023-11-27T18:42:44.050672+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:31:10.508092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"32'83","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:18.001546+0000","last_change":"2023-11-27T18:13:20.912482+0000","last_active":"2023-11-27T18:42:18.001546+0000","last_peered":"2023-11-27T18:42:18.001546+0000","last_clean":"2023-11-27T18:42:18.001546+0000","last_became_active":"2023-11-27T18:13:20.912063+0000","last_became_peered":"2023-11-27T18:13:20.912063+0000","last_unstale":"2023-11-27T18:42:18.001546+0000","last_undegraded":"2023-11-27T18:42:18.001546+0000","last_fullsized":"2023-11-27T18:42:18.001546+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:11:56.997205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":11074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"32'29","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.090872+0000","last_change":"2023-11-27T18:13:15.911622+0000","last_active":"2023-11-27T18:43:23.090872+0000","last_peered":"2023-11-27T18:43:23.090872+0000","last_clean":"2023-11-27T18:43:23.090872+0000","last_became_active":"2023-11-27T18:13:15.911255+0000","last_became_peered":"2023-11-27T18:13:15.911255+0000","last_unstale":"2023-11-27T18:43:23.090872+0000","last_undegraded":"2023-11-27T18:43:23.090872+0000","last_fullsized":"2023-11-27T18:43:23.090872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:04:03.068428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"32'6","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:53.405822+0000","last_change":"2023-11-27T18:13:12.168028+0000","last_active":"2023-11-27T18:42:53.405822+0000","last_peered":"2023-11-27T18:42:53.405822+0000","last_clean":"2023-11-27T18:42:53.405822+0000","last_became_active":"2023-11-27T18:13:12.167740+0000","last_became_peered":"2023-11-27T18:13:12.167740+0000","last_unstale":"2023-11-27T18:42:53.405822+0000","last_undegraded":"2023-11-27T18:42:53.405822+0000","last_fullsized":"2023-11-27T18:42:53.405822+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:34:21.166265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"32'75","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:13.791640+0000","last_change":"2023-11-27T18:13:20.915480+0000","last_active":"2023-11-27T18:42:13.791640+0000","last_peered":"2023-11-27T18:42:13.791640+0000","last_clean":"2023-11-27T18:42:13.791640+0000","last_became_active":"2023-11-27T18:13:20.914607+0000","last_became_peered":"2023-11-27T18:13:20.914607+0000","last_unstale":"2023-11-27T18:42:13.791640+0000","last_undegraded":"2023-11-27T18:42:13.791640+0000","last_fullsized":"2023-11-27T18:42:13.791640+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:07:38.034431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":8428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"32'67","reported_seq":98,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:14.803902+0000","last_change":"2023-11-27T18:13:20.930508+0000","last_active":"2023-11-27T18:42:14.803902+0000","last_peered":"2023-11-27T18:42:14.803902+0000","last_clean":"2023-11-27T18:42:14.803902+0000","last_became_active":"2023-11-27T18:13:20.930060+0000","last_became_peered":"2023-11-27T18:13:20.930060+0000","last_unstale":"2023-11-27T18:42:14.803902+0000","last_undegraded":"2023-11-27T18:42:14.803902+0000","last_fullsized":"2023-11-27T18:42:14.803902+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:43:18.464867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":4718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"32'28","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.125938+0000","last_change":"2023-11-27T18:13:14.380263+0000","last_active":"2023-11-27T18:43:23.125938+0000","last_peered":"2023-11-27T18:43:23.125938+0000","last_clean":"2023-11-27T18:43:23.125938+0000","last_became_active":"2023-11-27T18:13:14.379936+0000","last_became_peered":"2023-11-27T18:13:14.379936+0000","last_unstale":"2023-11-27T18:43:23.125938+0000","last_undegraded":"2023-11-27T18:43:23.125938+0000","last_fullsized":"2023-11-27T18:43:23.125938+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:50:34.713768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"32'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:53.354565+0000","last_change":"2023-11-27T18:13:12.300977+0000","last_active":"2023-11-27T18:42:53.354565+0000","last_peered":"2023-11-27T18:42:53.354565+0000","last_clean":"2023-11-27T18:42:53.354565+0000","last_became_active":"2023-11-27T18:13:12.300624+0000","last_became_peered":"2023-11-27T18:13:12.300624+0000","last_unstale":"2023-11-27T18:42:53.354565+0000","last_undegraded":"2023-11-27T18:42:53.354565+0000","last_fullsized":"2023-11-27T18:42:53.354565+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:52:29.021393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"32'93","reported_seq":124,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:22.982291+0000","last_change":"2023-11-27T18:13:20.919870+0000","last_active":"2023-11-27T18:42:22.982291+0000","last_peered":"2023-11-27T18:42:22.982291+0000","last_clean":"2023-11-27T18:42:22.982291+0000","last_became_active":"2023-11-27T18:13:20.918816+0000","last_became_peered":"2023-11-27T18:13:20.918816+0000","last_unstale":"2023-11-27T18:42:22.982291+0000","last_undegraded":"2023-11-27T18:42:22.982291+0000","last_fullsized":"2023-11-27T18:42:22.982291+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:41:38.778382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":12357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'29","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.089906+0000","last_change":"2023-11-27T18:13:14.369562+0000","last_active":"2023-11-27T18:43:23.089906+0000","last_peered":"2023-11-27T18:43:23.089906+0000","last_clean":"2023-11-27T18:43:23.089906+0000","last_became_active":"2023-11-27T18:13:14.368880+0000","last_became_peered":"2023-11-27T18:13:14.368880+0000","last_unstale":"2023-11-27T18:43:23.089906+0000","last_undegraded":"2023-11-27T18:43:23.089906+0000","last_fullsized":"2023-11-27T18:43:23.089906+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:22:13.884437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:37.590691+0000","last_change":"2023-11-27T18:13:12.270113+0000","last_active":"2023-11-27T18:42:37.590691+0000","last_peered":"2023-11-27T18:42:37.590691+0000","last_clean":"2023-11-27T18:42:37.590691+0000","last_became_active":"2023-11-27T18:13:12.269755+0000","last_became_peered":"2023-11-27T18:13:12.269755+0000","last_unstale":"2023-11-27T18:42:37.590691+0000","last_undegraded":"2023-11-27T18:42:37.590691+0000","last_fullsized":"2023-11-27T18:42:37.590691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:51:01.410940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"32'663","reported_seq":696,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:49.086954+0000","last_change":"2023-11-27T18:13:12.307568+0000","last_active":"2023-11-27T18:42:49.086954+0000","last_peered":"2023-11-27T18:42:49.086954+0000","last_clean":"2023-11-27T18:42:49.086954+0000","last_became_active":"2023-11-27T18:13:12.307299+0000","last_became_peered":"2023-11-27T18:13:12.307299+0000","last_unstale":"2023-11-27T18:42:49.086954+0000","last_undegraded":"2023-11-27T18:42:49.086954+0000","last_fullsized":"2023-11-27T18:42:49.086954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":663,"log_dups_size":0,"ondisk_log_size":663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:19:01.319681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":658,"num_write_kb":4457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"32'24","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.124787+0000","last_change":"2023-11-27T18:13:14.378937+0000","last_active":"2023-11-27T18:43:23.124787+0000","last_peered":"2023-11-27T18:43:23.124787+0000","last_clean":"2023-11-27T18:43:23.124787+0000","last_became_active":"2023-11-27T18:13:14.378635+0000","last_became_peered":"2023-11-27T18:13:14.378635+0000","last_unstale":"2023-11-27T18:43:23.124787+0000","last_undegraded":"2023-11-27T18:43:23.124787+0000","last_fullsized":"2023-11-27T18:43:23.124787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:06:40.533610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"32'56","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:20.778247+0000","last_change":"2023-11-27T18:13:20.903249+0000","last_active":"2023-11-27T18:42:20.778247+0000","last_peered":"2023-11-27T18:42:20.778247+0000","last_clean":"2023-11-27T18:42:20.778247+0000","last_became_active":"2023-11-27T18:13:20.902571+0000","last_became_peered":"2023-11-27T18:13:20.902571+0000","last_unstale":"2023-11-27T18:42:20.778247+0000","last_undegraded":"2023-11-27T18:42:20.778247+0000","last_fullsized":"2023-11-27T18:42:20.778247+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:41:48.892641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":3581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"32'592","reported_seq":624,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:01.804907+0000","last_change":"2023-11-27T18:13:12.304324+0000","last_active":"2023-11-27T18:43:01.804907+0000","last_peered":"2023-11-27T18:43:01.804907+0000","last_clean":"2023-11-27T18:43:01.804907+0000","last_became_active":"2023-11-27T18:13:12.303988+0000","last_became_peered":"2023-11-27T18:13:12.303988+0000","last_unstale":"2023-11-27T18:43:01.804907+0000","last_undegraded":"2023-11-27T18:43:01.804907+0000","last_fullsized":"2023-11-27T18:43:01.804907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:47:59.518332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":588,"num_write_kb":4406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"32'22","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.112292+0000","last_change":"2023-11-27T18:13:15.803183+0000","last_active":"2023-11-27T18:43:23.112292+0000","last_peered":"2023-11-27T18:43:23.112292+0000","last_clean":"2023-11-27T18:43:23.112292+0000","last_became_active":"2023-11-27T18:13:15.802420+0000","last_became_peered":"2023-11-27T18:13:15.802420+0000","last_unstale":"2023-11-27T18:43:23.112292+0000","last_undegraded":"2023-11-27T18:43:23.112292+0000","last_fullsized":"2023-11-27T18:43:23.112292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:51:02.615119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"32'93","reported_seq":116,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:20.605149+0000","last_change":"2023-11-27T18:14:22.716310+0000","last_active":"2023-11-27T18:42:20.605149+0000","last_peered":"2023-11-27T18:42:20.605149+0000","last_clean":"2023-11-27T18:42:20.605149+0000","last_became_active":"2023-11-27T18:14:22.715684+0000","last_became_peered":"2023-11-27T18:14:22.715684+0000","last_unstale":"2023-11-27T18:42:20.605149+0000","last_undegraded":"2023-11-27T18:42:20.605149+0000","last_fullsized":"2023-11-27T18:42:20.605149+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:33:36.215484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":6465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,0],"acting":[2,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"32'34","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.088789+0000","last_change":"2023-11-27T18:13:15.849183+0000","last_active":"2023-11-27T18:43:23.088789+0000","last_peered":"2023-11-27T18:43:23.088789+0000","last_clean":"2023-11-27T18:43:23.088789+0000","last_became_active":"2023-11-27T18:13:15.848503+0000","last_became_peered":"2023-11-27T18:13:15.848503+0000","last_unstale":"2023-11-27T18:43:23.088789+0000","last_undegraded":"2023-11-27T18:43:23.088789+0000","last_fullsized":"2023-11-27T18:43:23.088789+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:14:48.774302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"32'28","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:22.930797+0000","last_change":"2023-11-27T18:13:14.336349+0000","last_active":"2023-11-27T18:43:22.930797+0000","last_peered":"2023-11-27T18:43:22.930797+0000","last_clean":"2023-11-27T18:43:22.930797+0000","last_became_active":"2023-11-27T18:13:14.336072+0000","last_became_peered":"2023-11-27T18:13:14.336072+0000","last_unstale":"2023-11-27T18:43:22.930797+0000","last_undegraded":"2023-11-27T18:43:22.930797+0000","last_fullsized":"2023-11-27T18:43:22.930797+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:54:58.777656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"32'27","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.008110+0000","last_change":"2023-11-27T18:13:14.421713+0000","last_active":"2023-11-27T18:43:23.008110+0000","last_peered":"2023-11-27T18:43:23.008110+0000","last_clean":"2023-11-27T18:43:23.008110+0000","last_became_active":"2023-11-27T18:13:14.418679+0000","last_became_peered":"2023-11-27T18:13:14.418679+0000","last_unstale":"2023-11-27T18:43:23.008110+0000","last_undegraded":"2023-11-27T18:43:23.008110+0000","last_fullsized":"2023-11-27T18:43:23.008110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:53:03.917430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"32'22","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.087244+0000","last_change":"2023-11-27T18:13:14.376601+0000","last_active":"2023-11-27T18:43:23.087244+0000","last_peered":"2023-11-27T18:43:23.087244+0000","last_clean":"2023-11-27T18:43:23.087244+0000","last_became_active":"2023-11-27T18:13:14.376292+0000","last_became_peered":"2023-11-27T18:13:14.376292+0000","last_unstale":"2023-11-27T18:43:23.087244+0000","last_undegraded":"2023-11-27T18:43:23.087244+0000","last_fullsized":"2023-11-27T18:43:23.087244+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:52:30.225572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"32'16","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.007978+0000","last_change":"2023-11-27T18:13:14.367285+0000","last_active":"2023-11-27T18:43:23.007978+0000","last_peered":"2023-11-27T18:43:23.007978+0000","last_clean":"2023-11-27T18:43:23.007978+0000","last_became_active":"2023-11-27T18:13:14.366983+0000","last_became_peered":"2023-11-27T18:13:14.366983+0000","last_unstale":"2023-11-27T18:43:23.007978+0000","last_undegraded":"2023-11-27T18:43:23.007978+0000","last_fullsized":"2023-11-27T18:43:23.007978+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:04:31.925421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"32'22","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.008178+0000","last_change":"2023-11-27T18:13:14.375744+0000","last_active":"2023-11-27T18:43:23.008178+0000","last_peered":"2023-11-27T18:43:23.008178+0000","last_clean":"2023-11-27T18:43:23.008178+0000","last_became_active":"2023-11-27T18:13:14.375466+0000","last_became_peered":"2023-11-27T18:13:14.375466+0000","last_unstale":"2023-11-27T18:43:23.008178+0000","last_undegraded":"2023-11-27T18:43:23.008178+0000","last_fullsized":"2023-11-27T18:43:23.008178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:03:10.250350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"32'33","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.089376+0000","last_change":"2023-11-27T18:13:15.911021+0000","last_active":"2023-11-27T18:43:23.089376+0000","last_peered":"2023-11-27T18:43:23.089376+0000","last_clean":"2023-11-27T18:43:23.089376+0000","last_became_active":"2023-11-27T18:13:15.910418+0000","last_became_peered":"2023-11-27T18:13:15.910418+0000","last_unstale":"2023-11-27T18:43:23.089376+0000","last_undegraded":"2023-11-27T18:43:23.089376+0000","last_fullsized":"2023-11-27T18:43:23.089376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:55:45.033833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"32'19","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.087549+0000","last_change":"2023-11-27T18:13:14.368483+0000","last_active":"2023-11-27T18:43:23.087549+0000","last_peered":"2023-11-27T18:43:23.087549+0000","last_clean":"2023-11-27T18:43:23.087549+0000","last_became_active":"2023-11-27T18:13:14.366249+0000","last_became_peered":"2023-11-27T18:13:14.366249+0000","last_unstale":"2023-11-27T18:43:23.087549+0000","last_undegraded":"2023-11-27T18:43:23.087549+0000","last_fullsized":"2023-11-27T18:43:23.087549+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:52:43.071209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"32'19","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.009319+0000","last_change":"2023-11-27T18:13:14.415379+0000","last_active":"2023-11-27T18:43:23.009319+0000","last_peered":"2023-11-27T18:43:23.009319+0000","last_clean":"2023-11-27T18:43:23.009319+0000","last_became_active":"2023-11-27T18:13:14.414873+0000","last_became_peered":"2023-11-27T18:13:14.414873+0000","last_unstale":"2023-11-27T18:43:23.009319+0000","last_undegraded":"2023-11-27T18:43:23.009319+0000","last_fullsized":"2023-11-27T18:43:23.009319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:40:12.521779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'30","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.090541+0000","last_change":"2023-11-27T18:13:14.416351+0000","last_active":"2023-11-27T18:43:23.090541+0000","last_peered":"2023-11-27T18:43:23.090541+0000","last_clean":"2023-11-27T18:43:23.090541+0000","last_became_active":"2023-11-27T18:13:14.416072+0000","last_became_peered":"2023-11-27T18:13:14.416072+0000","last_unstale":"2023-11-27T18:43:23.090541+0000","last_undegraded":"2023-11-27T18:43:23.090541+0000","last_fullsized":"2023-11-27T18:43:23.090541+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:31:11.712270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"32'25","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.112998+0000","last_change":"2023-11-27T18:13:15.801534+0000","last_active":"2023-11-27T18:43:23.112998+0000","last_peered":"2023-11-27T18:43:23.112998+0000","last_clean":"2023-11-27T18:43:23.112998+0000","last_became_active":"2023-11-27T18:13:15.800699+0000","last_became_peered":"2023-11-27T18:13:15.800699+0000","last_unstale":"2023-11-27T18:43:23.112998+0000","last_undegraded":"2023-11-27T18:43:23.112998+0000","last_fullsized":"2023-11-27T18:43:23.112998+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:39:39.512202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"32'35","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.124464+0000","last_change":"2023-11-27T18:13:14.413935+0000","last_active":"2023-11-27T18:43:23.124464+0000","last_peered":"2023-11-27T18:43:23.124464+0000","last_clean":"2023-11-27T18:43:23.124464+0000","last_became_active":"2023-11-27T18:13:14.413567+0000","last_became_peered":"2023-11-27T18:13:14.413567+0000","last_unstale":"2023-11-27T18:43:23.124464+0000","last_undegraded":"2023-11-27T18:43:23.124464+0000","last_fullsized":"2023-11-27T18:43:23.124464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:51:07.667299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"32'26","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.090895+0000","last_change":"2023-11-27T18:13:14.363105+0000","last_active":"2023-11-27T18:43:23.090895+0000","last_peered":"2023-11-27T18:43:23.090895+0000","last_clean":"2023-11-27T18:43:23.090895+0000","last_became_active":"2023-11-27T18:13:14.362805+0000","last_became_peered":"2023-11-27T18:13:14.362805+0000","last_unstale":"2023-11-27T18:43:23.090895+0000","last_undegraded":"2023-11-27T18:43:23.090895+0000","last_fullsized":"2023-11-27T18:43:23.090895+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:19:02.523860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"32'25","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:22.999913+0000","last_change":"2023-11-27T18:13:14.416119+0000","last_active":"2023-11-27T18:43:22.999913+0000","last_peered":"2023-11-27T18:43:22.999913+0000","last_clean":"2023-11-27T18:43:22.999913+0000","last_became_active":"2023-11-27T18:13:14.415661+0000","last_became_peered":"2023-11-27T18:13:14.415661+0000","last_unstale":"2023-11-27T18:43:22.999913+0000","last_undegraded":"2023-11-27T18:43:22.999913+0000","last_fullsized":"2023-11-27T18:43:22.999913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:56:36.729814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"32'35","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:22.929454+0000","last_change":"2023-11-27T18:13:14.413859+0000","last_active":"2023-11-27T18:43:22.929454+0000","last_peered":"2023-11-27T18:43:22.929454+0000","last_clean":"2023-11-27T18:43:22.929454+0000","last_became_active":"2023-11-27T18:13:14.413542+0000","last_became_peered":"2023-11-27T18:13:14.413542+0000","last_unstale":"2023-11-27T18:43:22.929454+0000","last_undegraded":"2023-11-27T18:43:22.929454+0000","last_fullsized":"2023-11-27T18:43:22.929454+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:24:16.125984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"32'23","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.004112+0000","last_change":"2023-11-27T18:13:14.417018+0000","last_active":"2023-11-27T18:43:23.004112+0000","last_peered":"2023-11-27T18:43:23.004112+0000","last_clean":"2023-11-27T18:43:23.004112+0000","last_became_active":"2023-11-27T18:13:14.416556+0000","last_became_peered":"2023-11-27T18:13:14.416556+0000","last_unstale":"2023-11-27T18:43:23.004112+0000","last_undegraded":"2023-11-27T18:43:23.004112+0000","last_fullsized":"2023-11-27T18:43:23.004112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:03:59.054125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"32'28","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.011337+0000","last_change":"2023-11-27T18:13:14.419437+0000","last_active":"2023-11-27T18:43:23.011337+0000","last_peered":"2023-11-27T18:43:23.011337+0000","last_clean":"2023-11-27T18:43:23.011337+0000","last_became_active":"2023-11-27T18:13:14.418823+0000","last_became_peered":"2023-11-27T18:13:14.418823+0000","last_unstale":"2023-11-27T18:43:23.011337+0000","last_undegraded":"2023-11-27T18:43:23.011337+0000","last_fullsized":"2023-11-27T18:43:23.011337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:26:36.101388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"32'26","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.087519+0000","last_change":"2023-11-27T18:13:14.368373+0000","last_active":"2023-11-27T18:43:23.087519+0000","last_peered":"2023-11-27T18:43:23.087519+0000","last_clean":"2023-11-27T18:43:23.087519+0000","last_became_active":"2023-11-27T18:13:14.368100+0000","last_became_peered":"2023-11-27T18:13:14.368100+0000","last_unstale":"2023-11-27T18:43:23.087519+0000","last_undegraded":"2023-11-27T18:43:23.087519+0000","last_fullsized":"2023-11-27T18:43:23.087519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:27:05.736955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"32'26","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.008498+0000","last_change":"2023-11-27T18:13:14.376812+0000","last_active":"2023-11-27T18:43:23.008498+0000","last_peered":"2023-11-27T18:43:23.008498+0000","last_clean":"2023-11-27T18:43:23.008498+0000","last_became_active":"2023-11-27T18:13:14.376559+0000","last_became_peered":"2023-11-27T18:13:14.376559+0000","last_unstale":"2023-11-27T18:43:23.008498+0000","last_undegraded":"2023-11-27T18:43:23.008498+0000","last_fullsized":"2023-11-27T18:43:23.008498+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:31:25.796567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"32'32","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.008507+0000","last_change":"2023-11-27T18:13:14.367518+0000","last_active":"2023-11-27T18:43:23.008507+0000","last_peered":"2023-11-27T18:43:23.008507+0000","last_clean":"2023-11-27T18:43:23.008507+0000","last_became_active":"2023-11-27T18:13:14.367298+0000","last_became_peered":"2023-11-27T18:13:14.367298+0000","last_unstale":"2023-11-27T18:43:23.008507+0000","last_undegraded":"2023-11-27T18:43:23.008507+0000","last_fullsized":"2023-11-27T18:43:23.008507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:48:00.722511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"32'17","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.094029+0000","last_change":"2023-11-27T18:13:14.364130+0000","last_active":"2023-11-27T18:43:23.094029+0000","last_peered":"2023-11-27T18:43:23.094029+0000","last_clean":"2023-11-27T18:43:23.094029+0000","last_became_active":"2023-11-27T18:13:14.363776+0000","last_became_peered":"2023-11-27T18:13:14.363776+0000","last_unstale":"2023-11-27T18:43:23.094029+0000","last_undegraded":"2023-11-27T18:43:23.094029+0000","last_fullsized":"2023-11-27T18:43:23.094029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:14:10.603135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"32'24","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.069330+0000","last_change":"2023-11-27T18:13:14.423459+0000","last_active":"2023-11-27T18:43:23.069330+0000","last_peered":"2023-11-27T18:43:23.069330+0000","last_clean":"2023-11-27T18:43:23.069330+0000","last_became_active":"2023-11-27T18:13:14.423099+0000","last_became_peered":"2023-11-27T18:13:14.423099+0000","last_unstale":"2023-11-27T18:43:23.069330+0000","last_undegraded":"2023-11-27T18:43:23.069330+0000","last_fullsized":"2023-11-27T18:43:23.069330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:39:33.850547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"32'32","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.094039+0000","last_change":"2023-11-27T18:13:14.420348+0000","last_active":"2023-11-27T18:43:23.094039+0000","last_peered":"2023-11-27T18:43:23.094039+0000","last_clean":"2023-11-27T18:43:23.094039+0000","last_became_active":"2023-11-27T18:13:14.419780+0000","last_became_peered":"2023-11-27T18:13:14.419780+0000","last_unstale":"2023-11-27T18:43:23.094039+0000","last_undegraded":"2023-11-27T18:43:23.094039+0000","last_fullsized":"2023-11-27T18:43:23.094039+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:49:00.537995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"32'29","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.112441+0000","last_change":"2023-11-27T18:13:15.910347+0000","last_active":"2023-11-27T18:43:23.112441+0000","last_peered":"2023-11-27T18:43:23.112441+0000","last_clean":"2023-11-27T18:43:23.112441+0000","last_became_active":"2023-11-27T18:13:15.909918+0000","last_became_peered":"2023-11-27T18:13:15.909918+0000","last_unstale":"2023-11-27T18:43:23.112441+0000","last_undegraded":"2023-11-27T18:43:23.112441+0000","last_fullsized":"2023-11-27T18:43:23.112441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:14:48.774302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"32'19","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.095169+0000","last_change":"2023-11-27T18:13:14.369974+0000","last_active":"2023-11-27T18:43:23.095169+0000","last_peered":"2023-11-27T18:43:23.095169+0000","last_clean":"2023-11-27T18:43:23.095169+0000","last_became_active":"2023-11-27T18:13:14.369285+0000","last_became_peered":"2023-11-27T18:13:14.369285+0000","last_unstale":"2023-11-27T18:43:23.095169+0000","last_undegraded":"2023-11-27T18:43:23.095169+0000","last_fullsized":"2023-11-27T18:43:23.095169+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:23:56.484932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"32'20","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.056701+0000","last_change":"2023-11-27T18:13:14.385745+0000","last_active":"2023-11-27T18:43:23.056701+0000","last_peered":"2023-11-27T18:43:23.056701+0000","last_clean":"2023-11-27T18:43:23.056701+0000","last_became_active":"2023-11-27T18:13:14.385566+0000","last_became_peered":"2023-11-27T18:13:14.385566+0000","last_unstale":"2023-11-27T18:43:23.056701+0000","last_undegraded":"2023-11-27T18:43:23.056701+0000","last_fullsized":"2023-11-27T18:43:23.056701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:52:43.071209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"32'26","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.088701+0000","last_change":"2023-11-27T18:13:15.848952+0000","last_active":"2023-11-27T18:43:23.088701+0000","last_peered":"2023-11-27T18:43:23.088701+0000","last_clean":"2023-11-27T18:43:23.088701+0000","last_became_active":"2023-11-27T18:13:15.848237+0000","last_became_peered":"2023-11-27T18:13:15.848237+0000","last_unstale":"2023-11-27T18:43:23.088701+0000","last_undegraded":"2023-11-27T18:43:23.088701+0000","last_fullsized":"2023-11-27T18:43:23.088701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:39:39.512202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"32'23","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.087188+0000","last_change":"2023-11-27T18:13:14.373247+0000","last_active":"2023-11-27T18:43:23.087188+0000","last_peered":"2023-11-27T18:43:23.087188+0000","last_clean":"2023-11-27T18:43:23.087188+0000","last_became_active":"2023-11-27T18:13:14.372974+0000","last_became_peered":"2023-11-27T18:13:14.372974+0000","last_unstale":"2023-11-27T18:43:23.087188+0000","last_undegraded":"2023-11-27T18:43:23.087188+0000","last_fullsized":"2023-11-27T18:43:23.087188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:39:34.589545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"32'18","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.091049+0000","last_change":"2023-11-27T18:13:15.851685+0000","last_active":"2023-11-27T18:43:23.091049+0000","last_peered":"2023-11-27T18:43:23.091049+0000","last_clean":"2023-11-27T18:43:23.091049+0000","last_became_active":"2023-11-27T18:13:15.850353+0000","last_became_peered":"2023-11-27T18:13:15.850353+0000","last_unstale":"2023-11-27T18:43:23.091049+0000","last_undegraded":"2023-11-27T18:43:23.091049+0000","last_fullsized":"2023-11-27T18:43:23.091049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:51:02.615119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"32'25","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.085199+0000","last_change":"2023-11-27T18:13:14.381126+0000","last_active":"2023-11-27T18:43:23.085199+0000","last_peered":"2023-11-27T18:43:23.085199+0000","last_clean":"2023-11-27T18:43:23.085199+0000","last_became_active":"2023-11-27T18:13:14.380714+0000","last_became_peered":"2023-11-27T18:13:14.380714+0000","last_unstale":"2023-11-27T18:43:23.085199+0000","last_undegraded":"2023-11-27T18:43:23.085199+0000","last_fullsized":"2023-11-27T18:43:23.085199+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:14:10.603135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"32'19","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.084889+0000","last_change":"2023-11-27T18:13:14.368254+0000","last_active":"2023-11-27T18:43:23.084889+0000","last_peered":"2023-11-27T18:43:23.084889+0000","last_clean":"2023-11-27T18:43:23.084889+0000","last_became_active":"2023-11-27T18:13:14.367978+0000","last_became_peered":"2023-11-27T18:13:14.367978+0000","last_unstale":"2023-11-27T18:43:23.084889+0000","last_undegraded":"2023-11-27T18:43:23.084889+0000","last_fullsized":"2023-11-27T18:43:23.084889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:05:05.751108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"32'23","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.067010+0000","last_change":"2023-11-27T18:13:14.419332+0000","last_active":"2023-11-27T18:43:23.067010+0000","last_peered":"2023-11-27T18:43:23.067010+0000","last_clean":"2023-11-27T18:43:23.067010+0000","last_became_active":"2023-11-27T18:13:14.418928+0000","last_became_peered":"2023-11-27T18:13:14.418928+0000","last_unstale":"2023-11-27T18:43:23.067010+0000","last_undegraded":"2023-11-27T18:43:23.067010+0000","last_fullsized":"2023-11-27T18:43:23.067010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:34:08.186176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2386,"num_write_kb":255070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2569,"ondisk_log_size":2569,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1576,"ondisk_log_size":1576,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":24107291,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":549,"num_read_kb":581,"num_write":5694,"num_write_kb":26819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32874496,"data_stored":48214582,"data_compressed":4737124,"data_compressed_allocated":7356416,"data_compressed_original":22757376,"omap_allocated":0,"internal_metadata":0},"log_size":5241,"ondisk_log_size":5241,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67010,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719477110,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36008,"kb_used_data":4832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335832,"statfs":{"total":96636764160,"available":96599891968,"internally_reserved":0,"allocated":4947968,"data_stored":8056568,"data_compressed":850146,"data_compressed_allocated":1241088,"data_compressed_original":4562944,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.874,"15min":0.85699999999999998},"min":{"1min":0.64000000000000001,"5min":0.5,"15min":0.45400000000000001},"max":{"1min":1.262,"5min":1.288,"15min":1.4730000000000001},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.93799999999999994,"15min":0.93300000000000005},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.46000000000000002},"max":{"1min":1.258,"5min":1.377,"15min":1.49},"last":1.002}]},{"osd":1,"last update":"Mon Nov 27 18:42:37 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.998,"15min":0.96599999999999997},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.57199999999999995},"max":{"1min":1.319,"5min":1.51,"15min":1.51},"last":1.161},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.95099999999999996,"15min":0.93200000000000005},"min":{"1min":0.65400000000000003,"5min":0.55100000000000005,"15min":0.45900000000000002},"max":{"1min":1.3460000000000001,"5min":1.361,"15min":1.482},"last":1.052}]},{"osd":2,"last update":"Mon Nov 27 18:42:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":0.99199999999999999,"15min":0.97799999999999998},"min":{"1min":0.628,"5min":0.59899999999999998,"15min":0.53900000000000003},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.603},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.92800000000000005,"15min":0.93300000000000005},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.52700000000000002},"max":{"1min":1.2110000000000001,"5min":1.389,"15min":1.389},"last":1.087}]},{"osd":3,"last update":"Mon Nov 27 18:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.99099999999999999,"15min":0.97799999999999998},"min":{"1min":0.67900000000000005,"5min":0.64500000000000002,"15min":0.63300000000000001},"max":{"1min":1.244,"5min":1.3859999999999999,"15min":1.472},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.073,"5min":1.0589999999999999,"15min":1.0429999999999999},"min":{"1min":0.77100000000000002,"5min":0.64800000000000002,"15min":0.61399999999999999},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":1.3049999999999999}]},{"osd":4,"last update":"Mon Nov 27 18:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90800000000000003,"15min":0.90200000000000002},"min":{"1min":0.496,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.194,"5min":1.397,"15min":1.4470000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.03,"5min":1.0349999999999999,"15min":1.0049999999999999},"min":{"1min":0.56799999999999995,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.3120000000000001,"5min":1.6020000000000001,"15min":1.6379999999999999},"last":1.2809999999999999}]},{"osd":6,"last update":"Mon Nov 27 18:42:37 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.0189999999999999,"15min":1.0109999999999999},"min":{"1min":0.66400000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.4019999999999999,"5min":1.466,"15min":1.49},"last":1.2470000000000001},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0429999999999999,"15min":1.034},"min":{"1min":0.71599999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.2969999999999999,"5min":1.5049999999999999,"15min":1.605},"last":1.1899999999999999}]},{"osd":7,"last update":"Mon Nov 27 18:42:37 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.1679999999999999,"15min":1.125},"min":{"1min":0.65000000000000002,"5min":0.49299999999999999,"15min":0.47999999999999998},"max":{"1min":1.4910000000000001,"5min":1.6930000000000001,"15min":1.831},"last":1.327},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.2,"15min":1.181},"min":{"1min":0.76900000000000002,"5min":0.52400000000000002,"15min":0.48099999999999998},"max":{"1min":1.6639999999999999,"5min":1.768,"15min":1.768},"last":1.131}]}]},{"osd":7,"up_from":16,"seq":68719477111,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33280,"kb_used_data":2104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338560,"statfs":{"total":96636764160,"available":96602685440,"internally_reserved":0,"allocated":2154496,"data_stored":3272747,"data_compressed":386056,"data_compressed_allocated":532480,"data_compressed_original":1863680,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.88500000000000001,"15min":0.88},"min":{"1min":0.56899999999999995,"5min":0.54000000000000004,"15min":0.49399999999999999},"max":{"1min":1.3009999999999999,"5min":1.357,"15min":1.448},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.96799999999999997,"15min":0.93700000000000006},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.49299999999999999},"max":{"1min":1.2909999999999999,"5min":1.411,"15min":1.7110000000000001},"last":0.93799999999999994}]},{"osd":1,"last update":"Mon Nov 27 18:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.91900000000000004,"15min":0.92600000000000005},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.343,"5min":1.379,"15min":1.379},"last":1.081},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1,"15min":0.97799999999999998},"min":{"1min":0.65600000000000003,"5min":0.63100000000000001,"15min":0.54800000000000004},"max":{"1min":1.4259999999999999,"5min":1.4450000000000001,"15min":1.768},"last":1.2410000000000001}]},{"osd":2,"last update":"Mon Nov 27 18:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":1.0089999999999999,"15min":0.997},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.52000000000000002},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.6870000000000001},"last":1.327},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.95399999999999996,"15min":0.93999999999999995},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.204,"5min":1.363,"15min":1.415},"last":0.76900000000000002}]},{"osd":3,"last update":"Mon Nov 27 18:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.99099999999999999,"15min":0.97699999999999998},"min":{"1min":0.61899999999999999,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.2370000000000001,"5min":1.4370000000000001,"15min":1.4550000000000001},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.103,"15min":1.073},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.51300000000000001},"max":{"1min":1.4990000000000001,"5min":1.5649999999999999,"15min":1.5820000000000001},"last":0.85599999999999998}]},{"osd":4,"last update":"Mon Nov 27 18:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":1.006,"15min":0.92900000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.4610000000000001,"5min":6.6539999999999999,"15min":6.6539999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.996,"15min":1},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.3240000000000001,"5min":1.5469999999999999,"15min":2.0649999999999999},"last":1.2709999999999999}]},{"osd":5,"last update":"Mon Nov 27 18:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.099,"15min":1.0389999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35199999999999998},"max":{"1min":1.569,"5min":1.825,"15min":1.825},"last":1.115},{"interface":"front","average":{"1min":1.052,"5min":1.0449999999999999,"15min":1.0369999999999999},"min":{"1min":0.55900000000000005,"5min":0.53200000000000003,"15min":0.39200000000000002},"max":{"1min":1.361,"5min":1.679,"15min":1.679},"last":1.0409999999999999}]},{"osd":6,"last update":"Mon Nov 27 18:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.1120000000000001,"15min":1.0900000000000001},"min":{"1min":0.73999999999999999,"5min":0.45300000000000001,"15min":0.43099999999999999},"max":{"1min":1.431,"5min":1.732,"15min":1.956},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.159,"15min":1.149},"min":{"1min":0.48999999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.6479999999999999,"5min":1.7170000000000001,"15min":1.8839999999999999},"last":1.1559999999999999}]}]},{"osd":6,"up_from":16,"seq":68719477111,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30016,"kb_used_data":3000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341824,"statfs":{"total":96636764160,"available":96606027776,"internally_reserved":0,"allocated":3072000,"data_stored":4332626,"data_compressed":430585,"data_compressed_allocated":663552,"data_compressed_original":2125824,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.93999999999999995,"15min":0.93600000000000005},"min":{"1min":0.64600000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.2290000000000001,"5min":1.375,"15min":1.956},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0609999999999999,"15min":1.04},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.534,"5min":1.5429999999999999,"15min":1.5629999999999999},"last":1.1830000000000001}]},{"osd":1,"last update":"Mon Nov 27 18:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.879,"15min":0.89300000000000002},"min":{"1min":0.58099999999999996,"5min":0.56599999999999995,"15min":0.51200000000000001},"max":{"1min":1.1679999999999999,"5min":1.4179999999999999,"15min":1.5229999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.93799999999999994,"15min":0.93400000000000005},"min":{"1min":0.63100000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3819999999999999,"5min":1.512,"15min":2.2519999999999998},"last":0.96699999999999997}]},{"osd":2,"last update":"Mon Nov 27 18:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.95899999999999996,"15min":0.95999999999999996},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.2949999999999999,"5min":2.2349999999999999,"15min":2.2349999999999999},"last":1.012},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.071,"15min":1.0580000000000001},"min":{"1min":0.76100000000000001,"5min":0.63400000000000001,"15min":0.52900000000000003},"max":{"1min":1.3819999999999999,"5min":3.6549999999999998,"15min":3.6549999999999998},"last":1.0469999999999999}]},{"osd":3,"last update":"Mon Nov 27 18:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0429999999999999,"15min":1.0389999999999999},"min":{"1min":0.75800000000000001,"5min":0.64800000000000002,"15min":0.52800000000000002},"max":{"1min":1.3420000000000001,"5min":1.7949999999999999,"15min":2.3050000000000002},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.026,"5min":1.081,"15min":1.069},"min":{"1min":0.73999999999999999,"5min":0.67300000000000004,"15min":0.57699999999999996},"max":{"1min":1.3500000000000001,"5min":2.0750000000000002,"15min":2.097},"last":0.90900000000000003}]},{"osd":4,"last update":"Mon Nov 27 18:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.95499999999999996,"15min":0.97499999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.712},"last":0.67800000000000005},{"interface":"front","average":{"1min":1.079,"5min":1.0860000000000001,"15min":1.0640000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.607,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.61699999999999999}]},{"osd":5,"last update":"Mon Nov 27 18:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":1.016,"15min":0.99299999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.2909999999999999,"5min":1.879,"15min":2.173},"last":0.78700000000000003},{"interface":"front","average":{"1min":1.075,"5min":1.133,"15min":1.1439999999999999},"min":{"1min":0.59399999999999997,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.4790000000000001,"5min":3.7509999999999999,"15min":3.7509999999999999},"last":1.157}]},{"osd":7,"last update":"Mon Nov 27 18:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.1459999999999999,"15min":1.157},"min":{"1min":0.55300000000000005,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.4910000000000001,"5min":1.962,"15min":2.351},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.163,"15min":1.1579999999999999},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.499},"max":{"1min":1.6990000000000001,"5min":2.1150000000000002,"15min":2.2250000000000001},"last":1.115}]}]},{"osd":3,"up_from":16,"seq":68719477109,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58052,"kb_used_data":8828,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94313788,"statfs":{"total":96636764160,"available":96577318912,"internally_reserved":0,"allocated":9039872,"data_stored":12721816,"data_compressed":1205599,"data_compressed_allocated":1880064,"data_compressed_original":5767168,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.70399999999999996,"15min":0.72299999999999998},"min":{"1min":0.497,"5min":0.40100000000000002,"15min":0.29799999999999999},"max":{"1min":1.077,"5min":1.077,"15min":1.456},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.79700000000000004,"15min":0.78700000000000003},"min":{"1min":0.55800000000000005,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.006,"5min":1.387,"15min":1.4750000000000001},"last":0.77500000000000002}]},{"osd":1,"last update":"Mon Nov 27 18:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.79000000000000004,"15min":0.78700000000000003},"min":{"1min":0.54700000000000004,"5min":0.434,"15min":0.38900000000000001},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.88200000000000001,"15min":0.90300000000000002},"min":{"1min":0.64000000000000001,"5min":0.39200000000000002,"15min":0.36799999999999999},"max":{"1min":1.0880000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.878}]},{"osd":2,"last update":"Mon Nov 27 18:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.94799999999999995,"15min":0.92400000000000004},"min":{"1min":0.67200000000000004,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.3420000000000001,"5min":1.631,"15min":1.631},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.93600000000000005,"15min":0.94999999999999996},"min":{"1min":0.61299999999999999,"5min":0.441,"15min":0.39000000000000001},"max":{"1min":1.115,"5min":1.375,"15min":1.375},"last":1.081}]},{"osd":4,"last update":"Mon Nov 27 18:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":1.0149999999999999,"15min":0.98899999999999999},"min":{"1min":0.65700000000000003,"5min":0.57699999999999996,"15min":0.56799999999999995},"max":{"1min":1.3380000000000001,"5min":1.573,"15min":1.6439999999999999},"last":1.115},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0289999999999999,"15min":1.0589999999999999},"min":{"1min":0.76900000000000002,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.3320000000000001,"5min":1.4950000000000001,"15min":1.605},"last":1.048}]},{"osd":5,"last update":"Mon Nov 27 18:42:37 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.077,"15min":1.087},"min":{"1min":0.82499999999999996,"5min":0.69899999999999995,"15min":0.59799999999999998},"max":{"1min":1.409,"5min":1.6120000000000001,"15min":1.766},"last":1.167},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.1899999999999999,"15min":1.1839999999999999},"min":{"1min":0.90500000000000003,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.536,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.294}]},{"osd":6,"last update":"Mon Nov 27 18:42:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1319999999999999,"15min":1.099},"min":{"1min":0.88800000000000001,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.597,"5min":1.607,"15min":1.8720000000000001},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.141,"5min":1.171,"15min":1.1819999999999999},"min":{"1min":0.86599999999999999,"5min":0.73799999999999999,"15min":0.63300000000000001},"max":{"1min":1.504,"5min":1.7050000000000001,"15min":1.7270000000000001},"last":1.2629999999999999}]},{"osd":7,"last update":"Mon Nov 27 18:42:37 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.2490000000000001,"15min":1.2470000000000001},"min":{"1min":0.94299999999999995,"5min":0.88800000000000001,"15min":0.61299999999999999},"max":{"1min":1.4770000000000001,"5min":1.915,"15min":1.915},"last":1.401},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1990000000000001,"15min":1.1699999999999999},"min":{"1min":1.014,"5min":0.496,"15min":0.496},"max":{"1min":1.5389999999999999,"5min":1.6839999999999999,"15min":1.9339999999999999},"last":1.3600000000000001}]}]},{"osd":2,"up_from":16,"seq":68719477110,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33272,"kb_used_data":6256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94338568,"statfs":{"total":96636764160,"available":96602693632,"internally_reserved":0,"allocated":6406144,"data_stored":8527602,"data_compressed":750925,"data_compressed_allocated":1228800,"data_compressed_original":3559424,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:42:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.71699999999999997,"15min":0.72199999999999998},"min":{"1min":0.49099999999999999,"5min":0.47699999999999998,"15min":0.41599999999999998},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2869999999999999},"last":0.63},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.80400000000000005,"15min":0.82199999999999995},"min":{"1min":0.51700000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.3899999999999999,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":0.998}]},{"osd":1,"last update":"Mon Nov 27 18:42:43 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.83699999999999997,"15min":0.85399999999999998},"min":{"1min":0.61799999999999999,"5min":0.56799999999999995,"15min":0.38500000000000001},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.89000000000000001,"15min":0.88900000000000001},"min":{"1min":0.54700000000000004,"5min":0.49399999999999999,"15min":0.48499999999999999},"max":{"1min":1.0269999999999999,"5min":2.6400000000000001,"15min":2.6400000000000001},"last":0.72699999999999998}]},{"osd":3,"last update":"Mon Nov 27 18:42:43 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84499999999999997,"15min":0.82899999999999996},"min":{"1min":0.436,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.3799999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":1.002,"5min":0.96599999999999997,"15min":0.97399999999999998},"min":{"1min":0.72399999999999998,"5min":0.46100000000000002,"15min":0.40200000000000002},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":1.034}]},{"osd":4,"last update":"Mon Nov 27 18:42:43 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.0309999999999999,"15min":1.044},"min":{"1min":0.871,"5min":0.71799999999999997,"15min":0.56599999999999995},"max":{"1min":1.4339999999999999,"5min":1.49,"15min":1.7090000000000001},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.028,"5min":1.0329999999999999,"15min":1.05},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.57799999999999996},"max":{"1min":1.4179999999999999,"5min":1.861,"15min":1.861},"last":0.88}]},{"osd":5,"last update":"Mon Nov 27 18:42:43 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.0820000000000001,"15min":1.089},"min":{"1min":0.68700000000000006,"5min":0.68300000000000005,"15min":0.628},"max":{"1min":1.4650000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.012,"5min":1.0649999999999999,"15min":1.0509999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.53000000000000003},"max":{"1min":1.3180000000000001,"5min":1.5800000000000001,"15min":1.6859999999999999},"last":0.77300000000000002}]},{"osd":6,"last update":"Mon Nov 27 18:42:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.1180000000000001,"15min":1.1080000000000001},"min":{"1min":0.58999999999999997,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.3169999999999999,"5min":1.6339999999999999,"15min":1.7490000000000001},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.1890000000000001,"15min":1.1870000000000001},"min":{"1min":0.93000000000000005,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.786,"5min":1.786,"15min":1.958},"last":1.087}]},{"osd":7,"last update":"Mon Nov 27 18:42:43 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.194,"15min":1.1950000000000001},"min":{"1min":0.89200000000000002,"5min":0.88400000000000001,"15min":0.625},"max":{"1min":1.54,"5min":1.7869999999999999,"15min":1.8799999999999999},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.204,"15min":1.1830000000000001},"min":{"1min":0.61099999999999999,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.389,"5min":3.4289999999999998,"15min":3.4289999999999998},"last":0.92000000000000004}]}]},{"osd":1,"up_from":16,"seq":68719477110,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44056,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327784,"statfs":{"total":96636764160,"available":96591650816,"internally_reserved":0,"allocated":409600,"data_stored":728760,"data_compressed":33505,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:42:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.69899999999999995,"15min":0.71899999999999997},"min":{"1min":0.495,"5min":0.44700000000000001,"15min":0.41499999999999998},"max":{"1min":1.0209999999999999,"5min":1.1080000000000001,"15min":1.2969999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.80600000000000005,"15min":0.82899999999999996},"min":{"1min":0.54600000000000004,"5min":0.54300000000000004,"15min":0.34499999999999997},"max":{"1min":1.0629999999999999,"5min":1.306,"15min":1.397},"last":0.81599999999999995}]},{"osd":2,"last update":"Mon Nov 27 18:42:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.74099999999999999,"15min":0.74399999999999999},"min":{"1min":0.58599999999999997,"5min":0.40400000000000003,"15min":0.36299999999999999},"max":{"1min":1.0640000000000001,"5min":1.274,"15min":1.3480000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84699999999999998,"15min":0.89000000000000001},"min":{"1min":0.65400000000000003,"5min":0.48899999999999999,"15min":0.38500000000000001},"max":{"1min":1.1930000000000001,"5min":1.4359999999999999,"15min":1.9610000000000001},"last":0.93300000000000005}]},{"osd":3,"last update":"Mon Nov 27 18:42:34 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.95899999999999996,"15min":0.98199999999999998},"min":{"1min":0.52600000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.296,"5min":1.3520000000000001,"15min":1.8009999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.90300000000000002,"15min":0.91000000000000003},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.40699999999999997},"max":{"1min":1.462,"5min":1.462,"15min":2.0960000000000001},"last":1.2310000000000001}]},{"osd":4,"last update":"Mon Nov 27 18:42:34 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.97499999999999998,"15min":0.95299999999999996},"min":{"1min":0.70399999999999996,"5min":0.67800000000000005,"15min":0.51800000000000002},"max":{"1min":1.2170000000000001,"5min":1.4370000000000001,"15min":1.4970000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.087,"15min":1.099},"min":{"1min":0.75900000000000001,"5min":0.66900000000000004,"15min":0.61399999999999999},"max":{"1min":1.478,"5min":1.593,"15min":2.496},"last":1.056}]},{"osd":5,"last update":"Mon Nov 27 18:42:34 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.073,"15min":1.0940000000000001},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.51500000000000001},"max":{"1min":1.4990000000000001,"5min":1.534,"15min":2.1970000000000001},"last":0.996},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0660000000000001,"15min":1.0620000000000001},"min":{"1min":0.82699999999999996,"5min":0.73399999999999999,"15min":0.60599999999999998},"max":{"1min":1.573,"5min":1.605,"15min":1.7529999999999999},"last":0.96899999999999997}]},{"osd":6,"last update":"Mon Nov 27 18:42:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1830000000000001,"15min":1.2},"min":{"1min":0.83099999999999996,"5min":0.77100000000000002,"15min":0.503},"max":{"1min":1.6060000000000001,"5min":1.6879999999999999,"15min":2.4319999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.175,"15min":1.1859999999999999},"min":{"1min":0.94899999999999995,"5min":0.77800000000000002,"15min":0.52600000000000002},"max":{"1min":1.5660000000000001,"5min":1.7569999999999999,"15min":2.3700000000000001},"last":1.1850000000000001}]},{"osd":7,"last update":"Mon Nov 27 18:42:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.1919999999999999,"15min":1.2190000000000001},"min":{"1min":0.99299999999999999,"5min":0.79900000000000004,"15min":0.55200000000000005},"max":{"1min":1.6160000000000001,"5min":1.6990000000000001,"15min":2.2879999999999998},"last":1.127},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1799999999999999,"15min":1.1659999999999999},"min":{"1min":0.90700000000000003,"5min":0.79000000000000004,"15min":0.72999999999999998},"max":{"1min":1.4399999999999999,"5min":1.7070000000000001,"15min":1.7170000000000001},"last":1.1000000000000001}]}]},{"osd":0,"up_from":16,"seq":68719477111,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42672,"kb_used_data":3176,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329168,"statfs":{"total":96636764160,"available":96593068032,"internally_reserved":0,"allocated":3252224,"data_stored":4332682,"data_compressed":397480,"data_compressed_allocated":610304,"data_compressed_original":1900544,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 27 18:42:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.73799999999999999,"15min":0.72599999999999998},"min":{"1min":0.499,"5min":0.45100000000000001,"15min":0.441},"max":{"1min":1.2070000000000001,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.82599999999999996,"15min":0.83799999999999997},"min":{"1min":0.47499999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1120000000000001,"5min":1.391,"15min":1.391},"last":0.56799999999999995}]},{"osd":2,"last update":"Mon Nov 27 18:42:36 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.83399999999999996,"15min":0.86199999999999999},"min":{"1min":0.58299999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.127,"5min":1.3799999999999999,"15min":1.405},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.86099999999999999,"15min":0.86499999999999999},"min":{"1min":0.54600000000000004,"5min":0.52400000000000002,"15min":0.51900000000000002},"max":{"1min":1.1459999999999999,"5min":1.4730000000000001,"15min":1.5629999999999999},"last":0.82399999999999995}]},{"osd":3,"last update":"Mon Nov 27 18:42:36 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.88700000000000001,"15min":0.86899999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.42099999999999999},"max":{"1min":1.2410000000000001,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.96099999999999997,"15min":0.96799999999999997},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.29,"5min":1.421,"15min":2.073},"last":0.75700000000000001}]},{"osd":4,"last update":"Mon Nov 27 18:42:36 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.97799999999999998,"15min":0.97599999999999998},"min":{"1min":0.72399999999999998,"5min":0.63400000000000001,"15min":0.57099999999999995},"max":{"1min":1.2250000000000001,"5min":1.73,"15min":1.897},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.038,"5min":1.042,"15min":1.081},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.59399999999999997},"max":{"1min":1.3899999999999999,"5min":1.4059999999999999,"15min":2.1899999999999999},"last":0.93600000000000005}]},{"osd":5,"last update":"Mon Nov 27 18:42:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.089,"15min":1.0920000000000001},"min":{"1min":0.77800000000000002,"5min":0.70199999999999996,"15min":0.56899999999999995},"max":{"1min":1.3520000000000001,"5min":1.5369999999999999,"15min":2.0270000000000001},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.997,"5min":1.042,"15min":1.048},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.624},"max":{"1min":1.2509999999999999,"5min":1.855,"15min":2.1480000000000001},"last":1.248}]},{"osd":6,"last update":"Mon Nov 27 18:42:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.149,"15min":1.1679999999999999},"min":{"1min":0.73699999999999999,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.3440000000000001,"5min":1.6399999999999999,"15min":2.254},"last":1.163},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1579999999999999,"15min":1.1779999999999999},"min":{"1min":0.874,"5min":0.83299999999999996,"15min":0.745},"max":{"1min":1.5029999999999999,"5min":1.5800000000000001,"15min":1.8440000000000001},"last":1.046}]},{"osd":7,"last update":"Mon Nov 27 18:42:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1910000000000001,"15min":1.2070000000000001},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.60799999999999998},"max":{"1min":1.556,"5min":1.591,"15min":2.1600000000000001},"last":1.125},{"interface":"front","average":{"1min":1.153,"5min":1.169,"15min":1.1619999999999999},"min":{"1min":0.93700000000000006,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.349,"5min":1.7849999999999999,"15min":2.117},"last":1.081}]}]},{"osd":4,"up_from":15,"seq":64424509815,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55512,"kb_used_data":6288,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94316328,"statfs":{"total":96636764160,"available":96579919872,"internally_reserved":0,"allocated":6438912,"data_stored":8528274,"data_compressed":749838,"data_compressed_allocated":1245184,"data_compressed_original":3551232,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:42:36 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.92900000000000005,"15min":0.88500000000000001},"min":{"1min":0.63600000000000001,"5min":0.47099999999999997,"15min":0.46300000000000002},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.675},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.91500000000000004,"15min":0.91400000000000003},"min":{"1min":0.55300000000000005,"5min":0.373,"15min":0.373},"max":{"1min":1.298,"5min":1.504,"15min":1.5449999999999999},"last":0.90500000000000003}]},{"osd":1,"last update":"Mon Nov 27 18:42:36 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.93899999999999995,"15min":0.93500000000000005},"min":{"1min":0.71899999999999997,"5min":0.55100000000000005,"15min":0.46100000000000002},"max":{"1min":1.4199999999999999,"5min":1.4790000000000001,"15min":2.2759999999999998},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.95899999999999996,"15min":0.95299999999999996},"min":{"1min":0.73599999999999999,"5min":0.58899999999999997,"15min":0.49399999999999999},"max":{"1min":1.3080000000000001,"5min":1.371,"15min":1.569},"last":1.105}]},{"osd":2,"last update":"Mon Nov 27 18:42:36 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.98699999999999999,"15min":0.96599999999999997},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":2.3730000000000002},"last":0.996},{"interface":"front","average":{"1min":1.012,"5min":0.99099999999999999,"15min":0.999},"min":{"1min":0.52200000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.3129999999999999,"5min":1.4770000000000001,"15min":1.7729999999999999},"last":1.264}]},{"osd":3,"last update":"Mon Nov 27 18:42:36 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":0.97599999999999998,"15min":0.95899999999999996},"min":{"1min":0.77400000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.8300000000000001},"last":1.077},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0349999999999999,"15min":1.048},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.496,"5min":1.5169999999999999,"15min":2.2069999999999999},"last":1.0529999999999999}]},{"osd":5,"last update":"Mon Nov 27 18:42:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93899999999999995,"15min":0.96699999999999997},"min":{"1min":0.59899999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.2210000000000001,"5min":1.4410000000000001,"15min":1.7290000000000001},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.083,"5min":0.96199999999999997,"15min":0.96899999999999997},"min":{"1min":0.69099999999999995,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.355,"5min":1.597,"15min":1.7150000000000001},"last":0.80600000000000005}]},{"osd":6,"last update":"Mon Nov 27 18:42:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.0569999999999999,"15min":1.038},"min":{"1min":0.72099999999999997,"5min":0.52200000000000002,"15min":0.48299999999999998},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":2.4199999999999999},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.21,"5min":1.153,"15min":1.1399999999999999},"min":{"1min":0.79100000000000004,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.4510000000000001,"5min":1.591,"15min":1.8140000000000001},"last":1.1950000000000001}]},{"osd":7,"last update":"Mon Nov 27 18:42:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.089,"15min":1.073},"min":{"1min":0.504,"5min":0.46100000000000002,"15min":0.40400000000000003},"max":{"1min":1.623,"5min":1.6859999999999999,"15min":2.0419999999999998},"last":1.028},{"interface":"front","average":{"1min":1.196,"5min":1.1599999999999999,"15min":1.165},"min":{"1min":0.53200000000000003,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.736,"5min":1.736,"15min":2.3279999999999998},"last":1.145}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33505,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33505,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2912256,"data_stored":4194360,"data_compressed":397480,"data_compressed_allocated":610304,"data_compressed_original":1900544,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6066176,"data_stored":8389280,"data_compressed":750925,"data_compressed_allocated":1228800,"data_compressed_original":3559424,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8699904,"data_stored":12583494,"data_compressed":1205599,"data_compressed_allocated":1880064,"data_compressed_original":5767168,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6098944,"data_stored":8389952,"data_compressed":749838,"data_compressed_allocated":1245184,"data_compressed_original":3551232,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4546560,"data_stored":7328697,"data_compressed":816641,"data_compressed_allocated":1196032,"data_compressed_original":3989504,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":2732032,"data_stored":4194304,"data_compressed":430585,"data_compressed_allocated":663552,"data_compressed_original":2125824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1814528,"data_stored":3134425,"data_compressed":386056,"data_compressed_allocated":532480,"data_compressed_original":1863680,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T18:43:31.233 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T18:43:31.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.387+0000 7f22093b0640 1 Processor -- start 2023-11-27T18:43:31.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.387+0000 7f22093b0640 1 -- start start 2023-11-27T18:43:31.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.387+0000 7f22093b0640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f22041504c0 0x7f220415a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:31.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.387+0000 7f22093b0640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f22040c8610 0x7f2204071f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:31.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.387+0000 7f22093b0640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f22041508a0 0x7f2204072460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:31.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.387+0000 7f22093b0640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22040c1b10 con 0x7f22041508a0 2023-11-27T18:43:31.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.387+0000 7f22093b0640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f220415a900 con 0x7f22040c8610 2023-11-27T18:43:31.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.387+0000 7f22093b0640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22041563c0 con 0x7f22041504c0 2023-11-27T18:43:31.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.387+0000 7f22037fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f22041508a0 0x7f2204072460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:31.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.391+0000 7f22037fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f22041508a0 0x7f2204072460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:34724/0 (socket says 172.21.15.91:34724) 2023-11-27T18:43:31.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.391+0000 7f22037fe640 1 -- 172.21.15.91:0/3465434042 learned_addr learned my addr 172.21.15.91:0/3465434042 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:31.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.391+0000 7f22037fe640 1 -- 172.21.15.91:0/3465434042 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f22041504c0 msgr2=0x7f220415a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:31.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.391+0000 7f22037fe640 1 --2- 172.21.15.91:0/3465434042 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f22041504c0 0x7f220415a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:31.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.391+0000 7f22037fe640 1 -- 172.21.15.91:0/3465434042 >> v2:172.21.15.94:3300/0 conn(0x7f22040c8610 msgr2=0x7f2204071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:31.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.391+0000 7f22037fe640 1 --2- 172.21.15.91:0/3465434042 >> v2:172.21.15.94:3300/0 conn(0x7f22040c8610 0x7f2204071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:31.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.391+0000 7f22037fe640 1 -- 172.21.15.91:0/3465434042 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22040c6200 con 0x7f22041508a0 2023-11-27T18:43:31.398 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.395+0000 7f22037fe640 1 --2- 172.21.15.91:0/3465434042 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f22041508a0 0x7f2204072460 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2204072d50 tx=0x7f21f40213c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=580f381abe1d69bb server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:31.402 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.399+0000 7f2201ffb640 1 -- 172.21.15.91:0/3465434042 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f400b2d0 con 0x7f22041508a0 2023-11-27T18:43:31.402 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.399+0000 7f2201ffb640 1 -- 172.21.15.91:0/3465434042 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f40ad050 con 0x7f22041508a0 2023-11-27T18:43:31.402 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.399+0000 7f2201ffb640 1 -- 172.21.15.91:0/3465434042 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f4009820 con 0x7f22041508a0 2023-11-27T18:43:31.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.399+0000 7f22093b0640 1 -- 172.21.15.91:0/3465434042 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f22041508a0 msgr2=0x7f2204072460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:31.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.399+0000 7f22093b0640 1 --2- 172.21.15.91:0/3465434042 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f22041508a0 0x7f2204072460 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2204072d50 tx=0x7f21f40213c0 comp rx=0 tx=0).stop 2023-11-27T18:43:31.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.399+0000 7f22093b0640 1 -- 172.21.15.91:0/3465434042 shutdown_connections 2023-11-27T18:43:31.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.399+0000 7f22093b0640 1 --2- 172.21.15.91:0/3465434042 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f22041508a0 0x7f2204072460 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:31.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.399+0000 7f22093b0640 1 --2- 172.21.15.91:0/3465434042 >> v2:172.21.15.94:3300/0 conn(0x7f22040c8610 0x7f2204071f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:31.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.399+0000 7f22093b0640 1 --2- 172.21.15.91:0/3465434042 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f22041504c0 0x7f220415a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:31.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.399+0000 7f22093b0640 1 -- 172.21.15.91:0/3465434042 >> 172.21.15.91:0/3465434042 conn(0x7f22040c79b0 msgr2=0x7f22040c7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:31.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.399+0000 7f22093b0640 1 -- 172.21.15.91:0/3465434042 shutdown_connections 2023-11-27T18:43:31.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.399+0000 7f22093b0640 1 -- 172.21.15.91:0/3465434042 wait complete. 2023-11-27T18:43:31.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.403+0000 7f22093b0640 1 Processor -- start 2023-11-27T18:43:31.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.403+0000 7f22093b0640 1 -- start start 2023-11-27T18:43:31.405 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.403+0000 7f22093b0640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f22040c8610 0x7f22041577e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:31.405 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.403+0000 7f22093b0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f22041504c0 0x7f2204157d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:31.405 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.403+0000 7f22093b0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f22041508a0 0x7f2204158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:31.405 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.403+0000 7f22093b0640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22041efda0 con 0x7f22041508a0 2023-11-27T18:43:31.405 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.403+0000 7f22093b0640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2204153440 con 0x7f22041504c0 2023-11-27T18:43:31.405 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.403+0000 7f22093b0640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2204153720 con 0x7f22040c8610 2023-11-27T18:43:31.406 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.403+0000 7f22037fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f22041508a0 0x7f2204158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:31.406 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.403+0000 7f22037fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f22041508a0 0x7f2204158fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:34726/0 (socket says 172.21.15.91:34726) 2023-11-27T18:43:31.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.403+0000 7f22037fe640 1 -- 172.21.15.91:0/3305810062 learned_addr learned my addr 172.21.15.91:0/3305810062 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:31.409 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.407+0000 7f22037fe640 1 -- 172.21.15.91:0/3305810062 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f22040c8610 msgr2=0x7f22041577e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:31.409 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.407+0000 7f22037fe640 1 --2- 172.21.15.91:0/3305810062 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f22040c8610 0x7f22041577e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:31.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.407+0000 7f22037fe640 1 -- 172.21.15.91:0/3305810062 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f22041504c0 msgr2=0x7f2204157d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:31.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.407+0000 7f22037fe640 1 --2- 172.21.15.91:0/3305810062 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f22041504c0 0x7f2204157d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:31.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.407+0000 7f22037fe640 1 -- 172.21.15.91:0/3305810062 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f400bd40 con 0x7f22041508a0 2023-11-27T18:43:31.411 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.407+0000 7f22037fe640 1 --2- 172.21.15.91:0/3305810062 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f22041508a0 0x7f2204158fb0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f21f40b4040 tx=0x7f21f401e160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:31.416 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.411+0000 7f21fb7fe640 1 -- 172.21.15.91:0/3305810062 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f40c1070 con 0x7f22041508a0 2023-11-27T18:43:31.416 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.411+0000 7f21fb7fe640 1 -- 172.21.15.91:0/3305810062 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f40098d0 con 0x7f22041508a0 2023-11-27T18:43:31.416 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.411+0000 7f21fb7fe640 1 -- 172.21.15.91:0/3305810062 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f4009c80 con 0x7f22041508a0 2023-11-27T18:43:31.416 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.411+0000 7f22093b0640 1 -- 172.21.15.91:0/3305810062 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2204153a00 con 0x7f22041508a0 2023-11-27T18:43:31.416 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.411+0000 7f22093b0640 1 -- 172.21.15.91:0/3305810062 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2204152fb0 con 0x7f22041508a0 2023-11-27T18:43:31.416 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.415+0000 7f22093b0640 1 -- 172.21.15.91:0/3305810062 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22041588f0 con 0x7f22041508a0 2023-11-27T18:43:31.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.687+0000 7f21fb7fe640 1 -- 172.21.15.91:0/3305810062 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f21f40b8070 con 0x7f22041508a0 2023-11-27T18:43:31.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.687+0000 7f21fb7fe640 1 --2- 172.21.15.91:0/3305810062 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f21e4066840 0x7f21e4068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:31.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.687+0000 7f2202ffd640 1 --2- 172.21.15.91:0/3305810062 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f21e4066840 0x7f21e4068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:31.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.687+0000 7f2202ffd640 1 --2- 172.21.15.91:0/3305810062 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f21e4066840 0x7f21e4068d00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f21fc009730 tx=0x7f21fc006ca0 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:31.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.727+0000 7f21fb7fe640 1 -- 172.21.15.91:0/3305810062 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f21f40cee20 con 0x7f22041508a0 2023-11-27T18:43:31.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.727+0000 7f21fb7fe640 1 -- 172.21.15.91:0/3305810062 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f21f40f3950 con 0x7f22041508a0 2023-11-27T18:43:31.937 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.935+0000 7f22093b0640 1 -- 172.21.15.91:0/3305810062 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f22041588f0 con 0x7f22041508a0 2023-11-27T18:43:32.000 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.999+0000 7f21fb7fe640 1 -- 172.21.15.91:0/3305810062 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+18421 (secure 0 0 0) 0x7f22041588f0 con 0x7f22041508a0 2023-11-27T18:43:32.001 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:43:32.001 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":32,"fsid":"08c8ebbf-7936-4c41-a995-d5600de2d072","created":"2023-11-27T18:12:06.484593+0000","modified":"2023-11-27T18:14:21.835068+0000","last_up_change":"2023-11-27T18:12:33.154694+0000","last_in_change":"2023-11-27T18:12:23.622113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T18:12:35.450305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T18:13:09.589619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T18:13:11.439236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-27T18:13:18.514694+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ad53c08-dd19-4ae6-87c5-fa15bea3b4ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6811","nonce":472303992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6813","nonce":472303992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6817","nonce":472303992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6815","nonce":472303992}]},"public_addr":"172.21.15.91:6811/472303992","cluster_addr":"172.21.15.91:6813/472303992","heartbeat_back_addr":"172.21.15.91:6817/472303992","heartbeat_front_addr":"172.21.15.91:6815/472303992","state":["exists","up"]},{"osd":1,"uuid":"f8b5f147-ed29-4329-a787-a12cc34a2569","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6827","nonce":12316911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6829","nonce":12316911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6833","nonce":12316911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6831","nonce":12316911}]},"public_addr":"172.21.15.91:6827/12316911","cluster_addr":"172.21.15.91:6829/12316911","heartbeat_back_addr":"172.21.15.91:6833/12316911","heartbeat_front_addr":"172.21.15.91:6831/12316911","state":["exists","up"]},{"osd":2,"uuid":"c3029f9a-1c48-4f5d-983a-172a614d8795","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6803","nonce":3776125919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6805","nonce":3776125919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6809","nonce":3776125919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6807","nonce":3776125919}]},"public_addr":"172.21.15.91:6803/3776125919","cluster_addr":"172.21.15.91:6805/3776125919","heartbeat_back_addr":"172.21.15.91:6809/3776125919","heartbeat_front_addr":"172.21.15.91:6807/3776125919","state":["exists","up"]},{"osd":3,"uuid":"ab4b6fb2-0126-491b-9224-54a6badc5da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6819","nonce":1297704794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6821","nonce":1297704794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6825","nonce":1297704794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6823","nonce":1297704794}]},"public_addr":"172.21.15.91:6819/1297704794","cluster_addr":"172.21.15.91:6821/1297704794","heartbeat_back_addr":"172.21.15.91:6825/1297704794","heartbeat_front_addr":"172.21.15.91:6823/1297704794","state":["exists","up"]},{"osd":4,"uuid":"695071a8-2de8-4cba-bf20-050021a03bb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6809","nonce":2501531833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6811","nonce":2501531833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6815","nonce":2501531833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6813","nonce":2501531833}]},"public_addr":"172.21.15.94:6809/2501531833","cluster_addr":"172.21.15.94:6811/2501531833","heartbeat_back_addr":"172.21.15.94:6815/2501531833","heartbeat_front_addr":"172.21.15.94:6813/2501531833","state":["exists","up"]},{"osd":5,"uuid":"ca01da14-a700-4845-8db2-f5e3370677e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6817","nonce":2448969592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6819","nonce":2448969592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6823","nonce":2448969592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6821","nonce":2448969592}]},"public_addr":"172.21.15.94:6817/2448969592","cluster_addr":"172.21.15.94:6819/2448969592","heartbeat_back_addr":"172.21.15.94:6823/2448969592","heartbeat_front_addr":"172.21.15.94:6821/2448969592","state":["exists","up"]},{"osd":6,"uuid":"4784bc77-6c33-4e47-abba-d37484982f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6825","nonce":3389553935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6827","nonce":3389553935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6831","nonce":3389553935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6829","nonce":3389553935}]},"public_addr":"172.21.15.94:6825/3389553935","cluster_addr":"172.21.15.94:6827/3389553935","heartbeat_back_addr":"172.21.15.94:6831/3389553935","heartbeat_front_addr":"172.21.15.94:6829/3389553935","state":["exists","up"]},{"osd":7,"uuid":"b954cf3f-4a4f-4a75-9f90-014f72c16d15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6801","nonce":1606498064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6803","nonce":1606498064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6807","nonce":1606498064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6805","nonce":1606498064}]},"public_addr":"172.21.15.94:6801/1606498064","cluster_addr":"172.21.15.94:6803/1606498064","heartbeat_back_addr":"172.21.15.94:6807/1606498064","heartbeat_front_addr":"172.21.15.94:6805/1606498064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.534968+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.506182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.339267+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.532432+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:28.935756+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.471559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.485014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.352978+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":0,"to":7}]},{"pgid":"4.d","mappings":[{"from":3,"to":0}]},{"pgid":"4.1d","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T18:43:32.003 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.999+0000 7f22093b0640 1 -- 172.21.15.91:0/3305810062 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f21e4066840 msgr2=0x7f21e4068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:32.003 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.999+0000 7f22093b0640 1 --2- 172.21.15.91:0/3305810062 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f21e4066840 0x7f21e4068d00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f21fc009730 tx=0x7f21fc006ca0 comp rx=0 tx=0).stop 2023-11-27T18:43:32.003 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.999+0000 7f22093b0640 1 -- 172.21.15.91:0/3305810062 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f22041508a0 msgr2=0x7f2204158fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:32.003 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.999+0000 7f22093b0640 1 --2- 172.21.15.91:0/3305810062 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f22041508a0 0x7f2204158fb0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f21f40b4040 tx=0x7f21f401e160 comp rx=0 tx=0).stop 2023-11-27T18:43:32.003 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.999+0000 7f22093b0640 1 -- 172.21.15.91:0/3305810062 shutdown_connections 2023-11-27T18:43:32.003 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.999+0000 7f22093b0640 1 --2- 172.21.15.91:0/3305810062 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f21e4066840 0x7f21e4068d00 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:32.004 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.999+0000 7f22093b0640 1 --2- 172.21.15.91:0/3305810062 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f22041508a0 0x7f2204158fb0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:32.004 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.999+0000 7f22093b0640 1 --2- 172.21.15.91:0/3305810062 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f22041504c0 0x7f2204157d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:32.004 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.999+0000 7f22093b0640 1 --2- 172.21.15.91:0/3305810062 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f22040c8610 0x7f22041577e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:32.004 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.999+0000 7f22093b0640 1 -- 172.21.15.91:0/3305810062 >> 172.21.15.91:0/3305810062 conn(0x7f22040c79b0 msgr2=0x7f2204073720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:32.004 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.999+0000 7f22093b0640 1 -- 172.21.15.91:0/3305810062 shutdown_connections 2023-11-27T18:43:32.004 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:31.999+0000 7f22093b0640 1 -- 172.21.15.91:0/3305810062 wait complete. 2023-11-27T18:43:33.022 INFO:tasks.ceph:Scrubbing osd.0 2023-11-27T18:43:33.022 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-11-27T18:43:33.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.155+0000 7fb27c4ea640 1 Processor -- start 2023-11-27T18:43:33.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.155+0000 7fb27c4ea640 1 -- start start 2023-11-27T18:43:33.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.155+0000 7fb27c4ea640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb274151750 0x7fb2740c66d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:33.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.155+0000 7fb27c4ea640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb27406fe80 con 0x7fb274072480 2023-11-27T18:43:33.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.155+0000 7fb27c4ea640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb27406f8c0 con 0x7fb27415aa00 2023-11-27T18:43:33.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.155+0000 7fb27c4ea640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2740c56d0 con 0x7fb274151750 2023-11-27T18:43:33.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.159+0000 7fb27a286640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb274151750 0x7fb2740c66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:33.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.159+0000 7fb27a286640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb274151750 0x7fb2740c66d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.91:50978/0 (socket says 172.21.15.91:50978) 2023-11-27T18:43:33.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.159+0000 7fb27a286640 1 -- 172.21.15.91:0/4040029585 learned_addr learned my addr 172.21.15.91:0/4040029585 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:33.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.163+0000 7fb27a286640 1 -- 172.21.15.91:0/4040029585 >> v1:172.21.15.94:6789/0 conn(0x7fb27415aa00 legacy=0x7fb274161c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:33.168 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.163+0000 7fb27a286640 1 -- 172.21.15.91:0/4040029585 >> v1:172.21.15.91:6789/0 conn(0x7fb274072480 legacy=0x7fb2740c49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:33.168 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.163+0000 7fb27a286640 1 -- 172.21.15.91:0/4040029585 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb27406fba0 con 0x7fb274151750 2023-11-27T18:43:33.177 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.175+0000 7fb27a286640 1 --2- 172.21.15.91:0/4040029585 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb274151750 0x7fb2740c66d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb264009e50 tx=0x7fb26401c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6ce4f79ca50dde9 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:33.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.183+0000 7fb279284640 1 -- 172.21.15.91:0/4040029585 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2640a5740 con 0x7fb274151750 2023-11-27T18:43:33.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.183+0000 7fb279284640 1 -- 172.21.15.91:0/4040029585 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2640a58a0 con 0x7fb274151750 2023-11-27T18:43:33.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.183+0000 7fb279284640 1 -- 172.21.15.91:0/4040029585 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2640a5c30 con 0x7fb274151750 2023-11-27T18:43:33.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.187+0000 7fb27c4ea640 1 -- 172.21.15.91:0/4040029585 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb274151750 msgr2=0x7fb2740c66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:33.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.187+0000 7fb27c4ea640 1 --2- 172.21.15.91:0/4040029585 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb274151750 0x7fb2740c66d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb264009e50 tx=0x7fb26401c990 comp rx=0 tx=0).stop 2023-11-27T18:43:33.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.187+0000 7fb27c4ea640 1 -- 172.21.15.91:0/4040029585 shutdown_connections 2023-11-27T18:43:33.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.187+0000 7fb27c4ea640 1 --2- 172.21.15.91:0/4040029585 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb274151750 0x7fb2740c66d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:33.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.187+0000 7fb27c4ea640 1 -- 172.21.15.91:0/4040029585 >> 172.21.15.91:0/4040029585 conn(0x7fb274071500 msgr2=0x7fb274071910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:33.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.187+0000 7fb27c4ea640 1 -- 172.21.15.91:0/4040029585 shutdown_connections 2023-11-27T18:43:33.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.187+0000 7fb27c4ea640 1 -- 172.21.15.91:0/4040029585 wait complete. 2023-11-27T18:43:33.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.187+0000 7fb27c4ea640 1 Processor -- start 2023-11-27T18:43:33.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.187+0000 7fb27c4ea640 1 -- start start 2023-11-27T18:43:33.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.187+0000 7fb27c4ea640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb274072480 0x7fb2741595e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:33.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.187+0000 7fb27c4ea640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb274151750 0x7fb2740ca490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:33.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.187+0000 7fb27c4ea640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb27415aa00 0x7fb2740ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:33.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.187+0000 7fb27c4ea640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27414a180 con 0x7fb274151750 2023-11-27T18:43:33.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.187+0000 7fb27c4ea640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb274159b20 con 0x7fb274072480 2023-11-27T18:43:33.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.187+0000 7fb27c4ea640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2741f0a40 con 0x7fb27415aa00 2023-11-27T18:43:33.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.187+0000 7fb27aa87640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb27415aa00 0x7fb2740ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:33.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.191+0000 7fb27aa87640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb27415aa00 0x7fb2740ca9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.91:35648/0 (socket says 172.21.15.91:35648) 2023-11-27T18:43:33.193 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.191+0000 7fb27aa87640 1 -- 172.21.15.91:0/1721733413 learned_addr learned my addr 172.21.15.91:0/1721733413 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:33.193 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.191+0000 7fb27a286640 1 --2- 172.21.15.91:0/1721733413 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb274072480 0x7fb2741595e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:33.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.199+0000 7fb27aa87640 1 -- 172.21.15.91:0/1721733413 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb274072480 msgr2=0x7fb2741595e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:33.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.199+0000 7fb27aa87640 1 --2- 172.21.15.91:0/1721733413 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb274072480 0x7fb2741595e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:33.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.199+0000 7fb27aa87640 1 -- 172.21.15.91:0/1721733413 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb274151750 msgr2=0x7fb2740ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:33.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.199+0000 7fb27aa87640 1 --2- 172.21.15.91:0/1721733413 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb274151750 0x7fb2740ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:33.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.199+0000 7fb27aa87640 1 -- 172.21.15.91:0/1721733413 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb264009b30 con 0x7fb27415aa00 2023-11-27T18:43:33.210 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.207+0000 7fb27aa87640 1 --2- 172.21.15.91:0/1721733413 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb27415aa00 0x7fb2740ca9d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb26c00b440 tx=0x7fb26c00b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:33.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.219+0000 7fb272ffd640 1 -- 172.21.15.91:0/1721733413 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26c011830 con 0x7fb27415aa00 2023-11-27T18:43:33.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.219+0000 7fb272ffd640 1 -- 172.21.15.91:0/1721733413 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb26c0119b0 con 0x7fb27415aa00 2023-11-27T18:43:33.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.219+0000 7fb272ffd640 1 -- 172.21.15.91:0/1721733413 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26c011d60 con 0x7fb27415aa00 2023-11-27T18:43:33.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.219+0000 7fb27c4ea640 1 -- 172.21.15.91:0/1721733413 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2741f4150 con 0x7fb27415aa00 2023-11-27T18:43:33.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.219+0000 7fb27c4ea640 1 -- 172.21.15.91:0/1721733413 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2741f4710 con 0x7fb27415aa00 2023-11-27T18:43:33.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.219+0000 7fb27c4ea640 1 -- 172.21.15.91:0/1721733413 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb27415b2c0 con 0x7fb27415aa00 2023-11-27T18:43:33.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.403+0000 7fb272ffd640 1 -- 172.21.15.91:0/1721733413 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fb26c01a400 con 0x7fb27415aa00 2023-11-27T18:43:33.405 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.403+0000 7fb272ffd640 1 --2- 172.21.15.91:0/1721733413 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fb2600667f0 0x7fb260068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:33.405 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.403+0000 7fb27a286640 1 --2- 172.21.15.91:0/1721733413 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fb2600667f0 0x7fb260068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:33.406 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.403+0000 7fb27a286640 1 --2- 172.21.15.91:0/1721733413 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fb2600667f0 0x7fb260068cb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb2640ae000 tx=0x7fb2640a7070 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:33.411 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.407+0000 7fb272ffd640 1 -- 172.21.15.91:0/1721733413 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb26c055dc0 con 0x7fb27415aa00 2023-11-27T18:43:33.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.407+0000 7fb272ffd640 1 --2- 172.21.15.91:0/1721733413 >> [v2:172.21.15.91:6810/472303992,v1:172.21.15.91:6811/472303992] conn(0x7fb26006fdd0 0x7fb260072270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:33.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.407+0000 7fb272ffd640 1 -- 172.21.15.91:0/1721733413 --> [v2:172.21.15.91:6810/472303992,v1:172.21.15.91:6811/472303992] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb260072940 con 0x7fb26006fdd0 2023-11-27T18:43:33.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.411+0000 7fb272ffd640 1 -- 172.21.15.91:0/1721733413 <== mon.2 v2:172.21.15.94:3301/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb26c009190 con 0x7fb27415aa00 2023-11-27T18:43:33.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.411+0000 7fb279a85640 1 --2- 172.21.15.91:0/1721733413 >> [v2:172.21.15.91:6810/472303992,v1:172.21.15.91:6811/472303992] conn(0x7fb26006fdd0 0x7fb260072270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:33.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.411+0000 7fb279a85640 1 --2- 172.21.15.91:0/1721733413 >> [v2:172.21.15.91:6810/472303992,v1:172.21.15.91:6811/472303992] conn(0x7fb26006fdd0 0x7fb260072270 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:33.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.411+0000 7fb272ffd640 1 -- 172.21.15.91:0/1721733413 <== osd.0 v2:172.21.15.91:6810/472303992 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fb260072940 con 0x7fb26006fdd0 2023-11-27T18:43:33.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.427+0000 7fb27c4ea640 1 -- 172.21.15.91:0/1721733413 --> [v2:172.21.15.91:6810/472303992,v1:172.21.15.91:6811/472303992] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb2741f0c60 con 0x7fb26006fdd0 2023-11-27T18:43:33.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.427+0000 7fb272ffd640 1 -- 172.21.15.91:0/1721733413 <== osd.0 v2:172.21.15.91:6810/472303992 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fb2741f0c60 con 0x7fb26006fdd0 2023-11-27T18:43:33.431 INFO:teuthology.orchestra.run.smithi091.stdout:{ 2023-11-27T18:43:33.431 INFO:teuthology.orchestra.run.smithi091.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-27T18:43:33.431 INFO:teuthology.orchestra.run.smithi091.stdout:} 2023-11-27T18:43:33.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.427+0000 7fb27c4ea640 1 -- 172.21.15.91:0/1721733413 >> [v2:172.21.15.91:6810/472303992,v1:172.21.15.91:6811/472303992] conn(0x7fb26006fdd0 msgr2=0x7fb260072270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:33.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.427+0000 7fb27c4ea640 1 --2- 172.21.15.91:0/1721733413 >> [v2:172.21.15.91:6810/472303992,v1:172.21.15.91:6811/472303992] conn(0x7fb26006fdd0 0x7fb260072270 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:33.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.427+0000 7fb27c4ea640 1 -- 172.21.15.91:0/1721733413 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fb2600667f0 msgr2=0x7fb260068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:33.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.427+0000 7fb27c4ea640 1 --2- 172.21.15.91:0/1721733413 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fb2600667f0 0x7fb260068cb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb2640ae000 tx=0x7fb2640a7070 comp rx=0 tx=0).stop 2023-11-27T18:43:33.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.427+0000 7fb27c4ea640 1 -- 172.21.15.91:0/1721733413 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb27415aa00 msgr2=0x7fb2740ca9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:33.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.427+0000 7fb27c4ea640 1 --2- 172.21.15.91:0/1721733413 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb27415aa00 0x7fb2740ca9d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb26c00b440 tx=0x7fb26c00b900 comp rx=0 tx=0).stop 2023-11-27T18:43:33.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.427+0000 7fb27aa87640 1 -- 172.21.15.91:0/1721733413 reap_dead start 2023-11-27T18:43:33.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.427+0000 7fb27c4ea640 1 -- 172.21.15.91:0/1721733413 shutdown_connections 2023-11-27T18:43:33.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.427+0000 7fb27c4ea640 1 -- 172.21.15.91:0/1721733413 >> 172.21.15.91:0/1721733413 conn(0x7fb274071500 msgr2=0x7fb274143680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:33.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.427+0000 7fb27c4ea640 1 -- 172.21.15.91:0/1721733413 shutdown_connections 2023-11-27T18:43:33.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.427+0000 7fb27c4ea640 1 -- 172.21.15.91:0/1721733413 wait complete. 2023-11-27T18:43:33.454 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-11-27T18:43:33.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.579+0000 7f49fd003640 1 Processor -- start 2023-11-27T18:43:33.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.579+0000 7f49fd003640 1 -- start start 2023-11-27T18:43:33.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.579+0000 7f49fd003640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f49f813f640 0x7f49f8072480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:33.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.579+0000 7f49fd003640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f49f81598e0 0x7f49f8156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:33.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.579+0000 7f49fd003640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49f8156640 con 0x7f49f8157010 2023-11-27T18:43:33.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.579+0000 7f49fd003640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49f8070ce0 con 0x7f49f813f640 2023-11-27T18:43:33.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.579+0000 7f49fd003640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49f81562f0 con 0x7f49f81598e0 2023-11-27T18:43:33.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.579+0000 7f49f6d9d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f49f813f640 0x7f49f8072480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:33.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.579+0000 7f49f659c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f49f81598e0 0x7f49f8156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:33.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.579+0000 7f49f6d9d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f49f813f640 0x7f49f8072480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:34748/0 (socket says 172.21.15.91:34748) 2023-11-27T18:43:33.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.579+0000 7f49f6d9d640 1 -- 172.21.15.91:0/2310045131 learned_addr learned my addr 172.21.15.91:0/2310045131 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:33.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.583+0000 7f49f6d9d640 1 -- 172.21.15.91:0/2310045131 >> v2:172.21.15.94:3300/0 conn(0x7f49f81598e0 msgr2=0x7f49f8156ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:33.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.583+0000 7f49f6d9d640 1 --2- 172.21.15.91:0/2310045131 >> v2:172.21.15.94:3300/0 conn(0x7f49f81598e0 0x7f49f8156ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:33.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.583+0000 7f49f6d9d640 1 -- 172.21.15.91:0/2310045131 >> v1:172.21.15.94:6789/0 conn(0x7f49f8157010 legacy=0x7f49f806a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:33.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.583+0000 7f49f6d9d640 1 -- 172.21.15.91:0/2310045131 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f8159dd0 con 0x7f49f813f640 2023-11-27T18:43:33.591 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.587+0000 7f49f6d9d640 1 --2- 172.21.15.91:0/2310045131 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f49f813f640 0x7f49f8072480 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f49f80c1d20 tx=0x7f49e801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc152cfeb4284cd4 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:33.595 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.591+0000 7f49f5d9b640 1 -- 172.21.15.91:0/2310045131 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e80aa5f0 con 0x7f49f813f640 2023-11-27T18:43:33.595 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.591+0000 7f49f5d9b640 1 -- 172.21.15.91:0/2310045131 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e80aa750 con 0x7f49f813f640 2023-11-27T18:43:33.595 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.591+0000 7f49f5d9b640 1 -- 172.21.15.91:0/2310045131 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e80aaae0 con 0x7f49f813f640 2023-11-27T18:43:33.596 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.595+0000 7f49fd003640 1 -- 172.21.15.91:0/2310045131 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f49f813f640 msgr2=0x7f49f8072480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:33.596 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.595+0000 7f49fd003640 1 --2- 172.21.15.91:0/2310045131 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f49f813f640 0x7f49f8072480 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f49f80c1d20 tx=0x7f49e801c490 comp rx=0 tx=0).stop 2023-11-27T18:43:33.596 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.595+0000 7f49fd003640 1 -- 172.21.15.91:0/2310045131 shutdown_connections 2023-11-27T18:43:33.596 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.595+0000 7f49fd003640 1 --2- 172.21.15.91:0/2310045131 >> v2:172.21.15.94:3300/0 conn(0x7f49f81598e0 0x7f49f8156ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:33.596 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.595+0000 7f49fd003640 1 --2- 172.21.15.91:0/2310045131 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f49f813f640 0x7f49f8072480 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:33.597 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.595+0000 7f49fd003640 1 -- 172.21.15.91:0/2310045131 >> 172.21.15.91:0/2310045131 conn(0x7f49f80ca9d0 msgr2=0x7f49f80cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:33.597 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.595+0000 7f49fd003640 1 -- 172.21.15.91:0/2310045131 shutdown_connections 2023-11-27T18:43:33.597 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.595+0000 7f49fd003640 1 -- 172.21.15.91:0/2310045131 wait complete. 2023-11-27T18:43:33.597 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.595+0000 7f49fd003640 1 Processor -- start 2023-11-27T18:43:33.598 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.595+0000 7f49fd003640 1 -- start start 2023-11-27T18:43:33.598 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.595+0000 7f49fd003640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f49f813f640 0x7f49f813c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:33.598 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.595+0000 7f49fd003640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f49f8157010 0x7f49f80c9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:33.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.595+0000 7f49fd003640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f49f81598e0 0x7f49f813b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:33.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.595+0000 7f49fd003640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f80be9d0 con 0x7f49f813f640 2023-11-27T18:43:33.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.595+0000 7f49fd003640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f813ce20 con 0x7f49f81598e0 2023-11-27T18:43:33.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.595+0000 7f49fd003640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49f80c88e0 con 0x7f49f8157010 2023-11-27T18:43:33.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.595+0000 7f49f6d9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f49f813f640 0x7f49f813c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:33.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.595+0000 7f49f6d9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f49f813f640 0x7f49f813c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:34764/0 (socket says 172.21.15.91:34764) 2023-11-27T18:43:33.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.595+0000 7f49f6d9d640 1 -- 172.21.15.91:0/2491602674 learned_addr learned my addr 172.21.15.91:0/2491602674 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:33.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.599+0000 7f49f659c640 1 --2- 172.21.15.91:0/2491602674 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f49f8157010 0x7f49f80c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:33.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.599+0000 7f49f759e640 1 --2- 172.21.15.91:0/2491602674 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f49f81598e0 0x7f49f813b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:33.603 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.599+0000 7f49f6d9d640 1 -- 172.21.15.91:0/2491602674 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f49f8157010 msgr2=0x7f49f80c9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:33.603 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.599+0000 7f49f6d9d640 1 --2- 172.21.15.91:0/2491602674 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f49f8157010 0x7f49f80c9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:33.603 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.599+0000 7f49f6d9d640 1 -- 172.21.15.91:0/2491602674 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f49f81598e0 msgr2=0x7f49f813b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:33.603 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.599+0000 7f49f6d9d640 1 --2- 172.21.15.91:0/2491602674 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f49f81598e0 0x7f49f813b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:33.603 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.599+0000 7f49f6d9d640 1 -- 172.21.15.91:0/2491602674 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e80094d0 con 0x7f49f813f640 2023-11-27T18:43:33.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.603+0000 7f49f6d9d640 1 --2- 172.21.15.91:0/2491602674 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f49f813f640 0x7f49f813c8e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f49e801ab40 tx=0x7f49e801acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:33.610 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.607+0000 7f49df7fe640 1 -- 172.21.15.91:0/2491602674 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e80bd5f0 con 0x7f49f813f640 2023-11-27T18:43:33.610 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.607+0000 7f49df7fe640 1 -- 172.21.15.91:0/2491602674 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e80bd750 con 0x7f49f813f640 2023-11-27T18:43:33.610 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.607+0000 7f49df7fe640 1 -- 172.21.15.91:0/2491602674 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e80bdb00 con 0x7f49f813f640 2023-11-27T18:43:33.611 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.607+0000 7f49fd003640 1 -- 172.21.15.91:0/2491602674 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49f80c8bc0 con 0x7f49f813f640 2023-11-27T18:43:33.611 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.607+0000 7f49fd003640 1 -- 172.21.15.91:0/2491602674 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49f8157790 con 0x7f49f813f640 2023-11-27T18:43:33.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.611+0000 7f49fd003640 1 -- 172.21.15.91:0/2491602674 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49f804e850 con 0x7f49f813f640 2023-11-27T18:43:33.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.635+0000 7f49df7fe640 1 -- 172.21.15.91:0/2491602674 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f49e80b3600 con 0x7f49f813f640 2023-11-27T18:43:33.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.635+0000 7f49df7fe640 1 --2- 172.21.15.91:0/2491602674 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f49e4066840 0x7f49e4068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:33.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.635+0000 7f49f659c640 1 --2- 172.21.15.91:0/2491602674 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f49e4066840 0x7f49e4068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:33.638 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.635+0000 7f49f659c640 1 --2- 172.21.15.91:0/2491602674 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f49e4066840 0x7f49e4068d00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f49f8153500 tx=0x7f49ec009190 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:33.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.639+0000 7f49df7fe640 1 -- 172.21.15.91:0/2491602674 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f49e80a7070 con 0x7f49f813f640 2023-11-27T18:43:33.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:33.915+0000 7f49df7fe640 1 -- 172.21.15.91:0/2491602674 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f49e80ec660 con 0x7f49f813f640 2023-11-27T18:43:34.084 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.083+0000 7f49fd003640 1 -- 172.21.15.91:0/2491602674 --> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f49f813fa20 con 0x7f49e4066840 2023-11-27T18:43:34.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.083+0000 7f49df7fe640 1 -- 172.21.15.91:0/2491602674 <== mgr.4136 v2:172.21.15.91:6800/2814827118 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f49ec004020 con 0x7f49e4066840 2023-11-27T18:43:34.085 INFO:teuthology.orchestra.run.smithi091.stderr:instructed osd(s) 0 to deep-scrub 2023-11-27T18:43:34.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.083+0000 7f49fd003640 1 -- 172.21.15.91:0/2491602674 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f49e4066840 msgr2=0x7f49e4068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:34.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.083+0000 7f49fd003640 1 --2- 172.21.15.91:0/2491602674 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f49e4066840 0x7f49e4068d00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f49f8153500 tx=0x7f49ec009190 comp rx=0 tx=0).stop 2023-11-27T18:43:34.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.083+0000 7f49fd003640 1 -- 172.21.15.91:0/2491602674 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f49f813f640 msgr2=0x7f49f813c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:34.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.083+0000 7f49fd003640 1 --2- 172.21.15.91:0/2491602674 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f49f813f640 0x7f49f813c8e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f49e801ab40 tx=0x7f49e801acd0 comp rx=0 tx=0).stop 2023-11-27T18:43:34.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.083+0000 7f49fd003640 1 -- 172.21.15.91:0/2491602674 shutdown_connections 2023-11-27T18:43:34.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.083+0000 7f49fd003640 1 --2- 172.21.15.91:0/2491602674 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f49e4066840 0x7f49e4068d00 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:34.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.083+0000 7f49fd003640 1 --2- 172.21.15.91:0/2491602674 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f49f8157010 0x7f49f80c9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:34.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.083+0000 7f49fd003640 1 --2- 172.21.15.91:0/2491602674 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f49f81598e0 0x7f49f813b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:34.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.083+0000 7f49fd003640 1 --2- 172.21.15.91:0/2491602674 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f49f813f640 0x7f49f813c8e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:34.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.083+0000 7f49fd003640 1 -- 172.21.15.91:0/2491602674 >> 172.21.15.91:0/2491602674 conn(0x7f49f80ca9d0 msgr2=0x7f49f8073950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:34.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.083+0000 7f49fd003640 1 -- 172.21.15.91:0/2491602674 shutdown_connections 2023-11-27T18:43:34.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.083+0000 7f49fd003640 1 -- 172.21.15.91:0/2491602674 wait complete. 2023-11-27T18:43:34.105 INFO:tasks.ceph:Scrubbing osd.1 2023-11-27T18:43:34.105 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-11-27T18:43:34.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.227+0000 7fb5a8d82640 1 Processor -- start 2023-11-27T18:43:34.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.227+0000 7fb5a8d82640 1 -- start start 2023-11-27T18:43:34.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.227+0000 7fb5a8d82640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb5a4071000 0x7fb5a4159650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:34.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.227+0000 7fb5a8d82640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5a406b630 con 0x7fb5a40c86b0 2023-11-27T18:43:34.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.227+0000 7fb5a8d82640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5a406bbf0 con 0x7fb5a4070c20 2023-11-27T18:43:34.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.227+0000 7fb5a8d82640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5a40ca410 con 0x7fb5a4071000 2023-11-27T18:43:34.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.231+0000 7fb5a2d9d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb5a4071000 0x7fb5a4159650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:34.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.231+0000 7fb5a2d9d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb5a4071000 0x7fb5a4159650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:34766/0 (socket says 172.21.15.91:34766) 2023-11-27T18:43:34.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.231+0000 7fb5a2d9d640 1 -- 172.21.15.91:0/2923311462 learned_addr learned my addr 172.21.15.91:0/2923311462 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:34.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.235+0000 7fb5a2d9d640 1 -- 172.21.15.91:0/2923311462 >> v1:172.21.15.94:6789/0 conn(0x7fb5a4070c20 legacy=0x7fb5a415d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:34.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.235+0000 7fb5a2d9d640 1 -- 172.21.15.91:0/2923311462 >> v1:172.21.15.91:6789/0 conn(0x7fb5a40c86b0 legacy=0x7fb5a406c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:34.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.235+0000 7fb5a2d9d640 1 -- 172.21.15.91:0/2923311462 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5a4159e90 con 0x7fb5a4071000 2023-11-27T18:43:34.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.239+0000 7fb5a2d9d640 1 --2- 172.21.15.91:0/2923311462 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb5a4071000 0x7fb5a4159650 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb59c009e50 tx=0x7fb59c01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8419a1d9cd3d686a server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:34.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.243+0000 7fb5a159a640 1 -- 172.21.15.91:0/2923311462 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59c0a56f0 con 0x7fb5a4071000 2023-11-27T18:43:34.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.243+0000 7fb5a159a640 1 -- 172.21.15.91:0/2923311462 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb59c0a5850 con 0x7fb5a4071000 2023-11-27T18:43:34.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.243+0000 7fb5a159a640 1 -- 172.21.15.91:0/2923311462 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59c0a5be0 con 0x7fb5a4071000 2023-11-27T18:43:34.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.243+0000 7fb5a8d82640 1 -- 172.21.15.91:0/2923311462 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb5a4071000 msgr2=0x7fb5a4159650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:34.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.243+0000 7fb5a8d82640 1 --2- 172.21.15.91:0/2923311462 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb5a4071000 0x7fb5a4159650 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb59c009e50 tx=0x7fb59c01c940 comp rx=0 tx=0).stop 2023-11-27T18:43:34.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.243+0000 7fb5a8d82640 1 -- 172.21.15.91:0/2923311462 shutdown_connections 2023-11-27T18:43:34.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.243+0000 7fb5a8d82640 1 --2- 172.21.15.91:0/2923311462 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb5a4071000 0x7fb5a4159650 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:34.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.243+0000 7fb5a8d82640 1 -- 172.21.15.91:0/2923311462 >> 172.21.15.91:0/2923311462 conn(0x7fb5a4070060 msgr2=0x7fb5a406ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:34.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.243+0000 7fb5a8d82640 1 -- 172.21.15.91:0/2923311462 shutdown_connections 2023-11-27T18:43:34.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.243+0000 7fb5a8d82640 1 -- 172.21.15.91:0/2923311462 wait complete. 2023-11-27T18:43:34.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.247+0000 7fb5a8d82640 1 Processor -- start 2023-11-27T18:43:34.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.247+0000 7fb5a8d82640 1 -- start start 2023-11-27T18:43:34.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.247+0000 7fb5a8d82640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb5a4070c20 0x7fb5a414e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:34.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.247+0000 7fb5a8d82640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb5a4071000 0x7fb5a4142660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:34.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.247+0000 7fb5a8d82640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb5a40c86b0 0x7fb5a4142ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:34.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.247+0000 7fb5a8d82640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a4141510 con 0x7fb5a4071000 2023-11-27T18:43:34.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.247+0000 7fb5a8d82640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a4146f00 con 0x7fb5a40c86b0 2023-11-27T18:43:34.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.247+0000 7fb5a8d82640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a4164db0 con 0x7fb5a4070c20 2023-11-27T18:43:34.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.247+0000 7fb5a1d9b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb5a4071000 0x7fb5a4142660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:34.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.247+0000 7fb5a1d9b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb5a4071000 0x7fb5a4142660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:34780/0 (socket says 172.21.15.91:34780) 2023-11-27T18:43:34.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.247+0000 7fb5a1d9b640 1 -- 172.21.15.91:0/229282082 learned_addr learned my addr 172.21.15.91:0/229282082 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:34.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.251+0000 7fb5a1d9b640 1 -- 172.21.15.91:0/229282082 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb5a4070c20 msgr2=0x7fb5a414e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:34.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.251+0000 7fb5a1d9b640 1 --2- 172.21.15.91:0/229282082 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb5a4070c20 0x7fb5a414e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:34.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.251+0000 7fb5a1d9b640 1 -- 172.21.15.91:0/229282082 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb5a40c86b0 msgr2=0x7fb5a4142ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:34.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.251+0000 7fb5a1d9b640 1 --2- 172.21.15.91:0/229282082 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb5a40c86b0 0x7fb5a4142ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:34.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.251+0000 7fb5a1d9b640 1 -- 172.21.15.91:0/229282082 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb59c009b30 con 0x7fb5a4071000 2023-11-27T18:43:34.256 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.255+0000 7fb5a1d9b640 1 --2- 172.21.15.91:0/229282082 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb5a4071000 0x7fb5a4142660 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb59800c460 tx=0x7fb59800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:34.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.259+0000 7fb592ffd640 1 -- 172.21.15.91:0/229282082 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5980052d0 con 0x7fb5a4071000 2023-11-27T18:43:34.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.259+0000 7fb592ffd640 1 -- 172.21.15.91:0/229282082 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb598005430 con 0x7fb5a4071000 2023-11-27T18:43:34.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.259+0000 7fb592ffd640 1 -- 172.21.15.91:0/229282082 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb598007260 con 0x7fb5a4071000 2023-11-27T18:43:34.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.259+0000 7fb5a8d82640 1 -- 172.21.15.91:0/229282082 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5a4152e80 con 0x7fb5a4071000 2023-11-27T18:43:34.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.259+0000 7fb5a8d82640 1 -- 172.21.15.91:0/229282082 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5a4141760 con 0x7fb5a4071000 2023-11-27T18:43:34.261 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.259+0000 7fb5a8d82640 1 -- 172.21.15.91:0/229282082 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb5a4159b90 con 0x7fb5a4071000 2023-11-27T18:43:34.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.279+0000 7fb592ffd640 1 -- 172.21.15.91:0/229282082 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fb5980073c0 con 0x7fb5a4071000 2023-11-27T18:43:34.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.279+0000 7fb592ffd640 1 --2- 172.21.15.91:0/229282082 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fb5840667f0 0x7fb584068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:34.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.279+0000 7fb5a259c640 1 --2- 172.21.15.91:0/229282082 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fb5840667f0 0x7fb584068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:34.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.279+0000 7fb5a259c640 1 --2- 172.21.15.91:0/229282082 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fb5840667f0 0x7fb584068cb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb594009650 tx=0x7fb594006bb0 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:34.285 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.283+0000 7fb592ffd640 1 -- 172.21.15.91:0/229282082 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb598007670 con 0x7fb5a4071000 2023-11-27T18:43:34.285 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.283+0000 7fb592ffd640 1 --2- 172.21.15.91:0/229282082 >> [v2:172.21.15.91:6826/12316911,v1:172.21.15.91:6827/12316911] conn(0x7fb58406fdd0 0x7fb584072270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:34.285 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.283+0000 7fb592ffd640 1 -- 172.21.15.91:0/229282082 --> [v2:172.21.15.91:6826/12316911,v1:172.21.15.91:6827/12316911] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb584072940 con 0x7fb58406fdd0 2023-11-27T18:43:34.285 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.283+0000 7fb592ffd640 1 -- 172.21.15.91:0/229282082 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb598001150 con 0x7fb5a4071000 2023-11-27T18:43:34.285 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.283+0000 7fb5a2d9d640 1 --2- 172.21.15.91:0/229282082 >> [v2:172.21.15.91:6826/12316911,v1:172.21.15.91:6827/12316911] conn(0x7fb58406fdd0 0x7fb584072270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:34.286 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.283+0000 7fb5a2d9d640 1 --2- 172.21.15.91:0/229282082 >> [v2:172.21.15.91:6826/12316911,v1:172.21.15.91:6827/12316911] conn(0x7fb58406fdd0 0x7fb584072270 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:34.286 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.283+0000 7fb592ffd640 1 -- 172.21.15.91:0/229282082 <== osd.1 v2:172.21.15.91:6826/12316911 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fb584072940 con 0x7fb58406fdd0 2023-11-27T18:43:34.300 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.299+0000 7fb5a8d82640 1 -- 172.21.15.91:0/229282082 --> [v2:172.21.15.91:6826/12316911,v1:172.21.15.91:6827/12316911] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb5a404e8c0 con 0x7fb58406fdd0 2023-11-27T18:43:34.300 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.299+0000 7fb592ffd640 1 -- 172.21.15.91:0/229282082 <== osd.1 v2:172.21.15.91:6826/12316911 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fb5a404e8c0 con 0x7fb58406fdd0 2023-11-27T18:43:34.301 INFO:teuthology.orchestra.run.smithi091.stdout:{ 2023-11-27T18:43:34.301 INFO:teuthology.orchestra.run.smithi091.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-27T18:43:34.301 INFO:teuthology.orchestra.run.smithi091.stdout:} 2023-11-27T18:43:34.302 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.299+0000 7fb5a8d82640 1 -- 172.21.15.91:0/229282082 >> [v2:172.21.15.91:6826/12316911,v1:172.21.15.91:6827/12316911] conn(0x7fb58406fdd0 msgr2=0x7fb584072270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:34.302 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.299+0000 7fb5a8d82640 1 --2- 172.21.15.91:0/229282082 >> [v2:172.21.15.91:6826/12316911,v1:172.21.15.91:6827/12316911] conn(0x7fb58406fdd0 0x7fb584072270 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:34.302 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.299+0000 7fb5a8d82640 1 -- 172.21.15.91:0/229282082 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fb5840667f0 msgr2=0x7fb584068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:34.302 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.299+0000 7fb5a8d82640 1 --2- 172.21.15.91:0/229282082 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fb5840667f0 0x7fb584068cb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb594009650 tx=0x7fb594006bb0 comp rx=0 tx=0).stop 2023-11-27T18:43:34.302 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.299+0000 7fb5a8d82640 1 -- 172.21.15.91:0/229282082 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb5a4071000 msgr2=0x7fb5a4142660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:34.302 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.299+0000 7fb5a8d82640 1 --2- 172.21.15.91:0/229282082 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb5a4071000 0x7fb5a4142660 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb59800c460 tx=0x7fb59800c920 comp rx=0 tx=0).stop 2023-11-27T18:43:34.303 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.299+0000 7fb5a2d9d640 1 -- 172.21.15.91:0/229282082 reap_dead start 2023-11-27T18:43:34.303 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.299+0000 7fb5a8d82640 1 -- 172.21.15.91:0/229282082 shutdown_connections 2023-11-27T18:43:34.303 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.299+0000 7fb5a8d82640 1 -- 172.21.15.91:0/229282082 >> 172.21.15.91:0/229282082 conn(0x7fb5a4070060 msgr2=0x7fb5a4158390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:34.303 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.299+0000 7fb5a8d82640 1 -- 172.21.15.91:0/229282082 shutdown_connections 2023-11-27T18:43:34.303 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.299+0000 7fb5a8d82640 1 -- 172.21.15.91:0/229282082 wait complete. 2023-11-27T18:43:34.317 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-11-27T18:43:34.441 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.439+0000 7fc8742c6640 1 Processor -- start 2023-11-27T18:43:34.441 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.439+0000 7fc8742c6640 1 -- start start 2023-11-27T18:43:34.442 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.439+0000 7fc8742c6640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc86c157c40 0x7fc86c06f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:34.442 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.439+0000 7fc8742c6640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc86c0c2a10 0x7fc86c0c8340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:34.442 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.439+0000 7fc8742c6640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc86c06b190 con 0x7fc86c0704e0 2023-11-27T18:43:34.442 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.439+0000 7fc8742c6640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc86c0c14b0 con 0x7fc86c0c2a10 2023-11-27T18:43:34.442 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.439+0000 7fc8742c6640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc86c15e4e0 con 0x7fc86c157c40 2023-11-27T18:43:34.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.459+0000 7fc871861640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fc86c0704e0 0x7fc86c0cbb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:53224/0 (socket says 172.21.15.91:53224) 2023-11-27T18:43:34.462 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.459+0000 7fc871861640 1 -- 172.21.15.91:0/1181185668 learned_addr learned my addr 172.21.15.91:0/1181185668 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:43:34.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.463+0000 7fc871060640 1 -- 172.21.15.91:0/1181185668 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1575802583 0 0) 0x7fc86c06b190 con 0x7fc86c0704e0 2023-11-27T18:43:34.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.463+0000 7fc871060640 1 -- 172.21.15.91:0/1181185668 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc858003530 con 0x7fc86c0704e0 2023-11-27T18:43:34.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.467+0000 7fc871060640 1 -- 172.21.15.91:0/1181185668 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2623925229 0 0) 0x7fc858003530 con 0x7fc86c0704e0 2023-11-27T18:43:34.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.467+0000 7fc871060640 1 -- 172.21.15.91:0/1181185668 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc86c157c40 msgr2=0x7fc86c06f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:34.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.467+0000 7fc871060640 1 --2- 172.21.15.91:0/1181185668 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc86c157c40 0x7fc86c06f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:34.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.467+0000 7fc871060640 1 -- 172.21.15.91:0/1181185668 >> v2:172.21.15.94:3300/0 conn(0x7fc86c0c2a10 msgr2=0x7fc86c0c8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:34.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.467+0000 7fc871060640 1 --2- 172.21.15.91:0/1181185668 >> v2:172.21.15.94:3300/0 conn(0x7fc86c0c2a10 0x7fc86c0c8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:34.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.467+0000 7fc871060640 1 -- 172.21.15.91:0/1181185668 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc86c15d8f0 con 0x7fc86c0704e0 2023-11-27T18:43:34.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.467+0000 7fc871060640 1 -- 172.21.15.91:0/1181185668 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3378743932 0 0) 0x7fc868001680 con 0x7fc86c0704e0 2023-11-27T18:43:34.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.467+0000 7fc871060640 1 -- 172.21.15.91:0/1181185668 >> v1:172.21.15.91:6789/0 conn(0x7fc86c0704e0 legacy=0x7fc86c0cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:34.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.467+0000 7fc871060640 1 --2- 172.21.15.91:0/1181185668 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc86c157c40 0x7fc858003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:34.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.467+0000 7fc871060640 1 --2- 172.21.15.91:0/1181185668 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8580040e0 0x7fc8580047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:34.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.467+0000 7fc871060640 1 --2- 172.21.15.91:0/1181185668 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc858004e30 0x7fc85800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:34.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.467+0000 7fc871060640 1 -- 172.21.15.91:0/1181185668 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc86c15e4e0 con 0x7fc858004e30 2023-11-27T18:43:34.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.467+0000 7fc871060640 1 -- 172.21.15.91:0/1181185668 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc858005530 con 0x7fc8580040e0 2023-11-27T18:43:34.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.467+0000 7fc871060640 1 -- 172.21.15.91:0/1181185668 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc85800bed0 con 0x7fc86c157c40 2023-11-27T18:43:34.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.471+0000 7fc872863640 1 --2- 172.21.15.91:0/1181185668 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc858004e30 0x7fc85800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:34.477 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.475+0000 7fc872863640 1 -- 172.21.15.91:0/1181185668 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc86c157c40 msgr2=0x7fc858003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:34.477 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.475+0000 7fc872863640 1 --2- 172.21.15.91:0/1181185668 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc86c157c40 0x7fc858003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:34.477 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.475+0000 7fc872863640 1 -- 172.21.15.91:0/1181185668 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8580040e0 msgr2=0x7fc8580047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:34.477 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.475+0000 7fc872863640 1 --2- 172.21.15.91:0/1181185668 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8580040e0 0x7fc8580047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:34.477 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.475+0000 7fc872863640 1 -- 172.21.15.91:0/1181185668 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc858003530 con 0x7fc858004e30 2023-11-27T18:43:34.480 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.479+0000 7fc872863640 1 --2- 172.21.15.91:0/1181185668 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc858004e30 0x7fc85800b990 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc864009ca0 tx=0x7fc86401cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=476c2b107f4f3421 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:34.484 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.483+0000 7fc871060640 1 -- 172.21.15.91:0/1181185668 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8640a5c60 con 0x7fc858004e30 2023-11-27T18:43:34.485 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.483+0000 7fc871060640 1 -- 172.21.15.91:0/1181185668 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8640a5de0 con 0x7fc858004e30 2023-11-27T18:43:34.485 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.483+0000 7fc871060640 1 -- 172.21.15.91:0/1181185668 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8640ad680 con 0x7fc858004e30 2023-11-27T18:43:34.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.483+0000 7fc8742c6640 1 -- 172.21.15.91:0/1181185668 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc858004e30 msgr2=0x7fc85800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:34.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.483+0000 7fc8742c6640 1 --2- 172.21.15.91:0/1181185668 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc858004e30 0x7fc85800b990 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc864009ca0 tx=0x7fc86401cc50 comp rx=0 tx=0).stop 2023-11-27T18:43:34.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.483+0000 7fc872863640 1 -- 172.21.15.91:0/1181185668 reap_dead start 2023-11-27T18:43:34.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.483+0000 7fc8742c6640 1 -- 172.21.15.91:0/1181185668 shutdown_connections 2023-11-27T18:43:34.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.483+0000 7fc8742c6640 1 -- 172.21.15.91:0/1181185668 >> 172.21.15.91:0/1181185668 conn(0x7fc86c071da0 msgr2=0x7fc86c0721b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:34.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.483+0000 7fc8742c6640 1 -- 172.21.15.91:0/1181185668 shutdown_connections 2023-11-27T18:43:34.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.483+0000 7fc8742c6640 1 -- 172.21.15.91:0/1181185668 wait complete. 2023-11-27T18:43:34.487 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.483+0000 7fc8742c6640 1 Processor -- start 2023-11-27T18:43:34.487 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.483+0000 7fc8742c6640 1 -- start start 2023-11-27T18:43:34.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.487+0000 7fc8742c6640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc858004e30 0x7fc86c1e3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:34.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.487+0000 7fc8742c6640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc86c1e9d50 0x7fc86c0c49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:34.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.487+0000 7fc8742c6640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc86c1ea1b0 0x7fc86c0cac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:34.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.487+0000 7fc8742c6640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc86c1f4480 con 0x7fc858004e30 2023-11-27T18:43:34.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.487+0000 7fc8742c6640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc86c0c5640 con 0x7fc86c1e9d50 2023-11-27T18:43:34.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.487+0000 7fc8742c6640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc86c0c5920 con 0x7fc86c1ea1b0 2023-11-27T18:43:34.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.487+0000 7fc872062640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc858004e30 0x7fc86c1e3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:34.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.487+0000 7fc872062640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc858004e30 0x7fc86c1e3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:34792/0 (socket says 172.21.15.91:34792) 2023-11-27T18:43:34.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.487+0000 7fc872062640 1 -- 172.21.15.91:0/3667179705 learned_addr learned my addr 172.21.15.91:0/3667179705 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:34.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.491+0000 7fc872062640 1 -- 172.21.15.91:0/3667179705 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc86c1ea1b0 msgr2=0x7fc86c0cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:34.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.491+0000 7fc872062640 1 --2- 172.21.15.91:0/3667179705 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc86c1ea1b0 0x7fc86c0cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:34.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.491+0000 7fc872062640 1 -- 172.21.15.91:0/3667179705 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc86c1e9d50 msgr2=0x7fc86c0c49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:34.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.491+0000 7fc872062640 1 --2- 172.21.15.91:0/3667179705 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc86c1e9d50 0x7fc86c0c49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:34.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.491+0000 7fc872062640 1 -- 172.21.15.91:0/3667179705 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc86c0c5c00 con 0x7fc858004e30 2023-11-27T18:43:34.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.491+0000 7fc872062640 1 --2- 172.21.15.91:0/3667179705 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc858004e30 0x7fc86c1e3e60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc85c00b450 tx=0x7fc85c00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:34.500 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.495+0000 7fc862ffd640 1 -- 172.21.15.91:0/3667179705 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85c011830 con 0x7fc858004e30 2023-11-27T18:43:34.500 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.495+0000 7fc862ffd640 1 -- 172.21.15.91:0/3667179705 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc85c011990 con 0x7fc858004e30 2023-11-27T18:43:34.500 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.495+0000 7fc862ffd640 1 -- 172.21.15.91:0/3667179705 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85c011d60 con 0x7fc858004e30 2023-11-27T18:43:34.500 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.495+0000 7fc8742c6640 1 -- 172.21.15.91:0/3667179705 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc86c0c5ee0 con 0x7fc858004e30 2023-11-27T18:43:34.500 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.499+0000 7fc8742c6640 1 -- 172.21.15.91:0/3667179705 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc86c152d80 con 0x7fc858004e30 2023-11-27T18:43:34.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.499+0000 7fc8742c6640 1 -- 172.21.15.91:0/3667179705 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc86c04e850 con 0x7fc858004e30 2023-11-27T18:43:34.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.519+0000 7fc862ffd640 1 -- 172.21.15.91:0/3667179705 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fc85c01a400 con 0x7fc858004e30 2023-11-27T18:43:34.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.519+0000 7fc862ffd640 1 --2- 172.21.15.91:0/3667179705 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fc850066820 0x7fc850068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:34.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.519+0000 7fc871861640 1 --2- 172.21.15.91:0/3667179705 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fc850066820 0x7fc850068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:34.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.523+0000 7fc871861640 1 --2- 172.21.15.91:0/3667179705 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fc850066820 0x7fc850068ce0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc868001060 tx=0x7fc8680015e0 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:34.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.523+0000 7fc862ffd640 1 -- 172.21.15.91:0/3667179705 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc85c025e40 con 0x7fc858004e30 2023-11-27T18:43:34.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.787+0000 7fc862ffd640 1 -- 172.21.15.91:0/3667179705 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fc85c051ac0 con 0x7fc858004e30 2023-11-27T18:43:34.958 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.955+0000 7fc8742c6640 1 -- 172.21.15.91:0/3667179705 --> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fc86c1f42e0 con 0x7fc850066820 2023-11-27T18:43:34.959 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.955+0000 7fc862ffd640 1 -- 172.21.15.91:0/3667179705 <== mgr.4136 v2:172.21.15.91:6800/2814827118 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc868007050 con 0x7fc850066820 2023-11-27T18:43:34.959 INFO:teuthology.orchestra.run.smithi091.stderr:instructed osd(s) 1 to deep-scrub 2023-11-27T18:43:34.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.959+0000 7fc8742c6640 1 -- 172.21.15.91:0/3667179705 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fc850066820 msgr2=0x7fc850068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:34.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.959+0000 7fc8742c6640 1 --2- 172.21.15.91:0/3667179705 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fc850066820 0x7fc850068ce0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc868001060 tx=0x7fc8680015e0 comp rx=0 tx=0).stop 2023-11-27T18:43:34.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.959+0000 7fc8742c6640 1 -- 172.21.15.91:0/3667179705 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc858004e30 msgr2=0x7fc86c1e3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:34.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.959+0000 7fc8742c6640 1 --2- 172.21.15.91:0/3667179705 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc858004e30 0x7fc86c1e3e60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc85c00b450 tx=0x7fc85c00b910 comp rx=0 tx=0).stop 2023-11-27T18:43:34.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.959+0000 7fc8742c6640 1 -- 172.21.15.91:0/3667179705 shutdown_connections 2023-11-27T18:43:34.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.959+0000 7fc8742c6640 1 --2- 172.21.15.91:0/3667179705 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fc850066820 0x7fc850068ce0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:34.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.959+0000 7fc8742c6640 1 --2- 172.21.15.91:0/3667179705 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc86c1ea1b0 0x7fc86c0cac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:34.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.959+0000 7fc8742c6640 1 --2- 172.21.15.91:0/3667179705 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc86c1e9d50 0x7fc86c0c49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:34.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.959+0000 7fc8742c6640 1 --2- 172.21.15.91:0/3667179705 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc858004e30 0x7fc86c1e3e60 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:34.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.959+0000 7fc8742c6640 1 -- 172.21.15.91:0/3667179705 >> 172.21.15.91:0/3667179705 conn(0x7fc86c071da0 msgr2=0x7fc86c15c190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:34.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.959+0000 7fc8742c6640 1 -- 172.21.15.91:0/3667179705 shutdown_connections 2023-11-27T18:43:34.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:34.959+0000 7fc8742c6640 1 -- 172.21.15.91:0/3667179705 wait complete. 2023-11-27T18:43:34.979 INFO:tasks.ceph:Scrubbing osd.2 2023-11-27T18:43:34.980 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-11-27T18:43:35.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.103+0000 7fc7030cf640 1 Processor -- start 2023-11-27T18:43:35.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.103+0000 7fc7030cf640 1 -- start start 2023-11-27T18:43:35.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.103+0000 7fc7030cf640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc6fc151460 0x7fc6fc15ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:35.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.103+0000 7fc7030cf640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6fc15a950 con 0x7fc6fc151080 2023-11-27T18:43:35.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.103+0000 7fc7030cf640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6fc157340 con 0x7fc6fc0cd6f0 2023-11-27T18:43:35.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.103+0000 7fc7030cf640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6fc158180 con 0x7fc6fc151460 2023-11-27T18:43:35.109 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.107+0000 7fc70166c640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc6fc151460 0x7fc6fc15ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:35.109 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.107+0000 7fc6f3fff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fc6fc0cd6f0 0x7fc6fc0c86f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.91:47390/0 (socket says 172.21.15.91:47390) 2023-11-27T18:43:35.109 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.107+0000 7fc6f3fff640 1 -- 172.21.15.91:0/3611966112 learned_addr learned my addr 172.21.15.91:0/3611966112 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:43:35.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.115+0000 7fc6f37fe640 1 -- 172.21.15.91:0/3611966112 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 350667003 0 0) 0x7fc6fc157340 con 0x7fc6fc0cd6f0 2023-11-27T18:43:35.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.115+0000 7fc6f37fe640 1 -- 172.21.15.91:0/3611966112 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6e4003530 con 0x7fc6fc0cd6f0 2023-11-27T18:43:35.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.115+0000 7fc70166c640 1 -- 172.21.15.91:0/3611966112 >> v1:172.21.15.94:6789/0 conn(0x7fc6fc0cd6f0 legacy=0x7fc6fc0c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:35.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.115+0000 7fc70166c640 1 -- 172.21.15.91:0/3611966112 >> v1:172.21.15.91:6789/0 conn(0x7fc6fc151080 legacy=0x7fc6fc0c7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:35.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.115+0000 7fc70166c640 1 -- 172.21.15.91:0/3611966112 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6fc157600 con 0x7fc6fc151460 2023-11-27T18:43:35.124 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.123+0000 7fc70166c640 1 --2- 172.21.15.91:0/3611966112 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc6fc151460 0x7fc6fc15ade0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4009dc0 tx=0x7fc6f401f120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=510e9af6e7868a24 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:35.133 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.131+0000 7fc6f37fe640 1 -- 172.21.15.91:0/3611966112 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f40af600 con 0x7fc6fc151460 2023-11-27T18:43:35.133 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.131+0000 7fc6f37fe640 1 -- 172.21.15.91:0/3611966112 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f40ab050 con 0x7fc6fc151460 2023-11-27T18:43:35.133 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.131+0000 7fc6f37fe640 1 -- 172.21.15.91:0/3611966112 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f40af980 con 0x7fc6fc151460 2023-11-27T18:43:35.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.131+0000 7fc7030cf640 1 -- 172.21.15.91:0/3611966112 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc6fc151460 msgr2=0x7fc6fc15ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:35.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.131+0000 7fc7030cf640 1 --2- 172.21.15.91:0/3611966112 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc6fc151460 0x7fc6fc15ade0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4009dc0 tx=0x7fc6f401f120 comp rx=0 tx=0).stop 2023-11-27T18:43:35.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.131+0000 7fc7030cf640 1 -- 172.21.15.91:0/3611966112 shutdown_connections 2023-11-27T18:43:35.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.131+0000 7fc7030cf640 1 --2- 172.21.15.91:0/3611966112 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc6fc151460 0x7fc6fc15ade0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:35.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.131+0000 7fc7030cf640 1 -- 172.21.15.91:0/3611966112 >> 172.21.15.91:0/3611966112 conn(0x7fc6fc06a520 msgr2=0x7fc6fc06a930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:35.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.131+0000 7fc7030cf640 1 -- 172.21.15.91:0/3611966112 shutdown_connections 2023-11-27T18:43:35.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.131+0000 7fc7030cf640 1 -- 172.21.15.91:0/3611966112 wait complete. 2023-11-27T18:43:35.135 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.131+0000 7fc7030cf640 1 Processor -- start 2023-11-27T18:43:35.135 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.131+0000 7fc7030cf640 1 -- start start 2023-11-27T18:43:35.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.135+0000 7fc7030cf640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc6fc0cd6f0 0x7fc6fc06cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:35.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.135+0000 7fc7030cf640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc6fc151080 0x7fc6fc1566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:35.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.135+0000 7fc7030cf640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc6fc151460 0x7fc6fc1f2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:35.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.135+0000 7fc7030cf640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6fc0c4f60 con 0x7fc6fc0cd6f0 2023-11-27T18:43:35.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.135+0000 7fc7030cf640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6fc06d4f0 con 0x7fc6fc151080 2023-11-27T18:43:35.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.135+0000 7fc7030cf640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6fc0c4700 con 0x7fc6fc151460 2023-11-27T18:43:35.137 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.135+0000 7fc700e6b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc6fc0cd6f0 0x7fc6fc06cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:35.137 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.135+0000 7fc700e6b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc6fc0cd6f0 0x7fc6fc06cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:34794/0 (socket says 172.21.15.91:34794) 2023-11-27T18:43:35.137 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.135+0000 7fc700e6b640 1 -- 172.21.15.91:0/3180899254 learned_addr learned my addr 172.21.15.91:0/3180899254 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:35.137 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.135+0000 7fc6f3fff640 1 --2- 172.21.15.91:0/3180899254 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc6fc151080 0x7fc6fc1566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:35.139 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.135+0000 7fc70166c640 1 --2- 172.21.15.91:0/3180899254 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc6fc151460 0x7fc6fc1f2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:35.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.139+0000 7fc700e6b640 1 -- 172.21.15.91:0/3180899254 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc6fc151460 msgr2=0x7fc6fc1f2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:35.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.139+0000 7fc700e6b640 1 --2- 172.21.15.91:0/3180899254 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc6fc151460 0x7fc6fc1f2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:35.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.139+0000 7fc700e6b640 1 -- 172.21.15.91:0/3180899254 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc6fc151080 msgr2=0x7fc6fc1566b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:35.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.139+0000 7fc700e6b640 1 --2- 172.21.15.91:0/3180899254 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc6fc151080 0x7fc6fc1566b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:35.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.139+0000 7fc700e6b640 1 -- 172.21.15.91:0/3180899254 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f4009a70 con 0x7fc6fc0cd6f0 2023-11-27T18:43:35.143 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.143+0000 7fc700e6b640 1 --2- 172.21.15.91:0/3180899254 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc6fc0cd6f0 0x7fc6fc06cfb0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc6f800c4c0 tx=0x7fc6f8001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:35.148 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.147+0000 7fc6f17fa640 1 -- 172.21.15.91:0/3180899254 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f8003600 con 0x7fc6fc0cd6f0 2023-11-27T18:43:35.148 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.147+0000 7fc6f17fa640 1 -- 172.21.15.91:0/3180899254 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f8003780 con 0x7fc6fc0cd6f0 2023-11-27T18:43:35.148 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.147+0000 7fc6f17fa640 1 -- 172.21.15.91:0/3180899254 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f8003b30 con 0x7fc6fc0cd6f0 2023-11-27T18:43:35.149 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.147+0000 7fc7030cf640 1 -- 172.21.15.91:0/3180899254 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6fc0c4b90 con 0x7fc6fc0cd6f0 2023-11-27T18:43:35.149 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.147+0000 7fc7030cf640 1 -- 172.21.15.91:0/3180899254 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6fc0c5a10 con 0x7fc6fc0cd6f0 2023-11-27T18:43:35.149 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.147+0000 7fc7030cf640 1 -- 172.21.15.91:0/3180899254 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc6fc157ea0 con 0x7fc6fc0cd6f0 2023-11-27T18:43:35.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.167+0000 7fc6f17fa640 1 -- 172.21.15.91:0/3180899254 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fc6f8003c90 con 0x7fc6fc0cd6f0 2023-11-27T18:43:35.172 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.167+0000 7fc6f17fa640 1 --2- 172.21.15.91:0/3180899254 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fc6e8066870 0x7fc6e8068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:35.172 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.171+0000 7fc6f3fff640 1 --2- 172.21.15.91:0/3180899254 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fc6e8066870 0x7fc6e8068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:35.172 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.171+0000 7fc6f3fff640 1 --2- 172.21.15.91:0/3180899254 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fc6e8066870 0x7fc6e8068d30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc156ff0 tx=0x7fc6ec009040 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:35.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.171+0000 7fc6f17fa640 1 -- 172.21.15.91:0/3180899254 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc6f8054c70 con 0x7fc6fc0cd6f0 2023-11-27T18:43:35.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.171+0000 7fc6f17fa640 1 --2- 172.21.15.91:0/3180899254 >> [v2:172.21.15.91:6802/3776125919,v1:172.21.15.91:6803/3776125919] conn(0x7fc6e806fed0 0x7fc6e8072370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:35.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.171+0000 7fc6f17fa640 1 -- 172.21.15.91:0/3180899254 --> [v2:172.21.15.91:6802/3776125919,v1:172.21.15.91:6803/3776125919] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc6e8072a40 con 0x7fc6e806fed0 2023-11-27T18:43:35.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.171+0000 7fc70166c640 1 --2- 172.21.15.91:0/3180899254 >> [v2:172.21.15.91:6802/3776125919,v1:172.21.15.91:6803/3776125919] conn(0x7fc6e806fed0 0x7fc6e8072370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:35.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.171+0000 7fc70166c640 1 --2- 172.21.15.91:0/3180899254 >> [v2:172.21.15.91:6802/3776125919,v1:172.21.15.91:6803/3776125919] conn(0x7fc6e806fed0 0x7fc6e8072370 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:35.176 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.175+0000 7fc6f17fa640 1 -- 172.21.15.91:0/3180899254 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc6f8001150 con 0x7fc6fc0cd6f0 2023-11-27T18:43:35.176 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.175+0000 7fc6f17fa640 1 -- 172.21.15.91:0/3180899254 <== osd.2 v2:172.21.15.91:6802/3776125919 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fc6e8072a40 con 0x7fc6e806fed0 2023-11-27T18:43:35.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.187+0000 7fc7030cf640 1 -- 172.21.15.91:0/3180899254 --> [v2:172.21.15.91:6802/3776125919,v1:172.21.15.91:6803/3776125919] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc6fc157bc0 con 0x7fc6e806fed0 2023-11-27T18:43:35.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.187+0000 7fc6f17fa640 1 -- 172.21.15.91:0/3180899254 <== osd.2 v2:172.21.15.91:6802/3776125919 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fc6f40af6c0 con 0x7fc6e806fed0 2023-11-27T18:43:35.191 INFO:teuthology.orchestra.run.smithi091.stdout:{ 2023-11-27T18:43:35.191 INFO:teuthology.orchestra.run.smithi091.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-27T18:43:35.191 INFO:teuthology.orchestra.run.smithi091.stdout:} 2023-11-27T18:43:35.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.187+0000 7fc7030cf640 1 -- 172.21.15.91:0/3180899254 >> [v2:172.21.15.91:6802/3776125919,v1:172.21.15.91:6803/3776125919] conn(0x7fc6e806fed0 msgr2=0x7fc6e8072370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:35.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.187+0000 7fc7030cf640 1 --2- 172.21.15.91:0/3180899254 >> [v2:172.21.15.91:6802/3776125919,v1:172.21.15.91:6803/3776125919] conn(0x7fc6e806fed0 0x7fc6e8072370 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:35.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.187+0000 7fc7030cf640 1 -- 172.21.15.91:0/3180899254 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fc6e8066870 msgr2=0x7fc6e8068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:35.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.187+0000 7fc7030cf640 1 --2- 172.21.15.91:0/3180899254 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fc6e8066870 0x7fc6e8068d30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc156ff0 tx=0x7fc6ec009040 comp rx=0 tx=0).stop 2023-11-27T18:43:35.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.187+0000 7fc7030cf640 1 -- 172.21.15.91:0/3180899254 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc6fc0cd6f0 msgr2=0x7fc6fc06cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:35.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.187+0000 7fc7030cf640 1 --2- 172.21.15.91:0/3180899254 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc6fc0cd6f0 0x7fc6fc06cfb0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc6f800c4c0 tx=0x7fc6f8001e80 comp rx=0 tx=0).stop 2023-11-27T18:43:35.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.187+0000 7fc70166c640 1 -- 172.21.15.91:0/3180899254 reap_dead start 2023-11-27T18:43:35.193 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.187+0000 7fc7030cf640 1 -- 172.21.15.91:0/3180899254 shutdown_connections 2023-11-27T18:43:35.193 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.187+0000 7fc7030cf640 1 -- 172.21.15.91:0/3180899254 >> 172.21.15.91:0/3180899254 conn(0x7fc6fc06a520 msgr2=0x7fc6fc150860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:35.193 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.187+0000 7fc7030cf640 1 -- 172.21.15.91:0/3180899254 shutdown_connections 2023-11-27T18:43:35.193 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.187+0000 7fc7030cf640 1 -- 172.21.15.91:0/3180899254 wait complete. 2023-11-27T18:43:35.208 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-11-27T18:43:35.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.327+0000 7f5ccb5b9640 1 Processor -- start 2023-11-27T18:43:35.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.327+0000 7f5ccb5b9640 1 -- start start 2023-11-27T18:43:35.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.327+0000 7f5ccb5b9640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f5cc41539c0 0x7f5cc40700f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:35.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.327+0000 7f5ccb5b9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f5cc406ad20 0x7f5cc40cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:35.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.327+0000 7f5ccb5b9640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5cc40c2a80 0x7f5cc40cc050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:35.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.327+0000 7f5ccb5b9640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cc415d7b0 con 0x7f5cc406ad20 2023-11-27T18:43:35.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.327+0000 7f5ccb5b9640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cc40c1790 con 0x7f5cc41539c0 2023-11-27T18:43:35.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.327+0000 7f5ccb5b9640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc40707a0 con 0x7f5cc40c2a80 2023-11-27T18:43:35.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.327+0000 7f5cc8b54640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f5cc406ad20 0x7f5cc40cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:35.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.327+0000 7f5cc8b54640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f5cc406ad20 0x7f5cc40cbb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:34798/0 (socket says 172.21.15.91:34798) 2023-11-27T18:43:35.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.327+0000 7f5cc8b54640 1 -- 172.21.15.91:0/1972790596 learned_addr learned my addr 172.21.15.91:0/1972790596 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:35.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.327+0000 7f5cc9355640 1 --2- 172.21.15.91:0/1972790596 >> v2:172.21.15.94:3300/0 conn(0x7f5cc41539c0 0x7f5cc40700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:35.332 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.327+0000 7f5cc9b56640 1 --2- 172.21.15.91:0/1972790596 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5cc40c2a80 0x7f5cc40cc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:35.333 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.331+0000 7f5cc8b54640 1 -- 172.21.15.91:0/1972790596 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5cc40c2a80 msgr2=0x7f5cc40cc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:35.334 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.331+0000 7f5cc8b54640 1 --2- 172.21.15.91:0/1972790596 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5cc40c2a80 0x7f5cc40cc050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:35.334 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.331+0000 7f5cc8b54640 1 -- 172.21.15.91:0/1972790596 >> v2:172.21.15.94:3300/0 conn(0x7f5cc41539c0 msgr2=0x7f5cc40700f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:35.334 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.331+0000 7f5cc8b54640 1 --2- 172.21.15.91:0/1972790596 >> v2:172.21.15.94:3300/0 conn(0x7f5cc41539c0 0x7f5cc40700f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:35.334 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.331+0000 7f5cc8b54640 1 -- 172.21.15.91:0/1972790596 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc415cb30 con 0x7f5cc406ad20 2023-11-27T18:43:35.337 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.335+0000 7f5cc8b54640 1 --2- 172.21.15.91:0/1972790596 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5cc406ad20 0x7f5cc40cbb10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5cc406acb0 tx=0x7f5cbc01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8a0e8e7b5b5dc3b server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:35.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.339+0000 7f5cb7fff640 1 -- 172.21.15.91:0/1972790596 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cbc0a5790 con 0x7f5cc406ad20 2023-11-27T18:43:35.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.339+0000 7f5cb7fff640 1 -- 172.21.15.91:0/1972790596 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cbc0a58f0 con 0x7f5cc406ad20 2023-11-27T18:43:35.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.339+0000 7f5cb7fff640 1 -- 172.21.15.91:0/1972790596 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cbc0a5c80 con 0x7f5cc406ad20 2023-11-27T18:43:35.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.339+0000 7f5ccb5b9640 1 -- 172.21.15.91:0/1972790596 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5cc406ad20 msgr2=0x7f5cc40cbb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:35.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.339+0000 7f5ccb5b9640 1 --2- 172.21.15.91:0/1972790596 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5cc406ad20 0x7f5cc40cbb10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5cc406acb0 tx=0x7f5cbc01c910 comp rx=0 tx=0).stop 2023-11-27T18:43:35.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.339+0000 7f5ccb5b9640 1 -- 172.21.15.91:0/1972790596 shutdown_connections 2023-11-27T18:43:35.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.339+0000 7f5ccb5b9640 1 --2- 172.21.15.91:0/1972790596 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5cc40c2a80 0x7f5cc40cc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:35.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.339+0000 7f5ccb5b9640 1 --2- 172.21.15.91:0/1972790596 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5cc406ad20 0x7f5cc40cbb10 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:35.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.339+0000 7f5ccb5b9640 1 --2- 172.21.15.91:0/1972790596 >> v2:172.21.15.94:3300/0 conn(0x7f5cc41539c0 0x7f5cc40700f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:35.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.339+0000 7f5ccb5b9640 1 -- 172.21.15.91:0/1972790596 >> 172.21.15.91:0/1972790596 conn(0x7f5cc4071da0 msgr2=0x7f5cc40721b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:35.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.339+0000 7f5ccb5b9640 1 -- 172.21.15.91:0/1972790596 shutdown_connections 2023-11-27T18:43:35.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.339+0000 7f5ccb5b9640 1 -- 172.21.15.91:0/1972790596 wait complete. 2023-11-27T18:43:35.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.339+0000 7f5ccb5b9640 1 Processor -- start 2023-11-27T18:43:35.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.343+0000 7f5ccb5b9640 1 -- start start 2023-11-27T18:43:35.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.343+0000 7f5ccb5b9640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5cc406ad20 0x7f5cc414d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:35.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.343+0000 7f5ccb5b9640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5cc40c2a80 0x7f5cc415a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:35.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.343+0000 7f5ccb5b9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5cc41539c0 0x7f5cc41f58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:35.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.343+0000 7f5ccb5b9640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc415c870 con 0x7f5cc40c2a80 2023-11-27T18:43:35.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.343+0000 7f5ccb5b9640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc415c320 con 0x7f5cc41539c0 2023-11-27T18:43:35.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.343+0000 7f5ccb5b9640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc414a200 con 0x7f5cc406ad20 2023-11-27T18:43:35.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.343+0000 7f5cc8b54640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5cc40c2a80 0x7f5cc415a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:35.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.343+0000 7f5cc8b54640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5cc40c2a80 0x7f5cc415a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:34800/0 (socket says 172.21.15.91:34800) 2023-11-27T18:43:35.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.343+0000 7f5cc8b54640 1 -- 172.21.15.91:0/864793785 learned_addr learned my addr 172.21.15.91:0/864793785 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:35.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.343+0000 7f5cc9355640 1 --2- 172.21.15.91:0/864793785 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5cc406ad20 0x7f5cc414d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:35.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.343+0000 7f5cc9b56640 1 --2- 172.21.15.91:0/864793785 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5cc41539c0 0x7f5cc41f58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:35.349 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.347+0000 7f5cc8b54640 1 -- 172.21.15.91:0/864793785 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5cc406ad20 msgr2=0x7f5cc414d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:35.349 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.347+0000 7f5cc8b54640 1 --2- 172.21.15.91:0/864793785 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5cc406ad20 0x7f5cc414d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:35.349 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.347+0000 7f5cc8b54640 1 -- 172.21.15.91:0/864793785 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5cc41539c0 msgr2=0x7f5cc41f58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:35.349 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.347+0000 7f5cc8b54640 1 --2- 172.21.15.91:0/864793785 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5cc41539c0 0x7f5cc41f58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:35.349 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.347+0000 7f5cc8b54640 1 -- 172.21.15.91:0/864793785 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cbc009b30 con 0x7f5cc40c2a80 2023-11-27T18:43:35.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.347+0000 7f5cc8b54640 1 --2- 172.21.15.91:0/864793785 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5cc40c2a80 0x7f5cc415a8b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc01afc0 tx=0x7f5cbc0196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:35.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.355+0000 7f5cb5ffb640 1 -- 172.21.15.91:0/864793785 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cbc0b8670 con 0x7f5cc40c2a80 2023-11-27T18:43:35.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.355+0000 7f5cb5ffb640 1 -- 172.21.15.91:0/864793785 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cbc0b87f0 con 0x7f5cc40c2a80 2023-11-27T18:43:35.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.355+0000 7f5ccb5b9640 1 -- 172.21.15.91:0/864793785 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cc41f6390 con 0x7f5cc40c2a80 2023-11-27T18:43:35.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.355+0000 7f5cb5ffb640 1 -- 172.21.15.91:0/864793785 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cbc0b8ba0 con 0x7f5cc40c2a80 2023-11-27T18:43:35.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.355+0000 7f5ccb5b9640 1 -- 172.21.15.91:0/864793785 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cc4149f20 con 0x7f5cc40c2a80 2023-11-27T18:43:35.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.355+0000 7f5ccb5b9640 1 -- 172.21.15.91:0/864793785 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cc4149d80 con 0x7f5cc40c2a80 2023-11-27T18:43:35.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.635+0000 7f5cb5ffb640 1 -- 172.21.15.91:0/864793785 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f5cbc0b8d00 con 0x7f5cc40c2a80 2023-11-27T18:43:35.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.639+0000 7f5cb5ffb640 1 --2- 172.21.15.91:0/864793785 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f5ca8066840 0x7f5ca8068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:35.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.639+0000 7f5cc9355640 1 --2- 172.21.15.91:0/864793785 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f5ca8066840 0x7f5ca8068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:35.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.639+0000 7f5cc9355640 1 --2- 172.21.15.91:0/864793785 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f5ca8066840 0x7f5ca8068d00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5cc00079c0 tx=0x7f5cc0008040 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:35.677 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.675+0000 7f5cb5ffb640 1 -- 172.21.15.91:0/864793785 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5cbc0cbe30 con 0x7f5cc40c2a80 2023-11-27T18:43:35.677 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.675+0000 7f5cb5ffb640 1 -- 172.21.15.91:0/864793785 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f5cbc0ecbf0 con 0x7f5cc40c2a80 2023-11-27T18:43:35.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.843+0000 7f5ccb5b9640 1 -- 172.21.15.91:0/864793785 --> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f5cc4159b00 con 0x7f5ca8066840 2023-11-27T18:43:35.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.843+0000 7f5cb5ffb640 1 -- 172.21.15.91:0/864793785 <== mgr.4136 v2:172.21.15.91:6800/2814827118 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5cc4159b00 con 0x7f5ca8066840 2023-11-27T18:43:35.848 INFO:teuthology.orchestra.run.smithi091.stderr:instructed osd(s) 2 to deep-scrub 2023-11-27T18:43:35.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.847+0000 7f5ccb5b9640 1 -- 172.21.15.91:0/864793785 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f5ca8066840 msgr2=0x7f5ca8068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:35.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.847+0000 7f5ccb5b9640 1 --2- 172.21.15.91:0/864793785 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f5ca8066840 0x7f5ca8068d00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5cc00079c0 tx=0x7f5cc0008040 comp rx=0 tx=0).stop 2023-11-27T18:43:35.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.847+0000 7f5ccb5b9640 1 -- 172.21.15.91:0/864793785 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5cc40c2a80 msgr2=0x7f5cc415a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:35.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.847+0000 7f5ccb5b9640 1 --2- 172.21.15.91:0/864793785 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5cc40c2a80 0x7f5cc415a8b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc01afc0 tx=0x7f5cbc0196b0 comp rx=0 tx=0).stop 2023-11-27T18:43:35.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.847+0000 7f5ccb5b9640 1 -- 172.21.15.91:0/864793785 shutdown_connections 2023-11-27T18:43:35.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.847+0000 7f5ccb5b9640 1 --2- 172.21.15.91:0/864793785 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f5ca8066840 0x7f5ca8068d00 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:35.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.847+0000 7f5ccb5b9640 1 --2- 172.21.15.91:0/864793785 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5cc41539c0 0x7f5cc41f58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:35.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.847+0000 7f5ccb5b9640 1 --2- 172.21.15.91:0/864793785 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5cc40c2a80 0x7f5cc415a8b0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:35.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.847+0000 7f5ccb5b9640 1 --2- 172.21.15.91:0/864793785 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5cc406ad20 0x7f5cc414d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:35.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.847+0000 7f5ccb5b9640 1 -- 172.21.15.91:0/864793785 >> 172.21.15.91:0/864793785 conn(0x7f5cc4071da0 msgr2=0x7f5cc4072180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:35.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.847+0000 7f5ccb5b9640 1 -- 172.21.15.91:0/864793785 shutdown_connections 2023-11-27T18:43:35.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.847+0000 7f5ccb5b9640 1 -- 172.21.15.91:0/864793785 wait complete. 2023-11-27T18:43:35.867 INFO:tasks.ceph:Scrubbing osd.3 2023-11-27T18:43:35.867 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-11-27T18:43:35.993 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.991+0000 7f480ff2c640 1 Processor -- start 2023-11-27T18:43:35.994 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.991+0000 7f480ff2c640 1 -- start start 2023-11-27T18:43:35.994 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.991+0000 7f480ff2c640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4808151390 0x7f480806a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:35.994 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.991+0000 7f480ff2c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f480806e320 0x7f4808071130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:35.994 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.991+0000 7f480ff2c640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f480806aa60 con 0x7f4808071670 2023-11-27T18:43:35.995 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.991+0000 7f480ff2c640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f480806ad10 con 0x7f480806e320 2023-11-27T18:43:35.995 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.991+0000 7f480ff2c640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f480815a820 con 0x7f4808151390 2023-11-27T18:43:35.996 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.995+0000 7f480d4c7640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f480806e320 0x7f4808071130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:35.996 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.995+0000 7f480dcc8640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4808151390 0x7f480806a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:35.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.995+0000 7f480d4c7640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f480806e320 0x7f4808071130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.91:58612/0 (socket says 172.21.15.91:58612) 2023-11-27T18:43:35.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:35.995+0000 7f480d4c7640 1 -- 172.21.15.91:0/1532972892 learned_addr learned my addr 172.21.15.91:0/1532972892 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:36.004 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.003+0000 7f480dcc8640 1 -- 172.21.15.91:0/1532972892 >> v2:172.21.15.94:3300/0 conn(0x7f480806e320 msgr2=0x7f4808071130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:36.004 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.003+0000 7f480dcc8640 1 --2- 172.21.15.91:0/1532972892 >> v2:172.21.15.94:3300/0 conn(0x7f480806e320 0x7f4808071130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:36.004 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.003+0000 7f480dcc8640 1 -- 172.21.15.91:0/1532972892 >> v1:172.21.15.94:6789/0 conn(0x7f4808071670 legacy=0x7f48081574e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:36.004 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.003+0000 7f480dcc8640 1 -- 172.21.15.91:0/1532972892 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f480815ab00 con 0x7f4808151390 2023-11-27T18:43:36.011 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.007+0000 7f480dcc8640 1 --2- 172.21.15.91:0/1532972892 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4808151390 0x7f480806a520 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f47f80097c0 tx=0x7f47f801ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c416597c1e494fc server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:36.022 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.019+0000 7f480ccc6640 1 -- 172.21.15.91:0/1532972892 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f80a8970 con 0x7f4808151390 2023-11-27T18:43:36.022 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.019+0000 7f480ccc6640 1 -- 172.21.15.91:0/1532972892 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47f80a8ad0 con 0x7f4808151390 2023-11-27T18:43:36.022 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.019+0000 7f480ccc6640 1 -- 172.21.15.91:0/1532972892 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f80a8e60 con 0x7f4808151390 2023-11-27T18:43:36.023 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.019+0000 7f480ff2c640 1 -- 172.21.15.91:0/1532972892 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4808151390 msgr2=0x7f480806a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:36.023 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.019+0000 7f480ff2c640 1 --2- 172.21.15.91:0/1532972892 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4808151390 0x7f480806a520 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f47f80097c0 tx=0x7f47f801ec70 comp rx=0 tx=0).stop 2023-11-27T18:43:36.023 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.019+0000 7f480ff2c640 1 -- 172.21.15.91:0/1532972892 shutdown_connections 2023-11-27T18:43:36.023 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.019+0000 7f480ff2c640 1 --2- 172.21.15.91:0/1532972892 >> v2:172.21.15.94:3300/0 conn(0x7f480806e320 0x7f4808071130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:36.023 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.019+0000 7f480ff2c640 1 --2- 172.21.15.91:0/1532972892 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4808151390 0x7f480806a520 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:36.023 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.019+0000 7f480ff2c640 1 -- 172.21.15.91:0/1532972892 >> 172.21.15.91:0/1532972892 conn(0x7f480806f2d0 msgr2=0x7f48080cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:36.023 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.019+0000 7f480ff2c640 1 -- 172.21.15.91:0/1532972892 shutdown_connections 2023-11-27T18:43:36.023 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.019+0000 7f480ff2c640 1 -- 172.21.15.91:0/1532972892 wait complete. 2023-11-27T18:43:36.024 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.023+0000 7f480ff2c640 1 Processor -- start 2023-11-27T18:43:36.024 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.023+0000 7f480ff2c640 1 -- start start 2023-11-27T18:43:36.025 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.023+0000 7f480ff2c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f480806e320 0x7f4808138e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:36.025 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.023+0000 7f480ff2c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4808071670 0x7f4808159f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:36.025 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.023+0000 7f480ff2c640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4808151390 0x7f480813df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:36.025 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.023+0000 7f480ff2c640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48081ef8c0 con 0x7f480806e320 2023-11-27T18:43:36.025 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.023+0000 7f480ff2c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48081efdb0 con 0x7f4808071670 2023-11-27T18:43:36.025 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.023+0000 7f480ff2c640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48081594f0 con 0x7f4808151390 2023-11-27T18:43:36.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.023+0000 7f480dcc8640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f480806e320 0x7f4808138e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:36.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.023+0000 7f480dcc8640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f480806e320 0x7f4808138e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40202/0 (socket says 172.21.15.91:40202) 2023-11-27T18:43:36.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.023+0000 7f480dcc8640 1 -- 172.21.15.91:0/3670255524 learned_addr learned my addr 172.21.15.91:0/3670255524 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:36.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.023+0000 7f480d4c7640 1 --2- 172.21.15.91:0/3670255524 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4808071670 0x7f4808159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:36.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.027+0000 7f480e4c9640 1 --2- 172.21.15.91:0/3670255524 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4808151390 0x7f480813df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:36.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.027+0000 7f480dcc8640 1 -- 172.21.15.91:0/3670255524 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4808151390 msgr2=0x7f480813df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:36.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.027+0000 7f480dcc8640 1 --2- 172.21.15.91:0/3670255524 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4808151390 0x7f480813df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:36.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.027+0000 7f480dcc8640 1 -- 172.21.15.91:0/3670255524 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4808071670 msgr2=0x7f4808159f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:36.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.027+0000 7f480dcc8640 1 --2- 172.21.15.91:0/3670255524 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4808071670 0x7f4808159f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:36.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.027+0000 7f480dcc8640 1 -- 172.21.15.91:0/3670255524 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f8009420 con 0x7f480806e320 2023-11-27T18:43:36.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.031+0000 7f480dcc8640 1 --2- 172.21.15.91:0/3670255524 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f480806e320 0x7f4808138e30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f47f801b880 tx=0x7f47f801ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:36.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.035+0000 7f47fe7fc640 1 -- 172.21.15.91:0/3670255524 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f80b1dc0 con 0x7f480806e320 2023-11-27T18:43:36.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.035+0000 7f47fe7fc640 1 -- 172.21.15.91:0/3670255524 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47f80b9410 con 0x7f480806e320 2023-11-27T18:43:36.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.035+0000 7f47fe7fc640 1 -- 172.21.15.91:0/3670255524 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f80b97c0 con 0x7f480806e320 2023-11-27T18:43:36.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.035+0000 7f480ff2c640 1 -- 172.21.15.91:0/3670255524 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48081efad0 con 0x7f480806e320 2023-11-27T18:43:36.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.035+0000 7f480ff2c640 1 -- 172.21.15.91:0/3670255524 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4808159a70 con 0x7f480806e320 2023-11-27T18:43:36.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.035+0000 7f480ff2c640 1 -- 172.21.15.91:0/3670255524 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f480815b3a0 con 0x7f480806e320 2023-11-27T18:43:36.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.055+0000 7f47fe7fc640 1 -- 172.21.15.91:0/3670255524 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f47f80b7040 con 0x7f480806e320 2023-11-27T18:43:36.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.055+0000 7f47fe7fc640 1 --2- 172.21.15.91:0/3670255524 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f47ec0667f0 0x7f47ec068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:36.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.055+0000 7f480d4c7640 1 --2- 172.21.15.91:0/3670255524 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f47ec0667f0 0x7f47ec068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:36.058 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.055+0000 7f480d4c7640 1 --2- 172.21.15.91:0/3670255524 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f47ec0667f0 0x7f47ec068cb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4808154d00 tx=0x7f4804009240 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:36.061 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.059+0000 7f47fe7fc640 1 -- 172.21.15.91:0/3670255524 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f47f80f3ba0 con 0x7f480806e320 2023-11-27T18:43:36.061 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.059+0000 7f47fe7fc640 1 --2- 172.21.15.91:0/3670255524 >> [v2:172.21.15.91:6818/1297704794,v1:172.21.15.91:6819/1297704794] conn(0x7f47ec06fe50 0x7f47ec0722f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:36.061 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.059+0000 7f47fe7fc640 1 -- 172.21.15.91:0/3670255524 --> [v2:172.21.15.91:6818/1297704794,v1:172.21.15.91:6819/1297704794] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f47ec0729c0 con 0x7f47ec06fe50 2023-11-27T18:43:36.062 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.059+0000 7f47fe7fc640 1 -- 172.21.15.91:0/3670255524 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47f80ef7e0 con 0x7f480806e320 2023-11-27T18:43:36.062 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.059+0000 7f480e4c9640 1 --2- 172.21.15.91:0/3670255524 >> [v2:172.21.15.91:6818/1297704794,v1:172.21.15.91:6819/1297704794] conn(0x7f47ec06fe50 0x7f47ec0722f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:36.062 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.059+0000 7f480e4c9640 1 --2- 172.21.15.91:0/3670255524 >> [v2:172.21.15.91:6818/1297704794,v1:172.21.15.91:6819/1297704794] conn(0x7f47ec06fe50 0x7f47ec0722f0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:36.062 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.059+0000 7f47fe7fc640 1 -- 172.21.15.91:0/3670255524 <== osd.3 v2:172.21.15.91:6818/1297704794 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f47ec0729c0 con 0x7f47ec06fe50 2023-11-27T18:43:36.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.079+0000 7f480ff2c640 1 -- 172.21.15.91:0/3670255524 --> [v2:172.21.15.91:6818/1297704794,v1:172.21.15.91:6819/1297704794] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f48080c1b40 con 0x7f47ec06fe50 2023-11-27T18:43:36.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.079+0000 7f47fe7fc640 1 -- 172.21.15.91:0/3670255524 <== osd.3 v2:172.21.15.91:6818/1297704794 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f48080c1b40 con 0x7f47ec06fe50 2023-11-27T18:43:36.080 INFO:teuthology.orchestra.run.smithi091.stdout:{ 2023-11-27T18:43:36.080 INFO:teuthology.orchestra.run.smithi091.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-27T18:43:36.080 INFO:teuthology.orchestra.run.smithi091.stdout:} 2023-11-27T18:43:36.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.079+0000 7f480ff2c640 1 -- 172.21.15.91:0/3670255524 >> [v2:172.21.15.91:6818/1297704794,v1:172.21.15.91:6819/1297704794] conn(0x7f47ec06fe50 msgr2=0x7f47ec0722f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:36.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.079+0000 7f480ff2c640 1 --2- 172.21.15.91:0/3670255524 >> [v2:172.21.15.91:6818/1297704794,v1:172.21.15.91:6819/1297704794] conn(0x7f47ec06fe50 0x7f47ec0722f0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:36.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.079+0000 7f480ff2c640 1 -- 172.21.15.91:0/3670255524 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f47ec0667f0 msgr2=0x7f47ec068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:36.082 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.079+0000 7f480ff2c640 1 --2- 172.21.15.91:0/3670255524 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f47ec0667f0 0x7f47ec068cb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4808154d00 tx=0x7f4804009240 comp rx=0 tx=0).stop 2023-11-27T18:43:36.082 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.079+0000 7f480ff2c640 1 -- 172.21.15.91:0/3670255524 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f480806e320 msgr2=0x7f4808138e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:36.082 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.079+0000 7f480ff2c640 1 --2- 172.21.15.91:0/3670255524 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f480806e320 0x7f4808138e30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f47f801b880 tx=0x7f47f801ba10 comp rx=0 tx=0).stop 2023-11-27T18:43:36.083 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.079+0000 7f480e4c9640 1 -- 172.21.15.91:0/3670255524 reap_dead start 2023-11-27T18:43:36.083 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.079+0000 7f480ff2c640 1 -- 172.21.15.91:0/3670255524 shutdown_connections 2023-11-27T18:43:36.083 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.079+0000 7f480ff2c640 1 -- 172.21.15.91:0/3670255524 >> 172.21.15.91:0/3670255524 conn(0x7f480806f2d0 msgr2=0x7f4808073720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:36.083 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.079+0000 7f480ff2c640 1 -- 172.21.15.91:0/3670255524 shutdown_connections 2023-11-27T18:43:36.083 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.079+0000 7f480ff2c640 1 -- 172.21.15.91:0/3670255524 wait complete. 2023-11-27T18:43:36.100 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-11-27T18:43:36.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.219+0000 7f73db359640 1 Processor -- start 2023-11-27T18:43:36.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.219+0000 7f73db359640 1 -- start start 2023-11-27T18:43:36.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.219+0000 7f73db359640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f73d41505d0 0x7f73d40c18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:36.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.219+0000 7f73db359640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f73d4156700 0x7f73d4156b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:36.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.219+0000 7f73db359640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73d4157090 con 0x7f73d4070060 2023-11-27T18:43:36.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.219+0000 7f73db359640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73d4159a20 con 0x7f73d41505d0 2023-11-27T18:43:36.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.219+0000 7f73db359640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73d4159d00 con 0x7f73d4156700 2023-11-27T18:43:36.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.223+0000 7f73d98f6640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f73d4156700 0x7f73d4156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:36.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.223+0000 7f73d98f6640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f73d4156700 0x7f73d4156b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.91:40132/0 (socket says 172.21.15.91:40132) 2023-11-27T18:43:36.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.223+0000 7f73d98f6640 1 -- 172.21.15.91:0/2946338309 learned_addr learned my addr 172.21.15.91:0/2946338309 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:36.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.227+0000 7f73d98f6640 1 -- 172.21.15.91:0/2946338309 >> v2:172.21.15.91:3300/0 conn(0x7f73d41505d0 msgr2=0x7f73d40c18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:36.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.227+0000 7f73d98f6640 1 --2- 172.21.15.91:0/2946338309 >> v2:172.21.15.91:3300/0 conn(0x7f73d41505d0 0x7f73d40c18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:36.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.227+0000 7f73d98f6640 1 -- 172.21.15.91:0/2946338309 >> v1:172.21.15.94:6789/0 conn(0x7f73d4070060 legacy=0x7f73d40cbb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:36.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.227+0000 7f73d98f6640 1 -- 172.21.15.91:0/2946338309 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d4159fe0 con 0x7f73d4156700 2023-11-27T18:43:36.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.235+0000 7f73d98f6640 1 --2- 172.21.15.91:0/2946338309 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f73d4156700 0x7f73d4156b50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f73cc009e50 tx=0x7f73cc01f1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d50c6f27f27d0496 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:36.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.375+0000 7f73cbfff640 1 -- 172.21.15.91:0/2946338309 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73cc0af400 con 0x7f73d4156700 2023-11-27T18:43:36.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.375+0000 7f73cbfff640 1 -- 172.21.15.91:0/2946338309 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73cc0ab050 con 0x7f73d4156700 2023-11-27T18:43:36.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.375+0000 7f73cbfff640 1 -- 172.21.15.91:0/2946338309 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73cc0af780 con 0x7f73d4156700 2023-11-27T18:43:36.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.379+0000 7f73db359640 1 -- 172.21.15.91:0/2946338309 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f73d4156700 msgr2=0x7f73d4156b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:36.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.379+0000 7f73db359640 1 --2- 172.21.15.91:0/2946338309 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f73d4156700 0x7f73d4156b50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f73cc009e50 tx=0x7f73cc01f1c0 comp rx=0 tx=0).stop 2023-11-27T18:43:36.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.379+0000 7f73db359640 1 -- 172.21.15.91:0/2946338309 shutdown_connections 2023-11-27T18:43:36.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.379+0000 7f73db359640 1 --2- 172.21.15.91:0/2946338309 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f73d4156700 0x7f73d4156b50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:36.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.379+0000 7f73db359640 1 --2- 172.21.15.91:0/2946338309 >> v2:172.21.15.91:3300/0 conn(0x7f73d41505d0 0x7f73d40c18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:36.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.379+0000 7f73db359640 1 -- 172.21.15.91:0/2946338309 >> 172.21.15.91:0/2946338309 conn(0x7f73d40669c0 msgr2=0x7f73d4071e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:36.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.379+0000 7f73db359640 1 -- 172.21.15.91:0/2946338309 shutdown_connections 2023-11-27T18:43:36.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.379+0000 7f73db359640 1 -- 172.21.15.91:0/2946338309 wait complete. 2023-11-27T18:43:36.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.379+0000 7f73db359640 1 Processor -- start 2023-11-27T18:43:36.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.379+0000 7f73db359640 1 -- start start 2023-11-27T18:43:36.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.383+0000 7f73db359640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f73d4070060 0x7f73d406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:36.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.383+0000 7f73db359640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f73d4156700 0x7f73d41ef010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:36.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.383+0000 7f73db359640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f73d4159000 0x7f73d414a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:36.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.383+0000 7f73db359640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d4157290 con 0x7f73d4156700 2023-11-27T18:43:36.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.383+0000 7f73db359640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d4157510 con 0x7f73d4070060 2023-11-27T18:43:36.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.383+0000 7f73db359640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73d41577f0 con 0x7f73d4159000 2023-11-27T18:43:36.387 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.383+0000 7f73d88f4640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f73d4156700 0x7f73d41ef010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:36.387 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.383+0000 7f73d88f4640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f73d4156700 0x7f73d41ef010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40216/0 (socket says 172.21.15.91:40216) 2023-11-27T18:43:36.387 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.383+0000 7f73d98f6640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f73d4159000 0x7f73d414a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:36.387 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.383+0000 7f73d88f4640 1 -- 172.21.15.91:0/1089058936 learned_addr learned my addr 172.21.15.91:0/1089058936 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:36.387 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.383+0000 7f73d90f5640 1 --2- 172.21.15.91:0/1089058936 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f73d4070060 0x7f73d406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:36.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.395+0000 7f73d88f4640 1 -- 172.21.15.91:0/1089058936 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f73d4159000 msgr2=0x7f73d414a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:36.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.395+0000 7f73d88f4640 1 --2- 172.21.15.91:0/1089058936 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f73d4159000 0x7f73d414a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:36.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.395+0000 7f73d88f4640 1 -- 172.21.15.91:0/1089058936 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f73d4070060 msgr2=0x7f73d406bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:36.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.395+0000 7f73d88f4640 1 --2- 172.21.15.91:0/1089058936 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f73d4070060 0x7f73d406bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:36.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.395+0000 7f73d88f4640 1 -- 172.21.15.91:0/1089058936 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73cc009b30 con 0x7f73d4156700 2023-11-27T18:43:36.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.399+0000 7f73d88f4640 1 --2- 172.21.15.91:0/1089058936 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f73d4156700 0x7f73d41ef010 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f73c400c490 tx=0x7f73c4001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:36.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.407+0000 7f73c9ffb640 1 -- 172.21.15.91:0/1089058936 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c4003600 con 0x7f73d4156700 2023-11-27T18:43:36.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.407+0000 7f73c9ffb640 1 -- 172.21.15.91:0/1089058936 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73c4003780 con 0x7f73d4156700 2023-11-27T18:43:36.409 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.407+0000 7f73c9ffb640 1 -- 172.21.15.91:0/1089058936 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c4003b70 con 0x7f73d4156700 2023-11-27T18:43:36.409 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.407+0000 7f73db359640 1 -- 172.21.15.91:0/1089058936 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73d406aca0 con 0x7f73d4156700 2023-11-27T18:43:36.409 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.407+0000 7f73db359640 1 -- 172.21.15.91:0/1089058936 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73d406b260 con 0x7f73d4156700 2023-11-27T18:43:36.409 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.407+0000 7f73db359640 1 -- 172.21.15.91:0/1089058936 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73d406ab00 con 0x7f73d4156700 2023-11-27T18:43:36.692 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.691+0000 7f73c9ffb640 1 -- 172.21.15.91:0/1089058936 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f73c4003cd0 con 0x7f73d4156700 2023-11-27T18:43:36.693 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.691+0000 7f73c9ffb640 1 --2- 172.21.15.91:0/1089058936 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f73b8066840 0x7f73b8068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:36.693 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.691+0000 7f73d90f5640 1 --2- 172.21.15.91:0/1089058936 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f73b8066840 0x7f73b8068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:36.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.691+0000 7f73d90f5640 1 --2- 172.21.15.91:0/1089058936 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f73b8066840 0x7f73b8068d00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f73d0009990 tx=0x7f73d0009110 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:36.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.727+0000 7f73c9ffb640 1 -- 172.21.15.91:0/1089058936 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f73c40549c0 con 0x7f73d4156700 2023-11-27T18:43:36.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.727+0000 7f73c9ffb640 1 -- 172.21.15.91:0/1089058936 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f73c4050d00 con 0x7f73d4156700 2023-11-27T18:43:36.901 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.899+0000 7f73db359640 1 -- 172.21.15.91:0/1089058936 --> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f73d41561e0 con 0x7f73b8066840 2023-11-27T18:43:36.901 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.899+0000 7f73c9ffb640 1 -- 172.21.15.91:0/1089058936 <== mgr.4136 v2:172.21.15.91:6800/2814827118 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f73d000e850 con 0x7f73b8066840 2023-11-27T18:43:36.901 INFO:teuthology.orchestra.run.smithi091.stderr:instructed osd(s) 3 to deep-scrub 2023-11-27T18:43:36.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.899+0000 7f73db359640 1 -- 172.21.15.91:0/1089058936 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f73b8066840 msgr2=0x7f73b8068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:36.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.899+0000 7f73db359640 1 --2- 172.21.15.91:0/1089058936 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f73b8066840 0x7f73b8068d00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f73d0009990 tx=0x7f73d0009110 comp rx=0 tx=0).stop 2023-11-27T18:43:36.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.899+0000 7f73db359640 1 -- 172.21.15.91:0/1089058936 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f73d4156700 msgr2=0x7f73d41ef010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:36.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.899+0000 7f73db359640 1 --2- 172.21.15.91:0/1089058936 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f73d4156700 0x7f73d41ef010 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f73c400c490 tx=0x7f73c4001e80 comp rx=0 tx=0).stop 2023-11-27T18:43:36.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.899+0000 7f73db359640 1 -- 172.21.15.91:0/1089058936 shutdown_connections 2023-11-27T18:43:36.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.899+0000 7f73db359640 1 --2- 172.21.15.91:0/1089058936 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f73b8066840 0x7f73b8068d00 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:36.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.899+0000 7f73db359640 1 --2- 172.21.15.91:0/1089058936 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f73d4159000 0x7f73d414a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:36.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.899+0000 7f73db359640 1 --2- 172.21.15.91:0/1089058936 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f73d4156700 0x7f73d41ef010 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:36.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.899+0000 7f73db359640 1 --2- 172.21.15.91:0/1089058936 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f73d4070060 0x7f73d406bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:36.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.899+0000 7f73db359640 1 -- 172.21.15.91:0/1089058936 >> 172.21.15.91:0/1089058936 conn(0x7f73d40669c0 msgr2=0x7f73d414f730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:36.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.899+0000 7f73db359640 1 -- 172.21.15.91:0/1089058936 shutdown_connections 2023-11-27T18:43:36.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:36.899+0000 7f73db359640 1 -- 172.21.15.91:0/1089058936 wait complete. 2023-11-27T18:43:36.921 INFO:tasks.ceph:Scrubbing osd.4 2023-11-27T18:43:36.921 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-11-27T18:43:37.045 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.043+0000 7fae0fb2f640 1 Processor -- start 2023-11-27T18:43:37.045 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.043+0000 7fae0fb2f640 1 -- start start 2023-11-27T18:43:37.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.043+0000 7fae0fb2f640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fae08153640 0x7fae080c5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:37.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.043+0000 7fae0fb2f640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae08153a20 0x7fae080c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:37.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.043+0000 7fae0fb2f640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fae080c5650 0x7fae080ca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:37.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.043+0000 7fae0fb2f640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae080caed0 con 0x7fae080c5650 2023-11-27T18:43:37.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.043+0000 7fae0fb2f640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae0815d630 con 0x7fae08153640 2023-11-27T18:43:37.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.043+0000 7fae0fb2f640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae0815d910 con 0x7fae08153a20 2023-11-27T18:43:37.047 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.043+0000 7fae0e0cc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fae080c5650 0x7fae080ca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:37.047 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.043+0000 7fae0e0cc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fae080c5650 0x7fae080ca0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40226/0 (socket says 172.21.15.91:40226) 2023-11-27T18:43:37.047 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.043+0000 7fae0e0cc640 1 -- 172.21.15.91:0/798668534 learned_addr learned my addr 172.21.15.91:0/798668534 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:37.048 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.047+0000 7fae0d8cb640 1 --2- 172.21.15.91:0/798668534 >> v2:172.21.15.94:3300/0 conn(0x7fae08153640 0x7fae080c5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:37.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.047+0000 7fae0e0cc640 1 -- 172.21.15.91:0/798668534 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae08153a20 msgr2=0x7fae080c9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:37.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.047+0000 7fae0e0cc640 1 --2- 172.21.15.91:0/798668534 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae08153a20 0x7fae080c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:37.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.047+0000 7fae0e0cc640 1 -- 172.21.15.91:0/798668534 >> v2:172.21.15.94:3300/0 conn(0x7fae08153640 msgr2=0x7fae080c5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:37.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.047+0000 7fae0e0cc640 1 --2- 172.21.15.91:0/798668534 >> v2:172.21.15.94:3300/0 conn(0x7fae08153640 0x7fae080c5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:37.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.047+0000 7fae0e0cc640 1 -- 172.21.15.91:0/798668534 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae080c4650 con 0x7fae080c5650 2023-11-27T18:43:37.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.051+0000 7fae0e0cc640 1 --2- 172.21.15.91:0/798668534 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fae080c5650 0x7fae080ca0c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fae080cfdb0 tx=0x7fae0001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feeb3cf710361daa server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:37.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.051+0000 7fae0c8c9640 1 -- 172.21.15.91:0/798668534 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae000a56b0 con 0x7fae080c5650 2023-11-27T18:43:37.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.055+0000 7fae0c8c9640 1 -- 172.21.15.91:0/798668534 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae000a5810 con 0x7fae080c5650 2023-11-27T18:43:37.058 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.055+0000 7fae0c8c9640 1 -- 172.21.15.91:0/798668534 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae000a5ba0 con 0x7fae080c5650 2023-11-27T18:43:37.059 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.055+0000 7fae0fb2f640 1 -- 172.21.15.91:0/798668534 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fae080c5650 msgr2=0x7fae080ca0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:37.059 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.055+0000 7fae0fb2f640 1 --2- 172.21.15.91:0/798668534 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fae080c5650 0x7fae080ca0c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fae080cfdb0 tx=0x7fae0001c940 comp rx=0 tx=0).stop 2023-11-27T18:43:37.059 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.055+0000 7fae0fb2f640 1 -- 172.21.15.91:0/798668534 shutdown_connections 2023-11-27T18:43:37.059 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.055+0000 7fae0fb2f640 1 --2- 172.21.15.91:0/798668534 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fae080c5650 0x7fae080ca0c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:37.059 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.055+0000 7fae0fb2f640 1 --2- 172.21.15.91:0/798668534 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae08153a20 0x7fae080c9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:37.059 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.055+0000 7fae0fb2f640 1 --2- 172.21.15.91:0/798668534 >> v2:172.21.15.94:3300/0 conn(0x7fae08153640 0x7fae080c5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:37.059 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.055+0000 7fae0fb2f640 1 -- 172.21.15.91:0/798668534 >> 172.21.15.91:0/798668534 conn(0x7fae0806ba30 msgr2=0x7fae0806be40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:37.059 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.055+0000 7fae0fb2f640 1 -- 172.21.15.91:0/798668534 shutdown_connections 2023-11-27T18:43:37.059 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.055+0000 7fae0fb2f640 1 -- 172.21.15.91:0/798668534 wait complete. 2023-11-27T18:43:37.060 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.055+0000 7fae0fb2f640 1 Processor -- start 2023-11-27T18:43:37.060 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.055+0000 7fae0fb2f640 1 -- start start 2023-11-27T18:43:37.060 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.059+0000 7fae0fb2f640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae080c5650 0x7fae081510f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:37.060 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.059+0000 7fae0fb2f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fae08153640 0x7fae080c62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:37.060 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.059+0000 7fae0fb2f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fae08153a20 0x7fae080c7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:37.061 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.059+0000 7fae0fb2f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae080b48a0 con 0x7fae08153640 2023-11-27T18:43:37.061 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.059+0000 7fae0fb2f640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae080c88b0 con 0x7fae08153a20 2023-11-27T18:43:37.061 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.059+0000 7fae0fb2f640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae080b4370 con 0x7fae080c5650 2023-11-27T18:43:37.061 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.059+0000 7fae0d0ca640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fae08153640 0x7fae080c62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:37.061 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.059+0000 7fae0d0ca640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fae08153640 0x7fae080c62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40242/0 (socket says 172.21.15.91:40242) 2023-11-27T18:43:37.062 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.059+0000 7fae0d0ca640 1 -- 172.21.15.91:0/294711348 learned_addr learned my addr 172.21.15.91:0/294711348 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:37.062 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.059+0000 7fae0e0cc640 1 --2- 172.21.15.91:0/294711348 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fae08153a20 0x7fae080c7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:37.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.063+0000 7fae0d0ca640 1 -- 172.21.15.91:0/294711348 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae080c5650 msgr2=0x7fae081510f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:37.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.063+0000 7fae0d0ca640 1 --2- 172.21.15.91:0/294711348 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae080c5650 0x7fae081510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:37.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.063+0000 7fae0d0ca640 1 -- 172.21.15.91:0/294711348 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fae08153a20 msgr2=0x7fae080c7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:37.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.063+0000 7fae0d0ca640 1 --2- 172.21.15.91:0/294711348 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fae08153a20 0x7fae080c7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:37.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.063+0000 7fae0d0ca640 1 -- 172.21.15.91:0/294711348 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae00009b30 con 0x7fae08153640 2023-11-27T18:43:37.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.063+0000 7fae0d0ca640 1 --2- 172.21.15.91:0/294711348 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fae08153640 0x7fae080c62a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fadfc00b420 tx=0x7fadfc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:37.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.231+0000 7fadfa7fc640 1 -- 172.21.15.91:0/294711348 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadfc011830 con 0x7fae08153640 2023-11-27T18:43:37.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.231+0000 7fadfa7fc640 1 -- 172.21.15.91:0/294711348 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadfc0119b0 con 0x7fae08153640 2023-11-27T18:43:37.234 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.231+0000 7fae0fb2f640 1 -- 172.21.15.91:0/294711348 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae080b4d90 con 0x7fae08153640 2023-11-27T18:43:37.234 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.231+0000 7fadfa7fc640 1 -- 172.21.15.91:0/294711348 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadfc011d60 con 0x7fae08153640 2023-11-27T18:43:37.234 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.231+0000 7fae0fb2f640 1 -- 172.21.15.91:0/294711348 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae080b45c0 con 0x7fae08153640 2023-11-27T18:43:37.235 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.231+0000 7fae0fb2f640 1 -- 172.21.15.91:0/294711348 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fae080c99a0 con 0x7fae08153640 2023-11-27T18:43:37.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.291+0000 7fadfa7fc640 1 -- 172.21.15.91:0/294711348 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fadfc01b460 con 0x7fae08153640 2023-11-27T18:43:37.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.291+0000 7fadfa7fc640 1 --2- 172.21.15.91:0/294711348 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fadec066840 0x7fadec068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:37.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.291+0000 7fae0d8cb640 1 --2- 172.21.15.91:0/294711348 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fadec066840 0x7fadec068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:37.296 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.291+0000 7fae0d8cb640 1 --2- 172.21.15.91:0/294711348 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fadec066840 0x7fadec068d00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fae0400a8b0 tx=0x7fae04008040 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:37.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.311+0000 7fadfa7fc640 1 -- 172.21.15.91:0/294711348 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fadfc055e90 con 0x7fae08153640 2023-11-27T18:43:37.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.311+0000 7fadfa7fc640 1 --2- 172.21.15.91:0/294711348 >> [v2:172.21.15.94:6808/2501531833,v1:172.21.15.94:6809/2501531833] conn(0x7fadec06ff20 0x7fadec0723c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:37.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.311+0000 7fadfa7fc640 1 -- 172.21.15.91:0/294711348 --> [v2:172.21.15.94:6808/2501531833,v1:172.21.15.94:6809/2501531833] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fadec072a90 con 0x7fadec06ff20 2023-11-27T18:43:37.313 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.311+0000 7fadfa7fc640 1 -- 172.21.15.91:0/294711348 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fadfc051ad0 con 0x7fae08153640 2023-11-27T18:43:37.313 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.311+0000 7fae0e0cc640 1 --2- 172.21.15.91:0/294711348 >> [v2:172.21.15.94:6808/2501531833,v1:172.21.15.94:6809/2501531833] conn(0x7fadec06ff20 0x7fadec0723c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:37.313 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.311+0000 7fae0e0cc640 1 --2- 172.21.15.91:0/294711348 >> [v2:172.21.15.94:6808/2501531833,v1:172.21.15.94:6809/2501531833] conn(0x7fadec06ff20 0x7fadec0723c0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:37.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.311+0000 7fadfa7fc640 1 -- 172.21.15.91:0/294711348 <== osd.4 v2:172.21.15.94:6808/2501531833 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fadec072a90 con 0x7fadec06ff20 2023-11-27T18:43:37.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.335+0000 7fae0fb2f640 1 -- 172.21.15.91:0/294711348 --> [v2:172.21.15.94:6808/2501531833,v1:172.21.15.94:6809/2501531833] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fae080c8c90 con 0x7fadec06ff20 2023-11-27T18:43:37.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.335+0000 7fadfa7fc640 1 -- 172.21.15.91:0/294711348 <== osd.4 v2:172.21.15.94:6808/2501531833 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fae080c8c90 con 0x7fadec06ff20 2023-11-27T18:43:37.339 INFO:teuthology.orchestra.run.smithi091.stdout:{ 2023-11-27T18:43:37.339 INFO:teuthology.orchestra.run.smithi091.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-27T18:43:37.339 INFO:teuthology.orchestra.run.smithi091.stdout:} 2023-11-27T18:43:37.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.335+0000 7fae0fb2f640 1 -- 172.21.15.91:0/294711348 >> [v2:172.21.15.94:6808/2501531833,v1:172.21.15.94:6809/2501531833] conn(0x7fadec06ff20 msgr2=0x7fadec0723c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:37.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.335+0000 7fae0fb2f640 1 --2- 172.21.15.91:0/294711348 >> [v2:172.21.15.94:6808/2501531833,v1:172.21.15.94:6809/2501531833] conn(0x7fadec06ff20 0x7fadec0723c0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:37.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.335+0000 7fae0fb2f640 1 -- 172.21.15.91:0/294711348 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fadec066840 msgr2=0x7fadec068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:37.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.335+0000 7fae0fb2f640 1 --2- 172.21.15.91:0/294711348 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fadec066840 0x7fadec068d00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fae0400a8b0 tx=0x7fae04008040 comp rx=0 tx=0).stop 2023-11-27T18:43:37.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.335+0000 7fae0fb2f640 1 -- 172.21.15.91:0/294711348 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fae08153640 msgr2=0x7fae080c62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:37.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.335+0000 7fae0fb2f640 1 --2- 172.21.15.91:0/294711348 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fae08153640 0x7fae080c62a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fadfc00b420 tx=0x7fadfc00b8e0 comp rx=0 tx=0).stop 2023-11-27T18:43:37.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.335+0000 7fae0e0cc640 1 -- 172.21.15.91:0/294711348 reap_dead start 2023-11-27T18:43:37.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.339+0000 7fae0fb2f640 1 -- 172.21.15.91:0/294711348 shutdown_connections 2023-11-27T18:43:37.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.339+0000 7fae0fb2f640 1 -- 172.21.15.91:0/294711348 >> 172.21.15.91:0/294711348 conn(0x7fae0806ba30 msgr2=0x7fae08158800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:37.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.339+0000 7fae0fb2f640 1 -- 172.21.15.91:0/294711348 shutdown_connections 2023-11-27T18:43:37.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.339+0000 7fae0fb2f640 1 -- 172.21.15.91:0/294711348 wait complete. 2023-11-27T18:43:37.372 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-11-27T18:43:37.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.499+0000 7f1ae2e86640 1 Processor -- start 2023-11-27T18:43:37.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.499+0000 7f1ae2e86640 1 -- start start 2023-11-27T18:43:37.502 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.499+0000 7f1ae2e86640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1adc162ec0 0x7f1adc1652b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:37.502 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.499+0000 7f1ae2e86640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1adc15d500 con 0x7f1adc159fc0 2023-11-27T18:43:37.502 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.499+0000 7f1ae2e86640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1adc071270 con 0x7f1adc14ffb0 2023-11-27T18:43:37.502 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.499+0000 7f1ae2e86640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1adc0717f0 con 0x7f1adc162ec0 2023-11-27T18:43:37.502 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.499+0000 7f1adbfff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f1adc159fc0 0x7f1adc06e760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:44946/0 (socket says 172.21.15.91:44946) 2023-11-27T18:43:37.503 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.499+0000 7f1adbfff640 1 -- 172.21.15.91:0/166562132 learned_addr learned my addr 172.21.15.91:0/166562132 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:43:37.503 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.499+0000 7f1ae1423640 1 --2- 172.21.15.91:0/166562132 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1adc162ec0 0x7f1adc1652b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:37.506 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.503+0000 7f1adb7fe640 1 -- 172.21.15.91:0/166562132 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3843172166 0 0) 0x7f1adc15d500 con 0x7f1adc159fc0 2023-11-27T18:43:37.506 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.503+0000 7f1adb7fe640 1 -- 172.21.15.91:0/166562132 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ac4003530 con 0x7f1adc159fc0 2023-11-27T18:43:37.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.507+0000 7f1adb7fe640 1 -- 172.21.15.91:0/166562132 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3358863264 0 0) 0x7f1ac4003530 con 0x7f1adc159fc0 2023-11-27T18:43:37.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.507+0000 7f1adb7fe640 1 -- 172.21.15.91:0/166562132 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1adc162ec0 msgr2=0x7f1adc1652b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:37.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.507+0000 7f1adb7fe640 1 --2- 172.21.15.91:0/166562132 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1adc162ec0 0x7f1adc1652b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:37.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.507+0000 7f1adb7fe640 1 -- 172.21.15.91:0/166562132 >> v1:172.21.15.94:6789/0 conn(0x7f1adc14ffb0 legacy=0x7f1adc0c3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:37.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.507+0000 7f1adb7fe640 1 -- 172.21.15.91:0/166562132 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1adc15a400 con 0x7f1adc159fc0 2023-11-27T18:43:37.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.507+0000 7f1adb7fe640 1 -- 172.21.15.91:0/166562132 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3378743932 0 0) 0x7f1ad0001680 con 0x7f1adc159fc0 2023-11-27T18:43:37.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.507+0000 7f1adb7fe640 1 -- 172.21.15.91:0/166562132 >> v1:172.21.15.91:6789/0 conn(0x7f1adc159fc0 legacy=0x7f1adc06e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:37.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.507+0000 7f1adb7fe640 1 --2- 172.21.15.91:0/166562132 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1ac40039b0 0x7f1ac4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:37.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.507+0000 7f1adb7fe640 1 --2- 172.21.15.91:0/166562132 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1ac40047d0 0x7f1ac4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:37.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.507+0000 7f1adb7fe640 1 --2- 172.21.15.91:0/166562132 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1adc162ec0 0x7f1ac4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:37.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.507+0000 7f1adb7fe640 1 -- 172.21.15.91:0/166562132 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1adc0717f0 con 0x7f1ac40039b0 2023-11-27T18:43:37.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.507+0000 7f1adb7fe640 1 -- 172.21.15.91:0/166562132 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac4014310 con 0x7f1ac40047d0 2023-11-27T18:43:37.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.507+0000 7f1adb7fe640 1 -- 172.21.15.91:0/166562132 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac40144d0 con 0x7f1adc162ec0 2023-11-27T18:43:37.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.507+0000 7f1ae0c22640 1 --2- 172.21.15.91:0/166562132 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1ac40039b0 0x7f1ac4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:37.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.511+0000 7f1adbfff640 1 --2- 172.21.15.91:0/166562132 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1ac40047d0 0x7f1ac4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:37.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.515+0000 7f1ae1423640 1 --2- 172.21.15.91:0/166562132 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1adc162ec0 0x7f1ac4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:37.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.515+0000 7f1ae0c22640 1 -- 172.21.15.91:0/166562132 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1adc162ec0 msgr2=0x7f1ac4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:37.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.515+0000 7f1ae0c22640 1 --2- 172.21.15.91:0/166562132 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1adc162ec0 0x7f1ac4005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:37.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.515+0000 7f1ae0c22640 1 -- 172.21.15.91:0/166562132 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1ac40047d0 msgr2=0x7f1ac4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:37.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.515+0000 7f1ae0c22640 1 --2- 172.21.15.91:0/166562132 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1ac40047d0 0x7f1ac4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:37.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.515+0000 7f1ae0c22640 1 -- 172.21.15.91:0/166562132 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac4003530 con 0x7f1ac40039b0 2023-11-27T18:43:37.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.519+0000 7f1ae0c22640 1 --2- 172.21.15.91:0/166562132 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1ac40039b0 0x7f1ac4003dd0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1acc001750 tx=0x7f1acc01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d592b482cecaa26e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:37.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.523+0000 7f1adb7fe640 1 -- 172.21.15.91:0/166562132 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1acc0052d0 con 0x7f1ac40039b0 2023-11-27T18:43:37.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.523+0000 7f1adb7fe640 1 -- 172.21.15.91:0/166562132 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1acc0a7050 con 0x7f1ac40039b0 2023-11-27T18:43:37.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.523+0000 7f1adb7fe640 1 -- 172.21.15.91:0/166562132 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1acc003840 con 0x7f1ac40039b0 2023-11-27T18:43:37.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.523+0000 7f1ae2e86640 1 -- 172.21.15.91:0/166562132 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1ac40039b0 msgr2=0x7f1ac4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:37.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.523+0000 7f1ae2e86640 1 --2- 172.21.15.91:0/166562132 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1ac40039b0 0x7f1ac4003dd0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1acc001750 tx=0x7f1acc01c3a0 comp rx=0 tx=0).stop 2023-11-27T18:43:37.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.523+0000 7f1ae1423640 1 -- 172.21.15.91:0/166562132 reap_dead start 2023-11-27T18:43:37.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.523+0000 7f1ae2e86640 1 -- 172.21.15.91:0/166562132 shutdown_connections 2023-11-27T18:43:37.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.523+0000 7f1ae2e86640 1 -- 172.21.15.91:0/166562132 >> 172.21.15.91:0/166562132 conn(0x7f1adc0ca9d0 msgr2=0x7f1adc0cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:37.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.523+0000 7f1ae2e86640 1 -- 172.21.15.91:0/166562132 shutdown_connections 2023-11-27T18:43:37.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.523+0000 7f1ae2e86640 1 -- 172.21.15.91:0/166562132 wait complete. 2023-11-27T18:43:37.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.523+0000 7f1ae2e86640 1 Processor -- start 2023-11-27T18:43:37.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.523+0000 7f1ae2e86640 1 -- start start 2023-11-27T18:43:37.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.523+0000 7f1ae2e86640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1ac40039b0 0x7f1adc1eefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:37.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.523+0000 7f1ae2e86640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1adc0c0ff0 0x7f1adc13c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:37.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.523+0000 7f1ae2e86640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1adc0bf7e0 0x7f1adc1ec4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:37.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.523+0000 7f1ae2e86640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1adc0c0d30 con 0x7f1ac40039b0 2023-11-27T18:43:37.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.523+0000 7f1ae2e86640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1adc1405b0 con 0x7f1adc0c0ff0 2023-11-27T18:43:37.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.523+0000 7f1ae2e86640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1adc1ef4e0 con 0x7f1adc0bf7e0 2023-11-27T18:43:37.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.527+0000 7f1ae0c22640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1ac40039b0 0x7f1adc1eefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:37.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.527+0000 7f1ae0c22640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1ac40039b0 0x7f1adc1eefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40250/0 (socket says 172.21.15.91:40250) 2023-11-27T18:43:37.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.527+0000 7f1ae0c22640 1 -- 172.21.15.91:0/1941628048 learned_addr learned my addr 172.21.15.91:0/1941628048 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:37.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.527+0000 7f1adbfff640 1 --2- 172.21.15.91:0/1941628048 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1adc0c0ff0 0x7f1adc13c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:37.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.527+0000 7f1ae1423640 1 --2- 172.21.15.91:0/1941628048 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1adc0bf7e0 0x7f1adc1ec4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:37.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.531+0000 7f1ae0c22640 1 -- 172.21.15.91:0/1941628048 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1adc0bf7e0 msgr2=0x7f1adc1ec4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:37.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.531+0000 7f1ae0c22640 1 --2- 172.21.15.91:0/1941628048 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1adc0bf7e0 0x7f1adc1ec4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:37.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.531+0000 7f1ae0c22640 1 -- 172.21.15.91:0/1941628048 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1adc0c0ff0 msgr2=0x7f1adc13c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:37.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.531+0000 7f1ae0c22640 1 --2- 172.21.15.91:0/1941628048 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1adc0c0ff0 0x7f1adc13c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:37.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.531+0000 7f1ae0c22640 1 -- 172.21.15.91:0/1941628048 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1adc0c14c0 con 0x7f1ac40039b0 2023-11-27T18:43:37.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.531+0000 7f1ae0c22640 1 --2- 172.21.15.91:0/1941628048 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1ac40039b0 0x7f1adc1eefa0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1acc001750 tx=0x7f1ac4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:37.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.535+0000 7f1ad97fa640 1 -- 172.21.15.91:0/1941628048 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1acc007310 con 0x7f1ac40039b0 2023-11-27T18:43:37.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.535+0000 7f1ad97fa640 1 -- 172.21.15.91:0/1941628048 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1acc007470 con 0x7f1ac40039b0 2023-11-27T18:43:37.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.535+0000 7f1ad97fa640 1 -- 172.21.15.91:0/1941628048 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1acc0067e0 con 0x7f1ac40039b0 2023-11-27T18:43:37.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.535+0000 7f1ae2e86640 1 -- 172.21.15.91:0/1941628048 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1adc0c17a0 con 0x7f1ac40039b0 2023-11-27T18:43:37.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.535+0000 7f1ae2e86640 1 -- 172.21.15.91:0/1941628048 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1adc0befe0 con 0x7f1ac40039b0 2023-11-27T18:43:37.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.539+0000 7f1ae2e86640 1 -- 172.21.15.91:0/1941628048 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1adc06f730 con 0x7f1ac40039b0 2023-11-27T18:43:37.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.559+0000 7f1ad97fa640 1 -- 172.21.15.91:0/1941628048 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f1acc006940 con 0x7f1ac40039b0 2023-11-27T18:43:37.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.559+0000 7f1ad97fa640 1 --2- 172.21.15.91:0/1941628048 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f1ac8066870 0x7f1ac8068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:37.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.559+0000 7f1adbfff640 1 --2- 172.21.15.91:0/1941628048 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f1ac8066870 0x7f1ac8068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:37.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.559+0000 7f1adbfff640 1 --2- 172.21.15.91:0/1941628048 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f1ac8066870 0x7f1ac8068d30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1adc0c13f0 tx=0x7f1ad00050c0 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:37.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.827+0000 7f1ad97fa640 1 -- 172.21.15.91:0/1941628048 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f1acc0efdf0 con 0x7f1ac40039b0 2023-11-27T18:43:37.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.827+0000 7f1ad97fa640 1 -- 172.21.15.91:0/1941628048 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f1acc0ec130 con 0x7f1ac40039b0 2023-11-27T18:43:37.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.995+0000 7f1ae2e86640 1 -- 172.21.15.91:0/1941628048 --> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f1adc150390 con 0x7f1ac8066870 2023-11-27T18:43:37.999 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.995+0000 7f1ad97fa640 1 -- 172.21.15.91:0/1941628048 <== mgr.4136 v2:172.21.15.91:6800/2814827118 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1ad0014de0 con 0x7f1ac8066870 2023-11-27T18:43:37.999 INFO:teuthology.orchestra.run.smithi091.stderr:instructed osd(s) 4 to deep-scrub 2023-11-27T18:43:38.001 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.999+0000 7f1ae2e86640 1 -- 172.21.15.91:0/1941628048 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f1ac8066870 msgr2=0x7f1ac8068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:38.002 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.999+0000 7f1ae2e86640 1 --2- 172.21.15.91:0/1941628048 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f1ac8066870 0x7f1ac8068d30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1adc0c13f0 tx=0x7f1ad00050c0 comp rx=0 tx=0).stop 2023-11-27T18:43:38.002 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.999+0000 7f1ae2e86640 1 -- 172.21.15.91:0/1941628048 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1ac40039b0 msgr2=0x7f1adc1eefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:38.002 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.999+0000 7f1ae2e86640 1 --2- 172.21.15.91:0/1941628048 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1ac40039b0 0x7f1adc1eefa0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1acc001750 tx=0x7f1ac4005800 comp rx=0 tx=0).stop 2023-11-27T18:43:38.002 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.999+0000 7f1ae2e86640 1 -- 172.21.15.91:0/1941628048 shutdown_connections 2023-11-27T18:43:38.002 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.999+0000 7f1ae2e86640 1 --2- 172.21.15.91:0/1941628048 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f1ac8066870 0x7f1ac8068d30 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:38.002 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.999+0000 7f1ae2e86640 1 --2- 172.21.15.91:0/1941628048 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1adc0bf7e0 0x7f1adc1ec4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:38.002 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.999+0000 7f1ae2e86640 1 --2- 172.21.15.91:0/1941628048 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1adc0c0ff0 0x7f1adc13c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:38.002 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.999+0000 7f1ae2e86640 1 --2- 172.21.15.91:0/1941628048 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1ac40039b0 0x7f1adc1eefa0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:38.002 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.999+0000 7f1ae2e86640 1 -- 172.21.15.91:0/1941628048 >> 172.21.15.91:0/1941628048 conn(0x7f1adc0ca9d0 msgr2=0x7f1adc0c4160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:38.002 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.999+0000 7f1ae2e86640 1 -- 172.21.15.91:0/1941628048 shutdown_connections 2023-11-27T18:43:38.002 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:37.999+0000 7f1ae2e86640 1 -- 172.21.15.91:0/1941628048 wait complete. 2023-11-27T18:43:38.019 INFO:tasks.ceph:Scrubbing osd.5 2023-11-27T18:43:38.019 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-11-27T18:43:38.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.139+0000 7f5611f70640 1 Processor -- start 2023-11-27T18:43:38.142 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.139+0000 7f5611f70640 1 -- start start 2023-11-27T18:43:38.142 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.139+0000 7f5611f70640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f560c0c8b20 0x7f560c15a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:38.143 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.139+0000 7f5611f70640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f560c0c0ee0 0x7f560c14ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:38.143 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.139+0000 7f5611f70640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f560c159750 con 0x7f560c0c8f00 2023-11-27T18:43:38.143 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.139+0000 7f5611f70640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f560c15a6e0 con 0x7f560c0c8b20 2023-11-27T18:43:38.143 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.139+0000 7f5611f70640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f560c0c1490 con 0x7f560c0c0ee0 2023-11-27T18:43:38.144 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.143+0000 7f560bfff640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f560c0c0ee0 0x7f560c14ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:38.145 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.143+0000 7f560bfff640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f560c0c0ee0 0x7f560c14ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.91:40216/0 (socket says 172.21.15.91:40216) 2023-11-27T18:43:38.145 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.143+0000 7f560bfff640 1 -- 172.21.15.91:0/292788897 learned_addr learned my addr 172.21.15.91:0/292788897 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:38.151 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.147+0000 7f560bfff640 1 -- 172.21.15.91:0/292788897 >> v2:172.21.15.91:3300/0 conn(0x7f560c0c8b20 msgr2=0x7f560c15a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:38.151 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.147+0000 7f560bfff640 1 --2- 172.21.15.91:0/292788897 >> v2:172.21.15.91:3300/0 conn(0x7f560c0c8b20 0x7f560c15a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:38.151 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.147+0000 7f560bfff640 1 -- 172.21.15.91:0/292788897 >> v1:172.21.15.91:6789/0 conn(0x7f560c0c8f00 legacy=0x7f560c0c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:38.152 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.147+0000 7f560bfff640 1 -- 172.21.15.91:0/292788897 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f560c0c1770 con 0x7f560c0c0ee0 2023-11-27T18:43:38.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.155+0000 7f560bfff640 1 --2- 172.21.15.91:0/292788897 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f560c0c0ee0 0x7f560c14ffb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f560400d150 tx=0x7f56040213c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ea431a7e0dfb3a5 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:38.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.311+0000 7f560a7fc640 1 -- 172.21.15.91:0/292788897 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560400b2d0 con 0x7f560c0c0ee0 2023-11-27T18:43:38.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.311+0000 7f560a7fc640 1 -- 172.21.15.91:0/292788897 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56040ad050 con 0x7f560c0c0ee0 2023-11-27T18:43:38.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.311+0000 7f560a7fc640 1 -- 172.21.15.91:0/292788897 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5604009820 con 0x7f560c0c0ee0 2023-11-27T18:43:38.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.311+0000 7f5611f70640 1 -- 172.21.15.91:0/292788897 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f560c0c0ee0 msgr2=0x7f560c14ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:38.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.311+0000 7f5611f70640 1 --2- 172.21.15.91:0/292788897 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f560c0c0ee0 0x7f560c14ffb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f560400d150 tx=0x7f56040213c0 comp rx=0 tx=0).stop 2023-11-27T18:43:38.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.311+0000 7f5611f70640 1 -- 172.21.15.91:0/292788897 shutdown_connections 2023-11-27T18:43:38.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.311+0000 7f5611f70640 1 --2- 172.21.15.91:0/292788897 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f560c0c0ee0 0x7f560c14ffb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:38.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.311+0000 7f5611f70640 1 --2- 172.21.15.91:0/292788897 >> v2:172.21.15.91:3300/0 conn(0x7f560c0c8b20 0x7f560c15a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:38.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.311+0000 7f5611f70640 1 -- 172.21.15.91:0/292788897 >> 172.21.15.91:0/292788897 conn(0x7f560c071e80 msgr2=0x7f560c072290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:38.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.311+0000 7f5611f70640 1 -- 172.21.15.91:0/292788897 shutdown_connections 2023-11-27T18:43:38.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.311+0000 7f5611f70640 1 -- 172.21.15.91:0/292788897 wait complete. 2023-11-27T18:43:38.318 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.315+0000 7f5611f70640 1 Processor -- start 2023-11-27T18:43:38.318 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.315+0000 7f5611f70640 1 -- start start 2023-11-27T18:43:38.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.319+0000 7f5611f70640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f560c0c0ee0 0x7f560c146e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:38.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.319+0000 7f5611f70640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f560c0c8b20 0x7f560c1e0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:38.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.319+0000 7f5611f70640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f560c0c8f00 0x7f560c143cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:38.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.319+0000 7f5611f70640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f560c143100 con 0x7f560c0c8f00 2023-11-27T18:43:38.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.319+0000 7f5611f70640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f560c1df750 con 0x7f560c0c8b20 2023-11-27T18:43:38.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.319+0000 7f5611f70640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f560c1dfa30 con 0x7f560c0c0ee0 2023-11-27T18:43:38.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.319+0000 7f560bfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f560c0c8f00 0x7f560c143cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:38.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.319+0000 7f560bfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f560c0c8f00 0x7f560c143cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40264/0 (socket says 172.21.15.91:40264) 2023-11-27T18:43:38.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.319+0000 7f560bfff640 1 -- 172.21.15.91:0/64304708 learned_addr learned my addr 172.21.15.91:0/64304708 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:38.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.319+0000 7f560affd640 1 --2- 172.21.15.91:0/64304708 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f560c0c8b20 0x7f560c1e0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:38.324 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.323+0000 7f560b7fe640 1 --2- 172.21.15.91:0/64304708 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f560c0c0ee0 0x7f560c146e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:38.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.323+0000 7f560bfff640 1 -- 172.21.15.91:0/64304708 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f560c0c0ee0 msgr2=0x7f560c146e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:38.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.323+0000 7f560bfff640 1 --2- 172.21.15.91:0/64304708 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f560c0c0ee0 0x7f560c146e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:38.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.323+0000 7f560bfff640 1 -- 172.21.15.91:0/64304708 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f560c0c8b20 msgr2=0x7f560c1e0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:38.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.323+0000 7f560bfff640 1 --2- 172.21.15.91:0/64304708 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f560c0c8b20 0x7f560c1e0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:38.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.323+0000 7f560bfff640 1 -- 172.21.15.91:0/64304708 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f560400bd40 con 0x7f560c0c8f00 2023-11-27T18:43:38.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.327+0000 7f560bfff640 1 --2- 172.21.15.91:0/64304708 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f560c0c8f00 0x7f560c143cc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f560401fa70 tx=0x7f560401e160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:38.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.335+0000 7f55f3fff640 1 -- 172.21.15.91:0/64304708 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5604009b10 con 0x7f560c0c8f00 2023-11-27T18:43:38.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.335+0000 7f55f3fff640 1 -- 172.21.15.91:0/64304708 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5604009c70 con 0x7f560c0c8f00 2023-11-27T18:43:38.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.339+0000 7f5611f70640 1 -- 172.21.15.91:0/64304708 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f560c1dfd10 con 0x7f560c0c8f00 2023-11-27T18:43:38.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.339+0000 7f55f3fff640 1 -- 172.21.15.91:0/64304708 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56040ba400 con 0x7f560c0c8f00 2023-11-27T18:43:38.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.339+0000 7f5611f70640 1 -- 172.21.15.91:0/64304708 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f560c1e02d0 con 0x7f560c0c8f00 2023-11-27T18:43:38.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.339+0000 7f5611f70640 1 -- 172.21.15.91:0/64304708 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f560c159c80 con 0x7f560c0c8f00 2023-11-27T18:43:38.504 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.503+0000 7f55f3fff640 1 -- 172.21.15.91:0/64304708 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f56040b8040 con 0x7f560c0c8f00 2023-11-27T18:43:38.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.503+0000 7f55f3fff640 1 --2- 172.21.15.91:0/64304708 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f55f8066870 0x7f55f8068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:38.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.503+0000 7f560b7fe640 1 --2- 172.21.15.91:0/64304708 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f55f8066870 0x7f55f8068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:38.507 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.503+0000 7f560b7fe640 1 --2- 172.21.15.91:0/64304708 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f55f8066870 0x7f55f8068d30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5600006fd0 tx=0x7f5600008040 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:38.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.507+0000 7f55f3fff640 1 -- 172.21.15.91:0/64304708 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f56040f6100 con 0x7f560c0c8f00 2023-11-27T18:43:38.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.507+0000 7f55f3fff640 1 --2- 172.21.15.91:0/64304708 >> [v2:172.21.15.94:6816/2448969592,v1:172.21.15.94:6817/2448969592] conn(0x7f55f806fed0 0x7f55f8072370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:38.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.507+0000 7f55f3fff640 1 -- 172.21.15.91:0/64304708 --> [v2:172.21.15.94:6816/2448969592,v1:172.21.15.94:6817/2448969592] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f55f8072a40 con 0x7f55f806fed0 2023-11-27T18:43:38.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.507+0000 7f55f3fff640 1 -- 172.21.15.91:0/64304708 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f56040f1d40 con 0x7f560c0c8f00 2023-11-27T18:43:38.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.507+0000 7f560affd640 1 --2- 172.21.15.91:0/64304708 >> [v2:172.21.15.94:6816/2448969592,v1:172.21.15.94:6817/2448969592] conn(0x7f55f806fed0 0x7f55f8072370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:38.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.511+0000 7f560affd640 1 --2- 172.21.15.91:0/64304708 >> [v2:172.21.15.94:6816/2448969592,v1:172.21.15.94:6817/2448969592] conn(0x7f55f806fed0 0x7f55f8072370 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:38.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.511+0000 7f55f3fff640 1 -- 172.21.15.91:0/64304708 <== osd.5 v2:172.21.15.94:6816/2448969592 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f55f8072a40 con 0x7f55f806fed0 2023-11-27T18:43:38.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.531+0000 7f5611f70640 1 -- 172.21.15.91:0/64304708 --> [v2:172.21.15.94:6816/2448969592,v1:172.21.15.94:6817/2448969592] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f560c1599a0 con 0x7f55f806fed0 2023-11-27T18:43:38.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.531+0000 7f55f3fff640 1 -- 172.21.15.91:0/64304708 <== osd.5 v2:172.21.15.94:6816/2448969592 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f55fc009a10 con 0x7f55f806fed0 2023-11-27T18:43:38.535 INFO:teuthology.orchestra.run.smithi091.stdout:{ 2023-11-27T18:43:38.535 INFO:teuthology.orchestra.run.smithi091.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-27T18:43:38.535 INFO:teuthology.orchestra.run.smithi091.stdout:} 2023-11-27T18:43:38.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.531+0000 7f5611f70640 1 -- 172.21.15.91:0/64304708 >> [v2:172.21.15.94:6816/2448969592,v1:172.21.15.94:6817/2448969592] conn(0x7f55f806fed0 msgr2=0x7f55f8072370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:38.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.531+0000 7f5611f70640 1 --2- 172.21.15.91:0/64304708 >> [v2:172.21.15.94:6816/2448969592,v1:172.21.15.94:6817/2448969592] conn(0x7f55f806fed0 0x7f55f8072370 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:38.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.531+0000 7f5611f70640 1 -- 172.21.15.91:0/64304708 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f55f8066870 msgr2=0x7f55f8068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:38.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.531+0000 7f5611f70640 1 --2- 172.21.15.91:0/64304708 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f55f8066870 0x7f55f8068d30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5600006fd0 tx=0x7f5600008040 comp rx=0 tx=0).stop 2023-11-27T18:43:38.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.531+0000 7f5611f70640 1 -- 172.21.15.91:0/64304708 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f560c0c8f00 msgr2=0x7f560c143cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:38.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.531+0000 7f5611f70640 1 --2- 172.21.15.91:0/64304708 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f560c0c8f00 0x7f560c143cc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f560401fa70 tx=0x7f560401e160 comp rx=0 tx=0).stop 2023-11-27T18:43:38.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.535+0000 7f560bfff640 1 -- 172.21.15.91:0/64304708 reap_dead start 2023-11-27T18:43:38.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.535+0000 7f5611f70640 1 -- 172.21.15.91:0/64304708 shutdown_connections 2023-11-27T18:43:38.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.535+0000 7f5611f70640 1 -- 172.21.15.91:0/64304708 >> 172.21.15.91:0/64304708 conn(0x7f560c071e80 msgr2=0x7f560c155f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:38.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.535+0000 7f5611f70640 1 -- 172.21.15.91:0/64304708 shutdown_connections 2023-11-27T18:43:38.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.535+0000 7f5611f70640 1 -- 172.21.15.91:0/64304708 wait complete. 2023-11-27T18:43:38.560 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-11-27T18:43:38.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.687+0000 7fea16361640 1 Processor -- start 2023-11-27T18:43:38.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.687+0000 7fea16361640 1 -- start start 2023-11-27T18:43:38.692 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.691+0000 7fea16361640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fea100c40e0 0x7fea100c44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:38.692 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.691+0000 7fea16361640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fea10072820 0x7fea1006ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:38.692 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.691+0000 7fea16361640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fea1006b140 0x7fea101576e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:38.692 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.691+0000 7fea16361640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea100c7090 con 0x7fea100c40e0 2023-11-27T18:43:38.692 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.691+0000 7fea16361640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea100c4a00 con 0x7fea10072820 2023-11-27T18:43:38.692 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.691+0000 7fea16361640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea1015aa00 con 0x7fea1006b140 2023-11-27T18:43:38.693 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.691+0000 7fea0ffff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fea100c40e0 0x7fea100c44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:38.693 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.691+0000 7fea0ffff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fea100c40e0 0x7fea100c44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40270/0 (socket says 172.21.15.91:40270) 2023-11-27T18:43:38.693 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.691+0000 7fea0ffff640 1 -- 172.21.15.91:0/3722986356 learned_addr learned my addr 172.21.15.91:0/3722986356 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:38.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.691+0000 7fea0f7fe640 1 --2- 172.21.15.91:0/3722986356 >> v2:172.21.15.94:3300/0 conn(0x7fea10072820 0x7fea1006ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:38.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.691+0000 7fea148fe640 1 --2- 172.21.15.91:0/3722986356 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fea1006b140 0x7fea101576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:38.696 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.695+0000 7fea0ffff640 1 -- 172.21.15.91:0/3722986356 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fea1006b140 msgr2=0x7fea101576e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:38.696 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.695+0000 7fea0ffff640 1 --2- 172.21.15.91:0/3722986356 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fea1006b140 0x7fea101576e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:38.696 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.695+0000 7fea0ffff640 1 -- 172.21.15.91:0/3722986356 >> v2:172.21.15.94:3300/0 conn(0x7fea10072820 msgr2=0x7fea1006ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:38.696 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.695+0000 7fea0ffff640 1 --2- 172.21.15.91:0/3722986356 >> v2:172.21.15.94:3300/0 conn(0x7fea10072820 0x7fea1006ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:38.696 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.695+0000 7fea0ffff640 1 -- 172.21.15.91:0/3722986356 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea1015acc0 con 0x7fea100c40e0 2023-11-27T18:43:38.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.699+0000 7fea0ffff640 1 --2- 172.21.15.91:0/3722986356 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fea100c40e0 0x7fea100c44c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fea100c4e70 tx=0x7fea0001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c233ff0dbe8efa18 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:38.704 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.703+0000 7fea0effd640 1 -- 172.21.15.91:0/3722986356 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea000aa620 con 0x7fea100c40e0 2023-11-27T18:43:38.704 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.703+0000 7fea0effd640 1 -- 172.21.15.91:0/3722986356 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea000aa780 con 0x7fea100c40e0 2023-11-27T18:43:38.704 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.703+0000 7fea0effd640 1 -- 172.21.15.91:0/3722986356 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea000aab10 con 0x7fea100c40e0 2023-11-27T18:43:38.705 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.703+0000 7fea16361640 1 -- 172.21.15.91:0/3722986356 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fea100c40e0 msgr2=0x7fea100c44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:38.705 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.703+0000 7fea16361640 1 --2- 172.21.15.91:0/3722986356 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fea100c40e0 0x7fea100c44c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fea100c4e70 tx=0x7fea0001c500 comp rx=0 tx=0).stop 2023-11-27T18:43:38.705 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.703+0000 7fea16361640 1 -- 172.21.15.91:0/3722986356 shutdown_connections 2023-11-27T18:43:38.705 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.703+0000 7fea16361640 1 --2- 172.21.15.91:0/3722986356 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fea1006b140 0x7fea101576e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:38.705 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.703+0000 7fea16361640 1 --2- 172.21.15.91:0/3722986356 >> v2:172.21.15.94:3300/0 conn(0x7fea10072820 0x7fea1006ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:38.705 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.703+0000 7fea16361640 1 --2- 172.21.15.91:0/3722986356 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fea100c40e0 0x7fea100c44c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:38.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.703+0000 7fea16361640 1 -- 172.21.15.91:0/3722986356 >> 172.21.15.91:0/3722986356 conn(0x7fea100ca9d0 msgr2=0x7fea100cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:38.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.703+0000 7fea16361640 1 -- 172.21.15.91:0/3722986356 shutdown_connections 2023-11-27T18:43:38.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.703+0000 7fea16361640 1 -- 172.21.15.91:0/3722986356 wait complete. 2023-11-27T18:43:38.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.703+0000 7fea16361640 1 Processor -- start 2023-11-27T18:43:38.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.703+0000 7fea16361640 1 -- start start 2023-11-27T18:43:38.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.703+0000 7fea16361640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fea1006b140 0x7fea1014a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:38.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.703+0000 7fea16361640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fea10072820 0x7fea101f2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:38.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.703+0000 7fea16361640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fea100c40e0 0x7fea101f2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:38.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.703+0000 7fea16361640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea101f6640 con 0x7fea1006b140 2023-11-27T18:43:38.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.703+0000 7fea16361640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea101f5790 con 0x7fea100c40e0 2023-11-27T18:43:38.708 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.703+0000 7fea16361640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea101f5a30 con 0x7fea10072820 2023-11-27T18:43:38.708 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.703+0000 7fea0ffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fea1006b140 0x7fea1014a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:38.708 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.707+0000 7fea0ffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fea1006b140 0x7fea1014a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40282/0 (socket says 172.21.15.91:40282) 2023-11-27T18:43:38.708 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.707+0000 7fea0ffff640 1 -- 172.21.15.91:0/3739701328 learned_addr learned my addr 172.21.15.91:0/3739701328 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:38.709 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.707+0000 7fea0f7fe640 1 --2- 172.21.15.91:0/3739701328 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fea10072820 0x7fea101f2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:38.709 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.707+0000 7fea148fe640 1 --2- 172.21.15.91:0/3739701328 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fea100c40e0 0x7fea101f2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:38.712 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.711+0000 7fea0ffff640 1 -- 172.21.15.91:0/3739701328 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fea10072820 msgr2=0x7fea101f2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:38.712 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.711+0000 7fea0ffff640 1 --2- 172.21.15.91:0/3739701328 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fea10072820 0x7fea101f2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:38.712 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.711+0000 7fea0ffff640 1 -- 172.21.15.91:0/3739701328 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fea100c40e0 msgr2=0x7fea101f2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:38.712 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.711+0000 7fea0ffff640 1 --2- 172.21.15.91:0/3739701328 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fea100c40e0 0x7fea101f2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:38.712 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.711+0000 7fea0ffff640 1 -- 172.21.15.91:0/3739701328 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea000094d0 con 0x7fea1006b140 2023-11-27T18:43:38.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.711+0000 7fea0ffff640 1 --2- 172.21.15.91:0/3739701328 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fea1006b140 0x7fea1014a280 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fea0001abb0 tx=0x7fea0001ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:38.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.715+0000 7fea0cff9640 1 -- 172.21.15.91:0/3739701328 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea000bd3f0 con 0x7fea1006b140 2023-11-27T18:43:38.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.715+0000 7fea0cff9640 1 -- 172.21.15.91:0/3739701328 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea000bd570 con 0x7fea1006b140 2023-11-27T18:43:38.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.715+0000 7fea0cff9640 1 -- 172.21.15.91:0/3739701328 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea000bd920 con 0x7fea1006b140 2023-11-27T18:43:38.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.715+0000 7fea16361640 1 -- 172.21.15.91:0/3739701328 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea101f5d10 con 0x7fea1006b140 2023-11-27T18:43:38.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.715+0000 7fea16361640 1 -- 172.21.15.91:0/3739701328 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea101f62d0 con 0x7fea1006b140 2023-11-27T18:43:38.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.719+0000 7fea16361640 1 -- 172.21.15.91:0/3739701328 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea1004e850 con 0x7fea1006b140 2023-11-27T18:43:38.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.739+0000 7fea0cff9640 1 -- 172.21.15.91:0/3739701328 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fea000c8430 con 0x7fea1006b140 2023-11-27T18:43:38.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.739+0000 7fea0cff9640 1 --2- 172.21.15.91:0/3739701328 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe9fc0667f0 0x7fe9fc068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:38.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.739+0000 7fea0f7fe640 1 --2- 172.21.15.91:0/3739701328 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe9fc0667f0 0x7fe9fc068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:38.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:38.739+0000 7fea0f7fe640 1 --2- 172.21.15.91:0/3739701328 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe9fc0667f0 0x7fe9fc068cb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fea100c2110 tx=0x7fea04008040 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:39.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.023+0000 7fea0cff9640 1 -- 172.21.15.91:0/3739701328 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fea000ef760 con 0x7fea1006b140 2023-11-27T18:43:39.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.027+0000 7fea0cff9640 1 -- 172.21.15.91:0/3739701328 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fea000ebaa0 con 0x7fea1006b140 2023-11-27T18:43:39.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.195+0000 7fea16361640 1 -- 172.21.15.91:0/3739701328 --> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fea10158030 con 0x7fe9fc0667f0 2023-11-27T18:43:39.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.199+0000 7fea0cff9640 1 -- 172.21.15.91:0/3739701328 <== mgr.4136 v2:172.21.15.91:6800/2814827118 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fea040108d0 con 0x7fe9fc0667f0 2023-11-27T18:43:39.200 INFO:teuthology.orchestra.run.smithi091.stderr:instructed osd(s) 5 to deep-scrub 2023-11-27T18:43:39.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.199+0000 7fea16361640 1 -- 172.21.15.91:0/3739701328 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe9fc0667f0 msgr2=0x7fe9fc068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:39.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.199+0000 7fea16361640 1 --2- 172.21.15.91:0/3739701328 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe9fc0667f0 0x7fe9fc068cb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fea100c2110 tx=0x7fea04008040 comp rx=0 tx=0).stop 2023-11-27T18:43:39.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.199+0000 7fea16361640 1 -- 172.21.15.91:0/3739701328 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fea1006b140 msgr2=0x7fea1014a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:39.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.199+0000 7fea16361640 1 --2- 172.21.15.91:0/3739701328 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fea1006b140 0x7fea1014a280 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fea0001abb0 tx=0x7fea0001ad40 comp rx=0 tx=0).stop 2023-11-27T18:43:39.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.199+0000 7fea16361640 1 -- 172.21.15.91:0/3739701328 shutdown_connections 2023-11-27T18:43:39.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.199+0000 7fea16361640 1 --2- 172.21.15.91:0/3739701328 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fe9fc0667f0 0x7fe9fc068cb0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:39.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.199+0000 7fea16361640 1 --2- 172.21.15.91:0/3739701328 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fea10072820 0x7fea101f2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:39.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.199+0000 7fea16361640 1 --2- 172.21.15.91:0/3739701328 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fea100c40e0 0x7fea101f2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:39.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.199+0000 7fea16361640 1 --2- 172.21.15.91:0/3739701328 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fea1006b140 0x7fea1014a280 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:39.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.199+0000 7fea16361640 1 -- 172.21.15.91:0/3739701328 >> 172.21.15.91:0/3739701328 conn(0x7fea100ca9d0 msgr2=0x7fea1015fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:39.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.199+0000 7fea16361640 1 -- 172.21.15.91:0/3739701328 shutdown_connections 2023-11-27T18:43:39.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.199+0000 7fea16361640 1 -- 172.21.15.91:0/3739701328 wait complete. 2023-11-27T18:43:39.220 INFO:tasks.ceph:Scrubbing osd.6 2023-11-27T18:43:39.220 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-11-27T18:43:39.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.343+0000 7f3bcb925640 1 Processor -- start 2023-11-27T18:43:39.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.343+0000 7f3bcb925640 1 -- start start 2023-11-27T18:43:39.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.347+0000 7f3bcb925640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f3bc40cbd70 0x7f3bc40c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:39.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.347+0000 7f3bcb925640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f3bc40cc150 0x7f3bc40c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:39.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.347+0000 7f3bcb925640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bc4156d20 con 0x7f3bc40c18f0 2023-11-27T18:43:39.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.347+0000 7f3bcb925640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bc40c91c0 con 0x7f3bc40cbd70 2023-11-27T18:43:39.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.347+0000 7f3bcb925640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bc41563f0 con 0x7f3bc40cc150 2023-11-27T18:43:39.349 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.347+0000 7f3bc8ec0640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f3bc40cc150 0x7f3bc40c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:39.350 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.347+0000 7f3bc8ec0640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f3bc40cc150 0x7f3bc40c7af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.91:58702/0 (socket says 172.21.15.91:58702) 2023-11-27T18:43:39.350 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.347+0000 7f3bc8ec0640 1 -- 172.21.15.91:0/865582578 learned_addr learned my addr 172.21.15.91:0/865582578 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:39.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.351+0000 7f3bc96c1640 1 --2- 172.21.15.91:0/865582578 >> v2:172.21.15.91:3300/0 conn(0x7f3bc40cbd70 0x7f3bc40c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:39.355 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.351+0000 7f3bc8ec0640 1 -- 172.21.15.91:0/865582578 >> v2:172.21.15.91:3300/0 conn(0x7f3bc40cbd70 msgr2=0x7f3bc40c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:39.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.351+0000 7f3bc8ec0640 1 --2- 172.21.15.91:0/865582578 >> v2:172.21.15.91:3300/0 conn(0x7f3bc40cbd70 0x7f3bc40c8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:39.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.351+0000 7f3bc8ec0640 1 -- 172.21.15.91:0/865582578 >> v1:172.21.15.94:6789/0 conn(0x7f3bc40c18f0 legacy=0x7f3bc4159690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:39.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.351+0000 7f3bc8ec0640 1 -- 172.21.15.91:0/865582578 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc41566d0 con 0x7f3bc40cc150 2023-11-27T18:43:39.365 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.363+0000 7f3bc8ec0640 1 --2- 172.21.15.91:0/865582578 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3bc40cc150 0x7f3bc40c7af0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3bc406f530 tx=0x7f3bb401ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0859143dff59282 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:39.387 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.383+0000 7f3bbbfff640 1 -- 172.21.15.91:0/865582578 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb40a89b0 con 0x7f3bc40cc150 2023-11-27T18:43:39.387 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.383+0000 7f3bbbfff640 1 -- 172.21.15.91:0/865582578 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb40a8b10 con 0x7f3bc40cc150 2023-11-27T18:43:39.387 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.383+0000 7f3bbbfff640 1 -- 172.21.15.91:0/865582578 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb40a8ea0 con 0x7f3bc40cc150 2023-11-27T18:43:39.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.387+0000 7f3bcb925640 1 -- 172.21.15.91:0/865582578 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3bc40cc150 msgr2=0x7f3bc40c7af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:39.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.387+0000 7f3bcb925640 1 --2- 172.21.15.91:0/865582578 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3bc40cc150 0x7f3bc40c7af0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3bc406f530 tx=0x7f3bb401ecb0 comp rx=0 tx=0).stop 2023-11-27T18:43:39.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.387+0000 7f3bcb925640 1 -- 172.21.15.91:0/865582578 shutdown_connections 2023-11-27T18:43:39.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.387+0000 7f3bcb925640 1 --2- 172.21.15.91:0/865582578 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3bc40cc150 0x7f3bc40c7af0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:39.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.387+0000 7f3bcb925640 1 --2- 172.21.15.91:0/865582578 >> v2:172.21.15.91:3300/0 conn(0x7f3bc40cbd70 0x7f3bc40c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:39.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.387+0000 7f3bcb925640 1 -- 172.21.15.91:0/865582578 >> 172.21.15.91:0/865582578 conn(0x7f3bc4071dc0 msgr2=0x7f3bc40721d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:39.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.387+0000 7f3bcb925640 1 -- 172.21.15.91:0/865582578 shutdown_connections 2023-11-27T18:43:39.389 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.387+0000 7f3bcb925640 1 -- 172.21.15.91:0/865582578 wait complete. 2023-11-27T18:43:39.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.387+0000 7f3bcb925640 1 Processor -- start 2023-11-27T18:43:39.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.387+0000 7f3bcb925640 1 -- start start 2023-11-27T18:43:39.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.391+0000 7f3bcb925640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3bc40c18f0 0x7f3bc41eaa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:39.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.391+0000 7f3bcb925640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3bc40cbd70 0x7f3bc406adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:39.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.391+0000 7f3bcb925640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3bc40cc150 0x7f3bc406b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:39.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.391+0000 7f3bcb925640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc41eb950 con 0x7f3bc40cc150 2023-11-27T18:43:39.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.391+0000 7f3bcb925640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc41eb0b0 con 0x7f3bc40cbd70 2023-11-27T18:43:39.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.391+0000 7f3bcb925640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc41eb390 con 0x7f3bc40c18f0 2023-11-27T18:43:39.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.391+0000 7f3bc96c1640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3bc40c18f0 0x7f3bc41eaa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:39.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.391+0000 7f3bc8ec0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3bc40cbd70 0x7f3bc406adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:39.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.391+0000 7f3bc8ec0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3bc40cbd70 0x7f3bc406adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.91:58704/0 (socket says 172.21.15.91:58704) 2023-11-27T18:43:39.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.391+0000 7f3bc8ec0640 1 -- 172.21.15.91:0/386642114 learned_addr learned my addr 172.21.15.91:0/386642114 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:39.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.395+0000 7f3bc9ec2640 1 --2- 172.21.15.91:0/386642114 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3bc40cc150 0x7f3bc406b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:39.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.403+0000 7f3bc8ec0640 1 -- 172.21.15.91:0/386642114 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3bc40c18f0 msgr2=0x7f3bc41eaa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:39.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.403+0000 7f3bc8ec0640 1 --2- 172.21.15.91:0/386642114 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3bc40c18f0 0x7f3bc41eaa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:39.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.403+0000 7f3bc8ec0640 1 -- 172.21.15.91:0/386642114 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3bc40cc150 msgr2=0x7f3bc406b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:39.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.403+0000 7f3bc8ec0640 1 --2- 172.21.15.91:0/386642114 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3bc40cc150 0x7f3bc406b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:39.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.403+0000 7f3bc8ec0640 1 -- 172.21.15.91:0/386642114 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb40094d0 con 0x7f3bc40cbd70 2023-11-27T18:43:39.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.407+0000 7f3bc8ec0640 1 --2- 172.21.15.91:0/386642114 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3bc40cbd70 0x7f3bc406adf0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3bb40b3040 tx=0x7f3bb401ba50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:39.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.423+0000 7f3bb9ffb640 1 -- 172.21.15.91:0/386642114 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb40b9620 con 0x7f3bc40cbd70 2023-11-27T18:43:39.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.423+0000 7f3bb9ffb640 1 -- 172.21.15.91:0/386642114 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb40b9780 con 0x7f3bc40cbd70 2023-11-27T18:43:39.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.423+0000 7f3bcb925640 1 -- 172.21.15.91:0/386642114 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bc41eb670 con 0x7f3bc40cbd70 2023-11-27T18:43:39.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.423+0000 7f3bb9ffb640 1 -- 172.21.15.91:0/386642114 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb40b9b30 con 0x7f3bc40cbd70 2023-11-27T18:43:39.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.423+0000 7f3bcb925640 1 -- 172.21.15.91:0/386642114 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bc40c6680 con 0x7f3bc40cbd70 2023-11-27T18:43:39.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.423+0000 7f3bcb925640 1 -- 172.21.15.91:0/386642114 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3bc41506b0 con 0x7f3bc40cbd70 2023-11-27T18:43:39.630 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.627+0000 7f3bb9ffb640 1 -- 172.21.15.91:0/386642114 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f3bb40b7070 con 0x7f3bc40cbd70 2023-11-27T18:43:39.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.627+0000 7f3bb9ffb640 1 --2- 172.21.15.91:0/386642114 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f3ba8066840 0x7f3ba8068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:39.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.627+0000 7f3bc96c1640 1 --2- 172.21.15.91:0/386642114 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f3ba8066840 0x7f3ba8068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:39.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.631+0000 7f3bc96c1640 1 --2- 172.21.15.91:0/386642114 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f3ba8066840 0x7f3ba8068d00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0007a60 tx=0x7f3bc0008040 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:39.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.635+0000 7f3bb9ffb640 1 -- 172.21.15.91:0/386642114 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3bb40f4060 con 0x7f3bc40cbd70 2023-11-27T18:43:39.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.639+0000 7f3bb9ffb640 1 --2- 172.21.15.91:0/386642114 >> [v2:172.21.15.94:6824/3389553935,v1:172.21.15.94:6825/3389553935] conn(0x7f3ba806fea0 0x7f3ba8072340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:39.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.639+0000 7f3bb9ffb640 1 -- 172.21.15.91:0/386642114 --> [v2:172.21.15.94:6824/3389553935,v1:172.21.15.94:6825/3389553935] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3ba8072a10 con 0x7f3ba806fea0 2023-11-27T18:43:39.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.639+0000 7f3bc9ec2640 1 --2- 172.21.15.91:0/386642114 >> [v2:172.21.15.94:6824/3389553935,v1:172.21.15.94:6825/3389553935] conn(0x7f3ba806fea0 0x7f3ba8072340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:39.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.639+0000 7f3bc9ec2640 1 --2- 172.21.15.91:0/386642114 >> [v2:172.21.15.94:6824/3389553935,v1:172.21.15.94:6825/3389553935] conn(0x7f3ba806fea0 0x7f3ba8072340 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:39.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.639+0000 7f3bb9ffb640 1 -- 172.21.15.91:0/386642114 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3bb40efca0 con 0x7f3bc40cbd70 2023-11-27T18:43:39.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.639+0000 7f3bb9ffb640 1 -- 172.21.15.91:0/386642114 <== osd.6 v2:172.21.15.94:6824/3389553935 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f3ba8072a10 con 0x7f3ba806fea0 2023-11-27T18:43:39.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.659+0000 7f3bcb925640 1 -- 172.21.15.91:0/386642114 --> [v2:172.21.15.94:6824/3389553935,v1:172.21.15.94:6825/3389553935] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3bc41560a0 con 0x7f3ba806fea0 2023-11-27T18:43:39.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.659+0000 7f3bb9ffb640 1 -- 172.21.15.91:0/386642114 <== osd.6 v2:172.21.15.94:6824/3389553935 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f3bbc009b70 con 0x7f3ba806fea0 2023-11-27T18:43:39.664 INFO:teuthology.orchestra.run.smithi091.stdout:{ 2023-11-27T18:43:39.664 INFO:teuthology.orchestra.run.smithi091.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-27T18:43:39.664 INFO:teuthology.orchestra.run.smithi091.stdout:} 2023-11-27T18:43:39.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.663+0000 7f3bcb925640 1 -- 172.21.15.91:0/386642114 >> [v2:172.21.15.94:6824/3389553935,v1:172.21.15.94:6825/3389553935] conn(0x7f3ba806fea0 msgr2=0x7f3ba8072340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:39.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.663+0000 7f3bcb925640 1 --2- 172.21.15.91:0/386642114 >> [v2:172.21.15.94:6824/3389553935,v1:172.21.15.94:6825/3389553935] conn(0x7f3ba806fea0 0x7f3ba8072340 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:39.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.663+0000 7f3bcb925640 1 -- 172.21.15.91:0/386642114 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f3ba8066840 msgr2=0x7f3ba8068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:39.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.663+0000 7f3bcb925640 1 --2- 172.21.15.91:0/386642114 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f3ba8066840 0x7f3ba8068d00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0007a60 tx=0x7f3bc0008040 comp rx=0 tx=0).stop 2023-11-27T18:43:39.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.663+0000 7f3bcb925640 1 -- 172.21.15.91:0/386642114 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3bc40cbd70 msgr2=0x7f3bc406adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:39.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.663+0000 7f3bcb925640 1 --2- 172.21.15.91:0/386642114 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3bc40cbd70 0x7f3bc406adf0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3bb40b3040 tx=0x7f3bb401ba50 comp rx=0 tx=0).stop 2023-11-27T18:43:39.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.663+0000 7f3bc9ec2640 1 -- 172.21.15.91:0/386642114 reap_dead start 2023-11-27T18:43:39.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.663+0000 7f3bcb925640 1 -- 172.21.15.91:0/386642114 shutdown_connections 2023-11-27T18:43:39.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.663+0000 7f3bcb925640 1 -- 172.21.15.91:0/386642114 >> 172.21.15.91:0/386642114 conn(0x7f3bc4071dc0 msgr2=0x7f3bc40c0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:39.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.663+0000 7f3bcb925640 1 -- 172.21.15.91:0/386642114 shutdown_connections 2023-11-27T18:43:39.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.663+0000 7f3bcb925640 1 -- 172.21.15.91:0/386642114 wait complete. 2023-11-27T18:43:39.687 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-11-27T18:43:39.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.819+0000 7f087b4fc640 1 Processor -- start 2023-11-27T18:43:39.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.819+0000 7f087b4fc640 1 -- start start 2023-11-27T18:43:39.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.819+0000 7f087b4fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f08740c40e0 0x7f08740c44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:39.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.819+0000 7f087b4fc640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0874072820 0x7f087406ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:39.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.819+0000 7f087b4fc640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f087415aa00 con 0x7f087406b140 2023-11-27T18:43:39.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.819+0000 7f087b4fc640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08740c7090 con 0x7f08740c40e0 2023-11-27T18:43:39.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.819+0000 7f087b4fc640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08740c4a00 con 0x7f0874072820 2023-11-27T18:43:39.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.819+0000 7f0879298640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f08740c40e0 0x7f08740c44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:39.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.819+0000 7f0879a99640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f087406b140 0x7f08741576e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:44962/0 (socket says 172.21.15.91:44962) 2023-11-27T18:43:39.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.819+0000 7f0879a99640 1 -- 172.21.15.91:0/3032228501 learned_addr learned my addr 172.21.15.91:0/3032228501 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:43:39.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.819+0000 7f0878a97640 1 --2- 172.21.15.91:0/3032228501 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0874072820 0x7f087406ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:39.827 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.823+0000 7f0879298640 1 -- 172.21.15.91:0/3032228501 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0874072820 msgr2=0x7f087406ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:39.827 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.823+0000 7f0879298640 1 --2- 172.21.15.91:0/3032228501 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0874072820 0x7f087406ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:39.827 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.823+0000 7f0879298640 1 -- 172.21.15.91:0/3032228501 >> v1:172.21.15.91:6789/0 conn(0x7f087406b140 legacy=0x7f08741576e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:39.827 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.823+0000 7f0879298640 1 -- 172.21.15.91:0/3032228501 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f087415acc0 con 0x7f08740c40e0 2023-11-27T18:43:39.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.831+0000 7f0879298640 1 --2- 172.21.15.91:0/3032228501 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f08740c40e0 0x7f08740c44c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f08700097c0 tx=0x7f087001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59eca2bc15aea12e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:39.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.835+0000 7f086bfff640 1 -- 172.21.15.91:0/3032228501 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08700ab680 con 0x7f08740c40e0 2023-11-27T18:43:39.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.835+0000 7f086bfff640 1 -- 172.21.15.91:0/3032228501 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08700ab7e0 con 0x7f08740c40e0 2023-11-27T18:43:39.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.835+0000 7f086bfff640 1 -- 172.21.15.91:0/3032228501 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08700abb70 con 0x7f08740c40e0 2023-11-27T18:43:39.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.835+0000 7f087b4fc640 1 -- 172.21.15.91:0/3032228501 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f08740c40e0 msgr2=0x7f08740c44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:39.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.835+0000 7f087b4fc640 1 --2- 172.21.15.91:0/3032228501 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f08740c40e0 0x7f08740c44c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f08700097c0 tx=0x7f087001c480 comp rx=0 tx=0).stop 2023-11-27T18:43:39.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.835+0000 7f087b4fc640 1 -- 172.21.15.91:0/3032228501 shutdown_connections 2023-11-27T18:43:39.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.835+0000 7f087b4fc640 1 --2- 172.21.15.91:0/3032228501 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0874072820 0x7f087406ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:39.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.835+0000 7f087b4fc640 1 --2- 172.21.15.91:0/3032228501 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f08740c40e0 0x7f08740c44c0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:39.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.835+0000 7f087b4fc640 1 -- 172.21.15.91:0/3032228501 >> 172.21.15.91:0/3032228501 conn(0x7f08740ca9d0 msgr2=0x7f08740cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:39.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.835+0000 7f087b4fc640 1 -- 172.21.15.91:0/3032228501 shutdown_connections 2023-11-27T18:43:39.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.835+0000 7f087b4fc640 1 -- 172.21.15.91:0/3032228501 wait complete. 2023-11-27T18:43:39.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.839+0000 7f087b4fc640 1 Processor -- start 2023-11-27T18:43:39.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.839+0000 7f087b4fc640 1 -- start start 2023-11-27T18:43:39.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.839+0000 7f087b4fc640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f087406b140 0x7f08740bf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:39.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.839+0000 7f087b4fc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0874072820 0x7f0874159320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:39.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.839+0000 7f087b4fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f08740c40e0 0x7f0874147a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:39.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.839+0000 7f087b4fc640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0874146ae0 con 0x7f0874072820 2023-11-27T18:43:39.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.839+0000 7f087b4fc640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0874158e90 con 0x7f08740c40e0 2023-11-27T18:43:39.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.839+0000 7f087b4fc640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0874159ed0 con 0x7f087406b140 2023-11-27T18:43:39.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.839+0000 7f0878a97640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0874072820 0x7f0874159320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:39.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.839+0000 7f0878a97640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0874072820 0x7f0874159320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40312/0 (socket says 172.21.15.91:40312) 2023-11-27T18:43:39.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.839+0000 7f0878a97640 1 -- 172.21.15.91:0/2052687260 learned_addr learned my addr 172.21.15.91:0/2052687260 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:39.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.839+0000 7f0879a99640 1 --2- 172.21.15.91:0/2052687260 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f08740c40e0 0x7f0874147a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:39.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.839+0000 7f0879298640 1 --2- 172.21.15.91:0/2052687260 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f087406b140 0x7f08740bf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:39.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.843+0000 7f0878a97640 1 -- 172.21.15.91:0/2052687260 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f087406b140 msgr2=0x7f08740bf8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:39.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.843+0000 7f0878a97640 1 --2- 172.21.15.91:0/2052687260 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f087406b140 0x7f08740bf8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:39.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.843+0000 7f0878a97640 1 -- 172.21.15.91:0/2052687260 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f08740c40e0 msgr2=0x7f0874147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:39.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.843+0000 7f0878a97640 1 --2- 172.21.15.91:0/2052687260 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f08740c40e0 0x7f0874147a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:39.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.843+0000 7f0878a97640 1 -- 172.21.15.91:0/2052687260 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0870009420 con 0x7f0874072820 2023-11-27T18:43:39.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.847+0000 7f0878a97640 1 --2- 172.21.15.91:0/2052687260 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0874072820 0x7f0874159320 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f086400e930 tx=0x7f086400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:39.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.851+0000 7f0869ffb640 1 -- 172.21.15.91:0/2052687260 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0864009690 con 0x7f0874072820 2023-11-27T18:43:39.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.851+0000 7f0869ffb640 1 -- 172.21.15.91:0/2052687260 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f086400ca00 con 0x7f0874072820 2023-11-27T18:43:39.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.851+0000 7f0869ffb640 1 -- 172.21.15.91:0/2052687260 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086400cd70 con 0x7f0874072820 2023-11-27T18:43:39.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.851+0000 7f087b4fc640 1 -- 172.21.15.91:0/2052687260 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0874158560 con 0x7f0874072820 2023-11-27T18:43:39.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.851+0000 7f087b4fc640 1 -- 172.21.15.91:0/2052687260 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0874158b20 con 0x7f0874072820 2023-11-27T18:43:39.855 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:39.851+0000 7f087b4fc640 1 -- 172.21.15.91:0/2052687260 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0874158ce0 con 0x7f0874072820 2023-11-27T18:43:40.130 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.127+0000 7f0869ffb640 1 -- 172.21.15.91:0/2052687260 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f0864013470 con 0x7f0874072820 2023-11-27T18:43:40.130 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.127+0000 7f0869ffb640 1 --2- 172.21.15.91:0/2052687260 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f0858066840 0x7f0858068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:40.131 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.127+0000 7f0879298640 1 --2- 172.21.15.91:0/2052687260 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f0858066840 0x7f0858068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:40.131 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.127+0000 7f0879298640 1 --2- 172.21.15.91:0/2052687260 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f0858066840 0x7f0858068d00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f08700af000 tx=0x7f08700a7000 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:40.168 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.167+0000 7f0869ffb640 1 -- 172.21.15.91:0/2052687260 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0864055b00 con 0x7f0874072820 2023-11-27T18:43:40.193 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.191+0000 7f0869ffb640 1 -- 172.21.15.91:0/2052687260 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f0864051e40 con 0x7f0874072820 2023-11-27T18:43:40.362 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.359+0000 7f087b4fc640 1 -- 172.21.15.91:0/2052687260 --> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f08741644a0 con 0x7f0858066840 2023-11-27T18:43:40.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.359+0000 7f0869ffb640 1 -- 172.21.15.91:0/2052687260 <== mgr.4136 v2:172.21.15.91:6800/2814827118 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f08700ab660 con 0x7f0858066840 2023-11-27T18:43:40.363 INFO:teuthology.orchestra.run.smithi091.stderr:instructed osd(s) 6 to deep-scrub 2023-11-27T18:43:40.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.363+0000 7f087b4fc640 1 -- 172.21.15.91:0/2052687260 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f0858066840 msgr2=0x7f0858068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:40.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.363+0000 7f087b4fc640 1 --2- 172.21.15.91:0/2052687260 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f0858066840 0x7f0858068d00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f08700af000 tx=0x7f08700a7000 comp rx=0 tx=0).stop 2023-11-27T18:43:40.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.363+0000 7f087b4fc640 1 -- 172.21.15.91:0/2052687260 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0874072820 msgr2=0x7f0874159320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:40.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.363+0000 7f087b4fc640 1 --2- 172.21.15.91:0/2052687260 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0874072820 0x7f0874159320 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f086400e930 tx=0x7f086400edf0 comp rx=0 tx=0).stop 2023-11-27T18:43:40.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.363+0000 7f087b4fc640 1 -- 172.21.15.91:0/2052687260 shutdown_connections 2023-11-27T18:43:40.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.363+0000 7f087b4fc640 1 --2- 172.21.15.91:0/2052687260 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f0858066840 0x7f0858068d00 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:40.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.363+0000 7f087b4fc640 1 --2- 172.21.15.91:0/2052687260 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f08740c40e0 0x7f0874147a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:40.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.363+0000 7f087b4fc640 1 --2- 172.21.15.91:0/2052687260 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0874072820 0x7f0874159320 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:40.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.363+0000 7f087b4fc640 1 --2- 172.21.15.91:0/2052687260 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f087406b140 0x7f08740bf8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:40.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.363+0000 7f087b4fc640 1 -- 172.21.15.91:0/2052687260 >> 172.21.15.91:0/2052687260 conn(0x7f08740ca9d0 msgr2=0x7f08740cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:40.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.363+0000 7f087b4fc640 1 -- 172.21.15.91:0/2052687260 shutdown_connections 2023-11-27T18:43:40.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.363+0000 7f087b4fc640 1 -- 172.21.15.91:0/2052687260 wait complete. 2023-11-27T18:43:40.383 INFO:tasks.ceph:Scrubbing osd.7 2023-11-27T18:43:40.383 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-11-27T18:43:40.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.507+0000 7f23c181e640 1 Processor -- start 2023-11-27T18:43:40.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.507+0000 7f23c181e640 1 -- start start 2023-11-27T18:43:40.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.507+0000 7f23c181e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f23bc14fc10 0x7f23bc06f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:40.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.507+0000 7f23c181e640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f23bc0c27c0 0x7f23bc072020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:40.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.507+0000 7f23c181e640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23bc0c7b00 con 0x7f23bc0c5d50 2023-11-27T18:43:40.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.507+0000 7f23c181e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23bc06fef0 con 0x7f23bc14fc10 2023-11-27T18:43:40.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.507+0000 7f23c181e640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23bc0c2d90 con 0x7f23bc0c27c0 2023-11-27T18:43:40.513 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.511+0000 7f23baffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f23bc14fc10 0x7f23bc06f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:40.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.511+0000 7f23baffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f23bc14fc10 0x7f23bc06f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40316/0 (socket says 172.21.15.91:40316) 2023-11-27T18:43:40.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.511+0000 7f23baffd640 1 -- 172.21.15.91:0/1212675939 learned_addr learned my addr 172.21.15.91:0/1212675939 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:40.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.515+0000 7f23baffd640 1 -- 172.21.15.91:0/1212675939 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f23bc0c27c0 msgr2=0x7f23bc072020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:40.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.515+0000 7f23baffd640 1 --2- 172.21.15.91:0/1212675939 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f23bc0c27c0 0x7f23bc072020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:40.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.515+0000 7f23baffd640 1 -- 172.21.15.91:0/1212675939 >> v1:172.21.15.94:6789/0 conn(0x7f23bc0c5d50 legacy=0x7f23bc0c6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:40.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.515+0000 7f23baffd640 1 -- 172.21.15.91:0/1212675939 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23bc0c7540 con 0x7f23bc14fc10 2023-11-27T18:43:40.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.519+0000 7f23baffd640 1 --2- 172.21.15.91:0/1212675939 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f23bc14fc10 0x7f23bc06f9b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f23b4009870 tx=0x7f23b401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ae57543b1581c16 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:40.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.523+0000 7f23b9ffb640 1 -- 172.21.15.91:0/1212675939 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b40a89b0 con 0x7f23bc14fc10 2023-11-27T18:43:40.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.523+0000 7f23b9ffb640 1 -- 172.21.15.91:0/1212675939 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b40a8b10 con 0x7f23bc14fc10 2023-11-27T18:43:40.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.523+0000 7f23b9ffb640 1 -- 172.21.15.91:0/1212675939 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b40a8ea0 con 0x7f23bc14fc10 2023-11-27T18:43:40.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.523+0000 7f23c181e640 1 -- 172.21.15.91:0/1212675939 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f23bc14fc10 msgr2=0x7f23bc06f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:40.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.523+0000 7f23c181e640 1 --2- 172.21.15.91:0/1212675939 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f23bc14fc10 0x7f23bc06f9b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f23b4009870 tx=0x7f23b401ecf0 comp rx=0 tx=0).stop 2023-11-27T18:43:40.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.523+0000 7f23c181e640 1 -- 172.21.15.91:0/1212675939 shutdown_connections 2023-11-27T18:43:40.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.523+0000 7f23c181e640 1 --2- 172.21.15.91:0/1212675939 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f23bc0c27c0 0x7f23bc072020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:40.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.523+0000 7f23c181e640 1 --2- 172.21.15.91:0/1212675939 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f23bc14fc10 0x7f23bc06f9b0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:40.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.523+0000 7f23c181e640 1 -- 172.21.15.91:0/1212675939 >> 172.21.15.91:0/1212675939 conn(0x7f23bc071500 msgr2=0x7f23bc071910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:40.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.523+0000 7f23c181e640 1 -- 172.21.15.91:0/1212675939 shutdown_connections 2023-11-27T18:43:40.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.523+0000 7f23c181e640 1 -- 172.21.15.91:0/1212675939 wait complete. 2023-11-27T18:43:40.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.527+0000 7f23c181e640 1 Processor -- start 2023-11-27T18:43:40.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.527+0000 7f23c181e640 1 -- start start 2023-11-27T18:43:40.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.527+0000 7f23c181e640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f23bc0c27c0 0x7f23bc158a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:40.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.527+0000 7f23c181e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f23bc0c5d50 0x7f23bc1eb300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:40.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.527+0000 7f23c181e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f23bc14fc10 0x7f23bc156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:40.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.527+0000 7f23c181e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23bc158f50 con 0x7f23bc0c5d50 2023-11-27T18:43:40.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.527+0000 7f23c181e640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23bc154530 con 0x7f23bc14fc10 2023-11-27T18:43:40.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.527+0000 7f23c181e640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23bc153c90 con 0x7f23bc0c27c0 2023-11-27T18:43:40.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.527+0000 7f23ba7fc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f23bc0c5d50 0x7f23bc1eb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:40.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.527+0000 7f23ba7fc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f23bc0c5d50 0x7f23bc1eb300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40326/0 (socket says 172.21.15.91:40326) 2023-11-27T18:43:40.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.527+0000 7f23ba7fc640 1 -- 172.21.15.91:0/2303450083 learned_addr learned my addr 172.21.15.91:0/2303450083 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:40.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.531+0000 7f23ba7fc640 1 -- 172.21.15.91:0/2303450083 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f23bc0c27c0 msgr2=0x7f23bc158a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:40.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.531+0000 7f23ba7fc640 1 --2- 172.21.15.91:0/2303450083 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f23bc0c27c0 0x7f23bc158a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:40.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.531+0000 7f23ba7fc640 1 -- 172.21.15.91:0/2303450083 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f23bc14fc10 msgr2=0x7f23bc156a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:40.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.531+0000 7f23ba7fc640 1 --2- 172.21.15.91:0/2303450083 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f23bc14fc10 0x7f23bc156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:40.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.531+0000 7f23ba7fc640 1 -- 172.21.15.91:0/2303450083 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b40094d0 con 0x7f23bc0c5d50 2023-11-27T18:43:40.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.535+0000 7f23ba7fc640 1 --2- 172.21.15.91:0/2303450083 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f23bc0c5d50 0x7f23bc1eb300 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f23b000c410 tx=0x7f23b000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:40.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.535+0000 7f23a3fff640 1 -- 172.21.15.91:0/2303450083 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b0003600 con 0x7f23bc0c5d50 2023-11-27T18:43:40.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.535+0000 7f23a3fff640 1 -- 172.21.15.91:0/2303450083 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b0003780 con 0x7f23bc0c5d50 2023-11-27T18:43:40.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.535+0000 7f23c181e640 1 -- 172.21.15.91:0/2303450083 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23bc153f70 con 0x7f23bc0c5d50 2023-11-27T18:43:40.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.539+0000 7f23a3fff640 1 -- 172.21.15.91:0/2303450083 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b0003b30 con 0x7f23bc0c5d50 2023-11-27T18:43:40.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.539+0000 7f23c181e640 1 -- 172.21.15.91:0/2303450083 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23bc1eab00 con 0x7f23bc0c5d50 2023-11-27T18:43:40.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.539+0000 7f23c181e640 1 -- 172.21.15.91:0/2303450083 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f23bc0c6720 con 0x7f23bc0c5d50 2023-11-27T18:43:40.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.559+0000 7f23a3fff640 1 -- 172.21.15.91:0/2303450083 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f23b0003c90 con 0x7f23bc0c5d50 2023-11-27T18:43:40.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.563+0000 7f23a3fff640 1 --2- 172.21.15.91:0/2303450083 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f23a8066840 0x7f23a8068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:40.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.563+0000 7f23baffd640 1 --2- 172.21.15.91:0/2303450083 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f23a8066840 0x7f23a8068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:40.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.563+0000 7f23baffd640 1 --2- 172.21.15.91:0/2303450083 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f23a8066840 0x7f23a8068d00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f23b40b2000 tx=0x7f23b4004740 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:40.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.567+0000 7f23a3fff640 1 -- 172.21.15.91:0/2303450083 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f23b00010f0 con 0x7f23bc0c5d50 2023-11-27T18:43:40.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.567+0000 7f23a3fff640 1 --2- 172.21.15.91:0/2303450083 >> [v2:172.21.15.94:6800/1606498064,v1:172.21.15.94:6801/1606498064] conn(0x7f23a806ff20 0x7f23a80723c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:40.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.567+0000 7f23a3fff640 1 -- 172.21.15.91:0/2303450083 --> [v2:172.21.15.94:6800/1606498064,v1:172.21.15.94:6801/1606498064] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f23a8072a90 con 0x7f23a806ff20 2023-11-27T18:43:40.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.567+0000 7f23a3fff640 1 -- 172.21.15.91:0/2303450083 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f23b00514d0 con 0x7f23bc0c5d50 2023-11-27T18:43:40.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.567+0000 7f23bb7fe640 1 --2- 172.21.15.91:0/2303450083 >> [v2:172.21.15.94:6800/1606498064,v1:172.21.15.94:6801/1606498064] conn(0x7f23a806ff20 0x7f23a80723c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:40.571 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.567+0000 7f23bb7fe640 1 --2- 172.21.15.91:0/2303450083 >> [v2:172.21.15.94:6800/1606498064,v1:172.21.15.94:6801/1606498064] conn(0x7f23a806ff20 0x7f23a80723c0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:40.574 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.571+0000 7f23a3fff640 1 -- 172.21.15.91:0/2303450083 <== osd.7 v2:172.21.15.94:6800/1606498064 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f23a8072a90 con 0x7f23a806ff20 2023-11-27T18:43:40.589 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.587+0000 7f23c181e640 1 -- 172.21.15.91:0/2303450083 --> [v2:172.21.15.94:6800/1606498064,v1:172.21.15.94:6801/1606498064] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f23bc0c6440 con 0x7f23a806ff20 2023-11-27T18:43:40.590 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.587+0000 7f23a3fff640 1 -- 172.21.15.91:0/2303450083 <== osd.7 v2:172.21.15.94:6800/1606498064 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f23ac00ac70 con 0x7f23a806ff20 2023-11-27T18:43:40.590 INFO:teuthology.orchestra.run.smithi091.stdout:{ 2023-11-27T18:43:40.590 INFO:teuthology.orchestra.run.smithi091.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-27T18:43:40.591 INFO:teuthology.orchestra.run.smithi091.stdout:} 2023-11-27T18:43:40.591 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.587+0000 7f23c181e640 1 -- 172.21.15.91:0/2303450083 >> [v2:172.21.15.94:6800/1606498064,v1:172.21.15.94:6801/1606498064] conn(0x7f23a806ff20 msgr2=0x7f23a80723c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:40.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.587+0000 7f23c181e640 1 --2- 172.21.15.91:0/2303450083 >> [v2:172.21.15.94:6800/1606498064,v1:172.21.15.94:6801/1606498064] conn(0x7f23a806ff20 0x7f23a80723c0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:40.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.587+0000 7f23c181e640 1 -- 172.21.15.91:0/2303450083 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f23a8066840 msgr2=0x7f23a8068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:40.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.587+0000 7f23c181e640 1 --2- 172.21.15.91:0/2303450083 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f23a8066840 0x7f23a8068d00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f23b40b2000 tx=0x7f23b4004740 comp rx=0 tx=0).stop 2023-11-27T18:43:40.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.587+0000 7f23c181e640 1 -- 172.21.15.91:0/2303450083 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f23bc0c5d50 msgr2=0x7f23bc1eb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:40.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.587+0000 7f23c181e640 1 --2- 172.21.15.91:0/2303450083 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f23bc0c5d50 0x7f23bc1eb300 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f23b000c410 tx=0x7f23b000c8d0 comp rx=0 tx=0).stop 2023-11-27T18:43:40.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.587+0000 7f23bb7fe640 1 -- 172.21.15.91:0/2303450083 reap_dead start 2023-11-27T18:43:40.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.587+0000 7f23c181e640 1 -- 172.21.15.91:0/2303450083 shutdown_connections 2023-11-27T18:43:40.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.587+0000 7f23c181e640 1 -- 172.21.15.91:0/2303450083 >> 172.21.15.91:0/2303450083 conn(0x7f23bc071500 msgr2=0x7f23bc14ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:40.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.587+0000 7f23c181e640 1 -- 172.21.15.91:0/2303450083 shutdown_connections 2023-11-27T18:43:40.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.587+0000 7f23c181e640 1 -- 172.21.15.91:0/2303450083 wait complete. 2023-11-27T18:43:40.609 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-11-27T18:43:40.648 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:43:40.657 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:43:40.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.727+0000 7fb707210640 1 Processor -- start 2023-11-27T18:43:40.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.727+0000 7fb707210640 1 -- start start 2023-11-27T18:43:40.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.727+0000 7fb707210640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb70015b550 0x7fb700157230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:40.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.727+0000 7fb707210640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb7000c8be0 0x7fb700157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:40.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.727+0000 7fb707210640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb70015a820 con 0x7fb700151650 2023-11-27T18:43:40.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.727+0000 7fb707210640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7000b0410 con 0x7fb7000c8be0 2023-11-27T18:43:40.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.727+0000 7fb707210640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb70015b0c0 con 0x7fb70015b550 2023-11-27T18:43:40.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.791+0000 7fb7057ad640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb7000c8be0 0x7fb700157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:40.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.795+0000 7fb7057ad640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb7000c8be0 0x7fb700157770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.91:58748/0 (socket says 172.21.15.91:58748) 2023-11-27T18:43:40.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.795+0000 7fb7057ad640 1 -- 172.21.15.91:0/3358712255 learned_addr learned my addr 172.21.15.91:0/3358712255 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:40.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.811+0000 7fb7057ad640 1 -- 172.21.15.91:0/3358712255 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb70015b550 msgr2=0x7fb700157230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:40.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.811+0000 7fb7057ad640 1 --2- 172.21.15.91:0/3358712255 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb70015b550 0x7fb700157230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:40.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.811+0000 7fb7057ad640 1 -- 172.21.15.91:0/3358712255 >> v1:172.21.15.94:6789/0 conn(0x7fb700151650 legacy=0x7fb7000c1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:40.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.811+0000 7fb7057ad640 1 -- 172.21.15.91:0/3358712255 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb700157d50 con 0x7fb7000c8be0 2023-11-27T18:43:40.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.823+0000 7fb7057ad640 1 --2- 172.21.15.91:0/3358712255 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7000c8be0 0x7fb700157770 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8009e50 tx=0x7fb6f801c980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c48790a1ae35cd43 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:40.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.831+0000 7fb6f77fe640 1 -- 172.21.15.91:0/3358712255 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f80a5840 con 0x7fb7000c8be0 2023-11-27T18:43:40.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.831+0000 7fb6f77fe640 1 -- 172.21.15.91:0/3358712255 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6f80a59a0 con 0x7fb7000c8be0 2023-11-27T18:43:40.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.831+0000 7fb6f77fe640 1 -- 172.21.15.91:0/3358712255 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f80a5d30 con 0x7fb7000c8be0 2023-11-27T18:43:40.835 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.831+0000 7fb707210640 1 -- 172.21.15.91:0/3358712255 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7000c8be0 msgr2=0x7fb700157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:40.835 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.831+0000 7fb707210640 1 --2- 172.21.15.91:0/3358712255 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7000c8be0 0x7fb700157770 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8009e50 tx=0x7fb6f801c980 comp rx=0 tx=0).stop 2023-11-27T18:43:40.835 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.831+0000 7fb707210640 1 -- 172.21.15.91:0/3358712255 shutdown_connections 2023-11-27T18:43:40.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.831+0000 7fb707210640 1 --2- 172.21.15.91:0/3358712255 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7000c8be0 0x7fb700157770 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:40.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.831+0000 7fb707210640 1 --2- 172.21.15.91:0/3358712255 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb70015b550 0x7fb700157230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:40.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.831+0000 7fb707210640 1 -- 172.21.15.91:0/3358712255 >> 172.21.15.91:0/3358712255 conn(0x7fb7000709f0 msgr2=0x7fb700070e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:40.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.831+0000 7fb707210640 1 -- 172.21.15.91:0/3358712255 shutdown_connections 2023-11-27T18:43:40.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.831+0000 7fb707210640 1 -- 172.21.15.91:0/3358712255 wait complete. 2023-11-27T18:43:40.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.835+0000 7fb707210640 1 Processor -- start 2023-11-27T18:43:40.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.835+0000 7fb707210640 1 -- start start 2023-11-27T18:43:40.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.835+0000 7fb707210640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb7000c8be0 0x7fb7000b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:40.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.835+0000 7fb707210640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb700151650 0x7fb700156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:40.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.835+0000 7fb707210640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb70015b550 0x7fb700142d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:40.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.835+0000 7fb707210640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7001f3dd0 con 0x7fb700151650 2023-11-27T18:43:40.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.835+0000 7fb707210640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb700157160 con 0x7fb70015b550 2023-11-27T18:43:40.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.835+0000 7fb707210640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7001418b0 con 0x7fb7000c8be0 2023-11-27T18:43:40.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.839+0000 7fb7057ad640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb70015b550 0x7fb700142d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:40.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.839+0000 7fb6f7fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb700151650 0x7fb700156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:40.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.839+0000 7fb7057ad640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb70015b550 0x7fb700142d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.91:58758/0 (socket says 172.21.15.91:58758) 2023-11-27T18:43:40.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.839+0000 7fb7057ad640 1 -- 172.21.15.91:0/3713210894 learned_addr learned my addr 172.21.15.91:0/3713210894 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:40.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.843+0000 7fb6f7fff640 1 -- 172.21.15.91:0/3713210894 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb7000c8be0 msgr2=0x7fb7000b21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:40.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.843+0000 7fb6f7fff640 1 --2- 172.21.15.91:0/3713210894 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb7000c8be0 0x7fb7000b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:40.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.843+0000 7fb6f7fff640 1 -- 172.21.15.91:0/3713210894 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb70015b550 msgr2=0x7fb700142d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:40.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.843+0000 7fb6f7fff640 1 --2- 172.21.15.91:0/3713210894 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb70015b550 0x7fb700142d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:40.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.843+0000 7fb6f7fff640 1 -- 172.21.15.91:0/3713210894 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f8009b30 con 0x7fb700151650 2023-11-27T18:43:40.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.847+0000 7fb6f7fff640 1 --2- 172.21.15.91:0/3713210894 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb700151650 0x7fb700156b60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb6f000b410 tx=0x7fb6f000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:40.852 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.851+0000 7fb6f57fa640 1 -- 172.21.15.91:0/3713210894 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f0005980 con 0x7fb700151650 2023-11-27T18:43:40.852 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.851+0000 7fb6f57fa640 1 -- 172.21.15.91:0/3713210894 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6f0005b00 con 0x7fb700151650 2023-11-27T18:43:40.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.851+0000 7fb6f57fa640 1 -- 172.21.15.91:0/3713210894 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f0006020 con 0x7fb700151650 2023-11-27T18:43:40.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.851+0000 7fb707210640 1 -- 172.21.15.91:0/3713210894 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7001f3150 con 0x7fb700151650 2023-11-27T18:43:40.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.851+0000 7fb707210640 1 -- 172.21.15.91:0/3713210894 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7001f3710 con 0x7fb700151650 2023-11-27T18:43:40.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.851+0000 7fb707210640 1 -- 172.21.15.91:0/3713210894 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7001f3f10 con 0x7fb700151650 2023-11-27T18:43:40.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.871+0000 7fb6f57fa640 1 -- 172.21.15.91:0/3713210894 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fb6f0006180 con 0x7fb700151650 2023-11-27T18:43:40.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.871+0000 7fb6f57fa640 1 --2- 172.21.15.91:0/3713210894 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fb6ec0667f0 0x7fb6ec068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:40.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.871+0000 7fb704fac640 1 --2- 172.21.15.91:0/3713210894 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fb6ec0667f0 0x7fb6ec068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:40.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.871+0000 7fb704fac640 1 --2- 172.21.15.91:0/3713210894 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fb6ec0667f0 0x7fb6ec068cb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc000f70 tx=0x7fb6fc0079c0 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:40.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:40.875+0000 7fb6f57fa640 1 -- 172.21.15.91:0/3713210894 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb6f0055ba0 con 0x7fb700151650 2023-11-27T18:43:41.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.159+0000 7fb6f57fa640 1 -- 172.21.15.91:0/3713210894 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fb6f00517e0 con 0x7fb700151650 2023-11-27T18:43:41.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.339+0000 7fb707210640 1 -- 172.21.15.91:0/3713210894 --> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fb70004e850 con 0x7fb6ec0667f0 2023-11-27T18:43:41.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.343+0000 7fb6f57fa640 1 -- 172.21.15.91:0/3713210894 <== mgr.4136 v2:172.21.15.91:6800/2814827118 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb70004e850 con 0x7fb6ec0667f0 2023-11-27T18:43:41.344 INFO:teuthology.orchestra.run.smithi091.stderr:instructed osd(s) 7 to deep-scrub 2023-11-27T18:43:41.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.343+0000 7fb707210640 1 -- 172.21.15.91:0/3713210894 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fb6ec0667f0 msgr2=0x7fb6ec068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:41.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.343+0000 7fb707210640 1 --2- 172.21.15.91:0/3713210894 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fb6ec0667f0 0x7fb6ec068cb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc000f70 tx=0x7fb6fc0079c0 comp rx=0 tx=0).stop 2023-11-27T18:43:41.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.343+0000 7fb707210640 1 -- 172.21.15.91:0/3713210894 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb700151650 msgr2=0x7fb700156b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:41.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.343+0000 7fb707210640 1 --2- 172.21.15.91:0/3713210894 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb700151650 0x7fb700156b60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb6f000b410 tx=0x7fb6f000b8d0 comp rx=0 tx=0).stop 2023-11-27T18:43:41.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.343+0000 7fb707210640 1 -- 172.21.15.91:0/3713210894 shutdown_connections 2023-11-27T18:43:41.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.343+0000 7fb707210640 1 --2- 172.21.15.91:0/3713210894 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fb6ec0667f0 0x7fb6ec068cb0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:41.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.343+0000 7fb707210640 1 --2- 172.21.15.91:0/3713210894 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb70015b550 0x7fb700142d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:41.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.343+0000 7fb707210640 1 --2- 172.21.15.91:0/3713210894 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb700151650 0x7fb700156b60 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:41.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.343+0000 7fb707210640 1 --2- 172.21.15.91:0/3713210894 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb7000c8be0 0x7fb7000b21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:41.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.343+0000 7fb707210640 1 -- 172.21.15.91:0/3713210894 >> 172.21.15.91:0/3713210894 conn(0x7fb7000709f0 msgr2=0x7fb70014bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:41.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.343+0000 7fb707210640 1 -- 172.21.15.91:0/3713210894 shutdown_connections 2023-11-27T18:43:41.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.343+0000 7fb707210640 1 -- 172.21.15.91:0/3713210894 wait complete. 2023-11-27T18:43:41.365 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T18:43:41.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.531+0000 7ff86e399640 1 Processor -- start 2023-11-27T18:43:41.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.531+0000 7ff86e399640 1 -- start start 2023-11-27T18:43:41.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.531+0000 7ff86e399640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff868151820 0x7ff868070e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:41.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.531+0000 7ff86e399640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff8680c85c0 0x7ff86806cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:41.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.531+0000 7ff86e399640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff868072b70 con 0x7ff8680c5f10 2023-11-27T18:43:41.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.531+0000 7ff86e399640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8680c2d20 con 0x7ff8680c85c0 2023-11-27T18:43:41.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.531+0000 7ff86e399640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff868071350 con 0x7ff868151820 2023-11-27T18:43:41.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.539+0000 7ff8677fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff8680c85c0 0x7ff86806cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:41.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.539+0000 7ff8677fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff8680c85c0 0x7ff86806cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.91:58768/0 (socket says 172.21.15.91:58768) 2023-11-27T18:43:41.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.539+0000 7ff8677fe640 1 -- 172.21.15.91:0/1695709443 learned_addr learned my addr 172.21.15.91:0/1695709443 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:41.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.543+0000 7ff867fff640 1 --2- 172.21.15.91:0/1695709443 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff868151820 0x7ff868070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:41.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.547+0000 7ff8677fe640 1 -- 172.21.15.91:0/1695709443 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff868151820 msgr2=0x7ff868070e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:41.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.547+0000 7ff8677fe640 1 --2- 172.21.15.91:0/1695709443 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff868151820 0x7ff868070e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:41.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.547+0000 7ff8677fe640 1 -- 172.21.15.91:0/1695709443 >> v1:172.21.15.94:6789/0 conn(0x7ff8680c5f10 legacy=0x7ff86806d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:43:41.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.547+0000 7ff8677fe640 1 -- 172.21.15.91:0/1695709443 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8680c6490 con 0x7ff8680c85c0 2023-11-27T18:43:41.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.559+0000 7ff8677fe640 1 --2- 172.21.15.91:0/1695709443 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8680c85c0 0x7ff86806cb90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff85c009870 tx=0x7ff85c01ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f58c80aee07a8d98 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:41.568 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.567+0000 7ff866ffd640 1 -- 172.21.15.91:0/1695709443 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85c0a89b0 con 0x7ff8680c85c0 2023-11-27T18:43:41.568 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.567+0000 7ff866ffd640 1 -- 172.21.15.91:0/1695709443 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff85c0a8b10 con 0x7ff8680c85c0 2023-11-27T18:43:41.568 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.567+0000 7ff866ffd640 1 -- 172.21.15.91:0/1695709443 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85c0a8ea0 con 0x7ff8680c85c0 2023-11-27T18:43:41.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.567+0000 7ff86e399640 1 -- 172.21.15.91:0/1695709443 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8680c85c0 msgr2=0x7ff86806cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:41.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.567+0000 7ff86e399640 1 --2- 172.21.15.91:0/1695709443 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8680c85c0 0x7ff86806cb90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff85c009870 tx=0x7ff85c01ecf0 comp rx=0 tx=0).stop 2023-11-27T18:43:41.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.567+0000 7ff86e399640 1 -- 172.21.15.91:0/1695709443 shutdown_connections 2023-11-27T18:43:41.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.567+0000 7ff86e399640 1 --2- 172.21.15.91:0/1695709443 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8680c85c0 0x7ff86806cb90 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:41.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.567+0000 7ff86e399640 1 --2- 172.21.15.91:0/1695709443 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff868151820 0x7ff868070e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:41.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.567+0000 7ff86e399640 1 -- 172.21.15.91:0/1695709443 >> 172.21.15.91:0/1695709443 conn(0x7ff8680c79b0 msgr2=0x7ff8680c7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:41.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.567+0000 7ff86e399640 1 -- 172.21.15.91:0/1695709443 shutdown_connections 2023-11-27T18:43:41.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.567+0000 7ff86e399640 1 -- 172.21.15.91:0/1695709443 wait complete. 2023-11-27T18:43:41.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.567+0000 7ff86e399640 1 Processor -- start 2023-11-27T18:43:41.571 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.567+0000 7ff86e399640 1 -- start start 2023-11-27T18:43:41.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.571+0000 7ff86e399640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8680c5f10 0x7ff8681edb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:41.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.571+0000 7ff86e399640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8680c85c0 0x7ff86814d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:41.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.571+0000 7ff86e399640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff868151820 0x7ff868156790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:41.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.571+0000 7ff86e399640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff868144270 con 0x7ff8680c85c0 2023-11-27T18:43:41.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.571+0000 7ff86e399640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8681474f0 con 0x7ff8680c5f10 2023-11-27T18:43:41.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.571+0000 7ff86e399640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8681ed0b0 con 0x7ff868151820 2023-11-27T18:43:41.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.571+0000 7ff8677fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8680c85c0 0x7ff86814d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:41.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.571+0000 7ff86c936640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff868151820 0x7ff868156790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:41.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.571+0000 7ff8677fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8680c85c0 0x7ff86814d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40344/0 (socket says 172.21.15.91:40344) 2023-11-27T18:43:41.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.571+0000 7ff8677fe640 1 -- 172.21.15.91:0/3684044248 learned_addr learned my addr 172.21.15.91:0/3684044248 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:43:41.574 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.571+0000 7ff867fff640 1 --2- 172.21.15.91:0/3684044248 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8680c5f10 0x7ff8681edb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:41.577 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.575+0000 7ff8677fe640 1 -- 172.21.15.91:0/3684044248 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff868151820 msgr2=0x7ff868156790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:41.577 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.575+0000 7ff8677fe640 1 --2- 172.21.15.91:0/3684044248 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff868151820 0x7ff868156790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:41.577 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.575+0000 7ff8677fe640 1 -- 172.21.15.91:0/3684044248 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8680c5f10 msgr2=0x7ff8681edb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:41.577 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.575+0000 7ff8677fe640 1 --2- 172.21.15.91:0/3684044248 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8680c5f10 0x7ff8681edb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:41.577 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.575+0000 7ff8677fe640 1 -- 172.21.15.91:0/3684044248 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff85c0094d0 con 0x7ff8680c85c0 2023-11-27T18:43:41.579 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.575+0000 7ff8677fe640 1 --2- 172.21.15.91:0/3684044248 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8680c85c0 0x7ff86814d990 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff85c01c920 tx=0x7ff85c01ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:41.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.583+0000 7ff864ff9640 1 -- 172.21.15.91:0/3684044248 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85c0b0db0 con 0x7ff8680c85c0 2023-11-27T18:43:41.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.583+0000 7ff864ff9640 1 -- 172.21.15.91:0/3684044248 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff85c0ba440 con 0x7ff8680c85c0 2023-11-27T18:43:41.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.583+0000 7ff86e399640 1 -- 172.21.15.91:0/3684044248 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff868150420 con 0x7ff8680c85c0 2023-11-27T18:43:41.585 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.583+0000 7ff864ff9640 1 -- 172.21.15.91:0/3684044248 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85c0ba7d0 con 0x7ff8680c85c0 2023-11-27T18:43:41.585 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.583+0000 7ff86e399640 1 -- 172.21.15.91:0/3684044248 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8681ed600 con 0x7ff8680c85c0 2023-11-27T18:43:41.585 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.583+0000 7ff86e399640 1 -- 172.21.15.91:0/3684044248 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8681ed7f0 con 0x7ff8680c85c0 2023-11-27T18:43:41.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.863+0000 7ff864ff9640 1 -- 172.21.15.91:0/3684044248 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7ff85c0ba930 con 0x7ff8680c85c0 2023-11-27T18:43:41.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.867+0000 7ff864ff9640 1 --2- 172.21.15.91:0/3684044248 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7ff854066840 0x7ff854068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:43:41.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.867+0000 7ff867fff640 1 --2- 172.21.15.91:0/3684044248 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7ff854066840 0x7ff854068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:43:41.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.867+0000 7ff867fff640 1 --2- 172.21.15.91:0/3684044248 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7ff854066840 0x7ff854068d00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff858009ac0 tx=0x7ff858009190 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:43:41.884 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.883+0000 7ff864ff9640 1 -- 172.21.15.91:0/3684044248 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff85c0f3880 con 0x7ff8680c85c0 2023-11-27T18:43:41.884 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:41.883+0000 7ff864ff9640 1 -- 172.21.15.91:0/3684044248 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7ff85c0efbc0 con 0x7ff8680c85c0 2023-11-27T18:43:42.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:42.051+0000 7ff86e399640 1 -- 172.21.15.91:0/3684044248 --> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff8680c6a10 con 0x7ff854066840 2023-11-27T18:43:42.068 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:42.067+0000 7ff864ff9640 1 -- 172.21.15.91:0/3684044248 <== mgr.4136 v2:172.21.15.91:6800/2814827118 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+366673 (secure 0 0 0) 0x7ff8580119e0 con 0x7ff854066840 2023-11-27T18:43:42.071 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:43:42.074 INFO:teuthology.orchestra.run.smithi091.stderr:dumped all 2023-11-27T18:43:42.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:42.071+0000 7ff86e399640 1 -- 172.21.15.91:0/3684044248 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7ff854066840 msgr2=0x7ff854068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:42.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:42.071+0000 7ff86e399640 1 --2- 172.21.15.91:0/3684044248 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7ff854066840 0x7ff854068d00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff858009ac0 tx=0x7ff858009190 comp rx=0 tx=0).stop 2023-11-27T18:43:42.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:42.071+0000 7ff86e399640 1 -- 172.21.15.91:0/3684044248 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8680c85c0 msgr2=0x7ff86814d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:43:42.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:42.071+0000 7ff86e399640 1 --2- 172.21.15.91:0/3684044248 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8680c85c0 0x7ff86814d990 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff85c01c920 tx=0x7ff85c01ba90 comp rx=0 tx=0).stop 2023-11-27T18:43:42.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:42.071+0000 7ff86e399640 1 -- 172.21.15.91:0/3684044248 shutdown_connections 2023-11-27T18:43:42.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:42.071+0000 7ff86e399640 1 --2- 172.21.15.91:0/3684044248 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7ff854066840 0x7ff854068d00 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:42.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:42.071+0000 7ff86e399640 1 --2- 172.21.15.91:0/3684044248 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff868151820 0x7ff868156790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:42.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:42.071+0000 7ff86e399640 1 --2- 172.21.15.91:0/3684044248 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8680c85c0 0x7ff86814d990 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:42.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:42.071+0000 7ff86e399640 1 --2- 172.21.15.91:0/3684044248 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8680c5f10 0x7ff8681edb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:43:42.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:42.071+0000 7ff86e399640 1 -- 172.21.15.91:0/3684044248 >> 172.21.15.91:0/3684044248 conn(0x7ff8680c79b0 msgr2=0x7ff868071f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:43:42.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:42.071+0000 7ff86e399640 1 -- 172.21.15.91:0/3684044248 shutdown_connections 2023-11-27T18:43:42.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:43:42.071+0000 7ff86e399640 1 -- 172.21.15.91:0/3684044248 wait complete. 2023-11-27T18:43:42.092 INFO:teuthology.orchestra.run.smithi091.stdout:{"pg_ready":true,"pg_map":{"version":960,"stamp":"2023-11-27T18:43:41.895960+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":24697659,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":665,"num_read_kb":681,"num_write":8239,"num_write_kb":284305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9505,"ondisk_log_size":9505,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":332868,"kb_used_data":34884,"kb_used_omap":12,"kb_used_meta":297907,"kb_avail":754641852,"statfs":{"total":773094113280,"available":772753256448,"internally_reserved":0,"allocated":35721216,"data_stored":50501075,"data_compressed":4804134,"data_compressed_allocated":7446528,"data_compressed_original":23904256,"omap_allocated":12751,"internal_metadata":305057329},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004270"},"pg_stats":[{"pgid":"2.1f","version":"32'712","reported_seq":747,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:28.043175+0000","last_change":"2023-11-27T18:13:12.298503+0000","last_active":"2023-11-27T18:42:28.043175+0000","last_peered":"2023-11-27T18:42:28.043175+0000","last_clean":"2023-11-27T18:42:28.043175+0000","last_became_active":"2023-11-27T18:13:12.298140+0000","last_became_peered":"2023-11-27T18:13:12.298140+0000","last_unstale":"2023-11-27T18:42:28.043175+0000","last_undegraded":"2023-11-27T18:42:28.043175+0000","last_fullsized":"2023-11-27T18:42:28.043175+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":712,"log_dups_size":0,"ondisk_log_size":712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:04:02.661989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":710,"num_write_kb":4473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"32'16","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.085013+0000","last_change":"2023-11-27T18:13:14.416681+0000","last_active":"2023-11-27T18:43:23.085013+0000","last_peered":"2023-11-27T18:43:23.085013+0000","last_clean":"2023-11-27T18:43:23.085013+0000","last_became_active":"2023-11-27T18:13:14.416401+0000","last_became_peered":"2023-11-27T18:13:14.416401+0000","last_unstale":"2023-11-27T18:43:23.085013+0000","last_undegraded":"2023-11-27T18:43:23.085013+0000","last_fullsized":"2023-11-27T18:43:23.085013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"32'75","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:20.602326+0000","last_change":"2023-11-27T18:13:20.916435+0000","last_active":"2023-11-27T18:42:20.602326+0000","last_peered":"2023-11-27T18:42:20.602326+0000","last_clean":"2023-11-27T18:42:20.602326+0000","last_became_active":"2023-11-27T18:13:20.915358+0000","last_became_peered":"2023-11-27T18:13:20.915358+0000","last_unstale":"2023-11-27T18:42:20.602326+0000","last_undegraded":"2023-11-27T18:42:20.602326+0000","last_fullsized":"2023-11-27T18:42:20.602326+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:55:46.903556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":3642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"32'324","reported_seq":360,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.522586+0000","last_change":"2023-11-27T18:13:12.305296+0000","last_active":"2023-11-27T18:43:23.522586+0000","last_peered":"2023-11-27T18:43:23.522586+0000","last_clean":"2023-11-27T18:43:23.522586+0000","last_became_active":"2023-11-27T18:13:12.304981+0000","last_became_peered":"2023-11-27T18:13:12.304981+0000","last_unstale":"2023-11-27T18:43:23.522586+0000","last_undegraded":"2023-11-27T18:43:23.522586+0000","last_fullsized":"2023-11-27T18:43:23.522586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3006109,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":322,"num_write_kb":3093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"32'24","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.088245+0000","last_change":"2023-11-27T18:13:14.366102+0000","last_active":"2023-11-27T18:43:23.088245+0000","last_peered":"2023-11-27T18:43:23.088245+0000","last_clean":"2023-11-27T18:43:23.088245+0000","last_became_active":"2023-11-27T18:13:14.365787+0000","last_became_peered":"2023-11-27T18:13:14.365787+0000","last_unstale":"2023-11-27T18:43:23.088245+0000","last_undegraded":"2023-11-27T18:43:23.088245+0000","last_fullsized":"2023-11-27T18:43:23.088245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"32'88","reported_seq":118,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:24.473240+0000","last_change":"2023-11-27T18:13:20.915811+0000","last_active":"2023-11-27T18:42:24.473240+0000","last_peered":"2023-11-27T18:42:24.473240+0000","last_clean":"2023-11-27T18:42:24.473240+0000","last_became_active":"2023-11-27T18:13:20.914864+0000","last_became_peered":"2023-11-27T18:13:20.914864+0000","last_unstale":"2023-11-27T18:42:24.473240+0000","last_undegraded":"2023-11-27T18:42:24.473240+0000","last_fullsized":"2023-11-27T18:42:24.473240+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":6140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"32'9","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:14.224861+0000","last_change":"2023-11-27T18:13:12.272691+0000","last_active":"2023-11-27T18:43:14.224861+0000","last_peered":"2023-11-27T18:43:14.224861+0000","last_clean":"2023-11-27T18:43:14.224861+0000","last_became_active":"2023-11-27T18:13:12.272343+0000","last_became_peered":"2023-11-27T18:13:12.272343+0000","last_unstale":"2023-11-27T18:43:14.224861+0000","last_undegraded":"2023-11-27T18:43:14.224861+0000","last_fullsized":"2023-11-27T18:43:14.224861+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"32'21","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.113067+0000","last_change":"2023-11-27T18:13:15.804199+0000","last_active":"2023-11-27T18:43:23.113067+0000","last_peered":"2023-11-27T18:43:23.113067+0000","last_clean":"2023-11-27T18:43:23.113067+0000","last_became_active":"2023-11-27T18:13:15.803248+0000","last_became_peered":"2023-11-27T18:13:15.803248+0000","last_unstale":"2023-11-27T18:43:23.113067+0000","last_undegraded":"2023-11-27T18:43:23.113067+0000","last_fullsized":"2023-11-27T18:43:23.113067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"32'82","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:24.296114+0000","last_change":"2023-11-27T18:13:20.909371+0000","last_active":"2023-11-27T18:43:24.296114+0000","last_peered":"2023-11-27T18:43:24.296114+0000","last_clean":"2023-11-27T18:43:24.296114+0000","last_became_active":"2023-11-27T18:13:20.908285+0000","last_became_peered":"2023-11-27T18:13:20.908285+0000","last_unstale":"2023-11-27T18:43:24.296114+0000","last_undegraded":"2023-11-27T18:43:24.296114+0000","last_fullsized":"2023-11-27T18:43:24.296114+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":10516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"32'4","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:14.217924+0000","last_change":"2023-11-27T18:13:12.274531+0000","last_active":"2023-11-27T18:43:14.217924+0000","last_peered":"2023-11-27T18:43:14.217924+0000","last_clean":"2023-11-27T18:43:14.217924+0000","last_became_active":"2023-11-27T18:13:12.274275+0000","last_became_peered":"2023-11-27T18:13:12.274275+0000","last_unstale":"2023-11-27T18:43:14.217924+0000","last_undegraded":"2023-11-27T18:43:14.217924+0000","last_fullsized":"2023-11-27T18:43:14.217924+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"32'37","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.019011+0000","last_change":"2023-11-27T18:13:14.422531+0000","last_active":"2023-11-27T18:43:23.019011+0000","last_peered":"2023-11-27T18:43:23.019011+0000","last_clean":"2023-11-27T18:43:23.019011+0000","last_became_active":"2023-11-27T18:13:14.421811+0000","last_became_peered":"2023-11-27T18:13:14.421811+0000","last_unstale":"2023-11-27T18:43:23.019011+0000","last_undegraded":"2023-11-27T18:43:23.019011+0000","last_fullsized":"2023-11-27T18:43:23.019011+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"32'74","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:24.296034+0000","last_change":"2023-11-27T18:13:20.907358+0000","last_active":"2023-11-27T18:43:24.296034+0000","last_peered":"2023-11-27T18:43:24.296034+0000","last_clean":"2023-11-27T18:43:24.296034+0000","last_became_active":"2023-11-27T18:13:20.906418+0000","last_became_peered":"2023-11-27T18:13:20.906418+0000","last_unstale":"2023-11-27T18:43:24.296034+0000","last_undegraded":"2023-11-27T18:43:24.296034+0000","last_fullsized":"2023-11-27T18:43:24.296034+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":5836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"32'20","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.024348+0000","last_change":"2023-11-27T18:13:14.421453+0000","last_active":"2023-11-27T18:43:23.024348+0000","last_peered":"2023-11-27T18:43:23.024348+0000","last_clean":"2023-11-27T18:43:23.024348+0000","last_became_active":"2023-11-27T18:13:14.418640+0000","last_became_peered":"2023-11-27T18:13:14.418640+0000","last_unstale":"2023-11-27T18:43:23.024348+0000","last_undegraded":"2023-11-27T18:43:23.024348+0000","last_fullsized":"2023-11-27T18:43:23.024348+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"32'688","reported_seq":723,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:06.998077+0000","last_change":"2023-11-27T18:13:12.306690+0000","last_active":"2023-11-27T18:43:06.998077+0000","last_peered":"2023-11-27T18:43:06.998077+0000","last_clean":"2023-11-27T18:43:06.998077+0000","last_became_active":"2023-11-27T18:13:12.306331+0000","last_became_peered":"2023-11-27T18:13:12.306331+0000","last_unstale":"2023-11-27T18:43:06.998077+0000","last_undegraded":"2023-11-27T18:43:06.998077+0000","last_fullsized":"2023-11-27T18:43:06.998077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":683,"num_write_kb":4455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'77","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:34.087162+0000","last_change":"2023-11-27T18:14:22.718298+0000","last_active":"2023-11-27T18:43:34.087162+0000","last_peered":"2023-11-27T18:43:34.087162+0000","last_clean":"2023-11-27T18:43:34.087162+0000","last_became_active":"2023-11-27T18:14:22.717105+0000","last_became_peered":"2023-11-27T18:14:22.717105+0000","last_unstale":"2023-11-27T18:43:34.087162+0000","last_undegraded":"2023-11-27T18:43:34.087162+0000","last_fullsized":"2023-11-27T18:43:34.087162+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":10073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7,5],"acting":[0,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"32'22","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:22.927135+0000","last_change":"2023-11-27T18:13:14.368428+0000","last_active":"2023-11-27T18:43:22.927135+0000","last_peered":"2023-11-27T18:43:22.927135+0000","last_clean":"2023-11-27T18:43:22.927135+0000","last_became_active":"2023-11-27T18:13:14.368117+0000","last_became_peered":"2023-11-27T18:13:14.368117+0000","last_unstale":"2023-11-27T18:43:22.927135+0000","last_undegraded":"2023-11-27T18:43:22.927135+0000","last_fullsized":"2023-11-27T18:43:22.927135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:24:45.528760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"32'2","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:32.409623+0000","last_change":"2023-11-27T18:13:12.306963+0000","last_active":"2023-11-27T18:42:32.409623+0000","last_peered":"2023-11-27T18:42:32.409623+0000","last_clean":"2023-11-27T18:42:32.409623+0000","last_became_active":"2023-11-27T18:13:12.306644+0000","last_became_peered":"2023-11-27T18:13:12.306644+0000","last_unstale":"2023-11-27T18:42:32.409623+0000","last_undegraded":"2023-11-27T18:42:32.409623+0000","last_fullsized":"2023-11-27T18:42:32.409623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:55:43.829654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"32'100","reported_seq":131,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:39.210348+0000","last_change":"2023-11-27T18:13:20.930173+0000","last_active":"2023-11-27T18:42:39.210348+0000","last_peered":"2023-11-27T18:42:39.210348+0000","last_clean":"2023-11-27T18:42:39.210348+0000","last_became_active":"2023-11-27T18:13:20.928830+0000","last_became_peered":"2023-11-27T18:13:20.928830+0000","last_unstale":"2023-11-27T18:42:39.210348+0000","last_undegraded":"2023-11-27T18:42:39.210348+0000","last_fullsized":"2023-11-27T18:42:39.210348+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":7369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"32'24","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.125636+0000","last_change":"2023-11-27T18:13:14.378647+0000","last_active":"2023-11-27T18:43:23.125636+0000","last_peered":"2023-11-27T18:43:23.125636+0000","last_clean":"2023-11-27T18:43:23.125636+0000","last_became_active":"2023-11-27T18:13:14.378391+0000","last_became_peered":"2023-11-27T18:13:14.378391+0000","last_unstale":"2023-11-27T18:43:23.125636+0000","last_undegraded":"2023-11-27T18:43:23.125636+0000","last_fullsized":"2023-11-27T18:43:23.125636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:02:22.189845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"32'4","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:14.226257+0000","last_change":"2023-11-27T18:13:12.270283+0000","last_active":"2023-11-27T18:43:14.226257+0000","last_peered":"2023-11-27T18:43:14.226257+0000","last_clean":"2023-11-27T18:43:14.226257+0000","last_became_active":"2023-11-27T18:13:12.269795+0000","last_became_peered":"2023-11-27T18:13:12.269795+0000","last_unstale":"2023-11-27T18:43:14.226257+0000","last_undegraded":"2023-11-27T18:43:14.226257+0000","last_fullsized":"2023-11-27T18:43:14.226257+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:06:24.103678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'67","reported_seq":97,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:23.879026+0000","last_change":"2023-11-27T18:13:20.907340+0000","last_active":"2023-11-27T18:42:23.879026+0000","last_peered":"2023-11-27T18:42:23.879026+0000","last_clean":"2023-11-27T18:42:23.879026+0000","last_became_active":"2023-11-27T18:13:20.906609+0000","last_became_peered":"2023-11-27T18:13:20.906609+0000","last_unstale":"2023-11-27T18:42:23.879026+0000","last_undegraded":"2023-11-27T18:42:23.879026+0000","last_fullsized":"2023-11-27T18:42:23.879026+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:19:00.295457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":7315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"32'21","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:34.396966+0000","last_change":"2023-11-27T18:13:14.415177+0000","last_active":"2023-11-27T18:43:34.396966+0000","last_peered":"2023-11-27T18:43:34.396966+0000","last_clean":"2023-11-27T18:43:34.396966+0000","last_became_active":"2023-11-27T18:13:14.414888+0000","last_became_peered":"2023-11-27T18:13:14.414888+0000","last_unstale":"2023-11-27T18:43:34.396966+0000","last_undegraded":"2023-11-27T18:43:34.396966+0000","last_fullsized":"2023-11-27T18:43:34.396966+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"32'5","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:34.086827+0000","last_change":"2023-11-27T18:13:12.273724+0000","last_active":"2023-11-27T18:43:34.086827+0000","last_peered":"2023-11-27T18:43:34.086827+0000","last_clean":"2023-11-27T18:43:34.086827+0000","last_became_active":"2023-11-27T18:13:12.273356+0000","last_became_peered":"2023-11-27T18:13:12.273356+0000","last_unstale":"2023-11-27T18:43:34.086827+0000","last_undegraded":"2023-11-27T18:43:34.086827+0000","last_fullsized":"2023-11-27T18:43:34.086827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'85","reported_seq":116,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:39.286536+0000","last_change":"2023-11-27T18:13:20.935910+0000","last_active":"2023-11-27T18:42:39.286536+0000","last_peered":"2023-11-27T18:42:39.286536+0000","last_clean":"2023-11-27T18:42:39.286536+0000","last_became_active":"2023-11-27T18:13:20.934797+0000","last_became_peered":"2023-11-27T18:13:20.934797+0000","last_unstale":"2023-11-27T18:42:39.286536+0000","last_undegraded":"2023-11-27T18:42:39.286536+0000","last_fullsized":"2023-11-27T18:42:39.286536+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":5270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'29","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.125677+0000","last_change":"2023-11-27T18:13:14.376557+0000","last_active":"2023-11-27T18:43:23.125677+0000","last_peered":"2023-11-27T18:43:23.125677+0000","last_clean":"2023-11-27T18:43:23.125677+0000","last_became_active":"2023-11-27T18:13:14.376304+0000","last_became_peered":"2023-11-27T18:13:14.376304+0000","last_unstale":"2023-11-27T18:43:23.125677+0000","last_undegraded":"2023-11-27T18:43:23.125677+0000","last_fullsized":"2023-11-27T18:43:23.125677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:37:22.787246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"32'7","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:34.397301+0000","last_change":"2023-11-27T18:13:12.307806+0000","last_active":"2023-11-27T18:43:34.397301+0000","last_peered":"2023-11-27T18:43:34.397301+0000","last_clean":"2023-11-27T18:43:34.397301+0000","last_became_active":"2023-11-27T18:13:12.307492+0000","last_became_peered":"2023-11-27T18:13:12.307492+0000","last_unstale":"2023-11-27T18:43:34.397301+0000","last_undegraded":"2023-11-27T18:43:34.397301+0000","last_fullsized":"2023-11-27T18:43:34.397301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"32'53","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:34.285317+0000","last_change":"2023-11-27T18:13:20.918671+0000","last_active":"2023-11-27T18:42:34.285317+0000","last_peered":"2023-11-27T18:42:34.285317+0000","last_clean":"2023-11-27T18:42:34.285317+0000","last_became_active":"2023-11-27T18:13:20.917507+0000","last_became_peered":"2023-11-27T18:13:20.917507+0000","last_unstale":"2023-11-27T18:42:34.285317+0000","last_undegraded":"2023-11-27T18:42:34.285317+0000","last_fullsized":"2023-11-27T18:42:34.285317+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":7028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"32'21","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.125750+0000","last_change":"2023-11-27T18:13:14.377644+0000","last_active":"2023-11-27T18:43:23.125750+0000","last_peered":"2023-11-27T18:43:23.125750+0000","last_clean":"2023-11-27T18:43:23.125750+0000","last_became_active":"2023-11-27T18:13:14.377289+0000","last_became_peered":"2023-11-27T18:13:14.377289+0000","last_unstale":"2023-11-27T18:43:23.125750+0000","last_undegraded":"2023-11-27T18:43:23.125750+0000","last_fullsized":"2023-11-27T18:43:23.125750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:55:42.641433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"32'327","reported_seq":362,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:20.365509+0000","last_change":"2023-11-27T18:13:12.267960+0000","last_active":"2023-11-27T18:43:20.365509+0000","last_peered":"2023-11-27T18:43:20.365509+0000","last_clean":"2023-11-27T18:43:20.365509+0000","last_became_active":"2023-11-27T18:13:12.267552+0000","last_became_peered":"2023-11-27T18:13:12.267552+0000","last_unstale":"2023-11-27T18:43:20.365509+0000","last_undegraded":"2023-11-27T18:43:20.365509+0000","last_fullsized":"2023-11-27T18:43:20.365509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:26:13.819717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"32'94","reported_seq":126,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:23.002068+0000","last_change":"2023-11-27T18:13:20.929780+0000","last_active":"2023-11-27T18:42:23.002068+0000","last_peered":"2023-11-27T18:42:23.002068+0000","last_clean":"2023-11-27T18:42:23.002068+0000","last_became_active":"2023-11-27T18:13:20.929370+0000","last_became_peered":"2023-11-27T18:13:20.929370+0000","last_unstale":"2023-11-27T18:42:23.002068+0000","last_undegraded":"2023-11-27T18:42:23.002068+0000","last_fullsized":"2023-11-27T18:42:23.002068+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:04:33.249483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":11915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"32'22","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.010619+0000","last_change":"2023-11-27T18:13:14.369764+0000","last_active":"2023-11-27T18:43:23.010619+0000","last_peered":"2023-11-27T18:43:23.010619+0000","last_clean":"2023-11-27T18:43:23.010619+0000","last_became_active":"2023-11-27T18:13:14.369472+0000","last_became_peered":"2023-11-27T18:13:14.369472+0000","last_unstale":"2023-11-27T18:43:23.010619+0000","last_undegraded":"2023-11-27T18:43:23.010619+0000","last_fullsized":"2023-11-27T18:43:23.010619+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:35:38.706782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:03.762957+0000","last_change":"2023-11-27T18:13:12.310761+0000","last_active":"2023-11-27T18:43:03.762957+0000","last_peered":"2023-11-27T18:43:03.762957+0000","last_clean":"2023-11-27T18:43:03.762957+0000","last_became_active":"2023-11-27T18:13:12.310495+0000","last_became_peered":"2023-11-27T18:13:12.310495+0000","last_unstale":"2023-11-27T18:43:03.762957+0000","last_undegraded":"2023-11-27T18:43:03.762957+0000","last_fullsized":"2023-11-27T18:43:03.762957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"32'62","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:23.008415+0000","last_change":"2023-11-27T18:13:20.907638+0000","last_active":"2023-11-27T18:42:23.008415+0000","last_peered":"2023-11-27T18:42:23.008415+0000","last_clean":"2023-11-27T18:42:23.008415+0000","last_became_active":"2023-11-27T18:13:20.907229+0000","last_became_peered":"2023-11-27T18:13:20.907229+0000","last_unstale":"2023-11-27T18:42:23.008415+0000","last_undegraded":"2023-11-27T18:42:23.008415+0000","last_fullsized":"2023-11-27T18:42:23.008415+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:49:08.226420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":7408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"32'20","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.088638+0000","last_change":"2023-11-27T18:13:15.851127+0000","last_active":"2023-11-27T18:43:23.088638+0000","last_peered":"2023-11-27T18:43:23.088638+0000","last_clean":"2023-11-27T18:43:23.088638+0000","last_became_active":"2023-11-27T18:13:15.850263+0000","last_became_peered":"2023-11-27T18:13:15.850263+0000","last_unstale":"2023-11-27T18:43:23.088638+0000","last_undegraded":"2023-11-27T18:43:23.088638+0000","last_fullsized":"2023-11-27T18:43:23.088638+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"32'4","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:03.781293+0000","last_change":"2023-11-27T18:13:12.310451+0000","last_active":"2023-11-27T18:43:03.781293+0000","last_peered":"2023-11-27T18:43:03.781293+0000","last_clean":"2023-11-27T18:43:03.781293+0000","last_became_active":"2023-11-27T18:13:12.310138+0000","last_became_peered":"2023-11-27T18:13:12.310138+0000","last_unstale":"2023-11-27T18:43:03.781293+0000","last_undegraded":"2023-11-27T18:43:03.781293+0000","last_fullsized":"2023-11-27T18:43:03.781293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"32'81","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:23.006317+0000","last_change":"2023-11-27T18:13:20.896960+0000","last_active":"2023-11-27T18:42:23.006317+0000","last_peered":"2023-11-27T18:42:23.006317+0000","last_clean":"2023-11-27T18:42:23.006317+0000","last_became_active":"2023-11-27T18:13:20.896156+0000","last_became_peered":"2023-11-27T18:13:20.896156+0000","last_unstale":"2023-11-27T18:42:23.006317+0000","last_undegraded":"2023-11-27T18:42:23.006317+0000","last_fullsized":"2023-11-27T18:42:23.006317+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:00:52.213234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":6173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"32'22","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.065809+0000","last_change":"2023-11-27T18:13:14.421498+0000","last_active":"2023-11-27T18:43:23.065809+0000","last_peered":"2023-11-27T18:43:23.065809+0000","last_clean":"2023-11-27T18:43:23.065809+0000","last_became_active":"2023-11-27T18:13:14.421125+0000","last_became_peered":"2023-11-27T18:13:14.421125+0000","last_unstale":"2023-11-27T18:43:23.065809+0000","last_undegraded":"2023-11-27T18:43:23.065809+0000","last_fullsized":"2023-11-27T18:43:23.065809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"32'5","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:14.226128+0000","last_change":"2023-11-27T18:13:12.301922+0000","last_active":"2023-11-27T18:43:14.226128+0000","last_peered":"2023-11-27T18:43:14.226128+0000","last_clean":"2023-11-27T18:43:14.226128+0000","last_became_active":"2023-11-27T18:13:12.301617+0000","last_became_peered":"2023-11-27T18:13:12.301617+0000","last_unstale":"2023-11-27T18:43:14.226128+0000","last_undegraded":"2023-11-27T18:43:14.226128+0000","last_fullsized":"2023-11-27T18:43:14.226128+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'68","reported_seq":99,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:22.894328+0000","last_change":"2023-11-27T18:13:20.905013+0000","last_active":"2023-11-27T18:42:22.894328+0000","last_peered":"2023-11-27T18:42:22.894328+0000","last_clean":"2023-11-27T18:42:22.894328+0000","last_became_active":"2023-11-27T18:13:20.903019+0000","last_became_peered":"2023-11-27T18:13:20.903019+0000","last_unstale":"2023-11-27T18:42:22.894328+0000","last_undegraded":"2023-11-27T18:42:22.894328+0000","last_fullsized":"2023-11-27T18:42:22.894328+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:34:15.874601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":4275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"32'26","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.091030+0000","last_change":"2023-11-27T18:13:14.378913+0000","last_active":"2023-11-27T18:43:23.091030+0000","last_peered":"2023-11-27T18:43:23.091030+0000","last_clean":"2023-11-27T18:43:23.091030+0000","last_became_active":"2023-11-27T18:13:14.378644+0000","last_became_peered":"2023-11-27T18:13:14.378644+0000","last_unstale":"2023-11-27T18:43:23.091030+0000","last_undegraded":"2023-11-27T18:43:23.091030+0000","last_fullsized":"2023-11-27T18:43:23.091030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"32'556","reported_seq":1140,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:18.258483+0000","last_change":"2023-11-27T18:13:12.305733+0000","last_active":"2023-11-27T18:43:18.258483+0000","last_peered":"2023-11-27T18:43:18.258483+0000","last_clean":"2023-11-27T18:43:18.258483+0000","last_became_active":"2023-11-27T18:13:12.305380+0000","last_became_peered":"2023-11-27T18:13:12.305380+0000","last_unstale":"2023-11-27T18:43:18.258483+0000","last_undegraded":"2023-11-27T18:43:18.258483+0000","last_fullsized":"2023-11-27T18:43:18.258483+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:34:46.886091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128192,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":549,"num_read_kb":581,"num_write":552,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"32'76","reported_seq":106,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:20.596319+0000","last_change":"2023-11-27T18:13:20.913672+0000","last_active":"2023-11-27T18:42:20.596319+0000","last_peered":"2023-11-27T18:42:20.596319+0000","last_clean":"2023-11-27T18:42:20.596319+0000","last_became_active":"2023-11-27T18:13:20.913137+0000","last_became_peered":"2023-11-27T18:13:20.913137+0000","last_unstale":"2023-11-27T18:42:20.596319+0000","last_undegraded":"2023-11-27T18:42:20.596319+0000","last_fullsized":"2023-11-27T18:42:20.596319+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:40:20.210205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":7407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"32'15","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.001180+0000","last_change":"2023-11-27T18:13:14.413781+0000","last_active":"2023-11-27T18:43:23.001180+0000","last_peered":"2023-11-27T18:43:23.001180+0000","last_clean":"2023-11-27T18:43:23.001180+0000","last_became_active":"2023-11-27T18:13:14.413413+0000","last_became_peered":"2023-11-27T18:13:14.413413+0000","last_unstale":"2023-11-27T18:43:23.001180+0000","last_undegraded":"2023-11-27T18:43:23.001180+0000","last_fullsized":"2023-11-27T18:43:23.001180+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:04:03.068428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"32'6","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:24.394222+0000","last_change":"2023-11-27T18:13:12.315822+0000","last_active":"2023-11-27T18:43:24.394222+0000","last_peered":"2023-11-27T18:43:24.394222+0000","last_clean":"2023-11-27T18:43:24.394222+0000","last_became_active":"2023-11-27T18:13:12.315610+0000","last_became_peered":"2023-11-27T18:13:12.315610+0000","last_unstale":"2023-11-27T18:43:24.394222+0000","last_undegraded":"2023-11-27T18:43:24.394222+0000","last_fullsized":"2023-11-27T18:43:24.394222+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"32'85","reported_seq":117,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:39.204246+0000","last_change":"2023-11-27T18:13:20.912891+0000","last_active":"2023-11-27T18:43:39.204246+0000","last_peered":"2023-11-27T18:43:39.204246+0000","last_clean":"2023-11-27T18:43:39.204246+0000","last_became_active":"2023-11-27T18:13:20.912453+0000","last_became_peered":"2023-11-27T18:13:20.912453+0000","last_unstale":"2023-11-27T18:43:39.204246+0000","last_undegraded":"2023-11-27T18:43:39.204246+0000","last_fullsized":"2023-11-27T18:43:39.204246+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":10738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"32'21","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.122497+0000","last_change":"2023-11-27T18:13:14.414468+0000","last_active":"2023-11-27T18:43:23.122497+0000","last_peered":"2023-11-27T18:43:23.122497+0000","last_clean":"2023-11-27T18:43:23.122497+0000","last_became_active":"2023-11-27T18:13:14.414156+0000","last_became_peered":"2023-11-27T18:13:14.414156+0000","last_unstale":"2023-11-27T18:43:23.122497+0000","last_undegraded":"2023-11-27T18:43:23.122497+0000","last_fullsized":"2023-11-27T18:43:23.122497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:46:11.500006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"32'3","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:12.259812+0000","last_change":"2023-11-27T18:13:12.308337+0000","last_active":"2023-11-27T18:43:12.259812+0000","last_peered":"2023-11-27T18:43:12.259812+0000","last_clean":"2023-11-27T18:43:12.259812+0000","last_became_active":"2023-11-27T18:13:12.308050+0000","last_became_peered":"2023-11-27T18:13:12.308050+0000","last_unstale":"2023-11-27T18:43:12.259812+0000","last_undegraded":"2023-11-27T18:43:12.259812+0000","last_fullsized":"2023-11-27T18:43:12.259812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"32'119","reported_seq":198,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:35.406912+0000","last_change":"2023-11-27T18:43:35.406964+0000","last_active":"2023-11-27T18:43:35.406912+0000","last_peered":"2023-11-27T18:43:35.406912+0000","last_clean":"2023-11-27T18:43:35.406912+0000","last_became_active":"2023-11-27T18:12:38.370748+0000","last_became_peered":"2023-11-27T18:12:38.370748+0000","last_unstale":"2023-11-27T18:43:35.406912+0000","last_undegraded":"2023-11-27T18:43:35.406912+0000","last_fullsized":"2023-11-27T18:43:35.406912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2023-11-27T18:43:35.406767+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2023-11-27T18:43:35.406767+0000","last_clean_scrub_stamp":"2023-11-27T18:43:35.406767+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:03:00.314752+0000","scrub_duration":0.010946301,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'86","reported_seq":118,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:44.384201+0000","last_change":"2023-11-27T18:13:20.928359+0000","last_active":"2023-11-27T18:42:44.384201+0000","last_peered":"2023-11-27T18:42:44.384201+0000","last_clean":"2023-11-27T18:42:44.384201+0000","last_became_active":"2023-11-27T18:13:20.926559+0000","last_became_peered":"2023-11-27T18:13:20.926559+0000","last_unstale":"2023-11-27T18:42:44.384201+0000","last_undegraded":"2023-11-27T18:42:44.384201+0000","last_fullsized":"2023-11-27T18:42:44.384201+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":7930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"32'24","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.024334+0000","last_change":"2023-11-27T18:13:14.422275+0000","last_active":"2023-11-27T18:43:23.024334+0000","last_peered":"2023-11-27T18:43:23.024334+0000","last_clean":"2023-11-27T18:43:23.024334+0000","last_became_active":"2023-11-27T18:13:14.419636+0000","last_became_peered":"2023-11-27T18:13:14.419636+0000","last_unstale":"2023-11-27T18:43:23.024334+0000","last_undegraded":"2023-11-27T18:43:23.024334+0000","last_fullsized":"2023-11-27T18:43:23.024334+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"32'2","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:44.034879+0000","last_change":"2023-11-27T18:13:12.268222+0000","last_active":"2023-11-27T18:42:44.034879+0000","last_peered":"2023-11-27T18:42:44.034879+0000","last_clean":"2023-11-27T18:42:44.034879+0000","last_became_active":"2023-11-27T18:13:12.267764+0000","last_became_peered":"2023-11-27T18:13:12.267764+0000","last_unstale":"2023-11-27T18:42:44.034879+0000","last_undegraded":"2023-11-27T18:42:44.034879+0000","last_fullsized":"2023-11-27T18:42:44.034879+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:48:38.383796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"32'73","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:14.845768+0000","last_change":"2023-11-27T18:13:20.917055+0000","last_active":"2023-11-27T18:42:14.845768+0000","last_peered":"2023-11-27T18:42:14.845768+0000","last_clean":"2023-11-27T18:42:14.845768+0000","last_became_active":"2023-11-27T18:13:20.914157+0000","last_became_peered":"2023-11-27T18:13:20.914157+0000","last_unstale":"2023-11-27T18:42:14.845768+0000","last_undegraded":"2023-11-27T18:42:14.845768+0000","last_fullsized":"2023-11-27T18:42:14.845768+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":5275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'24","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.090687+0000","last_change":"2023-11-27T18:13:14.363559+0000","last_active":"2023-11-27T18:43:23.090687+0000","last_peered":"2023-11-27T18:43:23.090687+0000","last_clean":"2023-11-27T18:43:23.090687+0000","last_became_active":"2023-11-27T18:13:14.363285+0000","last_became_peered":"2023-11-27T18:13:14.363285+0000","last_unstale":"2023-11-27T18:43:23.090687+0000","last_undegraded":"2023-11-27T18:43:23.090687+0000","last_fullsized":"2023-11-27T18:43:23.090687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"32'3","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:54.425617+0000","last_change":"2023-11-27T18:13:12.312477+0000","last_active":"2023-11-27T18:42:54.425617+0000","last_peered":"2023-11-27T18:42:54.425617+0000","last_clean":"2023-11-27T18:42:54.425617+0000","last_became_active":"2023-11-27T18:13:12.312038+0000","last_became_peered":"2023-11-27T18:13:12.312038+0000","last_unstale":"2023-11-27T18:42:54.425617+0000","last_undegraded":"2023-11-27T18:42:54.425617+0000","last_fullsized":"2023-11-27T18:42:54.425617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"32'90","reported_seq":121,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:35.356176+0000","last_change":"2023-11-27T18:13:20.913830+0000","last_active":"2023-11-27T18:42:35.356176+0000","last_peered":"2023-11-27T18:42:35.356176+0000","last_clean":"2023-11-27T18:42:35.356176+0000","last_became_active":"2023-11-27T18:13:20.912734+0000","last_became_peered":"2023-11-27T18:13:20.912734+0000","last_unstale":"2023-11-27T18:42:35.356176+0000","last_undegraded":"2023-11-27T18:42:35.356176+0000","last_fullsized":"2023-11-27T18:42:35.356176+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":13642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"32'25","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.094908+0000","last_change":"2023-11-27T18:13:14.364027+0000","last_active":"2023-11-27T18:43:23.094908+0000","last_peered":"2023-11-27T18:43:23.094908+0000","last_clean":"2023-11-27T18:43:23.094908+0000","last_became_active":"2023-11-27T18:13:14.363772+0000","last_became_peered":"2023-11-27T18:13:14.363772+0000","last_unstale":"2023-11-27T18:43:23.094908+0000","last_undegraded":"2023-11-27T18:43:23.094908+0000","last_fullsized":"2023-11-27T18:43:23.094908+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"32'4","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:58.522360+0000","last_change":"2023-11-27T18:13:12.304785+0000","last_active":"2023-11-27T18:42:58.522360+0000","last_peered":"2023-11-27T18:42:58.522360+0000","last_clean":"2023-11-27T18:42:58.522360+0000","last_became_active":"2023-11-27T18:13:12.304400+0000","last_became_peered":"2023-11-27T18:13:12.304400+0000","last_unstale":"2023-11-27T18:42:58.522360+0000","last_undegraded":"2023-11-27T18:42:58.522360+0000","last_fullsized":"2023-11-27T18:42:58.522360+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:37:52.292054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"32'60","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:18.419357+0000","last_change":"2023-11-27T18:13:20.922959+0000","last_active":"2023-11-27T18:42:18.419357+0000","last_peered":"2023-11-27T18:42:18.419357+0000","last_clean":"2023-11-27T18:42:18.419357+0000","last_became_active":"2023-11-27T18:13:20.918984+0000","last_became_peered":"2023-11-27T18:13:20.918984+0000","last_unstale":"2023-11-27T18:42:18.419357+0000","last_undegraded":"2023-11-27T18:42:18.419357+0000","last_fullsized":"2023-11-27T18:42:18.419357+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":5801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"32'17","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.089526+0000","last_change":"2023-11-27T18:13:15.852939+0000","last_active":"2023-11-27T18:43:23.089526+0000","last_peered":"2023-11-27T18:43:23.089526+0000","last_clean":"2023-11-27T18:43:23.089526+0000","last_became_active":"2023-11-27T18:13:15.852339+0000","last_became_peered":"2023-11-27T18:13:15.852339+0000","last_unstale":"2023-11-27T18:43:23.089526+0000","last_undegraded":"2023-11-27T18:43:23.089526+0000","last_fullsized":"2023-11-27T18:43:23.089526+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"32'7","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:14.218413+0000","last_change":"2023-11-27T18:13:12.311109+0000","last_active":"2023-11-27T18:43:14.218413+0000","last_peered":"2023-11-27T18:43:14.218413+0000","last_clean":"2023-11-27T18:43:14.218413+0000","last_became_active":"2023-11-27T18:13:12.310921+0000","last_became_peered":"2023-11-27T18:13:12.310921+0000","last_unstale":"2023-11-27T18:43:14.218413+0000","last_undegraded":"2023-11-27T18:43:14.218413+0000","last_fullsized":"2023-11-27T18:43:14.218413+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"32'108","reported_seq":139,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:20.685645+0000","last_change":"2023-11-27T18:13:20.925265+0000","last_active":"2023-11-27T18:42:20.685645+0000","last_peered":"2023-11-27T18:42:20.685645+0000","last_clean":"2023-11-27T18:42:20.685645+0000","last_became_active":"2023-11-27T18:13:20.924209+0000","last_became_peered":"2023-11-27T18:13:20.924209+0000","last_unstale":"2023-11-27T18:42:20.685645+0000","last_undegraded":"2023-11-27T18:42:20.685645+0000","last_fullsized":"2023-11-27T18:42:20.685645+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":10743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"32'21","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:34.396943+0000","last_change":"2023-11-27T18:13:14.421768+0000","last_active":"2023-11-27T18:43:34.396943+0000","last_peered":"2023-11-27T18:43:34.396943+0000","last_clean":"2023-11-27T18:43:34.396943+0000","last_became_active":"2023-11-27T18:13:14.421377+0000","last_became_peered":"2023-11-27T18:13:14.421377+0000","last_unstale":"2023-11-27T18:43:34.396943+0000","last_undegraded":"2023-11-27T18:43:34.396943+0000","last_fullsized":"2023-11-27T18:43:34.396943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"32'12","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:18.275321+0000","last_change":"2023-11-27T18:13:12.178547+0000","last_active":"2023-11-27T18:43:18.275321+0000","last_peered":"2023-11-27T18:43:18.275321+0000","last_clean":"2023-11-27T18:43:18.275321+0000","last_became_active":"2023-11-27T18:13:12.177997+0000","last_became_peered":"2023-11-27T18:13:12.177997+0000","last_unstale":"2023-11-27T18:43:18.275321+0000","last_undegraded":"2023-11-27T18:43:18.275321+0000","last_fullsized":"2023-11-27T18:43:18.275321+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:29:10.535816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"32'95","reported_seq":125,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:23.002477+0000","last_change":"2023-11-27T18:13:20.914541+0000","last_active":"2023-11-27T18:42:23.002477+0000","last_peered":"2023-11-27T18:42:23.002477+0000","last_clean":"2023-11-27T18:42:23.002477+0000","last_became_active":"2023-11-27T18:13:20.914144+0000","last_became_peered":"2023-11-27T18:13:20.914144+0000","last_unstale":"2023-11-27T18:42:23.002477+0000","last_undegraded":"2023-11-27T18:42:23.002477+0000","last_fullsized":"2023-11-27T18:42:23.002477+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":5846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"32'23","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:34.340099+0000","last_change":"2023-11-27T18:13:15.802553+0000","last_active":"2023-11-27T18:43:34.340099+0000","last_peered":"2023-11-27T18:43:34.340099+0000","last_clean":"2023-11-27T18:43:34.340099+0000","last_became_active":"2023-11-27T18:13:15.801804+0000","last_became_peered":"2023-11-27T18:13:15.801804+0000","last_unstale":"2023-11-27T18:43:34.340099+0000","last_undegraded":"2023-11-27T18:43:34.340099+0000","last_fullsized":"2023-11-27T18:43:34.340099+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"32'5","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:34.086841+0000","last_change":"2023-11-27T18:13:12.300863+0000","last_active":"2023-11-27T18:43:34.086841+0000","last_peered":"2023-11-27T18:43:34.086841+0000","last_clean":"2023-11-27T18:43:34.086841+0000","last_became_active":"2023-11-27T18:13:12.300585+0000","last_became_peered":"2023-11-27T18:13:12.300585+0000","last_unstale":"2023-11-27T18:43:34.086841+0000","last_undegraded":"2023-11-27T18:43:34.086841+0000","last_fullsized":"2023-11-27T18:43:34.086841+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"32'85","reported_seq":115,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:23.839221+0000","last_change":"2023-11-27T18:13:20.915245+0000","last_active":"2023-11-27T18:42:23.839221+0000","last_peered":"2023-11-27T18:42:23.839221+0000","last_clean":"2023-11-27T18:42:23.839221+0000","last_became_active":"2023-11-27T18:13:20.914216+0000","last_became_peered":"2023-11-27T18:13:20.914216+0000","last_unstale":"2023-11-27T18:42:23.839221+0000","last_undegraded":"2023-11-27T18:42:23.839221+0000","last_fullsized":"2023-11-27T18:42:23.839221+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":6050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"32'39","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:34.397067+0000","last_change":"2023-11-27T18:14:22.518196+0000","last_active":"2023-11-27T18:43:34.397067+0000","last_peered":"2023-11-27T18:43:34.397067+0000","last_clean":"2023-11-27T18:43:34.397067+0000","last_became_active":"2023-11-27T18:14:22.517527+0000","last_became_peered":"2023-11-27T18:14:22.517527+0000","last_unstale":"2023-11-27T18:43:34.397067+0000","last_undegraded":"2023-11-27T18:43:34.397067+0000","last_fullsized":"2023-11-27T18:43:34.397067+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"32'5","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:34.397021+0000","last_change":"2023-11-27T18:13:12.305081+0000","last_active":"2023-11-27T18:43:34.397021+0000","last_peered":"2023-11-27T18:43:34.397021+0000","last_clean":"2023-11-27T18:43:34.397021+0000","last_became_active":"2023-11-27T18:13:12.304777+0000","last_became_peered":"2023-11-27T18:13:12.304777+0000","last_unstale":"2023-11-27T18:43:34.397021+0000","last_undegraded":"2023-11-27T18:43:34.397021+0000","last_fullsized":"2023-11-27T18:43:34.397021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"32'64","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:18.594470+0000","last_change":"2023-11-27T18:13:20.904088+0000","last_active":"2023-11-27T18:42:18.594470+0000","last_peered":"2023-11-27T18:42:18.594470+0000","last_clean":"2023-11-27T18:42:18.594470+0000","last_became_active":"2023-11-27T18:13:20.902282+0000","last_became_peered":"2023-11-27T18:13:20.902282+0000","last_unstale":"2023-11-27T18:42:18.594470+0000","last_undegraded":"2023-11-27T18:42:18.594470+0000","last_fullsized":"2023-11-27T18:42:18.594470+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:26:43.789814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":6349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"32'27","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.012518+0000","last_change":"2023-11-27T18:13:14.415302+0000","last_active":"2023-11-27T18:43:23.012518+0000","last_peered":"2023-11-27T18:43:23.012518+0000","last_clean":"2023-11-27T18:43:23.012518+0000","last_became_active":"2023-11-27T18:13:14.415004+0000","last_became_peered":"2023-11-27T18:13:14.415004+0000","last_unstale":"2023-11-27T18:43:23.012518+0000","last_undegraded":"2023-11-27T18:43:23.012518+0000","last_fullsized":"2023-11-27T18:43:23.012518+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:34:11.170873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"32'5","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:13.296847+0000","last_change":"2023-11-27T18:13:12.268542+0000","last_active":"2023-11-27T18:43:13.296847+0000","last_peered":"2023-11-27T18:43:13.296847+0000","last_clean":"2023-11-27T18:43:13.296847+0000","last_became_active":"2023-11-27T18:13:12.268237+0000","last_became_peered":"2023-11-27T18:13:12.268237+0000","last_unstale":"2023-11-27T18:43:13.296847+0000","last_undegraded":"2023-11-27T18:43:13.296847+0000","last_fullsized":"2023-11-27T18:43:13.296847+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:15:07.514381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"32'82","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:24.615247+0000","last_change":"2023-11-27T18:13:20.900393+0000","last_active":"2023-11-27T18:42:24.615247+0000","last_peered":"2023-11-27T18:42:24.615247+0000","last_clean":"2023-11-27T18:42:24.615247+0000","last_became_active":"2023-11-27T18:13:20.899358+0000","last_became_peered":"2023-11-27T18:13:20.899358+0000","last_unstale":"2023-11-27T18:42:24.615247+0000","last_undegraded":"2023-11-27T18:42:24.615247+0000","last_fullsized":"2023-11-27T18:42:24.615247+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":8446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"32'23","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.069246+0000","last_change":"2023-11-27T18:13:14.371842+0000","last_active":"2023-11-27T18:43:23.069246+0000","last_peered":"2023-11-27T18:43:23.069246+0000","last_clean":"2023-11-27T18:43:23.069246+0000","last_became_active":"2023-11-27T18:13:14.371637+0000","last_became_peered":"2023-11-27T18:13:14.371637+0000","last_unstale":"2023-11-27T18:43:23.069246+0000","last_undegraded":"2023-11-27T18:43:23.069246+0000","last_fullsized":"2023-11-27T18:43:23.069246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"32'871","reported_seq":905,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:10.515629+0000","last_change":"2023-11-27T18:13:12.248404+0000","last_active":"2023-11-27T18:43:10.515629+0000","last_peered":"2023-11-27T18:43:10.515629+0000","last_clean":"2023-11-27T18:43:10.515629+0000","last_became_active":"2023-11-27T18:13:12.248077+0000","last_became_peered":"2023-11-27T18:13:12.248077+0000","last_unstale":"2023-11-27T18:43:10.515629+0000","last_undegraded":"2023-11-27T18:43:10.515629+0000","last_fullsized":"2023-11-27T18:43:10.515629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":871,"log_dups_size":0,"ondisk_log_size":871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":867,"num_write_kb":4596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"32'83","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:18.926289+0000","last_change":"2023-11-27T18:13:20.919046+0000","last_active":"2023-11-27T18:42:18.926289+0000","last_peered":"2023-11-27T18:42:18.926289+0000","last_clean":"2023-11-27T18:42:18.926289+0000","last_became_active":"2023-11-27T18:13:20.918381+0000","last_became_peered":"2023-11-27T18:13:20.918381+0000","last_unstale":"2023-11-27T18:42:18.926289+0000","last_undegraded":"2023-11-27T18:42:18.926289+0000","last_fullsized":"2023-11-27T18:42:18.926289+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:17:07.092549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":11273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"32'25","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:38.063898+0000","last_change":"2023-11-27T18:43:38.063922+0000","last_active":"2023-11-27T18:43:38.063898+0000","last_peered":"2023-11-27T18:43:38.063898+0000","last_clean":"2023-11-27T18:43:38.063898+0000","last_became_active":"2023-11-27T18:13:14.415026+0000","last_became_peered":"2023-11-27T18:13:14.415026+0000","last_unstale":"2023-11-27T18:43:38.063898+0000","last_undegraded":"2023-11-27T18:43:38.063898+0000","last_fullsized":"2023-11-27T18:43:38.063898+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'25","last_scrub_stamp":"2023-11-27T18:43:38.063802+0000","last_deep_scrub":"32'25","last_deep_scrub_stamp":"2023-11-27T18:43:38.063802+0000","last_clean_scrub_stamp":"2023-11-27T18:43:38.063802+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:55:14.604318+0000","scrub_duration":0.0021425820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"32'400","reported_seq":433,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:15.251117+0000","last_change":"2023-11-27T18:13:12.180737+0000","last_active":"2023-11-27T18:43:15.251117+0000","last_peered":"2023-11-27T18:43:15.251117+0000","last_clean":"2023-11-27T18:43:15.251117+0000","last_became_active":"2023-11-27T18:13:12.180112+0000","last_became_peered":"2023-11-27T18:13:12.180112+0000","last_unstale":"2023-11-27T18:43:15.251117+0000","last_undegraded":"2023-11-27T18:43:15.251117+0000","last_fullsized":"2023-11-27T18:43:15.251117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:24:22.455257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":397,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"32'109","reported_seq":139,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:20.603943+0000","last_change":"2023-11-27T18:13:20.925012+0000","last_active":"2023-11-27T18:42:20.603943+0000","last_peered":"2023-11-27T18:42:20.603943+0000","last_clean":"2023-11-27T18:42:20.603943+0000","last_became_active":"2023-11-27T18:13:20.921675+0000","last_became_peered":"2023-11-27T18:13:20.921675+0000","last_unstale":"2023-11-27T18:42:20.603943+0000","last_undegraded":"2023-11-27T18:42:20.603943+0000","last_fullsized":"2023-11-27T18:42:20.603943+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":15987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"32'29","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.088125+0000","last_change":"2023-11-27T18:13:14.415432+0000","last_active":"2023-11-27T18:43:23.088125+0000","last_peered":"2023-11-27T18:43:23.088125+0000","last_clean":"2023-11-27T18:43:23.088125+0000","last_became_active":"2023-11-27T18:13:14.415142+0000","last_became_peered":"2023-11-27T18:13:14.415142+0000","last_unstale":"2023-11-27T18:43:23.088125+0000","last_undegraded":"2023-11-27T18:43:23.088125+0000","last_fullsized":"2023-11-27T18:43:23.088125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"32'2","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:12.258915+0000","last_change":"2023-11-27T18:13:12.273729+0000","last_active":"2023-11-27T18:43:12.258915+0000","last_peered":"2023-11-27T18:43:12.258915+0000","last_clean":"2023-11-27T18:43:12.258915+0000","last_became_active":"2023-11-27T18:13:12.273400+0000","last_became_peered":"2023-11-27T18:13:12.273400+0000","last_unstale":"2023-11-27T18:43:12.258915+0000","last_undegraded":"2023-11-27T18:43:12.258915+0000","last_fullsized":"2023-11-27T18:43:12.258915+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"32'83","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:18.001546+0000","last_change":"2023-11-27T18:13:20.912482+0000","last_active":"2023-11-27T18:42:18.001546+0000","last_peered":"2023-11-27T18:42:18.001546+0000","last_clean":"2023-11-27T18:42:18.001546+0000","last_became_active":"2023-11-27T18:13:20.912063+0000","last_became_peered":"2023-11-27T18:13:20.912063+0000","last_unstale":"2023-11-27T18:42:18.001546+0000","last_undegraded":"2023-11-27T18:42:18.001546+0000","last_fullsized":"2023-11-27T18:42:18.001546+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:11:56.997205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":11074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"32'29","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.090963+0000","last_change":"2023-11-27T18:13:15.911622+0000","last_active":"2023-11-27T18:43:23.090963+0000","last_peered":"2023-11-27T18:43:23.090963+0000","last_clean":"2023-11-27T18:43:23.090963+0000","last_became_active":"2023-11-27T18:13:15.911255+0000","last_became_peered":"2023-11-27T18:13:15.911255+0000","last_unstale":"2023-11-27T18:43:23.090963+0000","last_undegraded":"2023-11-27T18:43:23.090963+0000","last_fullsized":"2023-11-27T18:43:23.090963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"32'6","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:57.517436+0000","last_change":"2023-11-27T18:13:12.168028+0000","last_active":"2023-11-27T18:42:57.517436+0000","last_peered":"2023-11-27T18:42:57.517436+0000","last_clean":"2023-11-27T18:42:57.517436+0000","last_became_active":"2023-11-27T18:13:12.167740+0000","last_became_peered":"2023-11-27T18:13:12.167740+0000","last_unstale":"2023-11-27T18:42:57.517436+0000","last_undegraded":"2023-11-27T18:42:57.517436+0000","last_fullsized":"2023-11-27T18:42:57.517436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"32'75","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:13.791640+0000","last_change":"2023-11-27T18:13:20.915480+0000","last_active":"2023-11-27T18:42:13.791640+0000","last_peered":"2023-11-27T18:42:13.791640+0000","last_clean":"2023-11-27T18:42:13.791640+0000","last_became_active":"2023-11-27T18:13:20.914607+0000","last_became_peered":"2023-11-27T18:13:20.914607+0000","last_unstale":"2023-11-27T18:42:13.791640+0000","last_undegraded":"2023-11-27T18:42:13.791640+0000","last_fullsized":"2023-11-27T18:42:13.791640+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:07:38.034431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":8428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"32'67","reported_seq":99,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:14.804504+0000","last_change":"2023-11-27T18:13:20.930508+0000","last_active":"2023-11-27T18:42:14.804504+0000","last_peered":"2023-11-27T18:42:14.804504+0000","last_clean":"2023-11-27T18:42:14.804504+0000","last_became_active":"2023-11-27T18:13:20.930060+0000","last_became_peered":"2023-11-27T18:13:20.930060+0000","last_unstale":"2023-11-27T18:42:14.804504+0000","last_undegraded":"2023-11-27T18:42:14.804504+0000","last_fullsized":"2023-11-27T18:42:14.804504+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:43:18.464867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":4718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"32'28","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.125938+0000","last_change":"2023-11-27T18:13:14.380263+0000","last_active":"2023-11-27T18:43:23.125938+0000","last_peered":"2023-11-27T18:43:23.125938+0000","last_clean":"2023-11-27T18:43:23.125938+0000","last_became_active":"2023-11-27T18:13:14.379936+0000","last_became_peered":"2023-11-27T18:13:14.379936+0000","last_unstale":"2023-11-27T18:43:23.125938+0000","last_undegraded":"2023-11-27T18:43:23.125938+0000","last_fullsized":"2023-11-27T18:43:23.125938+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:50:34.713768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"32'4","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:06.996946+0000","last_change":"2023-11-27T18:13:12.300977+0000","last_active":"2023-11-27T18:43:06.996946+0000","last_peered":"2023-11-27T18:43:06.996946+0000","last_clean":"2023-11-27T18:43:06.996946+0000","last_became_active":"2023-11-27T18:13:12.300624+0000","last_became_peered":"2023-11-27T18:13:12.300624+0000","last_unstale":"2023-11-27T18:43:06.996946+0000","last_undegraded":"2023-11-27T18:43:06.996946+0000","last_fullsized":"2023-11-27T18:43:06.996946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"32'93","reported_seq":125,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:34.381876+0000","last_change":"2023-11-27T18:13:20.919870+0000","last_active":"2023-11-27T18:42:34.381876+0000","last_peered":"2023-11-27T18:42:34.381876+0000","last_clean":"2023-11-27T18:42:34.381876+0000","last_became_active":"2023-11-27T18:13:20.918816+0000","last_became_peered":"2023-11-27T18:13:20.918816+0000","last_unstale":"2023-11-27T18:42:34.381876+0000","last_undegraded":"2023-11-27T18:42:34.381876+0000","last_fullsized":"2023-11-27T18:42:34.381876+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":12357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'29","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.090004+0000","last_change":"2023-11-27T18:13:14.369562+0000","last_active":"2023-11-27T18:43:23.090004+0000","last_peered":"2023-11-27T18:43:23.090004+0000","last_clean":"2023-11-27T18:43:23.090004+0000","last_became_active":"2023-11-27T18:13:14.368880+0000","last_became_peered":"2023-11-27T18:13:14.368880+0000","last_unstale":"2023-11-27T18:43:23.090004+0000","last_undegraded":"2023-11-27T18:43:23.090004+0000","last_fullsized":"2023-11-27T18:43:23.090004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:37.590691+0000","last_change":"2023-11-27T18:13:12.270113+0000","last_active":"2023-11-27T18:42:37.590691+0000","last_peered":"2023-11-27T18:42:37.590691+0000","last_clean":"2023-11-27T18:42:37.590691+0000","last_became_active":"2023-11-27T18:13:12.269755+0000","last_became_peered":"2023-11-27T18:13:12.269755+0000","last_unstale":"2023-11-27T18:42:37.590691+0000","last_undegraded":"2023-11-27T18:42:37.590691+0000","last_fullsized":"2023-11-27T18:42:37.590691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:51:01.410940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"32'663","reported_seq":697,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:14.391880+0000","last_change":"2023-11-27T18:13:12.307568+0000","last_active":"2023-11-27T18:43:14.391880+0000","last_peered":"2023-11-27T18:43:14.391880+0000","last_clean":"2023-11-27T18:43:14.391880+0000","last_became_active":"2023-11-27T18:13:12.307299+0000","last_became_peered":"2023-11-27T18:13:12.307299+0000","last_unstale":"2023-11-27T18:43:14.391880+0000","last_undegraded":"2023-11-27T18:43:14.391880+0000","last_fullsized":"2023-11-27T18:43:14.391880+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":663,"log_dups_size":0,"ondisk_log_size":663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":658,"num_write_kb":4457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"32'24","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.124787+0000","last_change":"2023-11-27T18:13:14.378937+0000","last_active":"2023-11-27T18:43:23.124787+0000","last_peered":"2023-11-27T18:43:23.124787+0000","last_clean":"2023-11-27T18:43:23.124787+0000","last_became_active":"2023-11-27T18:13:14.378635+0000","last_became_peered":"2023-11-27T18:13:14.378635+0000","last_unstale":"2023-11-27T18:43:23.124787+0000","last_undegraded":"2023-11-27T18:43:23.124787+0000","last_fullsized":"2023-11-27T18:43:23.124787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:06:40.533610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"32'56","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:20.778247+0000","last_change":"2023-11-27T18:13:20.903249+0000","last_active":"2023-11-27T18:42:20.778247+0000","last_peered":"2023-11-27T18:42:20.778247+0000","last_clean":"2023-11-27T18:42:20.778247+0000","last_became_active":"2023-11-27T18:13:20.902571+0000","last_became_peered":"2023-11-27T18:13:20.902571+0000","last_unstale":"2023-11-27T18:42:20.778247+0000","last_undegraded":"2023-11-27T18:42:20.778247+0000","last_fullsized":"2023-11-27T18:42:20.778247+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:41:48.892641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":3581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"32'592","reported_seq":625,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:15.365186+0000","last_change":"2023-11-27T18:13:12.304324+0000","last_active":"2023-11-27T18:43:15.365186+0000","last_peered":"2023-11-27T18:43:15.365186+0000","last_clean":"2023-11-27T18:43:15.365186+0000","last_became_active":"2023-11-27T18:13:12.303988+0000","last_became_peered":"2023-11-27T18:13:12.303988+0000","last_unstale":"2023-11-27T18:43:15.365186+0000","last_undegraded":"2023-11-27T18:43:15.365186+0000","last_fullsized":"2023-11-27T18:43:15.365186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":588,"num_write_kb":4406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"32'22","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.117307+0000","last_change":"2023-11-27T18:13:15.803183+0000","last_active":"2023-11-27T18:43:23.117307+0000","last_peered":"2023-11-27T18:43:23.117307+0000","last_clean":"2023-11-27T18:43:23.117307+0000","last_became_active":"2023-11-27T18:13:15.802420+0000","last_became_peered":"2023-11-27T18:13:15.802420+0000","last_unstale":"2023-11-27T18:43:23.117307+0000","last_undegraded":"2023-11-27T18:43:23.117307+0000","last_fullsized":"2023-11-27T18:43:23.117307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"32'93","reported_seq":117,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:22.951779+0000","last_change":"2023-11-27T18:14:22.716310+0000","last_active":"2023-11-27T18:42:22.951779+0000","last_peered":"2023-11-27T18:42:22.951779+0000","last_clean":"2023-11-27T18:42:22.951779+0000","last_became_active":"2023-11-27T18:14:22.715684+0000","last_became_peered":"2023-11-27T18:14:22.715684+0000","last_unstale":"2023-11-27T18:42:22.951779+0000","last_undegraded":"2023-11-27T18:42:22.951779+0000","last_fullsized":"2023-11-27T18:42:22.951779+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":6465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,0],"acting":[2,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"32'34","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.088909+0000","last_change":"2023-11-27T18:13:15.849183+0000","last_active":"2023-11-27T18:43:23.088909+0000","last_peered":"2023-11-27T18:43:23.088909+0000","last_clean":"2023-11-27T18:43:23.088909+0000","last_became_active":"2023-11-27T18:13:15.848503+0000","last_became_peered":"2023-11-27T18:13:15.848503+0000","last_unstale":"2023-11-27T18:43:23.088909+0000","last_undegraded":"2023-11-27T18:43:23.088909+0000","last_fullsized":"2023-11-27T18:43:23.088909+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"32'28","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:22.930797+0000","last_change":"2023-11-27T18:13:14.336349+0000","last_active":"2023-11-27T18:43:22.930797+0000","last_peered":"2023-11-27T18:43:22.930797+0000","last_clean":"2023-11-27T18:43:22.930797+0000","last_became_active":"2023-11-27T18:13:14.336072+0000","last_became_peered":"2023-11-27T18:13:14.336072+0000","last_unstale":"2023-11-27T18:43:22.930797+0000","last_undegraded":"2023-11-27T18:43:22.930797+0000","last_fullsized":"2023-11-27T18:43:22.930797+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:54:58.777656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"32'27","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.017035+0000","last_change":"2023-11-27T18:13:14.421713+0000","last_active":"2023-11-27T18:43:23.017035+0000","last_peered":"2023-11-27T18:43:23.017035+0000","last_clean":"2023-11-27T18:43:23.017035+0000","last_became_active":"2023-11-27T18:13:14.418679+0000","last_became_peered":"2023-11-27T18:13:14.418679+0000","last_unstale":"2023-11-27T18:43:23.017035+0000","last_undegraded":"2023-11-27T18:43:23.017035+0000","last_fullsized":"2023-11-27T18:43:23.017035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"32'22","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.087337+0000","last_change":"2023-11-27T18:13:14.376601+0000","last_active":"2023-11-27T18:43:23.087337+0000","last_peered":"2023-11-27T18:43:23.087337+0000","last_clean":"2023-11-27T18:43:23.087337+0000","last_became_active":"2023-11-27T18:13:14.376292+0000","last_became_peered":"2023-11-27T18:13:14.376292+0000","last_unstale":"2023-11-27T18:43:23.087337+0000","last_undegraded":"2023-11-27T18:43:23.087337+0000","last_fullsized":"2023-11-27T18:43:23.087337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"32'16","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.008729+0000","last_change":"2023-11-27T18:13:14.367285+0000","last_active":"2023-11-27T18:43:23.008729+0000","last_peered":"2023-11-27T18:43:23.008729+0000","last_clean":"2023-11-27T18:43:23.008729+0000","last_became_active":"2023-11-27T18:13:14.366983+0000","last_became_peered":"2023-11-27T18:13:14.366983+0000","last_unstale":"2023-11-27T18:43:23.008729+0000","last_undegraded":"2023-11-27T18:43:23.008729+0000","last_fullsized":"2023-11-27T18:43:23.008729+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:04:31.925421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"32'22","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.008462+0000","last_change":"2023-11-27T18:13:14.375744+0000","last_active":"2023-11-27T18:43:23.008462+0000","last_peered":"2023-11-27T18:43:23.008462+0000","last_clean":"2023-11-27T18:43:23.008462+0000","last_became_active":"2023-11-27T18:13:14.375466+0000","last_became_peered":"2023-11-27T18:13:14.375466+0000","last_unstale":"2023-11-27T18:43:23.008462+0000","last_undegraded":"2023-11-27T18:43:23.008462+0000","last_fullsized":"2023-11-27T18:43:23.008462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:03:10.250350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"32'33","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:34.297722+0000","last_change":"2023-11-27T18:13:15.911021+0000","last_active":"2023-11-27T18:43:34.297722+0000","last_peered":"2023-11-27T18:43:34.297722+0000","last_clean":"2023-11-27T18:43:34.297722+0000","last_became_active":"2023-11-27T18:13:15.910418+0000","last_became_peered":"2023-11-27T18:13:15.910418+0000","last_unstale":"2023-11-27T18:43:34.297722+0000","last_undegraded":"2023-11-27T18:43:34.297722+0000","last_fullsized":"2023-11-27T18:43:34.297722+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"32'19","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:40.213006+0000","last_change":"2023-11-27T18:43:40.213056+0000","last_active":"2023-11-27T18:43:40.213006+0000","last_peered":"2023-11-27T18:43:40.213006+0000","last_clean":"2023-11-27T18:43:40.213006+0000","last_became_active":"2023-11-27T18:13:14.366249+0000","last_became_peered":"2023-11-27T18:13:14.366249+0000","last_unstale":"2023-11-27T18:43:40.213006+0000","last_undegraded":"2023-11-27T18:43:40.213006+0000","last_fullsized":"2023-11-27T18:43:40.213006+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'19","last_scrub_stamp":"2023-11-27T18:43:40.212814+0000","last_deep_scrub":"32'19","last_deep_scrub_stamp":"2023-11-27T18:43:40.212814+0000","last_clean_scrub_stamp":"2023-11-27T18:43:40.212814+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:43:45.456072+0000","scrub_duration":0.0037923340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"32'19","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.012015+0000","last_change":"2023-11-27T18:13:14.415379+0000","last_active":"2023-11-27T18:43:23.012015+0000","last_peered":"2023-11-27T18:43:23.012015+0000","last_clean":"2023-11-27T18:43:23.012015+0000","last_became_active":"2023-11-27T18:13:14.414873+0000","last_became_peered":"2023-11-27T18:13:14.414873+0000","last_unstale":"2023-11-27T18:43:23.012015+0000","last_undegraded":"2023-11-27T18:43:23.012015+0000","last_fullsized":"2023-11-27T18:43:23.012015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'30","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.090705+0000","last_change":"2023-11-27T18:13:14.416351+0000","last_active":"2023-11-27T18:43:23.090705+0000","last_peered":"2023-11-27T18:43:23.090705+0000","last_clean":"2023-11-27T18:43:23.090705+0000","last_became_active":"2023-11-27T18:13:14.416072+0000","last_became_peered":"2023-11-27T18:13:14.416072+0000","last_unstale":"2023-11-27T18:43:23.090705+0000","last_undegraded":"2023-11-27T18:43:23.090705+0000","last_fullsized":"2023-11-27T18:43:23.090705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"32'25","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.113074+0000","last_change":"2023-11-27T18:13:15.801534+0000","last_active":"2023-11-27T18:43:23.113074+0000","last_peered":"2023-11-27T18:43:23.113074+0000","last_clean":"2023-11-27T18:43:23.113074+0000","last_became_active":"2023-11-27T18:13:15.800699+0000","last_became_peered":"2023-11-27T18:13:15.800699+0000","last_unstale":"2023-11-27T18:43:23.113074+0000","last_undegraded":"2023-11-27T18:43:23.113074+0000","last_fullsized":"2023-11-27T18:43:23.113074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"32'35","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.124464+0000","last_change":"2023-11-27T18:13:14.413935+0000","last_active":"2023-11-27T18:43:23.124464+0000","last_peered":"2023-11-27T18:43:23.124464+0000","last_clean":"2023-11-27T18:43:23.124464+0000","last_became_active":"2023-11-27T18:13:14.413567+0000","last_became_peered":"2023-11-27T18:13:14.413567+0000","last_unstale":"2023-11-27T18:43:23.124464+0000","last_undegraded":"2023-11-27T18:43:23.124464+0000","last_fullsized":"2023-11-27T18:43:23.124464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:51:07.667299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"32'26","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.094988+0000","last_change":"2023-11-27T18:13:14.363105+0000","last_active":"2023-11-27T18:43:23.094988+0000","last_peered":"2023-11-27T18:43:23.094988+0000","last_clean":"2023-11-27T18:43:23.094988+0000","last_became_active":"2023-11-27T18:13:14.362805+0000","last_became_peered":"2023-11-27T18:13:14.362805+0000","last_unstale":"2023-11-27T18:43:23.094988+0000","last_undegraded":"2023-11-27T18:43:23.094988+0000","last_fullsized":"2023-11-27T18:43:23.094988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"32'25","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.018899+0000","last_change":"2023-11-27T18:13:14.416119+0000","last_active":"2023-11-27T18:43:23.018899+0000","last_peered":"2023-11-27T18:43:23.018899+0000","last_clean":"2023-11-27T18:43:23.018899+0000","last_became_active":"2023-11-27T18:13:14.415661+0000","last_became_peered":"2023-11-27T18:13:14.415661+0000","last_unstale":"2023-11-27T18:43:23.018899+0000","last_undegraded":"2023-11-27T18:43:23.018899+0000","last_fullsized":"2023-11-27T18:43:23.018899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"32'35","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:22.929656+0000","last_change":"2023-11-27T18:13:14.413859+0000","last_active":"2023-11-27T18:43:22.929656+0000","last_peered":"2023-11-27T18:43:22.929656+0000","last_clean":"2023-11-27T18:43:22.929656+0000","last_became_active":"2023-11-27T18:13:14.413542+0000","last_became_peered":"2023-11-27T18:13:14.413542+0000","last_unstale":"2023-11-27T18:43:22.929656+0000","last_undegraded":"2023-11-27T18:43:22.929656+0000","last_fullsized":"2023-11-27T18:43:22.929656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:24:16.125984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"32'23","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:34.397278+0000","last_change":"2023-11-27T18:13:14.417018+0000","last_active":"2023-11-27T18:43:34.397278+0000","last_peered":"2023-11-27T18:43:34.397278+0000","last_clean":"2023-11-27T18:43:34.397278+0000","last_became_active":"2023-11-27T18:13:14.416556+0000","last_became_peered":"2023-11-27T18:13:14.416556+0000","last_unstale":"2023-11-27T18:43:34.397278+0000","last_undegraded":"2023-11-27T18:43:34.397278+0000","last_fullsized":"2023-11-27T18:43:34.397278+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"32'28","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:34.396879+0000","last_change":"2023-11-27T18:13:14.419437+0000","last_active":"2023-11-27T18:43:34.396879+0000","last_peered":"2023-11-27T18:43:34.396879+0000","last_clean":"2023-11-27T18:43:34.396879+0000","last_became_active":"2023-11-27T18:13:14.418823+0000","last_became_peered":"2023-11-27T18:13:14.418823+0000","last_unstale":"2023-11-27T18:43:34.396879+0000","last_undegraded":"2023-11-27T18:43:34.396879+0000","last_fullsized":"2023-11-27T18:43:34.396879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"32'26","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:35.369455+0000","last_change":"2023-11-27T18:13:14.368373+0000","last_active":"2023-11-27T18:43:35.369455+0000","last_peered":"2023-11-27T18:43:35.369455+0000","last_clean":"2023-11-27T18:43:35.369455+0000","last_became_active":"2023-11-27T18:13:14.368100+0000","last_became_peered":"2023-11-27T18:13:14.368100+0000","last_unstale":"2023-11-27T18:43:35.369455+0000","last_undegraded":"2023-11-27T18:43:35.369455+0000","last_fullsized":"2023-11-27T18:43:35.369455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"32'26","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.008498+0000","last_change":"2023-11-27T18:13:14.376812+0000","last_active":"2023-11-27T18:43:23.008498+0000","last_peered":"2023-11-27T18:43:23.008498+0000","last_clean":"2023-11-27T18:43:23.008498+0000","last_became_active":"2023-11-27T18:13:14.376559+0000","last_became_peered":"2023-11-27T18:13:14.376559+0000","last_unstale":"2023-11-27T18:43:23.008498+0000","last_undegraded":"2023-11-27T18:43:23.008498+0000","last_fullsized":"2023-11-27T18:43:23.008498+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:31:25.796567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"32'32","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.008507+0000","last_change":"2023-11-27T18:13:14.367518+0000","last_active":"2023-11-27T18:43:23.008507+0000","last_peered":"2023-11-27T18:43:23.008507+0000","last_clean":"2023-11-27T18:43:23.008507+0000","last_became_active":"2023-11-27T18:13:14.367298+0000","last_became_peered":"2023-11-27T18:13:14.367298+0000","last_unstale":"2023-11-27T18:43:23.008507+0000","last_undegraded":"2023-11-27T18:43:23.008507+0000","last_fullsized":"2023-11-27T18:43:23.008507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:48:00.722511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"32'17","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.094887+0000","last_change":"2023-11-27T18:13:14.364130+0000","last_active":"2023-11-27T18:43:23.094887+0000","last_peered":"2023-11-27T18:43:23.094887+0000","last_clean":"2023-11-27T18:43:23.094887+0000","last_became_active":"2023-11-27T18:13:14.363776+0000","last_became_peered":"2023-11-27T18:13:14.363776+0000","last_unstale":"2023-11-27T18:43:23.094887+0000","last_undegraded":"2023-11-27T18:43:23.094887+0000","last_fullsized":"2023-11-27T18:43:23.094887+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"32'24","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.091753+0000","last_change":"2023-11-27T18:13:14.423459+0000","last_active":"2023-11-27T18:43:23.091753+0000","last_peered":"2023-11-27T18:43:23.091753+0000","last_clean":"2023-11-27T18:43:23.091753+0000","last_became_active":"2023-11-27T18:13:14.423099+0000","last_became_peered":"2023-11-27T18:13:14.423099+0000","last_unstale":"2023-11-27T18:43:23.091753+0000","last_undegraded":"2023-11-27T18:43:23.091753+0000","last_fullsized":"2023-11-27T18:43:23.091753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"32'32","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.094094+0000","last_change":"2023-11-27T18:13:14.420348+0000","last_active":"2023-11-27T18:43:23.094094+0000","last_peered":"2023-11-27T18:43:23.094094+0000","last_clean":"2023-11-27T18:43:23.094094+0000","last_became_active":"2023-11-27T18:13:14.419780+0000","last_became_peered":"2023-11-27T18:13:14.419780+0000","last_unstale":"2023-11-27T18:43:23.094094+0000","last_undegraded":"2023-11-27T18:43:23.094094+0000","last_fullsized":"2023-11-27T18:43:23.094094+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"32'29","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.112551+0000","last_change":"2023-11-27T18:13:15.910347+0000","last_active":"2023-11-27T18:43:23.112551+0000","last_peered":"2023-11-27T18:43:23.112551+0000","last_clean":"2023-11-27T18:43:23.112551+0000","last_became_active":"2023-11-27T18:13:15.909918+0000","last_became_peered":"2023-11-27T18:13:15.909918+0000","last_unstale":"2023-11-27T18:43:23.112551+0000","last_undegraded":"2023-11-27T18:43:23.112551+0000","last_fullsized":"2023-11-27T18:43:23.112551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"32'19","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.095292+0000","last_change":"2023-11-27T18:13:14.369974+0000","last_active":"2023-11-27T18:43:23.095292+0000","last_peered":"2023-11-27T18:43:23.095292+0000","last_clean":"2023-11-27T18:43:23.095292+0000","last_became_active":"2023-11-27T18:13:14.369285+0000","last_became_peered":"2023-11-27T18:13:14.369285+0000","last_unstale":"2023-11-27T18:43:23.095292+0000","last_undegraded":"2023-11-27T18:43:23.095292+0000","last_fullsized":"2023-11-27T18:43:23.095292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"32'20","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.069085+0000","last_change":"2023-11-27T18:13:14.385745+0000","last_active":"2023-11-27T18:43:23.069085+0000","last_peered":"2023-11-27T18:43:23.069085+0000","last_clean":"2023-11-27T18:43:23.069085+0000","last_became_active":"2023-11-27T18:13:14.385566+0000","last_became_peered":"2023-11-27T18:13:14.385566+0000","last_unstale":"2023-11-27T18:43:23.069085+0000","last_undegraded":"2023-11-27T18:43:23.069085+0000","last_fullsized":"2023-11-27T18:43:23.069085+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"32'26","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.090892+0000","last_change":"2023-11-27T18:13:15.848952+0000","last_active":"2023-11-27T18:43:23.090892+0000","last_peered":"2023-11-27T18:43:23.090892+0000","last_clean":"2023-11-27T18:43:23.090892+0000","last_became_active":"2023-11-27T18:13:15.848237+0000","last_became_peered":"2023-11-27T18:13:15.848237+0000","last_unstale":"2023-11-27T18:43:23.090892+0000","last_undegraded":"2023-11-27T18:43:23.090892+0000","last_fullsized":"2023-11-27T18:43:23.090892+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"32'23","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.093613+0000","last_change":"2023-11-27T18:13:14.373247+0000","last_active":"2023-11-27T18:43:23.093613+0000","last_peered":"2023-11-27T18:43:23.093613+0000","last_clean":"2023-11-27T18:43:23.093613+0000","last_became_active":"2023-11-27T18:13:14.372974+0000","last_became_peered":"2023-11-27T18:13:14.372974+0000","last_unstale":"2023-11-27T18:43:23.093613+0000","last_undegraded":"2023-11-27T18:43:23.093613+0000","last_fullsized":"2023-11-27T18:43:23.093613+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"32'18","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:24.296144+0000","last_change":"2023-11-27T18:13:15.851685+0000","last_active":"2023-11-27T18:43:24.296144+0000","last_peered":"2023-11-27T18:43:24.296144+0000","last_clean":"2023-11-27T18:43:24.296144+0000","last_became_active":"2023-11-27T18:13:15.850353+0000","last_became_peered":"2023-11-27T18:13:15.850353+0000","last_unstale":"2023-11-27T18:43:24.296144+0000","last_undegraded":"2023-11-27T18:43:24.296144+0000","last_fullsized":"2023-11-27T18:43:24.296144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"32'25","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.087567+0000","last_change":"2023-11-27T18:13:14.381126+0000","last_active":"2023-11-27T18:43:23.087567+0000","last_peered":"2023-11-27T18:43:23.087567+0000","last_clean":"2023-11-27T18:43:23.087567+0000","last_became_active":"2023-11-27T18:13:14.380714+0000","last_became_peered":"2023-11-27T18:13:14.380714+0000","last_unstale":"2023-11-27T18:43:23.087567+0000","last_undegraded":"2023-11-27T18:43:23.087567+0000","last_fullsized":"2023-11-27T18:43:23.087567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"32'19","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.085110+0000","last_change":"2023-11-27T18:13:14.368254+0000","last_active":"2023-11-27T18:43:23.085110+0000","last_peered":"2023-11-27T18:43:23.085110+0000","last_clean":"2023-11-27T18:43:23.085110+0000","last_became_active":"2023-11-27T18:13:14.367978+0000","last_became_peered":"2023-11-27T18:13:14.367978+0000","last_unstale":"2023-11-27T18:43:23.085110+0000","last_undegraded":"2023-11-27T18:43:23.085110+0000","last_fullsized":"2023-11-27T18:43:23.085110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"32'23","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:38.508776+0000","last_change":"2023-11-27T18:43:38.508875+0000","last_active":"2023-11-27T18:43:38.508776+0000","last_peered":"2023-11-27T18:43:38.508776+0000","last_clean":"2023-11-27T18:43:38.508776+0000","last_became_active":"2023-11-27T18:13:14.418928+0000","last_became_peered":"2023-11-27T18:13:14.418928+0000","last_unstale":"2023-11-27T18:43:38.508776+0000","last_undegraded":"2023-11-27T18:43:38.508776+0000","last_fullsized":"2023-11-27T18:43:38.508776+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2023-11-27T18:43:38.508560+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2023-11-27T18:43:38.508560+0000","last_clean_scrub_stamp":"2023-11-27T18:43:38.508560+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:08:35.190483+0000","scrub_duration":0.0073382730000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2386,"num_write_kb":255070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2569,"ondisk_log_size":2569,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1576,"ondisk_log_size":1576,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":24107291,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":549,"num_read_kb":581,"num_write":5694,"num_write_kb":26819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32874496,"data_stored":48214582,"data_compressed":4737124,"data_compressed_allocated":7356416,"data_compressed_original":22757376,"omap_allocated":0,"internal_metadata":0},"log_size":5241,"ondisk_log_size":5241,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67010,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719477113,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36008,"kb_used_data":4832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335832,"statfs":{"total":96636764160,"available":96599891968,"internally_reserved":0,"allocated":4947968,"data_stored":8056568,"data_compressed":850146,"data_compressed_allocated":1241088,"data_compressed_original":4562944,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.88300000000000001,"15min":0.85999999999999999},"min":{"1min":0.60399999999999998,"5min":0.55800000000000005,"15min":0.45400000000000001},"max":{"1min":1.373,"5min":1.373,"15min":1.4730000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.93500000000000005,"15min":0.93300000000000005},"min":{"1min":0.58499999999999996,"5min":0.49399999999999999,"15min":0.46000000000000002},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.64200000000000002}]},{"osd":1,"last update":"Mon Nov 27 18:43:38 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":0.995,"15min":0.96899999999999997},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.4790000000000001,"5min":1.51,"15min":1.51},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.93899999999999995,"15min":0.92800000000000005},"min":{"1min":0.58899999999999997,"5min":0.55100000000000005,"15min":0.54000000000000004},"max":{"1min":1.1950000000000001,"5min":1.361,"15min":1.482},"last":0.82299999999999995}]},{"osd":2,"last update":"Mon Nov 27 18:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.98499999999999999,"15min":0.97299999999999998},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.53900000000000003},"max":{"1min":1.2170000000000001,"5min":1.4730000000000001,"15min":1.603},"last":1.032},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92300000000000004,"15min":0.92700000000000005},"min":{"1min":0.59699999999999998,"5min":0.58299999999999996,"15min":0.52700000000000002},"max":{"1min":1.2549999999999999,"5min":1.389,"15min":1.389},"last":1.002}]},{"osd":3,"last update":"Mon Nov 27 18:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.98799999999999999,"15min":0.97499999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.472},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.0389999999999999,"15min":1.0409999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.3049999999999999,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.96599999999999997}]},{"osd":4,"last update":"Mon Nov 27 18:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.90600000000000003,"15min":0.90200000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.518,"5min":1.518,"15min":1.518},"last":0.71099999999999997},{"interface":"front","average":{"1min":1.036,"5min":1.018,"15min":1.0029999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.76600000000000001}]},{"osd":6,"last update":"Mon Nov 27 18:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":1.01,"15min":1.0029999999999999},"min":{"1min":0.505,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.3240000000000001,"5min":1.417,"15min":1.49},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.02,"5min":1.026,"15min":1.03},"min":{"1min":0.46899999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.4419999999999999,"5min":1.5049999999999999,"15min":1.605},"last":1.087}]},{"osd":7,"last update":"Mon Nov 27 18:43:38 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.1459999999999999,"15min":1.125},"min":{"1min":0.73699999999999999,"5min":0.49299999999999999,"15min":0.47999999999999998},"max":{"1min":1.617,"5min":1.617,"15min":1.831},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.141,"5min":1.1779999999999999,"15min":1.1759999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.4790000000000001,"5min":1.6639999999999999,"15min":1.768},"last":1.1830000000000001}]}]},{"osd":7,"up_from":16,"seq":68719477113,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33280,"kb_used_data":2104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338560,"statfs":{"total":96636764160,"available":96602685440,"internally_reserved":0,"allocated":2154496,"data_stored":3272747,"data_compressed":386056,"data_compressed_allocated":532480,"data_compressed_original":1863680,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.88500000000000001,"15min":0.88},"min":{"1min":0.56899999999999995,"5min":0.54000000000000004,"15min":0.49399999999999999},"max":{"1min":1.3009999999999999,"5min":1.357,"15min":1.448},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.96799999999999997,"15min":0.93700000000000006},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.49299999999999999},"max":{"1min":1.2909999999999999,"5min":1.411,"15min":1.7110000000000001},"last":1.1910000000000001}]},{"osd":1,"last update":"Mon Nov 27 18:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.91900000000000004,"15min":0.92600000000000005},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.343,"5min":1.379,"15min":1.379},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1,"15min":0.97799999999999998},"min":{"1min":0.65600000000000003,"5min":0.63100000000000001,"15min":0.54800000000000004},"max":{"1min":1.4259999999999999,"5min":1.4450000000000001,"15min":1.768},"last":1.4299999999999999}]},{"osd":2,"last update":"Mon Nov 27 18:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":1.0089999999999999,"15min":0.997},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.52000000000000002},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.6870000000000001},"last":1.089},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.95399999999999996,"15min":0.93999999999999995},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.204,"5min":1.363,"15min":1.415},"last":0.89100000000000001}]},{"osd":3,"last update":"Mon Nov 27 18:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.99099999999999999,"15min":0.97699999999999998},"min":{"1min":0.61899999999999999,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.2370000000000001,"5min":1.4370000000000001,"15min":1.4550000000000001},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.103,"15min":1.073},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.51300000000000001},"max":{"1min":1.4990000000000001,"5min":1.5649999999999999,"15min":1.5820000000000001},"last":1.25}]},{"osd":4,"last update":"Mon Nov 27 18:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":1.006,"15min":0.92900000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.4610000000000001,"5min":6.6539999999999999,"15min":6.6539999999999999},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.996,"15min":1},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.3240000000000001,"5min":1.5469999999999999,"15min":2.0649999999999999},"last":1.0469999999999999}]},{"osd":5,"last update":"Mon Nov 27 18:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.099,"15min":1.0389999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35199999999999998},"max":{"1min":1.569,"5min":1.825,"15min":1.825},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.052,"5min":1.0449999999999999,"15min":1.0369999999999999},"min":{"1min":0.55900000000000005,"5min":0.53200000000000003,"15min":0.39200000000000002},"max":{"1min":1.361,"5min":1.679,"15min":1.679},"last":1.127}]},{"osd":6,"last update":"Mon Nov 27 18:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.1120000000000001,"15min":1.0900000000000001},"min":{"1min":0.73999999999999999,"5min":0.45300000000000001,"15min":0.43099999999999999},"max":{"1min":1.431,"5min":1.732,"15min":1.956},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.159,"15min":1.149},"min":{"1min":0.48999999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.6479999999999999,"5min":1.7170000000000001,"15min":1.8839999999999999},"last":1.3320000000000001}]}]},{"osd":6,"up_from":16,"seq":68719477113,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30016,"kb_used_data":3000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341824,"statfs":{"total":96636764160,"available":96606027776,"internally_reserved":0,"allocated":3072000,"data_stored":4332626,"data_compressed":430585,"data_compressed_allocated":663552,"data_compressed_original":2125824,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.94799999999999995,"15min":0.93200000000000005},"min":{"1min":0.61499999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.256,"5min":1.375,"15min":1.956},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.056,"15min":1.0349999999999999},"min":{"1min":0.69699999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.2090000000000001,"5min":1.5429999999999999,"15min":1.5629999999999999},"last":0.91900000000000004}]},{"osd":1,"last update":"Mon Nov 27 18:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.90100000000000002,"15min":0.89100000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.51200000000000001},"max":{"1min":1.2829999999999999,"5min":1.4179999999999999,"15min":1.5229999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.92600000000000005,"15min":0.92500000000000004},"min":{"1min":0.62,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.252,"5min":1.3839999999999999,"15min":2.2519999999999998},"last":0.76700000000000002}]},{"osd":2,"last update":"Mon Nov 27 18:43:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":0.97099999999999997,"15min":0.96599999999999997},"min":{"1min":0.747,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.214,"5min":2.2349999999999999,"15min":2.2349999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.081,"15min":1.056},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.52900000000000003},"max":{"1min":1.3959999999999999,"5min":3.6549999999999998,"15min":3.6549999999999998},"last":0.99099999999999999}]},{"osd":3,"last update":"Mon Nov 27 18:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":1.044,"15min":1.034},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.52800000000000002},"max":{"1min":1.24,"5min":1.7949999999999999,"15min":2.3050000000000002},"last":1.1240000000000001},{"interface":"front","average":{"1min":1,"5min":1.0740000000000001,"15min":1.0660000000000001},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.57699999999999996},"max":{"1min":1.2170000000000001,"5min":2.0750000000000002,"15min":2.097},"last":1.038}]},{"osd":4,"last update":"Mon Nov 27 18:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.96599999999999997,"15min":0.96999999999999997},"min":{"1min":0.59499999999999997,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.3680000000000001,"5min":1.5309999999999999,"15min":1.712},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.016,"5min":1.097,"15min":1.0580000000000001},"min":{"1min":0.502,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.544,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.238}]},{"osd":5,"last update":"Mon Nov 27 18:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.0089999999999999,"15min":0.996},"min":{"1min":0.58999999999999997,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.399,"5min":1.879,"15min":2.173},"last":1.294},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.1299999999999999,"15min":1.137},"min":{"1min":0.65900000000000003,"5min":0.59399999999999997,"15min":0.46500000000000002},"max":{"1min":1.339,"5min":3.7509999999999999,"15min":3.7509999999999999},"last":1.331}]},{"osd":7,"last update":"Mon Nov 27 18:43:30 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.165,"15min":1.1559999999999999},"min":{"1min":0.56499999999999995,"5min":0.55300000000000005,"15min":0.40400000000000003},"max":{"1min":1.7470000000000001,"5min":1.962,"15min":2.351},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.177,"15min":1.1619999999999999},"min":{"1min":0.80300000000000005,"5min":0.55800000000000005,"15min":0.499},"max":{"1min":1.613,"5min":2.1150000000000002,"15min":2.2250000000000001},"last":1.385}]}]},{"osd":3,"up_from":16,"seq":68719477111,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58052,"kb_used_data":8828,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94313788,"statfs":{"total":96636764160,"available":96577318912,"internally_reserved":0,"allocated":9039872,"data_stored":12721816,"data_compressed":1205599,"data_compressed_allocated":1880064,"data_compressed_original":5767168,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.70399999999999996,"15min":0.72299999999999998},"min":{"1min":0.497,"5min":0.40100000000000002,"15min":0.29799999999999999},"max":{"1min":1.077,"5min":1.077,"15min":1.456},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.79700000000000004,"15min":0.78700000000000003},"min":{"1min":0.55800000000000005,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.006,"5min":1.387,"15min":1.4750000000000001},"last":0.95899999999999996}]},{"osd":1,"last update":"Mon Nov 27 18:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.79000000000000004,"15min":0.78700000000000003},"min":{"1min":0.54700000000000004,"5min":0.434,"15min":0.38900000000000001},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.88200000000000001,"15min":0.90300000000000002},"min":{"1min":0.64000000000000001,"5min":0.39200000000000002,"15min":0.36799999999999999},"max":{"1min":1.0880000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.46000000000000002}]},{"osd":2,"last update":"Mon Nov 27 18:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.94799999999999995,"15min":0.92400000000000004},"min":{"1min":0.67200000000000004,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.3420000000000001,"5min":1.631,"15min":1.631},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.93600000000000005,"15min":0.94999999999999996},"min":{"1min":0.61299999999999999,"5min":0.441,"15min":0.39000000000000001},"max":{"1min":1.115,"5min":1.375,"15min":1.375},"last":0.91200000000000003}]},{"osd":4,"last update":"Mon Nov 27 18:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":1.0149999999999999,"15min":0.98899999999999999},"min":{"1min":0.65700000000000003,"5min":0.57699999999999996,"15min":0.56799999999999995},"max":{"1min":1.3380000000000001,"5min":1.573,"15min":1.6439999999999999},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0289999999999999,"15min":1.0589999999999999},"min":{"1min":0.76900000000000002,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.3320000000000001,"5min":1.4950000000000001,"15min":1.605},"last":1.1399999999999999}]},{"osd":5,"last update":"Mon Nov 27 18:42:37 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.077,"15min":1.087},"min":{"1min":0.82499999999999996,"5min":0.69899999999999995,"15min":0.59799999999999998},"max":{"1min":1.409,"5min":1.6120000000000001,"15min":1.766},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.1899999999999999,"15min":1.1839999999999999},"min":{"1min":0.90500000000000003,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.536,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.1020000000000001}]},{"osd":6,"last update":"Mon Nov 27 18:42:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1319999999999999,"15min":1.099},"min":{"1min":0.88800000000000001,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.597,"5min":1.607,"15min":1.8720000000000001},"last":1.167},{"interface":"front","average":{"1min":1.141,"5min":1.171,"15min":1.1819999999999999},"min":{"1min":0.86599999999999999,"5min":0.73799999999999999,"15min":0.63300000000000001},"max":{"1min":1.504,"5min":1.7050000000000001,"15min":1.7270000000000001},"last":1.016}]},{"osd":7,"last update":"Mon Nov 27 18:42:37 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.2490000000000001,"15min":1.2470000000000001},"min":{"1min":0.94299999999999995,"5min":0.88800000000000001,"15min":0.61299999999999999},"max":{"1min":1.4770000000000001,"5min":1.915,"15min":1.915},"last":1.21},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1990000000000001,"15min":1.1699999999999999},"min":{"1min":1.014,"5min":0.496,"15min":0.496},"max":{"1min":1.5389999999999999,"5min":1.6839999999999999,"15min":1.9339999999999999},"last":1.0669999999999999}]}]},{"osd":2,"up_from":16,"seq":68719477112,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33272,"kb_used_data":6256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94338568,"statfs":{"total":96636764160,"available":96602693632,"internally_reserved":0,"allocated":6406144,"data_stored":8527602,"data_compressed":750925,"data_compressed_allocated":1228800,"data_compressed_original":3559424,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:42:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.71699999999999997,"15min":0.72199999999999998},"min":{"1min":0.49099999999999999,"5min":0.47699999999999998,"15min":0.41599999999999998},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2869999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.80400000000000005,"15min":0.82199999999999995},"min":{"1min":0.51700000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.3899999999999999,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":0.38800000000000001}]},{"osd":1,"last update":"Mon Nov 27 18:42:43 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.83699999999999997,"15min":0.85399999999999998},"min":{"1min":0.61799999999999999,"5min":0.56799999999999995,"15min":0.38500000000000001},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.89000000000000001,"15min":0.88900000000000001},"min":{"1min":0.54700000000000004,"5min":0.49399999999999999,"15min":0.48499999999999999},"max":{"1min":1.0269999999999999,"5min":2.6400000000000001,"15min":2.6400000000000001},"last":0.77000000000000002}]},{"osd":3,"last update":"Mon Nov 27 18:42:43 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84499999999999997,"15min":0.82899999999999996},"min":{"1min":0.436,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.3799999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":1.002,"5min":0.96599999999999997,"15min":0.97399999999999998},"min":{"1min":0.72399999999999998,"5min":0.46100000000000002,"15min":0.40200000000000002},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":0.61099999999999999}]},{"osd":4,"last update":"Mon Nov 27 18:42:43 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.0309999999999999,"15min":1.044},"min":{"1min":0.871,"5min":0.71799999999999997,"15min":0.56599999999999995},"max":{"1min":1.4339999999999999,"5min":1.49,"15min":1.7090000000000001},"last":0.746},{"interface":"front","average":{"1min":1.028,"5min":1.0329999999999999,"15min":1.05},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.57799999999999996},"max":{"1min":1.4179999999999999,"5min":1.861,"15min":1.861},"last":0.96699999999999997}]},{"osd":5,"last update":"Mon Nov 27 18:42:43 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.0820000000000001,"15min":1.089},"min":{"1min":0.68700000000000006,"5min":0.68300000000000005,"15min":0.628},"max":{"1min":1.4650000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.012,"5min":1.0649999999999999,"15min":1.0509999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.53000000000000003},"max":{"1min":1.3180000000000001,"5min":1.5800000000000001,"15min":1.6859999999999999},"last":1.0840000000000001}]},{"osd":6,"last update":"Mon Nov 27 18:42:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.1180000000000001,"15min":1.1080000000000001},"min":{"1min":0.58999999999999997,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.3169999999999999,"5min":1.6339999999999999,"15min":1.7490000000000001},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.1890000000000001,"15min":1.1870000000000001},"min":{"1min":0.93000000000000005,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.786,"5min":1.786,"15min":1.958},"last":0.83299999999999996}]},{"osd":7,"last update":"Mon Nov 27 18:42:43 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.194,"15min":1.1950000000000001},"min":{"1min":0.89200000000000002,"5min":0.88400000000000001,"15min":0.625},"max":{"1min":1.54,"5min":1.7869999999999999,"15min":1.8799999999999999},"last":1.04},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.204,"15min":1.1830000000000001},"min":{"1min":0.61099999999999999,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.389,"5min":3.4289999999999998,"15min":3.4289999999999998},"last":1.169}]}]},{"osd":1,"up_from":16,"seq":68719477112,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44056,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327784,"statfs":{"total":96636764160,"available":96591650816,"internally_reserved":0,"allocated":409600,"data_stored":728760,"data_compressed":33505,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.67600000000000005,"15min":0.70999999999999996},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.91500000000000004,"5min":1.1080000000000001,"15min":1.2969999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.77400000000000002,"15min":0.81599999999999995},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.282,"5min":1.306,"15min":1.397},"last":0.66400000000000003}]},{"osd":2,"last update":"Mon Nov 27 18:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.73199999999999998,"15min":0.73899999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.36299999999999999},"max":{"1min":1.0760000000000001,"5min":1.1439999999999999,"15min":1.3480000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.755,"5min":0.83299999999999996,"15min":0.88},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.38500000000000001},"max":{"1min":1.252,"5min":1.4359999999999999,"15min":1.9610000000000001},"last":0.71299999999999997}]},{"osd":3,"last update":"Mon Nov 27 18:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.92300000000000004,"15min":0.96799999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.0880000000000001,"5min":1.3520000000000001,"15min":1.8009999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.90300000000000002,"15min":0.90500000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.3140000000000001,"5min":1.462,"15min":2.0960000000000001},"last":0.46999999999999997}]},{"osd":4,"last update":"Mon Nov 27 18:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.95299999999999996,"15min":0.94799999999999995},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.51800000000000002},"max":{"1min":1.2070000000000001,"5min":1.4370000000000001,"15min":1.4970000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.93799999999999994,"5min":1.0589999999999999,"15min":1.0900000000000001},"min":{"1min":0.629,"5min":0.629,"15min":0.61399999999999999},"max":{"1min":1.379,"5min":1.478,"15min":2.496},"last":0.94199999999999995}]},{"osd":5,"last update":"Mon Nov 27 18:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.048,"15min":1.0880000000000001},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.51500000000000001},"max":{"1min":1.327,"5min":1.534,"15min":2.1970000000000001},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.97699999999999998,"5min":1.0489999999999999,"15min":1.0549999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.60599999999999998},"max":{"1min":1.3700000000000001,"5min":1.605,"15min":1.7529999999999999},"last":0.80600000000000005}]},{"osd":6,"last update":"Mon Nov 27 18:43:36 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.141,"15min":1.1890000000000001},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.503},"max":{"1min":1.502,"5min":1.6060000000000001,"15min":2.4319999999999999},"last":1.014},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.1459999999999999,"15min":1.1759999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.52600000000000002},"max":{"1min":1.5269999999999999,"5min":1.7569999999999999,"15min":2.3700000000000001},"last":0.89900000000000002}]},{"osd":7,"last update":"Mon Nov 27 18:43:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.167,"15min":1.206},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.55200000000000005},"max":{"1min":1.4510000000000001,"5min":1.6990000000000001,"15min":2.2879999999999998},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.028,"5min":1.1499999999999999,"15min":1.1579999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.319,"5min":1.7070000000000001,"15min":1.7170000000000001},"last":1.083}]}]},{"osd":0,"up_from":16,"seq":68719477113,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42672,"kb_used_data":3176,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329168,"statfs":{"total":96636764160,"available":96593068032,"internally_reserved":0,"allocated":3252224,"data_stored":4332682,"data_compressed":397480,"data_compressed_allocated":610304,"data_compressed_original":1900544,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 27 18:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.69599999999999995,"15min":0.71999999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.86199999999999999,"5min":1.2070000000000001,"15min":1.6599999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.82799999999999996,"15min":0.83999999999999997},"min":{"1min":0.47799999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2310000000000001,"5min":1.391,"15min":1.391},"last":0.77600000000000002}]},{"osd":2,"last update":"Mon Nov 27 18:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.81499999999999995,"15min":0.85299999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1140000000000001,"5min":1.3799999999999999,"15min":1.405},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.84599999999999997,"15min":0.85899999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.145,"5min":1.4730000000000001,"15min":1.5629999999999999},"last":0.58699999999999997}]},{"osd":3,"last update":"Mon Nov 27 18:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.85899999999999999,"15min":0.86499999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.42099999999999999},"max":{"1min":1.3140000000000001,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.96099999999999997,"15min":0.96599999999999997},"min":{"1min":0.53000000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.3839999999999999,"5min":1.421,"15min":2.073},"last":0.73599999999999999}]},{"osd":4,"last update":"Mon Nov 27 18:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.96499999999999997,"15min":0.97299999999999998},"min":{"1min":0.69999999999999996,"5min":0.64400000000000002,"15min":0.57099999999999995},"max":{"1min":1.222,"5min":1.73,"15min":1.897},"last":1.1000000000000001},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.0349999999999999,"15min":1.0740000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.3140000000000001,"5min":1.4059999999999999,"15min":2.1899999999999999},"last":0.82499999999999996}]},{"osd":5,"last update":"Mon Nov 27 18:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":1.0760000000000001,"15min":1.085},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.56899999999999995},"max":{"1min":1.3380000000000001,"5min":1.5369999999999999,"15min":2.0270000000000001},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.97899999999999998,"5min":1.036,"15min":1.04},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.624},"max":{"1min":1.248,"5min":1.855,"15min":1.9870000000000001},"last":1.0409999999999999}]},{"osd":6,"last update":"Mon Nov 27 18:43:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.1379999999999999,"15min":1.1639999999999999},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.59599999999999997},"max":{"1min":1.4830000000000001,"5min":1.6399999999999999,"15min":2.254},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.071,"5min":1.143,"15min":1.1719999999999999},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.745},"max":{"1min":1.4159999999999999,"5min":1.5800000000000001,"15min":1.8440000000000001},"last":0.98799999999999999}]},{"osd":7,"last update":"Mon Nov 27 18:43:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1799999999999999,"15min":1.2},"min":{"1min":0.85499999999999998,"5min":0.76100000000000001,"15min":0.60799999999999998},"max":{"1min":1.454,"5min":1.591,"15min":2.1600000000000001},"last":0.91500000000000004},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.151,"15min":1.155},"min":{"1min":0.84199999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.377,"5min":1.7849999999999999,"15min":2.117},"last":0.95099999999999996}]}]},{"osd":4,"up_from":15,"seq":64424509817,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55512,"kb_used_data":6288,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94316328,"statfs":{"total":96636764160,"available":96579919872,"internally_reserved":0,"allocated":6438912,"data_stored":8528274,"data_compressed":749838,"data_compressed_allocated":1245184,"data_compressed_original":3551232,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:42:36 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.92900000000000005,"15min":0.88500000000000001},"min":{"1min":0.63600000000000001,"5min":0.47099999999999997,"15min":0.46300000000000002},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.675},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.91500000000000004,"15min":0.91400000000000003},"min":{"1min":0.55300000000000005,"5min":0.373,"15min":0.373},"max":{"1min":1.298,"5min":1.504,"15min":1.5449999999999999},"last":0.68400000000000005}]},{"osd":1,"last update":"Mon Nov 27 18:42:36 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.93899999999999995,"15min":0.93500000000000005},"min":{"1min":0.71899999999999997,"5min":0.55100000000000005,"15min":0.46100000000000002},"max":{"1min":1.4199999999999999,"5min":1.4790000000000001,"15min":2.2759999999999998},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.95899999999999996,"15min":0.95299999999999996},"min":{"1min":0.73599999999999999,"5min":0.58899999999999997,"15min":0.49399999999999999},"max":{"1min":1.3080000000000001,"5min":1.371,"15min":1.569},"last":0.73599999999999999}]},{"osd":2,"last update":"Mon Nov 27 18:42:36 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.98699999999999999,"15min":0.96599999999999997},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":2.3730000000000002},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.012,"5min":0.99099999999999999,"15min":0.999},"min":{"1min":0.52200000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.3129999999999999,"5min":1.4770000000000001,"15min":1.7729999999999999},"last":1.1539999999999999}]},{"osd":3,"last update":"Mon Nov 27 18:42:36 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":0.97599999999999998,"15min":0.95899999999999996},"min":{"1min":0.77400000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.8300000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0349999999999999,"15min":1.048},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.496,"5min":1.5169999999999999,"15min":2.2069999999999999},"last":1.1240000000000001}]},{"osd":5,"last update":"Mon Nov 27 18:42:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93899999999999995,"15min":0.96699999999999997},"min":{"1min":0.59899999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.2210000000000001,"5min":1.4410000000000001,"15min":1.7290000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":1.083,"5min":0.96199999999999997,"15min":0.96899999999999997},"min":{"1min":0.69099999999999995,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.355,"5min":1.597,"15min":1.7150000000000001},"last":0.96399999999999997}]},{"osd":6,"last update":"Mon Nov 27 18:42:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.0569999999999999,"15min":1.038},"min":{"1min":0.72099999999999997,"5min":0.52200000000000002,"15min":0.48299999999999998},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":2.4199999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":1.21,"5min":1.153,"15min":1.1399999999999999},"min":{"1min":0.79100000000000004,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.4510000000000001,"5min":1.591,"15min":1.8140000000000001},"last":1.099}]},{"osd":7,"last update":"Mon Nov 27 18:42:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.089,"15min":1.073},"min":{"1min":0.504,"5min":0.46100000000000002,"15min":0.40400000000000003},"max":{"1min":1.623,"5min":1.6859999999999999,"15min":2.0419999999999998},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.196,"5min":1.1599999999999999,"15min":1.165},"min":{"1min":0.53200000000000003,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.736,"5min":1.736,"15min":2.3279999999999998},"last":1.179}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33505,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33505,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2912256,"data_stored":4194360,"data_compressed":397480,"data_compressed_allocated":610304,"data_compressed_original":1900544,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6066176,"data_stored":8389280,"data_compressed":750925,"data_compressed_allocated":1228800,"data_compressed_original":3559424,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8699904,"data_stored":12583494,"data_compressed":1205599,"data_compressed_allocated":1880064,"data_compressed_original":5767168,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6098944,"data_stored":8389952,"data_compressed":749838,"data_compressed_allocated":1245184,"data_compressed_original":3551232,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4546560,"data_stored":7328697,"data_compressed":816641,"data_compressed_allocated":1196032,"data_compressed_original":3989504,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":2732032,"data_stored":4194304,"data_compressed":430585,"data_compressed_allocated":663552,"data_compressed_original":2125824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1814528,"data_stored":3134425,"data_compressed":386056,"data_compressed_allocated":532480,"data_compressed_original":1863680,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T18:43:42.100 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2023-11-27T18:13:10.491982+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=10, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.100 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.101 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.101 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2023-11-27T18:13:10.491982+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=10, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.101 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.101 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.101 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2023-11-27T18:13:10.491982+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=10, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.101 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.101 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.101 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2023-11-27T18:13:10.491982+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=10, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.102 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.102 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.102 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.102 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2023-11-27T18:13:10.491982+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=10, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.102 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.102 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.102 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2023-11-27T18:13:10.491982+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=10, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.102 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.103 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.103 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2023-11-27T18:13:10.491982+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=10, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.103 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.103 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.103 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2023-11-27T18:13:10.491982+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=10, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.103 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.103 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.103 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-27T18:13:10.491982+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=10, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.103 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.104 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.104 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-27T18:13:10.491982+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=10, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.104 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.104 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.104 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-27T18:13:10.491982+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=10, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.104 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.104 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.104 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-27T18:13:10.491982+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=10, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.104 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.105 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.105 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-27T18:13:10.491982+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=10, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.105 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.105 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.105 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-27T18:13:10.491982+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=10, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.105 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.105 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.105 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-27T18:13:10.491982+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=10, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.105 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.106 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.106 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-27T18:13:10.491982+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=10, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.106 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.106 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.106 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2023-11-27T18:13:10.491982+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=10, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.106 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.106 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.106 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2023-11-27T18:13:10.491982+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=10, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.107 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.107 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.107 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2023-11-27T18:13:10.491982+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=10, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.107 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.107 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.107 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2023-11-27T18:13:10.491982+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=10, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.107 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.107 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.108 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2023-11-27T18:13:10.491982+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=10, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.108 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.108 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.108 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2023-11-27T18:13:10.491982+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=10, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.108 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.108 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.108 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2023-11-27T18:13:10.491982+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=10, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.108 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.108 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.109 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2023-11-27T18:13:10.491982+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=10, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.109 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.109 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.109 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2023-11-27T18:13:10.491982+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=10, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.109 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.109 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2023-11-27T18:13:10.491982+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=10, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.109 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.109 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.109 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2023-11-27T18:13:10.491982+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=10, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.110 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.110 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.110 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2023-11-27T18:13:10.491982+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=10, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.110 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.110 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.110 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.110 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2023-11-27T18:13:10.491982+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=10, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.110 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.111 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.111 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2023-11-27T18:13:10.491982+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=10, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.111 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2023-11-27T18:13:10.491982+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=10, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.111 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.111 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.111 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2023-11-27T18:13:10.491982+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=10, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.111 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.111 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.111 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.112 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.112 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.112 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.112 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.112 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.112 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.112 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.112 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.112 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.113 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.113 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.113 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.113 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.113 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.113 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.113 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.113 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.114 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.114 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.114 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.114 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.114 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.114 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.114 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.114 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.114 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.115 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.115 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.115 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:43:42.115 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-27T18:44:02.116 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T18:44:02.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.247+0000 7fea54b00640 1 Processor -- start 2023-11-27T18:44:02.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.247+0000 7fea54b00640 1 -- start start 2023-11-27T18:44:02.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.247+0000 7fea54b00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fea501514c0 0x7fea500c4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:44:02.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.251+0000 7fea54b00640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea501518a0 con 0x7fea500c68b0 2023-11-27T18:44:02.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.251+0000 7fea54b00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea5006b750 con 0x7fea50157ff0 2023-11-27T18:44:02.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.251+0000 7fea54b00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea500c7b70 con 0x7fea501514c0 2023-11-27T18:44:02.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.251+0000 7fea4dd9b640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fea500c68b0 0x7fea501578e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:57202/0 (socket says 172.21.15.91:57202) 2023-11-27T18:44:02.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.251+0000 7fea4dd9b640 1 -- 172.21.15.91:0/3047819612 learned_addr learned my addr 172.21.15.91:0/3047819612 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:44:02.255 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.251+0000 7fea4d59a640 1 -- 172.21.15.91:0/3047819612 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4273464113 0 0) 0x7fea501518a0 con 0x7fea500c68b0 2023-11-27T18:44:02.255 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.251+0000 7fea4d59a640 1 -- 172.21.15.91:0/3047819612 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea38003530 con 0x7fea500c68b0 2023-11-27T18:44:02.259 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.255+0000 7fea4d59a640 1 -- 172.21.15.91:0/3047819612 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2662912834 0 0) 0x7fea38003530 con 0x7fea500c68b0 2023-11-27T18:44:02.259 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.255+0000 7fea4d59a640 1 -- 172.21.15.91:0/3047819612 >> v2:172.21.15.94:3300/0 conn(0x7fea501514c0 msgr2=0x7fea500c4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:44:02.259 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.255+0000 7fea4d59a640 1 --2- 172.21.15.91:0/3047819612 >> v2:172.21.15.94:3300/0 conn(0x7fea501514c0 0x7fea500c4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:44:02.259 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.255+0000 7fea4d59a640 1 -- 172.21.15.91:0/3047819612 >> v1:172.21.15.94:6789/0 conn(0x7fea50157ff0 legacy=0x7fea50161d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:44:02.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.255+0000 7fea4d59a640 1 -- 172.21.15.91:0/3047819612 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea501573e0 con 0x7fea500c68b0 2023-11-27T18:44:02.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.255+0000 7fea4d59a640 1 -- 172.21.15.91:0/3047819612 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3378743932 0 0) 0x7fea44001680 con 0x7fea500c68b0 2023-11-27T18:44:02.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.255+0000 7fea4d59a640 1 -- 172.21.15.91:0/3047819612 >> v1:172.21.15.91:6789/0 conn(0x7fea500c68b0 legacy=0x7fea501578e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:44:02.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.255+0000 7fea4d59a640 1 --2- 172.21.15.91:0/3047819612 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fea380039d0 0x7fea38003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:44:02.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.255+0000 7fea4d59a640 1 --2- 172.21.15.91:0/3047819612 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fea380047d0 0x7fea38004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:44:02.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.255+0000 7fea4d59a640 1 --2- 172.21.15.91:0/3047819612 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fea380052b0 0x7fea3800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:44:02.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.255+0000 7fea4d59a640 1 -- 172.21.15.91:0/3047819612 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea500c7b70 con 0x7fea380039d0 2023-11-27T18:44:02.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.255+0000 7fea4d59a640 1 -- 172.21.15.91:0/3047819612 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea3800c1f0 con 0x7fea380047d0 2023-11-27T18:44:02.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.255+0000 7fea4d59a640 1 -- 172.21.15.91:0/3047819612 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea3800c3b0 con 0x7fea380052b0 2023-11-27T18:44:02.262 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.259+0000 7fea4e59c640 1 --2- 172.21.15.91:0/3047819612 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fea380039d0 0x7fea38003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:44:02.265 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.263+0000 7fea4e59c640 1 -- 172.21.15.91:0/3047819612 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fea380052b0 msgr2=0x7fea3800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:44:02.265 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.263+0000 7fea4e59c640 1 --2- 172.21.15.91:0/3047819612 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fea380052b0 0x7fea3800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:44:02.265 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.263+0000 7fea4e59c640 1 -- 172.21.15.91:0/3047819612 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fea380047d0 msgr2=0x7fea38004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:44:02.265 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.263+0000 7fea4e59c640 1 --2- 172.21.15.91:0/3047819612 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fea380047d0 0x7fea38004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:44:02.265 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.263+0000 7fea4e59c640 1 -- 172.21.15.91:0/3047819612 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea38003530 con 0x7fea380039d0 2023-11-27T18:44:02.265 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.263+0000 7fea4ed9d640 1 -- 172.21.15.91:0/3047819612 reap_dead start 2023-11-27T18:44:02.268 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.267+0000 7fea4e59c640 1 --2- 172.21.15.91:0/3047819612 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fea380039d0 0x7fea38003dd0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fea40009860 tx=0x7fea4001c300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efadd1283a49b58c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:44:02.272 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.271+0000 7fea4d59a640 1 -- 172.21.15.91:0/3047819612 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea400ab600 con 0x7fea380039d0 2023-11-27T18:44:02.272 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.271+0000 7fea4d59a640 1 -- 172.21.15.91:0/3047819612 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea400a7050 con 0x7fea380039d0 2023-11-27T18:44:02.273 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.271+0000 7fea4d59a640 1 -- 172.21.15.91:0/3047819612 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea400aba00 con 0x7fea380039d0 2023-11-27T18:44:02.273 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.271+0000 7fea54b00640 1 -- 172.21.15.91:0/3047819612 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fea380039d0 msgr2=0x7fea38003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:44:02.273 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.271+0000 7fea54b00640 1 --2- 172.21.15.91:0/3047819612 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fea380039d0 0x7fea38003dd0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fea40009860 tx=0x7fea4001c300 comp rx=0 tx=0).stop 2023-11-27T18:44:02.273 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.271+0000 7fea54b00640 1 -- 172.21.15.91:0/3047819612 shutdown_connections 2023-11-27T18:44:02.273 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.271+0000 7fea54b00640 1 --2- 172.21.15.91:0/3047819612 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fea380039d0 0x7fea38003dd0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:44:02.274 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.271+0000 7fea54b00640 1 -- 172.21.15.91:0/3047819612 >> 172.21.15.91:0/3047819612 conn(0x7fea500c7fa0 msgr2=0x7fea500c83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:44:02.274 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.271+0000 7fea54b00640 1 -- 172.21.15.91:0/3047819612 shutdown_connections 2023-11-27T18:44:02.274 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.271+0000 7fea54b00640 1 -- 172.21.15.91:0/3047819612 wait complete. 2023-11-27T18:44:02.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.271+0000 7fea54b00640 1 Processor -- start 2023-11-27T18:44:02.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.271+0000 7fea54b00640 1 -- start start 2023-11-27T18:44:02.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.271+0000 7fea54b00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fea380039d0 0x7fea500ca400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:44:02.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.271+0000 7fea54b00640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fea500caf80 0x7fea500c5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:44:02.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.271+0000 7fea54b00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fea501423a0 0x7fea500c92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:44:02.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.271+0000 7fea54b00640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea501e2490 con 0x7fea500caf80 2023-11-27T18:44:02.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.271+0000 7fea54b00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea500ca940 con 0x7fea501423a0 2023-11-27T18:44:02.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.271+0000 7fea54b00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea501e3010 con 0x7fea380039d0 2023-11-27T18:44:02.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.275+0000 7fea4dd9b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fea500caf80 0x7fea500c5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:44:02.277 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.275+0000 7fea4dd9b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fea500caf80 0x7fea500c5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:56124/0 (socket says 172.21.15.91:56124) 2023-11-27T18:44:02.277 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.275+0000 7fea4dd9b640 1 -- 172.21.15.91:0/3545034212 learned_addr learned my addr 172.21.15.91:0/3545034212 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:44:02.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.279+0000 7fea4dd9b640 1 -- 172.21.15.91:0/3545034212 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fea380039d0 msgr2=0x7fea500ca400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:44:02.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.279+0000 7fea4dd9b640 1 --2- 172.21.15.91:0/3545034212 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fea380039d0 0x7fea500ca400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:44:02.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.279+0000 7fea4dd9b640 1 -- 172.21.15.91:0/3545034212 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fea501423a0 msgr2=0x7fea500c92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:44:02.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.279+0000 7fea4dd9b640 1 --2- 172.21.15.91:0/3545034212 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fea501423a0 0x7fea500c92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:44:02.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.279+0000 7fea4dd9b640 1 -- 172.21.15.91:0/3545034212 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea501e2d10 con 0x7fea500caf80 2023-11-27T18:44:02.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.279+0000 7fea4dd9b640 1 --2- 172.21.15.91:0/3545034212 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fea500caf80 0x7fea500c5df0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fea4400f760 tx=0x7fea4400fc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:44:02.286 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.283+0000 7fea3effd640 1 -- 172.21.15.91:0/3545034212 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea44007af0 con 0x7fea500caf80 2023-11-27T18:44:02.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.283+0000 7fea3effd640 1 -- 172.21.15.91:0/3545034212 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea44007c90 con 0x7fea500caf80 2023-11-27T18:44:02.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.283+0000 7fea3effd640 1 -- 172.21.15.91:0/3545034212 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4400a0d0 con 0x7fea500caf80 2023-11-27T18:44:02.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.283+0000 7fea54b00640 1 -- 172.21.15.91:0/3545034212 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea501ef860 con 0x7fea500caf80 2023-11-27T18:44:02.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.283+0000 7fea54b00640 1 -- 172.21.15.91:0/3545034212 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea501e2670 con 0x7fea500caf80 2023-11-27T18:44:02.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.283+0000 7fea54b00640 1 -- 172.21.15.91:0/3545034212 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea50067810 con 0x7fea500caf80 2023-11-27T18:44:02.307 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.303+0000 7fea3effd640 1 -- 172.21.15.91:0/3545034212 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fea4400a230 con 0x7fea500caf80 2023-11-27T18:44:02.308 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.307+0000 7fea3effd640 1 --2- 172.21.15.91:0/3545034212 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fea30066870 0x7fea30068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:44:02.308 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.307+0000 7fea4e59c640 1 --2- 172.21.15.91:0/3545034212 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fea30066870 0x7fea30068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:44:02.309 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.307+0000 7fea4e59c640 1 --2- 172.21.15.91:0/3545034212 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fea30066870 0x7fea30068d30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fea400ad000 tx=0x7fea400047e0 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:44:02.310 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.307+0000 7fea3effd640 1 -- 172.21.15.91:0/3545034212 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fea44057b90 con 0x7fea500caf80 2023-11-27T18:44:02.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.559+0000 7fea3effd640 1 -- 172.21.15.91:0/3545034212 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fea44053ed0 con 0x7fea500caf80 2023-11-27T18:44:02.722 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.719+0000 7fea54b00640 1 -- 172.21.15.91:0/3545034212 --> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fea5006b9f0 con 0x7fea30066870 2023-11-27T18:44:02.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.747+0000 7fea3effd640 1 -- 172.21.15.91:0/3545034212 <== mgr.4136 v2:172.21.15.91:6800/2814827118 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368333 (secure 0 0 0) 0x7fea400ab6e0 con 0x7fea30066870 2023-11-27T18:44:02.751 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:44:02.754 INFO:teuthology.orchestra.run.smithi091.stderr:dumped all 2023-11-27T18:44:02.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.751+0000 7fea54b00640 1 -- 172.21.15.91:0/3545034212 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fea30066870 msgr2=0x7fea30068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:44:02.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.751+0000 7fea54b00640 1 --2- 172.21.15.91:0/3545034212 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fea30066870 0x7fea30068d30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fea400ad000 tx=0x7fea400047e0 comp rx=0 tx=0).stop 2023-11-27T18:44:02.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.751+0000 7fea54b00640 1 -- 172.21.15.91:0/3545034212 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fea500caf80 msgr2=0x7fea500c5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:44:02.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.751+0000 7fea54b00640 1 --2- 172.21.15.91:0/3545034212 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fea500caf80 0x7fea500c5df0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fea4400f760 tx=0x7fea4400fc20 comp rx=0 tx=0).stop 2023-11-27T18:44:02.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.751+0000 7fea54b00640 1 -- 172.21.15.91:0/3545034212 shutdown_connections 2023-11-27T18:44:02.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.751+0000 7fea54b00640 1 --2- 172.21.15.91:0/3545034212 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fea30066870 0x7fea30068d30 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:44:02.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.751+0000 7fea54b00640 1 --2- 172.21.15.91:0/3545034212 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fea501423a0 0x7fea500c92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:44:02.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.751+0000 7fea54b00640 1 --2- 172.21.15.91:0/3545034212 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fea500caf80 0x7fea500c5df0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:44:02.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.751+0000 7fea54b00640 1 --2- 172.21.15.91:0/3545034212 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fea380039d0 0x7fea500ca400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:44:02.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.751+0000 7fea54b00640 1 -- 172.21.15.91:0/3545034212 >> 172.21.15.91:0/3545034212 conn(0x7fea500c7fa0 msgr2=0x7fea50155820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:44:02.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.751+0000 7fea54b00640 1 -- 172.21.15.91:0/3545034212 shutdown_connections 2023-11-27T18:44:02.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:02.751+0000 7fea54b00640 1 -- 172.21.15.91:0/3545034212 wait complete. 2023-11-27T18:44:02.774 INFO:teuthology.orchestra.run.smithi091.stdout:{"pg_ready":true,"pg_map":{"version":970,"stamp":"2023-11-27T18:44:01.904879+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":24697659,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":665,"num_read_kb":681,"num_write":8239,"num_write_kb":284305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9525,"ondisk_log_size":9525,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":332868,"kb_used_data":34884,"kb_used_omap":12,"kb_used_meta":297907,"kb_avail":754641852,"statfs":{"total":773094113280,"available":772753256448,"internally_reserved":0,"allocated":35721216,"data_stored":50501075,"data_compressed":4804134,"data_compressed_allocated":7446528,"data_compressed_original":23904256,"omap_allocated":12751,"internal_metadata":305057329},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005401"},"pg_stats":[{"pgid":"2.1f","version":"32'715","reported_seq":759,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:47.848041+0000","last_change":"2023-11-27T18:43:47.848187+0000","last_active":"2023-11-27T18:43:47.848041+0000","last_peered":"2023-11-27T18:43:47.848041+0000","last_clean":"2023-11-27T18:43:47.848041+0000","last_became_active":"2023-11-27T18:13:12.298140+0000","last_became_peered":"2023-11-27T18:13:12.298140+0000","last_unstale":"2023-11-27T18:43:47.848041+0000","last_undegraded":"2023-11-27T18:43:47.848041+0000","last_fullsized":"2023-11-27T18:43:47.848041+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'715","last_scrub_stamp":"2023-11-27T18:43:47.847820+0000","last_deep_scrub":"32'715","last_deep_scrub_stamp":"2023-11-27T18:43:47.847820+0000","last_clean_scrub_stamp":"2023-11-27T18:43:47.847820+0000","objects_scrubbed":3,"log_size":715,"log_dups_size":0,"ondisk_log_size":715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:50:51.204330+0000","scrub_duration":0.035779559000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":710,"num_write_kb":4473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"32'16","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.085013+0000","last_change":"2023-11-27T18:13:14.416681+0000","last_active":"2023-11-27T18:43:23.085013+0000","last_peered":"2023-11-27T18:43:23.085013+0000","last_clean":"2023-11-27T18:43:23.085013+0000","last_became_active":"2023-11-27T18:13:14.416401+0000","last_became_peered":"2023-11-27T18:13:14.416401+0000","last_unstale":"2023-11-27T18:43:23.085013+0000","last_undegraded":"2023-11-27T18:43:23.085013+0000","last_fullsized":"2023-11-27T18:43:23.085013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"32'75","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:29.414625+0000","last_change":"2023-11-27T18:13:20.916435+0000","last_active":"2023-11-27T18:42:29.414625+0000","last_peered":"2023-11-27T18:42:29.414625+0000","last_clean":"2023-11-27T18:42:29.414625+0000","last_became_active":"2023-11-27T18:13:20.915358+0000","last_became_peered":"2023-11-27T18:13:20.915358+0000","last_unstale":"2023-11-27T18:42:29.414625+0000","last_undegraded":"2023-11-27T18:42:29.414625+0000","last_fullsized":"2023-11-27T18:42:29.414625+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":3642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"32'325","reported_seq":369,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:57.075955+0000","last_change":"2023-11-27T18:43:57.076012+0000","last_active":"2023-11-27T18:43:57.075955+0000","last_peered":"2023-11-27T18:43:57.075955+0000","last_clean":"2023-11-27T18:43:57.075955+0000","last_became_active":"2023-11-27T18:13:12.304981+0000","last_became_peered":"2023-11-27T18:13:12.304981+0000","last_unstale":"2023-11-27T18:43:57.075955+0000","last_undegraded":"2023-11-27T18:43:57.075955+0000","last_fullsized":"2023-11-27T18:43:57.075955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'325","last_scrub_stamp":"2023-11-27T18:43:57.075766+0000","last_deep_scrub":"32'325","last_deep_scrub_stamp":"2023-11-27T18:43:57.075766+0000","last_clean_scrub_stamp":"2023-11-27T18:43:57.075766+0000","objects_scrubbed":1,"log_size":325,"log_dups_size":0,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:30:28.504144+0000","scrub_duration":0.022777430000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3006109,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":322,"num_write_kb":3093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"32'24","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:41.204294+0000","last_change":"2023-11-27T18:43:41.204401+0000","last_active":"2023-11-27T18:43:41.204294+0000","last_peered":"2023-11-27T18:43:41.204294+0000","last_clean":"2023-11-27T18:43:41.204294+0000","last_became_active":"2023-11-27T18:13:14.365787+0000","last_became_peered":"2023-11-27T18:13:14.365787+0000","last_unstale":"2023-11-27T18:43:41.204294+0000","last_undegraded":"2023-11-27T18:43:41.204294+0000","last_fullsized":"2023-11-27T18:43:41.204294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'24","last_scrub_stamp":"2023-11-27T18:43:41.204069+0000","last_deep_scrub":"32'24","last_deep_scrub_stamp":"2023-11-27T18:43:41.204069+0000","last_clean_scrub_stamp":"2023-11-27T18:43:41.204069+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:32:19.911402+0000","scrub_duration":0.0057151110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"32'88","reported_seq":118,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:24.473240+0000","last_change":"2023-11-27T18:13:20.915811+0000","last_active":"2023-11-27T18:42:24.473240+0000","last_peered":"2023-11-27T18:42:24.473240+0000","last_clean":"2023-11-27T18:42:24.473240+0000","last_became_active":"2023-11-27T18:13:20.914864+0000","last_became_peered":"2023-11-27T18:13:20.914864+0000","last_unstale":"2023-11-27T18:42:24.473240+0000","last_undegraded":"2023-11-27T18:42:24.473240+0000","last_fullsized":"2023-11-27T18:42:24.473240+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":6140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"32'9","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:14.224861+0000","last_change":"2023-11-27T18:13:12.272691+0000","last_active":"2023-11-27T18:43:14.224861+0000","last_peered":"2023-11-27T18:43:14.224861+0000","last_clean":"2023-11-27T18:43:14.224861+0000","last_became_active":"2023-11-27T18:13:12.272343+0000","last_became_peered":"2023-11-27T18:13:12.272343+0000","last_unstale":"2023-11-27T18:43:14.224861+0000","last_undegraded":"2023-11-27T18:43:14.224861+0000","last_fullsized":"2023-11-27T18:43:14.224861+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"32'21","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:44.441251+0000","last_change":"2023-11-27T18:43:44.441307+0000","last_active":"2023-11-27T18:43:44.441251+0000","last_peered":"2023-11-27T18:43:44.441251+0000","last_clean":"2023-11-27T18:43:44.441251+0000","last_became_active":"2023-11-27T18:13:15.803248+0000","last_became_peered":"2023-11-27T18:13:15.803248+0000","last_unstale":"2023-11-27T18:43:44.441251+0000","last_undegraded":"2023-11-27T18:43:44.441251+0000","last_fullsized":"2023-11-27T18:43:44.441251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2023-11-27T18:43:44.441030+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2023-11-27T18:43:44.441030+0000","last_clean_scrub_stamp":"2023-11-27T18:43:44.441030+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:32:54.895787+0000","scrub_duration":0.0033392019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"32'82","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:24.296114+0000","last_change":"2023-11-27T18:13:20.909371+0000","last_active":"2023-11-27T18:43:24.296114+0000","last_peered":"2023-11-27T18:43:24.296114+0000","last_clean":"2023-11-27T18:43:24.296114+0000","last_became_active":"2023-11-27T18:13:20.908285+0000","last_became_peered":"2023-11-27T18:13:20.908285+0000","last_unstale":"2023-11-27T18:43:24.296114+0000","last_undegraded":"2023-11-27T18:43:24.296114+0000","last_fullsized":"2023-11-27T18:43:24.296114+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":10516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"32'5","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:46.597260+0000","last_change":"2023-11-27T18:43:46.597376+0000","last_active":"2023-11-27T18:43:46.597260+0000","last_peered":"2023-11-27T18:43:46.597260+0000","last_clean":"2023-11-27T18:43:46.597260+0000","last_became_active":"2023-11-27T18:13:12.274275+0000","last_became_peered":"2023-11-27T18:13:12.274275+0000","last_unstale":"2023-11-27T18:43:46.597260+0000","last_undegraded":"2023-11-27T18:43:46.597260+0000","last_fullsized":"2023-11-27T18:43:46.597260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2023-11-27T18:43:46.597014+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2023-11-27T18:43:46.597014+0000","last_clean_scrub_stamp":"2023-11-27T18:43:46.597014+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:38:25.702336+0000","scrub_duration":0.0064410480000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"32'37","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.019011+0000","last_change":"2023-11-27T18:13:14.422531+0000","last_active":"2023-11-27T18:43:23.019011+0000","last_peered":"2023-11-27T18:43:23.019011+0000","last_clean":"2023-11-27T18:43:23.019011+0000","last_became_active":"2023-11-27T18:13:14.421811+0000","last_became_peered":"2023-11-27T18:13:14.421811+0000","last_unstale":"2023-11-27T18:43:23.019011+0000","last_undegraded":"2023-11-27T18:43:23.019011+0000","last_fullsized":"2023-11-27T18:43:23.019011+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"32'74","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:24.296034+0000","last_change":"2023-11-27T18:13:20.907358+0000","last_active":"2023-11-27T18:43:24.296034+0000","last_peered":"2023-11-27T18:43:24.296034+0000","last_clean":"2023-11-27T18:43:24.296034+0000","last_became_active":"2023-11-27T18:13:20.906418+0000","last_became_peered":"2023-11-27T18:13:20.906418+0000","last_unstale":"2023-11-27T18:43:24.296034+0000","last_undegraded":"2023-11-27T18:43:24.296034+0000","last_fullsized":"2023-11-27T18:43:24.296034+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":5836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"32'20","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:59.211521+0000","last_change":"2023-11-27T18:43:59.211572+0000","last_active":"2023-11-27T18:43:59.211521+0000","last_peered":"2023-11-27T18:43:59.211521+0000","last_clean":"2023-11-27T18:43:59.211521+0000","last_became_active":"2023-11-27T18:13:14.418640+0000","last_became_peered":"2023-11-27T18:13:14.418640+0000","last_unstale":"2023-11-27T18:43:59.211521+0000","last_undegraded":"2023-11-27T18:43:59.211521+0000","last_fullsized":"2023-11-27T18:43:59.211521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2023-11-27T18:43:59.211339+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2023-11-27T18:43:59.211339+0000","last_clean_scrub_stamp":"2023-11-27T18:43:59.211339+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:15:35.201396+0000","scrub_duration":0.0038460930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"32'688","reported_seq":723,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:06.998077+0000","last_change":"2023-11-27T18:13:12.306690+0000","last_active":"2023-11-27T18:43:06.998077+0000","last_peered":"2023-11-27T18:43:06.998077+0000","last_clean":"2023-11-27T18:43:06.998077+0000","last_became_active":"2023-11-27T18:13:12.306331+0000","last_became_peered":"2023-11-27T18:13:12.306331+0000","last_unstale":"2023-11-27T18:43:06.998077+0000","last_undegraded":"2023-11-27T18:43:06.998077+0000","last_fullsized":"2023-11-27T18:43:06.998077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":683,"num_write_kb":4455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'77","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:34.087162+0000","last_change":"2023-11-27T18:14:22.718298+0000","last_active":"2023-11-27T18:43:34.087162+0000","last_peered":"2023-11-27T18:43:34.087162+0000","last_clean":"2023-11-27T18:43:34.087162+0000","last_became_active":"2023-11-27T18:14:22.717105+0000","last_became_peered":"2023-11-27T18:14:22.717105+0000","last_unstale":"2023-11-27T18:43:34.087162+0000","last_undegraded":"2023-11-27T18:43:34.087162+0000","last_fullsized":"2023-11-27T18:43:34.087162+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":10073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7,5],"acting":[0,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"32'22","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:51.107667+0000","last_change":"2023-11-27T18:43:51.107717+0000","last_active":"2023-11-27T18:43:51.107667+0000","last_peered":"2023-11-27T18:43:51.107667+0000","last_clean":"2023-11-27T18:43:51.107667+0000","last_became_active":"2023-11-27T18:13:14.368117+0000","last_became_peered":"2023-11-27T18:13:14.368117+0000","last_unstale":"2023-11-27T18:43:51.107667+0000","last_undegraded":"2023-11-27T18:43:51.107667+0000","last_fullsized":"2023-11-27T18:43:51.107667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2023-11-27T18:43:51.107469+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2023-11-27T18:43:51.107469+0000","last_clean_scrub_stamp":"2023-11-27T18:43:51.107469+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:57:21.965939+0000","scrub_duration":0.0058469949999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"32'2","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:49.531217+0000","last_change":"2023-11-27T18:43:49.531318+0000","last_active":"2023-11-27T18:43:49.531217+0000","last_peered":"2023-11-27T18:43:49.531217+0000","last_clean":"2023-11-27T18:43:49.531217+0000","last_became_active":"2023-11-27T18:13:12.306644+0000","last_became_peered":"2023-11-27T18:13:12.306644+0000","last_unstale":"2023-11-27T18:43:49.531217+0000","last_undegraded":"2023-11-27T18:43:49.531217+0000","last_fullsized":"2023-11-27T18:43:49.531217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2023-11-27T18:43:49.530967+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2023-11-27T18:43:49.530967+0000","last_clean_scrub_stamp":"2023-11-27T18:43:49.530967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:08:46.212891+0000","scrub_duration":0.003406638,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"32'100","reported_seq":131,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:39.210348+0000","last_change":"2023-11-27T18:13:20.930173+0000","last_active":"2023-11-27T18:42:39.210348+0000","last_peered":"2023-11-27T18:42:39.210348+0000","last_clean":"2023-11-27T18:42:39.210348+0000","last_became_active":"2023-11-27T18:13:20.928830+0000","last_became_peered":"2023-11-27T18:13:20.928830+0000","last_unstale":"2023-11-27T18:42:39.210348+0000","last_undegraded":"2023-11-27T18:42:39.210348+0000","last_fullsized":"2023-11-27T18:42:39.210348+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":7369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"32'24","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:52.943762+0000","last_change":"2023-11-27T18:43:52.943813+0000","last_active":"2023-11-27T18:43:52.943762+0000","last_peered":"2023-11-27T18:43:52.943762+0000","last_clean":"2023-11-27T18:43:52.943762+0000","last_became_active":"2023-11-27T18:13:14.378391+0000","last_became_peered":"2023-11-27T18:13:14.378391+0000","last_unstale":"2023-11-27T18:43:52.943762+0000","last_undegraded":"2023-11-27T18:43:52.943762+0000","last_fullsized":"2023-11-27T18:43:52.943762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'24","last_scrub_stamp":"2023-11-27T18:43:52.943561+0000","last_deep_scrub":"32'24","last_deep_scrub_stamp":"2023-11-27T18:43:52.943561+0000","last_clean_scrub_stamp":"2023-11-27T18:43:52.943561+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:36:18.307587+0000","scrub_duration":0.003991362,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"32'4","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:45.824544+0000","last_change":"2023-11-27T18:43:45.824599+0000","last_active":"2023-11-27T18:43:45.824544+0000","last_peered":"2023-11-27T18:43:45.824544+0000","last_clean":"2023-11-27T18:43:45.824544+0000","last_became_active":"2023-11-27T18:13:12.269795+0000","last_became_peered":"2023-11-27T18:13:12.269795+0000","last_unstale":"2023-11-27T18:43:45.824544+0000","last_undegraded":"2023-11-27T18:43:45.824544+0000","last_fullsized":"2023-11-27T18:43:45.824544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2023-11-27T18:43:45.824352+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2023-11-27T18:43:45.824352+0000","last_clean_scrub_stamp":"2023-11-27T18:43:45.824352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:21:33.244186+0000","scrub_duration":0.0037706549999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'67","reported_seq":98,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:49.273896+0000","last_change":"2023-11-27T18:13:20.907340+0000","last_active":"2023-11-27T18:42:49.273896+0000","last_peered":"2023-11-27T18:42:49.273896+0000","last_clean":"2023-11-27T18:42:49.273896+0000","last_became_active":"2023-11-27T18:13:20.906609+0000","last_became_peered":"2023-11-27T18:13:20.906609+0000","last_unstale":"2023-11-27T18:42:49.273896+0000","last_undegraded":"2023-11-27T18:42:49.273896+0000","last_fullsized":"2023-11-27T18:42:49.273896+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":7315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"32'21","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:43.136981+0000","last_change":"2023-11-27T18:43:43.137113+0000","last_active":"2023-11-27T18:43:43.136981+0000","last_peered":"2023-11-27T18:43:43.136981+0000","last_clean":"2023-11-27T18:43:43.136981+0000","last_became_active":"2023-11-27T18:13:14.414888+0000","last_became_peered":"2023-11-27T18:13:14.414888+0000","last_unstale":"2023-11-27T18:43:43.136981+0000","last_undegraded":"2023-11-27T18:43:43.136981+0000","last_fullsized":"2023-11-27T18:43:43.136981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2023-11-27T18:43:43.136763+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2023-11-27T18:43:43.136763+0000","last_clean_scrub_stamp":"2023-11-27T18:43:43.136763+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:48:26.024827+0000","scrub_duration":0.003973931,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"32'5","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:43.558828+0000","last_change":"2023-11-27T18:43:43.558883+0000","last_active":"2023-11-27T18:43:43.558828+0000","last_peered":"2023-11-27T18:43:43.558828+0000","last_clean":"2023-11-27T18:43:43.558828+0000","last_became_active":"2023-11-27T18:13:12.273356+0000","last_became_peered":"2023-11-27T18:13:12.273356+0000","last_unstale":"2023-11-27T18:43:43.558828+0000","last_undegraded":"2023-11-27T18:43:43.558828+0000","last_fullsized":"2023-11-27T18:43:43.558828+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2023-11-27T18:43:43.558640+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2023-11-27T18:43:43.558640+0000","last_clean_scrub_stamp":"2023-11-27T18:43:43.558640+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:49:12.209206+0000","scrub_duration":0.0032465200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'85","reported_seq":116,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:39.286536+0000","last_change":"2023-11-27T18:13:20.935910+0000","last_active":"2023-11-27T18:42:39.286536+0000","last_peered":"2023-11-27T18:42:39.286536+0000","last_clean":"2023-11-27T18:42:39.286536+0000","last_became_active":"2023-11-27T18:13:20.934797+0000","last_became_peered":"2023-11-27T18:13:20.934797+0000","last_unstale":"2023-11-27T18:42:39.286536+0000","last_undegraded":"2023-11-27T18:42:39.286536+0000","last_fullsized":"2023-11-27T18:42:39.286536+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":5270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'29","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:32.660027+0000","last_change":"2023-11-27T18:13:14.376557+0000","last_active":"2023-11-27T18:43:32.660027+0000","last_peered":"2023-11-27T18:43:32.660027+0000","last_clean":"2023-11-27T18:43:32.660027+0000","last_became_active":"2023-11-27T18:13:14.376304+0000","last_became_peered":"2023-11-27T18:13:14.376304+0000","last_unstale":"2023-11-27T18:43:32.660027+0000","last_undegraded":"2023-11-27T18:43:32.660027+0000","last_fullsized":"2023-11-27T18:43:32.660027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"32'7","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:34.397301+0000","last_change":"2023-11-27T18:13:12.307806+0000","last_active":"2023-11-27T18:43:34.397301+0000","last_peered":"2023-11-27T18:43:34.397301+0000","last_clean":"2023-11-27T18:43:34.397301+0000","last_became_active":"2023-11-27T18:13:12.307492+0000","last_became_peered":"2023-11-27T18:13:12.307492+0000","last_unstale":"2023-11-27T18:43:34.397301+0000","last_undegraded":"2023-11-27T18:43:34.397301+0000","last_fullsized":"2023-11-27T18:43:34.397301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"32'53","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:34.285317+0000","last_change":"2023-11-27T18:13:20.918671+0000","last_active":"2023-11-27T18:42:34.285317+0000","last_peered":"2023-11-27T18:42:34.285317+0000","last_clean":"2023-11-27T18:42:34.285317+0000","last_became_active":"2023-11-27T18:13:20.917507+0000","last_became_peered":"2023-11-27T18:13:20.917507+0000","last_unstale":"2023-11-27T18:42:34.285317+0000","last_undegraded":"2023-11-27T18:42:34.285317+0000","last_fullsized":"2023-11-27T18:42:34.285317+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":7028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"32'21","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:49.863843+0000","last_change":"2023-11-27T18:43:49.863898+0000","last_active":"2023-11-27T18:43:49.863843+0000","last_peered":"2023-11-27T18:43:49.863843+0000","last_clean":"2023-11-27T18:43:49.863843+0000","last_became_active":"2023-11-27T18:13:14.377289+0000","last_became_peered":"2023-11-27T18:13:14.377289+0000","last_unstale":"2023-11-27T18:43:49.863843+0000","last_undegraded":"2023-11-27T18:43:49.863843+0000","last_fullsized":"2023-11-27T18:43:49.863843+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2023-11-27T18:43:49.863644+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2023-11-27T18:43:49.863644+0000","last_clean_scrub_stamp":"2023-11-27T18:43:49.863644+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:01:22.274023+0000","scrub_duration":0.0055625429999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"32'327","reported_seq":371,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:40.843422+0000","last_change":"2023-11-27T18:43:40.843448+0000","last_active":"2023-11-27T18:43:40.843422+0000","last_peered":"2023-11-27T18:43:40.843422+0000","last_clean":"2023-11-27T18:43:40.843422+0000","last_became_active":"2023-11-27T18:13:12.267552+0000","last_became_peered":"2023-11-27T18:13:12.267552+0000","last_unstale":"2023-11-27T18:43:40.843422+0000","last_undegraded":"2023-11-27T18:43:40.843422+0000","last_fullsized":"2023-11-27T18:43:40.843422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'327","last_scrub_stamp":"2023-11-27T18:43:40.843323+0000","last_deep_scrub":"32'327","last_deep_scrub_stamp":"2023-11-27T18:43:40.843323+0000","last_clean_scrub_stamp":"2023-11-27T18:43:40.843323+0000","objects_scrubbed":1,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:56:06.018967+0000","scrub_duration":0.013467106,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"32'94","reported_seq":127,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:32.659768+0000","last_change":"2023-11-27T18:13:20.929780+0000","last_active":"2023-11-27T18:43:32.659768+0000","last_peered":"2023-11-27T18:43:32.659768+0000","last_clean":"2023-11-27T18:43:32.659768+0000","last_became_active":"2023-11-27T18:13:20.929370+0000","last_became_peered":"2023-11-27T18:13:20.929370+0000","last_unstale":"2023-11-27T18:43:32.659768+0000","last_undegraded":"2023-11-27T18:43:32.659768+0000","last_fullsized":"2023-11-27T18:43:32.659768+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":11915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"32'22","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.010739+0000","last_change":"2023-11-27T18:13:14.369764+0000","last_active":"2023-11-27T18:43:23.010739+0000","last_peered":"2023-11-27T18:43:23.010739+0000","last_clean":"2023-11-27T18:43:23.010739+0000","last_became_active":"2023-11-27T18:13:14.369472+0000","last_became_peered":"2023-11-27T18:13:14.369472+0000","last_unstale":"2023-11-27T18:43:23.010739+0000","last_undegraded":"2023-11-27T18:43:23.010739+0000","last_fullsized":"2023-11-27T18:43:23.010739+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:03.762957+0000","last_change":"2023-11-27T18:13:12.310761+0000","last_active":"2023-11-27T18:43:03.762957+0000","last_peered":"2023-11-27T18:43:03.762957+0000","last_clean":"2023-11-27T18:43:03.762957+0000","last_became_active":"2023-11-27T18:13:12.310495+0000","last_became_peered":"2023-11-27T18:13:12.310495+0000","last_unstale":"2023-11-27T18:43:03.762957+0000","last_undegraded":"2023-11-27T18:43:03.762957+0000","last_fullsized":"2023-11-27T18:43:03.762957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"32'62","reported_seq":94,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:34.230933+0000","last_change":"2023-11-27T18:13:20.907638+0000","last_active":"2023-11-27T18:42:34.230933+0000","last_peered":"2023-11-27T18:42:34.230933+0000","last_clean":"2023-11-27T18:42:34.230933+0000","last_became_active":"2023-11-27T18:13:20.907229+0000","last_became_peered":"2023-11-27T18:13:20.907229+0000","last_unstale":"2023-11-27T18:42:34.230933+0000","last_undegraded":"2023-11-27T18:42:34.230933+0000","last_fullsized":"2023-11-27T18:42:34.230933+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":7408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"32'20","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:49.434941+0000","last_change":"2023-11-27T18:43:49.434991+0000","last_active":"2023-11-27T18:43:49.434941+0000","last_peered":"2023-11-27T18:43:49.434941+0000","last_clean":"2023-11-27T18:43:49.434941+0000","last_became_active":"2023-11-27T18:13:15.850263+0000","last_became_peered":"2023-11-27T18:13:15.850263+0000","last_unstale":"2023-11-27T18:43:49.434941+0000","last_undegraded":"2023-11-27T18:43:49.434941+0000","last_fullsized":"2023-11-27T18:43:49.434941+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2023-11-27T18:43:49.434748+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2023-11-27T18:43:49.434748+0000","last_clean_scrub_stamp":"2023-11-27T18:43:49.434748+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:46:15.277193+0000","scrub_duration":0.004346305,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:54.064395+0000","last_change":"2023-11-27T18:43:54.064497+0000","last_active":"2023-11-27T18:43:54.064395+0000","last_peered":"2023-11-27T18:43:54.064395+0000","last_clean":"2023-11-27T18:43:54.064395+0000","last_became_active":"2023-11-27T18:13:12.310138+0000","last_became_peered":"2023-11-27T18:13:12.310138+0000","last_unstale":"2023-11-27T18:43:54.064395+0000","last_undegraded":"2023-11-27T18:43:54.064395+0000","last_fullsized":"2023-11-27T18:43:54.064395+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2023-11-27T18:43:54.064090+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2023-11-27T18:43:54.064090+0000","last_clean_scrub_stamp":"2023-11-27T18:43:54.064090+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:32:42.710824+0000","scrub_duration":0.0045180919999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"32'81","reported_seq":113,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:34.230777+0000","last_change":"2023-11-27T18:13:20.896960+0000","last_active":"2023-11-27T18:42:34.230777+0000","last_peered":"2023-11-27T18:42:34.230777+0000","last_clean":"2023-11-27T18:42:34.230777+0000","last_became_active":"2023-11-27T18:13:20.896156+0000","last_became_peered":"2023-11-27T18:13:20.896156+0000","last_unstale":"2023-11-27T18:42:34.230777+0000","last_undegraded":"2023-11-27T18:42:34.230777+0000","last_fullsized":"2023-11-27T18:42:34.230777+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":6173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"32'22","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:41.582044+0000","last_change":"2023-11-27T18:43:41.582072+0000","last_active":"2023-11-27T18:43:41.582044+0000","last_peered":"2023-11-27T18:43:41.582044+0000","last_clean":"2023-11-27T18:43:41.582044+0000","last_became_active":"2023-11-27T18:13:14.421125+0000","last_became_peered":"2023-11-27T18:13:14.421125+0000","last_unstale":"2023-11-27T18:43:41.582044+0000","last_undegraded":"2023-11-27T18:43:41.582044+0000","last_fullsized":"2023-11-27T18:43:41.582044+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2023-11-27T18:43:41.581900+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2023-11-27T18:43:41.581900+0000","last_clean_scrub_stamp":"2023-11-27T18:43:41.581900+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:46:07.424345+0000","scrub_duration":0.0018251680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"32'5","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:14.226128+0000","last_change":"2023-11-27T18:13:12.301922+0000","last_active":"2023-11-27T18:43:14.226128+0000","last_peered":"2023-11-27T18:43:14.226128+0000","last_clean":"2023-11-27T18:43:14.226128+0000","last_became_active":"2023-11-27T18:13:12.301617+0000","last_became_peered":"2023-11-27T18:13:12.301617+0000","last_unstale":"2023-11-27T18:43:14.226128+0000","last_undegraded":"2023-11-27T18:43:14.226128+0000","last_fullsized":"2023-11-27T18:43:14.226128+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'68","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:34.231054+0000","last_change":"2023-11-27T18:13:20.905013+0000","last_active":"2023-11-27T18:42:34.231054+0000","last_peered":"2023-11-27T18:42:34.231054+0000","last_clean":"2023-11-27T18:42:34.231054+0000","last_became_active":"2023-11-27T18:13:20.903019+0000","last_became_peered":"2023-11-27T18:13:20.903019+0000","last_unstale":"2023-11-27T18:42:34.231054+0000","last_undegraded":"2023-11-27T18:42:34.231054+0000","last_fullsized":"2023-11-27T18:42:34.231054+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":4275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"32'26","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.091030+0000","last_change":"2023-11-27T18:13:14.378913+0000","last_active":"2023-11-27T18:43:23.091030+0000","last_peered":"2023-11-27T18:43:23.091030+0000","last_clean":"2023-11-27T18:43:23.091030+0000","last_became_active":"2023-11-27T18:13:14.378644+0000","last_became_peered":"2023-11-27T18:13:14.378644+0000","last_unstale":"2023-11-27T18:43:23.091030+0000","last_undegraded":"2023-11-27T18:43:23.091030+0000","last_fullsized":"2023-11-27T18:43:23.091030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"32'556","reported_seq":1149,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:44.099692+0000","last_change":"2023-11-27T18:43:44.099800+0000","last_active":"2023-11-27T18:43:44.099692+0000","last_peered":"2023-11-27T18:43:44.099692+0000","last_clean":"2023-11-27T18:43:44.099692+0000","last_became_active":"2023-11-27T18:13:12.305380+0000","last_became_peered":"2023-11-27T18:13:12.305380+0000","last_unstale":"2023-11-27T18:43:44.099692+0000","last_undegraded":"2023-11-27T18:43:44.099692+0000","last_fullsized":"2023-11-27T18:43:44.099692+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'556","last_scrub_stamp":"2023-11-27T18:43:44.099467+0000","last_deep_scrub":"32'556","last_deep_scrub_stamp":"2023-11-27T18:43:44.099467+0000","last_clean_scrub_stamp":"2023-11-27T18:43:44.099467+0000","objects_scrubbed":1,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:29:30.687440+0000","scrub_duration":0.0048880249999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128192,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":549,"num_read_kb":581,"num_write":552,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"32'76","reported_seq":108,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:40.367654+0000","last_change":"2023-11-27T18:13:20.913672+0000","last_active":"2023-11-27T18:43:40.367654+0000","last_peered":"2023-11-27T18:43:40.367654+0000","last_clean":"2023-11-27T18:43:40.367654+0000","last_became_active":"2023-11-27T18:13:20.913137+0000","last_became_peered":"2023-11-27T18:13:20.913137+0000","last_unstale":"2023-11-27T18:43:40.367654+0000","last_undegraded":"2023-11-27T18:43:40.367654+0000","last_fullsized":"2023-11-27T18:43:40.367654+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":7407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"32'15","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:58.444576+0000","last_change":"2023-11-27T18:43:58.444628+0000","last_active":"2023-11-27T18:43:58.444576+0000","last_peered":"2023-11-27T18:43:58.444576+0000","last_clean":"2023-11-27T18:43:58.444576+0000","last_became_active":"2023-11-27T18:13:14.413413+0000","last_became_peered":"2023-11-27T18:13:14.413413+0000","last_unstale":"2023-11-27T18:43:58.444576+0000","last_undegraded":"2023-11-27T18:43:58.444576+0000","last_fullsized":"2023-11-27T18:43:58.444576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2023-11-27T18:43:58.444377+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2023-11-27T18:43:58.444377+0000","last_clean_scrub_stamp":"2023-11-27T18:43:58.444377+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:46:24.286822+0000","scrub_duration":0.003852397,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"32'6","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:24.394222+0000","last_change":"2023-11-27T18:13:12.315822+0000","last_active":"2023-11-27T18:43:24.394222+0000","last_peered":"2023-11-27T18:43:24.394222+0000","last_clean":"2023-11-27T18:43:24.394222+0000","last_became_active":"2023-11-27T18:13:12.315610+0000","last_became_peered":"2023-11-27T18:13:12.315610+0000","last_unstale":"2023-11-27T18:43:24.394222+0000","last_undegraded":"2023-11-27T18:43:24.394222+0000","last_fullsized":"2023-11-27T18:43:24.394222+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"32'85","reported_seq":117,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:39.204246+0000","last_change":"2023-11-27T18:13:20.912891+0000","last_active":"2023-11-27T18:43:39.204246+0000","last_peered":"2023-11-27T18:43:39.204246+0000","last_clean":"2023-11-27T18:43:39.204246+0000","last_became_active":"2023-11-27T18:13:20.912453+0000","last_became_peered":"2023-11-27T18:13:20.912453+0000","last_unstale":"2023-11-27T18:43:39.204246+0000","last_undegraded":"2023-11-27T18:43:39.204246+0000","last_fullsized":"2023-11-27T18:43:39.204246+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":10738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"32'21","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:38.774297+0000","last_change":"2023-11-27T18:43:38.774348+0000","last_active":"2023-11-27T18:43:38.774297+0000","last_peered":"2023-11-27T18:43:38.774297+0000","last_clean":"2023-11-27T18:43:38.774297+0000","last_became_active":"2023-11-27T18:13:14.414156+0000","last_became_peered":"2023-11-27T18:13:14.414156+0000","last_unstale":"2023-11-27T18:43:38.774297+0000","last_undegraded":"2023-11-27T18:43:38.774297+0000","last_fullsized":"2023-11-27T18:43:38.774297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2023-11-27T18:43:38.774109+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2023-11-27T18:43:38.774109+0000","last_clean_scrub_stamp":"2023-11-27T18:43:38.774109+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:37:26.401993+0000","scrub_duration":0.003067443,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"32'3","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:12.259812+0000","last_change":"2023-11-27T18:13:12.308337+0000","last_active":"2023-11-27T18:43:12.259812+0000","last_peered":"2023-11-27T18:43:12.259812+0000","last_clean":"2023-11-27T18:43:12.259812+0000","last_became_active":"2023-11-27T18:13:12.308050+0000","last_became_peered":"2023-11-27T18:13:12.308050+0000","last_unstale":"2023-11-27T18:43:12.259812+0000","last_undegraded":"2023-11-27T18:43:12.259812+0000","last_fullsized":"2023-11-27T18:43:12.259812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"32'119","reported_seq":198,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:35.406912+0000","last_change":"2023-11-27T18:43:35.406964+0000","last_active":"2023-11-27T18:43:35.406912+0000","last_peered":"2023-11-27T18:43:35.406912+0000","last_clean":"2023-11-27T18:43:35.406912+0000","last_became_active":"2023-11-27T18:12:38.370748+0000","last_became_peered":"2023-11-27T18:12:38.370748+0000","last_unstale":"2023-11-27T18:43:35.406912+0000","last_undegraded":"2023-11-27T18:43:35.406912+0000","last_fullsized":"2023-11-27T18:43:35.406912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2023-11-27T18:43:35.406767+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2023-11-27T18:43:35.406767+0000","last_clean_scrub_stamp":"2023-11-27T18:43:35.406767+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:03:00.314752+0000","scrub_duration":0.010946301,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'86","reported_seq":118,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:44.384201+0000","last_change":"2023-11-27T18:13:20.928359+0000","last_active":"2023-11-27T18:42:44.384201+0000","last_peered":"2023-11-27T18:42:44.384201+0000","last_clean":"2023-11-27T18:42:44.384201+0000","last_became_active":"2023-11-27T18:13:20.926559+0000","last_became_peered":"2023-11-27T18:13:20.926559+0000","last_unstale":"2023-11-27T18:42:44.384201+0000","last_undegraded":"2023-11-27T18:42:44.384201+0000","last_fullsized":"2023-11-27T18:42:44.384201+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":7930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"32'24","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.024334+0000","last_change":"2023-11-27T18:13:14.422275+0000","last_active":"2023-11-27T18:43:23.024334+0000","last_peered":"2023-11-27T18:43:23.024334+0000","last_clean":"2023-11-27T18:43:23.024334+0000","last_became_active":"2023-11-27T18:13:14.419636+0000","last_became_peered":"2023-11-27T18:13:14.419636+0000","last_unstale":"2023-11-27T18:43:23.024334+0000","last_undegraded":"2023-11-27T18:43:23.024334+0000","last_fullsized":"2023-11-27T18:43:23.024334+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"32'2","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:43.374000+0000","last_change":"2023-11-27T18:43:43.374050+0000","last_active":"2023-11-27T18:43:43.374000+0000","last_peered":"2023-11-27T18:43:43.374000+0000","last_clean":"2023-11-27T18:43:43.374000+0000","last_became_active":"2023-11-27T18:13:12.267764+0000","last_became_peered":"2023-11-27T18:13:12.267764+0000","last_unstale":"2023-11-27T18:43:43.374000+0000","last_undegraded":"2023-11-27T18:43:43.374000+0000","last_fullsized":"2023-11-27T18:43:43.374000+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2023-11-27T18:43:43.373801+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2023-11-27T18:43:43.373801+0000","last_clean_scrub_stamp":"2023-11-27T18:43:43.373801+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:57:29.602489+0000","scrub_duration":0.0042106540000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"32'73","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:35.849777+0000","last_change":"2023-11-27T18:13:20.917055+0000","last_active":"2023-11-27T18:43:35.849777+0000","last_peered":"2023-11-27T18:43:35.849777+0000","last_clean":"2023-11-27T18:43:35.849777+0000","last_became_active":"2023-11-27T18:13:20.914157+0000","last_became_peered":"2023-11-27T18:13:20.914157+0000","last_unstale":"2023-11-27T18:43:35.849777+0000","last_undegraded":"2023-11-27T18:43:35.849777+0000","last_fullsized":"2023-11-27T18:43:35.849777+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":5275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'24","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.090687+0000","last_change":"2023-11-27T18:13:14.363559+0000","last_active":"2023-11-27T18:43:23.090687+0000","last_peered":"2023-11-27T18:43:23.090687+0000","last_clean":"2023-11-27T18:43:23.090687+0000","last_became_active":"2023-11-27T18:13:14.363285+0000","last_became_peered":"2023-11-27T18:13:14.363285+0000","last_unstale":"2023-11-27T18:43:23.090687+0000","last_undegraded":"2023-11-27T18:43:23.090687+0000","last_fullsized":"2023-11-27T18:43:23.090687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:59.020721+0000","last_change":"2023-11-27T18:43:59.020774+0000","last_active":"2023-11-27T18:43:59.020721+0000","last_peered":"2023-11-27T18:43:59.020721+0000","last_clean":"2023-11-27T18:43:59.020721+0000","last_became_active":"2023-11-27T18:13:12.312038+0000","last_became_peered":"2023-11-27T18:13:12.312038+0000","last_unstale":"2023-11-27T18:43:59.020721+0000","last_undegraded":"2023-11-27T18:43:59.020721+0000","last_fullsized":"2023-11-27T18:43:59.020721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2023-11-27T18:43:59.020532+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2023-11-27T18:43:59.020532+0000","last_clean_scrub_stamp":"2023-11-27T18:43:59.020532+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:11:10.104848+0000","scrub_duration":0.007309444,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"32'90","reported_seq":121,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:35.356176+0000","last_change":"2023-11-27T18:13:20.913830+0000","last_active":"2023-11-27T18:42:35.356176+0000","last_peered":"2023-11-27T18:42:35.356176+0000","last_clean":"2023-11-27T18:42:35.356176+0000","last_became_active":"2023-11-27T18:13:20.912734+0000","last_became_peered":"2023-11-27T18:13:20.912734+0000","last_unstale":"2023-11-27T18:42:35.356176+0000","last_undegraded":"2023-11-27T18:42:35.356176+0000","last_fullsized":"2023-11-27T18:42:35.356176+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":13642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"32'25","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.094908+0000","last_change":"2023-11-27T18:13:14.364027+0000","last_active":"2023-11-27T18:43:23.094908+0000","last_peered":"2023-11-27T18:43:23.094908+0000","last_clean":"2023-11-27T18:43:23.094908+0000","last_became_active":"2023-11-27T18:13:14.363772+0000","last_became_peered":"2023-11-27T18:13:14.363772+0000","last_unstale":"2023-11-27T18:43:23.094908+0000","last_undegraded":"2023-11-27T18:43:23.094908+0000","last_fullsized":"2023-11-27T18:43:23.094908+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"32'5","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:44.804789+0000","last_change":"2023-11-27T18:43:44.804824+0000","last_active":"2023-11-27T18:43:44.804789+0000","last_peered":"2023-11-27T18:43:44.804789+0000","last_clean":"2023-11-27T18:43:44.804789+0000","last_became_active":"2023-11-27T18:13:12.304400+0000","last_became_peered":"2023-11-27T18:13:12.304400+0000","last_unstale":"2023-11-27T18:43:44.804789+0000","last_undegraded":"2023-11-27T18:43:44.804789+0000","last_fullsized":"2023-11-27T18:43:44.804789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2023-11-27T18:43:44.804676+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2023-11-27T18:43:44.804676+0000","last_clean_scrub_stamp":"2023-11-27T18:43:44.804676+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:34:25.156520+0000","scrub_duration":0.005907214,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"32'60","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:36.903818+0000","last_change":"2023-11-27T18:13:20.922959+0000","last_active":"2023-11-27T18:43:36.903818+0000","last_peered":"2023-11-27T18:43:36.903818+0000","last_clean":"2023-11-27T18:43:36.903818+0000","last_became_active":"2023-11-27T18:13:20.918984+0000","last_became_peered":"2023-11-27T18:13:20.918984+0000","last_unstale":"2023-11-27T18:43:36.903818+0000","last_undegraded":"2023-11-27T18:43:36.903818+0000","last_fullsized":"2023-11-27T18:43:36.903818+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":5801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"32'17","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.089526+0000","last_change":"2023-11-27T18:13:15.852939+0000","last_active":"2023-11-27T18:43:23.089526+0000","last_peered":"2023-11-27T18:43:23.089526+0000","last_clean":"2023-11-27T18:43:23.089526+0000","last_became_active":"2023-11-27T18:13:15.852339+0000","last_became_peered":"2023-11-27T18:13:15.852339+0000","last_unstale":"2023-11-27T18:43:23.089526+0000","last_undegraded":"2023-11-27T18:43:23.089526+0000","last_fullsized":"2023-11-27T18:43:23.089526+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"32'8","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:53.554964+0000","last_change":"2023-11-27T18:43:53.555022+0000","last_active":"2023-11-27T18:43:53.554964+0000","last_peered":"2023-11-27T18:43:53.554964+0000","last_clean":"2023-11-27T18:43:53.554964+0000","last_became_active":"2023-11-27T18:13:12.310921+0000","last_became_peered":"2023-11-27T18:13:12.310921+0000","last_unstale":"2023-11-27T18:43:53.554964+0000","last_undegraded":"2023-11-27T18:43:53.554964+0000","last_fullsized":"2023-11-27T18:43:53.554964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2023-11-27T18:43:53.554762+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2023-11-27T18:43:53.554762+0000","last_clean_scrub_stamp":"2023-11-27T18:43:53.554762+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:55:00.948692+0000","scrub_duration":0.0077624699999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"32'108","reported_seq":148,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:48.434011+0000","last_change":"2023-11-27T18:43:48.434127+0000","last_active":"2023-11-27T18:43:48.434011+0000","last_peered":"2023-11-27T18:43:48.434011+0000","last_clean":"2023-11-27T18:43:48.434011+0000","last_became_active":"2023-11-27T18:13:20.924209+0000","last_became_peered":"2023-11-27T18:13:20.924209+0000","last_unstale":"2023-11-27T18:43:48.434011+0000","last_undegraded":"2023-11-27T18:43:48.434011+0000","last_fullsized":"2023-11-27T18:43:48.434011+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'108","last_scrub_stamp":"2023-11-27T18:43:48.433759+0000","last_deep_scrub":"32'108","last_deep_scrub_stamp":"2023-11-27T18:43:48.433759+0000","last_clean_scrub_stamp":"2023-11-27T18:43:48.433759+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:01:47.609449+0000","scrub_duration":0.0086909529999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":10743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"32'21","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:44.098293+0000","last_change":"2023-11-27T18:43:44.098343+0000","last_active":"2023-11-27T18:43:44.098293+0000","last_peered":"2023-11-27T18:43:44.098293+0000","last_clean":"2023-11-27T18:43:44.098293+0000","last_became_active":"2023-11-27T18:13:14.421377+0000","last_became_peered":"2023-11-27T18:13:14.421377+0000","last_unstale":"2023-11-27T18:43:44.098293+0000","last_undegraded":"2023-11-27T18:43:44.098293+0000","last_fullsized":"2023-11-27T18:43:44.098293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2023-11-27T18:43:44.098079+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2023-11-27T18:43:44.098079+0000","last_clean_scrub_stamp":"2023-11-27T18:43:44.098079+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:35:06.114321+0000","scrub_duration":0.0038697369999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"32'16","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:39.823098+0000","last_change":"2023-11-27T18:43:39.823170+0000","last_active":"2023-11-27T18:43:39.823098+0000","last_peered":"2023-11-27T18:43:39.823098+0000","last_clean":"2023-11-27T18:43:39.823098+0000","last_became_active":"2023-11-27T18:13:12.177997+0000","last_became_peered":"2023-11-27T18:13:12.177997+0000","last_unstale":"2023-11-27T18:43:39.823098+0000","last_undegraded":"2023-11-27T18:43:39.823098+0000","last_fullsized":"2023-11-27T18:43:39.823098+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2023-11-27T18:43:39.822860+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2023-11-27T18:43:39.822860+0000","last_clean_scrub_stamp":"2023-11-27T18:43:39.822860+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:51:20.471317+0000","scrub_duration":0.0097847799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"32'95","reported_seq":125,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:23.002477+0000","last_change":"2023-11-27T18:13:20.914541+0000","last_active":"2023-11-27T18:42:23.002477+0000","last_peered":"2023-11-27T18:42:23.002477+0000","last_clean":"2023-11-27T18:42:23.002477+0000","last_became_active":"2023-11-27T18:13:20.914144+0000","last_became_peered":"2023-11-27T18:13:20.914144+0000","last_unstale":"2023-11-27T18:42:23.002477+0000","last_undegraded":"2023-11-27T18:42:23.002477+0000","last_fullsized":"2023-11-27T18:42:23.002477+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":5846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"32'23","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:40.431950+0000","last_change":"2023-11-27T18:43:40.431969+0000","last_active":"2023-11-27T18:43:40.431950+0000","last_peered":"2023-11-27T18:43:40.431950+0000","last_clean":"2023-11-27T18:43:40.431950+0000","last_became_active":"2023-11-27T18:13:15.801804+0000","last_became_peered":"2023-11-27T18:13:15.801804+0000","last_unstale":"2023-11-27T18:43:40.431950+0000","last_undegraded":"2023-11-27T18:43:40.431950+0000","last_fullsized":"2023-11-27T18:43:40.431950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2023-11-27T18:43:40.431874+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2023-11-27T18:43:40.431874+0000","last_clean_scrub_stamp":"2023-11-27T18:43:40.431874+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:16:45.688555+0000","scrub_duration":0.002873408,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"32'5","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:57.545050+0000","last_change":"2023-11-27T18:43:57.545160+0000","last_active":"2023-11-27T18:43:57.545050+0000","last_peered":"2023-11-27T18:43:57.545050+0000","last_clean":"2023-11-27T18:43:57.545050+0000","last_became_active":"2023-11-27T18:13:12.300585+0000","last_became_peered":"2023-11-27T18:13:12.300585+0000","last_unstale":"2023-11-27T18:43:57.545050+0000","last_undegraded":"2023-11-27T18:43:57.545050+0000","last_fullsized":"2023-11-27T18:43:57.545050+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2023-11-27T18:43:57.544819+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2023-11-27T18:43:57.544819+0000","last_clean_scrub_stamp":"2023-11-27T18:43:57.544819+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:33:15.951006+0000","scrub_duration":0.0033027500000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"32'85","reported_seq":115,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:23.839221+0000","last_change":"2023-11-27T18:13:20.915245+0000","last_active":"2023-11-27T18:42:23.839221+0000","last_peered":"2023-11-27T18:42:23.839221+0000","last_clean":"2023-11-27T18:42:23.839221+0000","last_became_active":"2023-11-27T18:13:20.914216+0000","last_became_peered":"2023-11-27T18:13:20.914216+0000","last_unstale":"2023-11-27T18:42:23.839221+0000","last_undegraded":"2023-11-27T18:42:23.839221+0000","last_fullsized":"2023-11-27T18:42:23.839221+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":6050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"32'39","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:34.397067+0000","last_change":"2023-11-27T18:14:22.518196+0000","last_active":"2023-11-27T18:43:34.397067+0000","last_peered":"2023-11-27T18:43:34.397067+0000","last_clean":"2023-11-27T18:43:34.397067+0000","last_became_active":"2023-11-27T18:14:22.517527+0000","last_became_peered":"2023-11-27T18:14:22.517527+0000","last_unstale":"2023-11-27T18:43:34.397067+0000","last_undegraded":"2023-11-27T18:43:34.397067+0000","last_fullsized":"2023-11-27T18:43:34.397067+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"32'5","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:34.397021+0000","last_change":"2023-11-27T18:13:12.305081+0000","last_active":"2023-11-27T18:43:34.397021+0000","last_peered":"2023-11-27T18:43:34.397021+0000","last_clean":"2023-11-27T18:43:34.397021+0000","last_became_active":"2023-11-27T18:13:12.304777+0000","last_became_peered":"2023-11-27T18:13:12.304777+0000","last_unstale":"2023-11-27T18:43:34.397021+0000","last_undegraded":"2023-11-27T18:43:34.397021+0000","last_fullsized":"2023-11-27T18:43:34.397021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"32'64","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:40.367692+0000","last_change":"2023-11-27T18:13:20.904088+0000","last_active":"2023-11-27T18:43:40.367692+0000","last_peered":"2023-11-27T18:43:40.367692+0000","last_clean":"2023-11-27T18:43:40.367692+0000","last_became_active":"2023-11-27T18:13:20.902282+0000","last_became_peered":"2023-11-27T18:13:20.902282+0000","last_unstale":"2023-11-27T18:43:40.367692+0000","last_undegraded":"2023-11-27T18:43:40.367692+0000","last_fullsized":"2023-11-27T18:43:40.367692+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":6349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"32'27","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:34.242413+0000","last_change":"2023-11-27T18:13:14.415302+0000","last_active":"2023-11-27T18:43:34.242413+0000","last_peered":"2023-11-27T18:43:34.242413+0000","last_clean":"2023-11-27T18:43:34.242413+0000","last_became_active":"2023-11-27T18:13:14.415004+0000","last_became_peered":"2023-11-27T18:13:14.415004+0000","last_unstale":"2023-11-27T18:43:34.242413+0000","last_undegraded":"2023-11-27T18:43:34.242413+0000","last_fullsized":"2023-11-27T18:43:34.242413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"32'7","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:43.077245+0000","last_change":"2023-11-27T18:43:43.077303+0000","last_active":"2023-11-27T18:43:43.077245+0000","last_peered":"2023-11-27T18:43:43.077245+0000","last_clean":"2023-11-27T18:43:43.077245+0000","last_became_active":"2023-11-27T18:13:12.268237+0000","last_became_peered":"2023-11-27T18:13:12.268237+0000","last_unstale":"2023-11-27T18:43:43.077245+0000","last_undegraded":"2023-11-27T18:43:43.077245+0000","last_fullsized":"2023-11-27T18:43:43.077245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2023-11-27T18:43:43.077057+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2023-11-27T18:43:43.077057+0000","last_clean_scrub_stamp":"2023-11-27T18:43:43.077057+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:43:39.542648+0000","scrub_duration":0.0087600239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"32'82","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:24.615247+0000","last_change":"2023-11-27T18:13:20.900393+0000","last_active":"2023-11-27T18:42:24.615247+0000","last_peered":"2023-11-27T18:42:24.615247+0000","last_clean":"2023-11-27T18:42:24.615247+0000","last_became_active":"2023-11-27T18:13:20.899358+0000","last_became_peered":"2023-11-27T18:13:20.899358+0000","last_unstale":"2023-11-27T18:42:24.615247+0000","last_undegraded":"2023-11-27T18:42:24.615247+0000","last_fullsized":"2023-11-27T18:42:24.615247+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":8446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"32'23","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.069246+0000","last_change":"2023-11-27T18:13:14.371842+0000","last_active":"2023-11-27T18:43:23.069246+0000","last_peered":"2023-11-27T18:43:23.069246+0000","last_clean":"2023-11-27T18:43:23.069246+0000","last_became_active":"2023-11-27T18:13:14.371637+0000","last_became_peered":"2023-11-27T18:13:14.371637+0000","last_unstale":"2023-11-27T18:43:23.069246+0000","last_undegraded":"2023-11-27T18:43:23.069246+0000","last_fullsized":"2023-11-27T18:43:23.069246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"32'875","reported_seq":918,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:43.474525+0000","last_change":"2023-11-27T18:43:43.474525+0000","last_active":"2023-11-27T18:43:43.474525+0000","last_peered":"2023-11-27T18:43:43.474525+0000","last_clean":"2023-11-27T18:43:43.474525+0000","last_became_active":"2023-11-27T18:13:12.248077+0000","last_became_peered":"2023-11-27T18:13:12.248077+0000","last_unstale":"2023-11-27T18:43:43.474525+0000","last_undegraded":"2023-11-27T18:43:43.474525+0000","last_fullsized":"2023-11-27T18:43:43.474525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'875","last_scrub_stamp":"2023-11-27T18:43:43.474251+0000","last_deep_scrub":"32'875","last_deep_scrub_stamp":"2023-11-27T18:43:43.474251+0000","last_clean_scrub_stamp":"2023-11-27T18:43:43.474251+0000","objects_scrubbed":4,"log_size":875,"log_dups_size":0,"ondisk_log_size":875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:21:15.277979+0000","scrub_duration":0.045304398000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":867,"num_write_kb":4596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"32'83","reported_seq":114,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:38.003149+0000","last_change":"2023-11-27T18:13:20.919046+0000","last_active":"2023-11-27T18:43:38.003149+0000","last_peered":"2023-11-27T18:43:38.003149+0000","last_clean":"2023-11-27T18:43:38.003149+0000","last_became_active":"2023-11-27T18:13:20.918381+0000","last_became_peered":"2023-11-27T18:13:20.918381+0000","last_unstale":"2023-11-27T18:43:38.003149+0000","last_undegraded":"2023-11-27T18:43:38.003149+0000","last_fullsized":"2023-11-27T18:43:38.003149+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":11273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"32'25","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:38.063922+0000","last_change":"2023-11-27T18:43:38.063922+0000","last_active":"2023-11-27T18:43:38.063922+0000","last_peered":"2023-11-27T18:43:38.063922+0000","last_clean":"2023-11-27T18:43:38.063922+0000","last_became_active":"2023-11-27T18:13:14.415026+0000","last_became_peered":"2023-11-27T18:13:14.415026+0000","last_unstale":"2023-11-27T18:43:38.063922+0000","last_undegraded":"2023-11-27T18:43:38.063922+0000","last_fullsized":"2023-11-27T18:43:38.063922+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'25","last_scrub_stamp":"2023-11-27T18:43:38.063802+0000","last_deep_scrub":"32'25","last_deep_scrub_stamp":"2023-11-27T18:43:38.063802+0000","last_clean_scrub_stamp":"2023-11-27T18:43:38.063802+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:55:14.604318+0000","scrub_duration":0.0021425820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"32'401","reported_seq":443,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:46.071879+0000","last_change":"2023-11-27T18:43:46.071950+0000","last_active":"2023-11-27T18:43:46.071879+0000","last_peered":"2023-11-27T18:43:46.071879+0000","last_clean":"2023-11-27T18:43:46.071879+0000","last_became_active":"2023-11-27T18:13:12.180112+0000","last_became_peered":"2023-11-27T18:13:12.180112+0000","last_unstale":"2023-11-27T18:43:46.071879+0000","last_undegraded":"2023-11-27T18:43:46.071879+0000","last_fullsized":"2023-11-27T18:43:46.071879+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'401","last_scrub_stamp":"2023-11-27T18:43:46.071689+0000","last_deep_scrub":"32'401","last_deep_scrub_stamp":"2023-11-27T18:43:46.071689+0000","last_clean_scrub_stamp":"2023-11-27T18:43:46.071689+0000","objects_scrubbed":2,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:53:59.905538+0000","scrub_duration":0.0074079840000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":397,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"32'109","reported_seq":140,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:35.849787+0000","last_change":"2023-11-27T18:13:20.925012+0000","last_active":"2023-11-27T18:43:35.849787+0000","last_peered":"2023-11-27T18:43:35.849787+0000","last_clean":"2023-11-27T18:43:35.849787+0000","last_became_active":"2023-11-27T18:13:20.921675+0000","last_became_peered":"2023-11-27T18:13:20.921675+0000","last_unstale":"2023-11-27T18:43:35.849787+0000","last_undegraded":"2023-11-27T18:43:35.849787+0000","last_fullsized":"2023-11-27T18:43:35.849787+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":15987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"32'29","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.088125+0000","last_change":"2023-11-27T18:13:14.415432+0000","last_active":"2023-11-27T18:43:23.088125+0000","last_peered":"2023-11-27T18:43:23.088125+0000","last_clean":"2023-11-27T18:43:23.088125+0000","last_became_active":"2023-11-27T18:13:14.415142+0000","last_became_peered":"2023-11-27T18:13:14.415142+0000","last_unstale":"2023-11-27T18:43:23.088125+0000","last_undegraded":"2023-11-27T18:43:23.088125+0000","last_fullsized":"2023-11-27T18:43:23.088125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:54.529500+0000","last_change":"2023-11-27T18:43:54.529597+0000","last_active":"2023-11-27T18:43:54.529500+0000","last_peered":"2023-11-27T18:43:54.529500+0000","last_clean":"2023-11-27T18:43:54.529500+0000","last_became_active":"2023-11-27T18:13:12.273400+0000","last_became_peered":"2023-11-27T18:13:12.273400+0000","last_unstale":"2023-11-27T18:43:54.529500+0000","last_undegraded":"2023-11-27T18:43:54.529500+0000","last_fullsized":"2023-11-27T18:43:54.529500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2023-11-27T18:43:54.529213+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2023-11-27T18:43:54.529213+0000","last_clean_scrub_stamp":"2023-11-27T18:43:54.529213+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:42:29.722428+0000","scrub_duration":0.0039019240000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"32'83","reported_seq":122,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:54.129517+0000","last_change":"2023-11-27T18:43:54.129623+0000","last_active":"2023-11-27T18:43:54.129517+0000","last_peered":"2023-11-27T18:43:54.129517+0000","last_clean":"2023-11-27T18:43:54.129517+0000","last_became_active":"2023-11-27T18:13:20.912063+0000","last_became_peered":"2023-11-27T18:13:20.912063+0000","last_unstale":"2023-11-27T18:43:54.129517+0000","last_undegraded":"2023-11-27T18:43:54.129517+0000","last_fullsized":"2023-11-27T18:43:54.129517+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'83","last_scrub_stamp":"2023-11-27T18:43:54.129288+0000","last_deep_scrub":"32'83","last_deep_scrub_stamp":"2023-11-27T18:43:54.129288+0000","last_clean_scrub_stamp":"2023-11-27T18:43:54.129288+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:31:56.018013+0000","scrub_duration":0.010352907999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":11074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"32'29","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:57.411434+0000","last_change":"2023-11-27T18:43:57.411534+0000","last_active":"2023-11-27T18:43:57.411434+0000","last_peered":"2023-11-27T18:43:57.411434+0000","last_clean":"2023-11-27T18:43:57.411434+0000","last_became_active":"2023-11-27T18:13:15.911255+0000","last_became_peered":"2023-11-27T18:13:15.911255+0000","last_unstale":"2023-11-27T18:43:57.411434+0000","last_undegraded":"2023-11-27T18:43:57.411434+0000","last_fullsized":"2023-11-27T18:43:57.411434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'29","last_scrub_stamp":"2023-11-27T18:43:57.411145+0000","last_deep_scrub":"32'29","last_deep_scrub_stamp":"2023-11-27T18:43:57.411145+0000","last_clean_scrub_stamp":"2023-11-27T18:43:57.411145+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:14:36.787565+0000","scrub_duration":0.0040442129999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"32'6","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:39.424073+0000","last_change":"2023-11-27T18:43:39.424093+0000","last_active":"2023-11-27T18:43:39.424073+0000","last_peered":"2023-11-27T18:43:39.424073+0000","last_clean":"2023-11-27T18:43:39.424073+0000","last_became_active":"2023-11-27T18:13:12.167740+0000","last_became_peered":"2023-11-27T18:13:12.167740+0000","last_unstale":"2023-11-27T18:43:39.424073+0000","last_undegraded":"2023-11-27T18:43:39.424073+0000","last_fullsized":"2023-11-27T18:43:39.424073+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2023-11-27T18:43:39.423989+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2023-11-27T18:43:39.423989+0000","last_clean_scrub_stamp":"2023-11-27T18:43:39.423989+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:46:23.132083+0000","scrub_duration":0.0030606299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"32'75","reported_seq":106,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:38.003110+0000","last_change":"2023-11-27T18:13:20.915480+0000","last_active":"2023-11-27T18:43:38.003110+0000","last_peered":"2023-11-27T18:43:38.003110+0000","last_clean":"2023-11-27T18:43:38.003110+0000","last_became_active":"2023-11-27T18:13:20.914607+0000","last_became_peered":"2023-11-27T18:13:20.914607+0000","last_unstale":"2023-11-27T18:43:38.003110+0000","last_undegraded":"2023-11-27T18:43:38.003110+0000","last_fullsized":"2023-11-27T18:43:38.003110+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":8428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"32'67","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:32.659996+0000","last_change":"2023-11-27T18:13:20.930508+0000","last_active":"2023-11-27T18:43:32.659996+0000","last_peered":"2023-11-27T18:43:32.659996+0000","last_clean":"2023-11-27T18:43:32.659996+0000","last_became_active":"2023-11-27T18:13:20.930060+0000","last_became_peered":"2023-11-27T18:13:20.930060+0000","last_unstale":"2023-11-27T18:43:32.659996+0000","last_undegraded":"2023-11-27T18:43:32.659996+0000","last_fullsized":"2023-11-27T18:43:32.659996+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":4718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"32'28","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:48.824402+0000","last_change":"2023-11-27T18:43:48.824454+0000","last_active":"2023-11-27T18:43:48.824402+0000","last_peered":"2023-11-27T18:43:48.824402+0000","last_clean":"2023-11-27T18:43:48.824402+0000","last_became_active":"2023-11-27T18:13:14.379936+0000","last_became_peered":"2023-11-27T18:13:14.379936+0000","last_unstale":"2023-11-27T18:43:48.824402+0000","last_undegraded":"2023-11-27T18:43:48.824402+0000","last_fullsized":"2023-11-27T18:43:48.824402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'28","last_scrub_stamp":"2023-11-27T18:43:48.824202+0000","last_deep_scrub":"32'28","last_deep_scrub_stamp":"2023-11-27T18:43:48.824202+0000","last_clean_scrub_stamp":"2023-11-27T18:43:48.824202+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:33:23.140569+0000","scrub_duration":0.0037596090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"32'4","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:06.996946+0000","last_change":"2023-11-27T18:13:12.300977+0000","last_active":"2023-11-27T18:43:06.996946+0000","last_peered":"2023-11-27T18:43:06.996946+0000","last_clean":"2023-11-27T18:43:06.996946+0000","last_became_active":"2023-11-27T18:13:12.300624+0000","last_became_peered":"2023-11-27T18:13:12.300624+0000","last_unstale":"2023-11-27T18:43:06.996946+0000","last_undegraded":"2023-11-27T18:43:06.996946+0000","last_fullsized":"2023-11-27T18:43:06.996946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"32'93","reported_seq":125,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:34.381876+0000","last_change":"2023-11-27T18:13:20.919870+0000","last_active":"2023-11-27T18:42:34.381876+0000","last_peered":"2023-11-27T18:42:34.381876+0000","last_clean":"2023-11-27T18:42:34.381876+0000","last_became_active":"2023-11-27T18:13:20.918816+0000","last_became_peered":"2023-11-27T18:13:20.918816+0000","last_unstale":"2023-11-27T18:42:34.381876+0000","last_undegraded":"2023-11-27T18:42:34.381876+0000","last_fullsized":"2023-11-27T18:42:34.381876+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":12357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'29","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:00.013136+0000","last_change":"2023-11-27T18:44:00.013177+0000","last_active":"2023-11-27T18:44:00.013136+0000","last_peered":"2023-11-27T18:44:00.013136+0000","last_clean":"2023-11-27T18:44:00.013136+0000","last_became_active":"2023-11-27T18:13:14.368880+0000","last_became_peered":"2023-11-27T18:13:14.368880+0000","last_unstale":"2023-11-27T18:44:00.013136+0000","last_undegraded":"2023-11-27T18:44:00.013136+0000","last_fullsized":"2023-11-27T18:44:00.013136+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'29","last_scrub_stamp":"2023-11-27T18:44:00.012994+0000","last_deep_scrub":"32'29","last_deep_scrub_stamp":"2023-11-27T18:44:00.012994+0000","last_clean_scrub_stamp":"2023-11-27T18:44:00.012994+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:11:00.650657+0000","scrub_duration":0.0025903329999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:45.456179+0000","last_change":"2023-11-27T18:43:45.456272+0000","last_active":"2023-11-27T18:43:45.456179+0000","last_peered":"2023-11-27T18:43:45.456179+0000","last_clean":"2023-11-27T18:43:45.456179+0000","last_became_active":"2023-11-27T18:13:12.269755+0000","last_became_peered":"2023-11-27T18:13:12.269755+0000","last_unstale":"2023-11-27T18:43:45.456179+0000","last_undegraded":"2023-11-27T18:43:45.456179+0000","last_fullsized":"2023-11-27T18:43:45.456179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2023-11-27T18:43:45.455903+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2023-11-27T18:43:45.455903+0000","last_clean_scrub_stamp":"2023-11-27T18:43:45.455903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:48:41.926518+0000","scrub_duration":0.0043083679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"32'663","reported_seq":697,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:14.391880+0000","last_change":"2023-11-27T18:13:12.307568+0000","last_active":"2023-11-27T18:43:14.391880+0000","last_peered":"2023-11-27T18:43:14.391880+0000","last_clean":"2023-11-27T18:43:14.391880+0000","last_became_active":"2023-11-27T18:13:12.307299+0000","last_became_peered":"2023-11-27T18:13:12.307299+0000","last_unstale":"2023-11-27T18:43:14.391880+0000","last_undegraded":"2023-11-27T18:43:14.391880+0000","last_fullsized":"2023-11-27T18:43:14.391880+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":663,"log_dups_size":0,"ondisk_log_size":663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":658,"num_write_kb":4457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"32'24","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:56.906458+0000","last_change":"2023-11-27T18:43:56.906562+0000","last_active":"2023-11-27T18:43:56.906458+0000","last_peered":"2023-11-27T18:43:56.906458+0000","last_clean":"2023-11-27T18:43:56.906458+0000","last_became_active":"2023-11-27T18:13:14.378635+0000","last_became_peered":"2023-11-27T18:13:14.378635+0000","last_unstale":"2023-11-27T18:43:56.906458+0000","last_undegraded":"2023-11-27T18:43:56.906458+0000","last_fullsized":"2023-11-27T18:43:56.906458+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'24","last_scrub_stamp":"2023-11-27T18:43:56.906221+0000","last_deep_scrub":"32'24","last_deep_scrub_stamp":"2023-11-27T18:43:56.906221+0000","last_clean_scrub_stamp":"2023-11-27T18:43:56.906221+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:37:13.969082+0000","scrub_duration":0.0049891079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"32'56","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:22.657694+0000","last_change":"2023-11-27T18:13:20.903249+0000","last_active":"2023-11-27T18:43:22.657694+0000","last_peered":"2023-11-27T18:43:22.657694+0000","last_clean":"2023-11-27T18:43:22.657694+0000","last_became_active":"2023-11-27T18:13:20.902571+0000","last_became_peered":"2023-11-27T18:13:20.902571+0000","last_unstale":"2023-11-27T18:43:22.657694+0000","last_undegraded":"2023-11-27T18:43:22.657694+0000","last_fullsized":"2023-11-27T18:43:22.657694+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":3581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"32'593","reported_seq":634,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:53.084392+0000","last_change":"2023-11-27T18:43:53.084442+0000","last_active":"2023-11-27T18:43:53.084392+0000","last_peered":"2023-11-27T18:43:53.084392+0000","last_clean":"2023-11-27T18:43:53.084392+0000","last_became_active":"2023-11-27T18:13:12.303988+0000","last_became_peered":"2023-11-27T18:13:12.303988+0000","last_unstale":"2023-11-27T18:43:53.084392+0000","last_undegraded":"2023-11-27T18:43:53.084392+0000","last_fullsized":"2023-11-27T18:43:53.084392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'593","last_scrub_stamp":"2023-11-27T18:43:53.084250+0000","last_deep_scrub":"32'593","last_deep_scrub_stamp":"2023-11-27T18:43:53.084250+0000","last_clean_scrub_stamp":"2023-11-27T18:43:53.084250+0000","objects_scrubbed":1,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:42:28.277464+0000","scrub_duration":0.035525191999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":588,"num_write_kb":4406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"32'22","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:45.471070+0000","last_change":"2023-11-27T18:43:45.471121+0000","last_active":"2023-11-27T18:43:45.471070+0000","last_peered":"2023-11-27T18:43:45.471070+0000","last_clean":"2023-11-27T18:43:45.471070+0000","last_became_active":"2023-11-27T18:13:15.802420+0000","last_became_peered":"2023-11-27T18:13:15.802420+0000","last_unstale":"2023-11-27T18:43:45.471070+0000","last_undegraded":"2023-11-27T18:43:45.471070+0000","last_fullsized":"2023-11-27T18:43:45.471070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2023-11-27T18:43:45.470886+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2023-11-27T18:43:45.470886+0000","last_clean_scrub_stamp":"2023-11-27T18:43:45.470886+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:31:10.801503+0000","scrub_duration":0.0041067050000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"32'93","reported_seq":117,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:22.951779+0000","last_change":"2023-11-27T18:14:22.716310+0000","last_active":"2023-11-27T18:42:22.951779+0000","last_peered":"2023-11-27T18:42:22.951779+0000","last_clean":"2023-11-27T18:42:22.951779+0000","last_became_active":"2023-11-27T18:14:22.715684+0000","last_became_peered":"2023-11-27T18:14:22.715684+0000","last_unstale":"2023-11-27T18:42:22.951779+0000","last_undegraded":"2023-11-27T18:42:22.951779+0000","last_fullsized":"2023-11-27T18:42:22.951779+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":6465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,0],"acting":[2,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"32'34","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:46.457046+0000","last_change":"2023-11-27T18:43:46.457142+0000","last_active":"2023-11-27T18:43:46.457046+0000","last_peered":"2023-11-27T18:43:46.457046+0000","last_clean":"2023-11-27T18:43:46.457046+0000","last_became_active":"2023-11-27T18:13:15.848503+0000","last_became_peered":"2023-11-27T18:13:15.848503+0000","last_unstale":"2023-11-27T18:43:46.457046+0000","last_undegraded":"2023-11-27T18:43:46.457046+0000","last_fullsized":"2023-11-27T18:43:46.457046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'34","last_scrub_stamp":"2023-11-27T18:43:46.456824+0000","last_deep_scrub":"32'34","last_deep_scrub_stamp":"2023-11-27T18:43:46.456824+0000","last_clean_scrub_stamp":"2023-11-27T18:43:46.456824+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:08:43.138748+0000","scrub_duration":0.0043843550000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"32'28","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:49.064038+0000","last_change":"2023-11-27T18:43:49.064091+0000","last_active":"2023-11-27T18:43:49.064038+0000","last_peered":"2023-11-27T18:43:49.064038+0000","last_clean":"2023-11-27T18:43:49.064038+0000","last_became_active":"2023-11-27T18:13:14.336072+0000","last_became_peered":"2023-11-27T18:13:14.336072+0000","last_unstale":"2023-11-27T18:43:49.064038+0000","last_undegraded":"2023-11-27T18:43:49.064038+0000","last_fullsized":"2023-11-27T18:43:49.064038+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'28","last_scrub_stamp":"2023-11-27T18:43:49.063835+0000","last_deep_scrub":"32'28","last_deep_scrub_stamp":"2023-11-27T18:43:49.063835+0000","last_clean_scrub_stamp":"2023-11-27T18:43:49.063835+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:47:03.229458+0000","scrub_duration":0.0039140190000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"32'27","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.017035+0000","last_change":"2023-11-27T18:13:14.421713+0000","last_active":"2023-11-27T18:43:23.017035+0000","last_peered":"2023-11-27T18:43:23.017035+0000","last_clean":"2023-11-27T18:43:23.017035+0000","last_became_active":"2023-11-27T18:13:14.418679+0000","last_became_peered":"2023-11-27T18:13:14.418679+0000","last_unstale":"2023-11-27T18:43:23.017035+0000","last_undegraded":"2023-11-27T18:43:23.017035+0000","last_fullsized":"2023-11-27T18:43:23.017035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"32'22","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.087337+0000","last_change":"2023-11-27T18:13:14.376601+0000","last_active":"2023-11-27T18:43:23.087337+0000","last_peered":"2023-11-27T18:43:23.087337+0000","last_clean":"2023-11-27T18:43:23.087337+0000","last_became_active":"2023-11-27T18:13:14.376292+0000","last_became_peered":"2023-11-27T18:13:14.376292+0000","last_unstale":"2023-11-27T18:43:23.087337+0000","last_undegraded":"2023-11-27T18:43:23.087337+0000","last_fullsized":"2023-11-27T18:43:23.087337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"32'16","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:34.242553+0000","last_change":"2023-11-27T18:13:14.367285+0000","last_active":"2023-11-27T18:43:34.242553+0000","last_peered":"2023-11-27T18:43:34.242553+0000","last_clean":"2023-11-27T18:43:34.242553+0000","last_became_active":"2023-11-27T18:13:14.366983+0000","last_became_peered":"2023-11-27T18:13:14.366983+0000","last_unstale":"2023-11-27T18:43:34.242553+0000","last_undegraded":"2023-11-27T18:43:34.242553+0000","last_fullsized":"2023-11-27T18:43:34.242553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"32'22","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:34.242603+0000","last_change":"2023-11-27T18:13:14.375744+0000","last_active":"2023-11-27T18:43:34.242603+0000","last_peered":"2023-11-27T18:43:34.242603+0000","last_clean":"2023-11-27T18:43:34.242603+0000","last_became_active":"2023-11-27T18:13:14.375466+0000","last_became_peered":"2023-11-27T18:13:14.375466+0000","last_unstale":"2023-11-27T18:43:34.242603+0000","last_undegraded":"2023-11-27T18:43:34.242603+0000","last_fullsized":"2023-11-27T18:43:34.242603+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"32'33","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:54.330470+0000","last_change":"2023-11-27T18:43:54.330520+0000","last_active":"2023-11-27T18:43:54.330470+0000","last_peered":"2023-11-27T18:43:54.330470+0000","last_clean":"2023-11-27T18:43:54.330470+0000","last_became_active":"2023-11-27T18:13:15.910418+0000","last_became_peered":"2023-11-27T18:13:15.910418+0000","last_unstale":"2023-11-27T18:43:54.330470+0000","last_undegraded":"2023-11-27T18:43:54.330470+0000","last_fullsized":"2023-11-27T18:43:54.330470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'33","last_scrub_stamp":"2023-11-27T18:43:54.330345+0000","last_deep_scrub":"32'33","last_deep_scrub_stamp":"2023-11-27T18:43:54.330345+0000","last_clean_scrub_stamp":"2023-11-27T18:43:54.330345+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:38:33.435667+0000","scrub_duration":0.003384789,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"32'19","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:40.213006+0000","last_change":"2023-11-27T18:43:40.213056+0000","last_active":"2023-11-27T18:43:40.213006+0000","last_peered":"2023-11-27T18:43:40.213006+0000","last_clean":"2023-11-27T18:43:40.213006+0000","last_became_active":"2023-11-27T18:13:14.366249+0000","last_became_peered":"2023-11-27T18:13:14.366249+0000","last_unstale":"2023-11-27T18:43:40.213006+0000","last_undegraded":"2023-11-27T18:43:40.213006+0000","last_fullsized":"2023-11-27T18:43:40.213006+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'19","last_scrub_stamp":"2023-11-27T18:43:40.212814+0000","last_deep_scrub":"32'19","last_deep_scrub_stamp":"2023-11-27T18:43:40.212814+0000","last_clean_scrub_stamp":"2023-11-27T18:43:40.212814+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:43:45.456072+0000","scrub_duration":0.0037923340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"32'19","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:57.205712+0000","last_change":"2023-11-27T18:43:57.205768+0000","last_active":"2023-11-27T18:43:57.205712+0000","last_peered":"2023-11-27T18:43:57.205712+0000","last_clean":"2023-11-27T18:43:57.205712+0000","last_became_active":"2023-11-27T18:13:14.414873+0000","last_became_peered":"2023-11-27T18:13:14.414873+0000","last_unstale":"2023-11-27T18:43:57.205712+0000","last_undegraded":"2023-11-27T18:43:57.205712+0000","last_fullsized":"2023-11-27T18:43:57.205712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'19","last_scrub_stamp":"2023-11-27T18:43:57.205511+0000","last_deep_scrub":"32'19","last_deep_scrub_stamp":"2023-11-27T18:43:57.205511+0000","last_clean_scrub_stamp":"2023-11-27T18:43:57.205511+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:15:56.065694+0000","scrub_duration":0.0041963039999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'30","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:42.178276+0000","last_change":"2023-11-27T18:43:42.178327+0000","last_active":"2023-11-27T18:43:42.178276+0000","last_peered":"2023-11-27T18:43:42.178276+0000","last_clean":"2023-11-27T18:43:42.178276+0000","last_became_active":"2023-11-27T18:13:14.416072+0000","last_became_peered":"2023-11-27T18:13:14.416072+0000","last_unstale":"2023-11-27T18:43:42.178276+0000","last_undegraded":"2023-11-27T18:43:42.178276+0000","last_fullsized":"2023-11-27T18:43:42.178276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'30","last_scrub_stamp":"2023-11-27T18:43:42.178083+0000","last_deep_scrub":"32'30","last_deep_scrub_stamp":"2023-11-27T18:43:42.178083+0000","last_clean_scrub_stamp":"2023-11-27T18:43:42.178083+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:38:21.283406+0000","scrub_duration":0.0037760110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"32'25","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:43.469664+0000","last_change":"2023-11-27T18:43:43.469763+0000","last_active":"2023-11-27T18:43:43.469664+0000","last_peered":"2023-11-27T18:43:43.469664+0000","last_clean":"2023-11-27T18:43:43.469664+0000","last_became_active":"2023-11-27T18:13:15.800699+0000","last_became_peered":"2023-11-27T18:13:15.800699+0000","last_unstale":"2023-11-27T18:43:43.469664+0000","last_undegraded":"2023-11-27T18:43:43.469664+0000","last_fullsized":"2023-11-27T18:43:43.469664+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'25","last_scrub_stamp":"2023-11-27T18:43:43.469354+0000","last_deep_scrub":"32'25","last_deep_scrub_stamp":"2023-11-27T18:43:43.469354+0000","last_clean_scrub_stamp":"2023-11-27T18:43:43.469354+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:06:57.450424+0000","scrub_duration":0.0036779529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"32'35","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:54.929069+0000","last_change":"2023-11-27T18:43:54.929176+0000","last_active":"2023-11-27T18:43:54.929069+0000","last_peered":"2023-11-27T18:43:54.929069+0000","last_clean":"2023-11-27T18:43:54.929069+0000","last_became_active":"2023-11-27T18:13:14.413567+0000","last_became_peered":"2023-11-27T18:13:14.413567+0000","last_unstale":"2023-11-27T18:43:54.929069+0000","last_undegraded":"2023-11-27T18:43:54.929069+0000","last_fullsized":"2023-11-27T18:43:54.929069+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'35","last_scrub_stamp":"2023-11-27T18:43:54.928847+0000","last_deep_scrub":"32'35","last_deep_scrub_stamp":"2023-11-27T18:43:54.928847+0000","last_clean_scrub_stamp":"2023-11-27T18:43:54.928847+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:04:35.264476+0000","scrub_duration":0.0070704210000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"32'26","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:39.551227+0000","last_change":"2023-11-27T18:43:39.551329+0000","last_active":"2023-11-27T18:43:39.551227+0000","last_peered":"2023-11-27T18:43:39.551227+0000","last_clean":"2023-11-27T18:43:39.551227+0000","last_became_active":"2023-11-27T18:13:14.362805+0000","last_became_peered":"2023-11-27T18:13:14.362805+0000","last_unstale":"2023-11-27T18:43:39.551227+0000","last_undegraded":"2023-11-27T18:43:39.551227+0000","last_fullsized":"2023-11-27T18:43:39.551227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'26","last_scrub_stamp":"2023-11-27T18:43:39.551003+0000","last_deep_scrub":"32'26","last_deep_scrub_stamp":"2023-11-27T18:43:39.551003+0000","last_clean_scrub_stamp":"2023-11-27T18:43:39.551003+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:35:59.020605+0000","scrub_duration":0.0038830560000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"32'25","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:49.220670+0000","last_change":"2023-11-27T18:43:49.220754+0000","last_active":"2023-11-27T18:43:49.220670+0000","last_peered":"2023-11-27T18:43:49.220670+0000","last_clean":"2023-11-27T18:43:49.220670+0000","last_became_active":"2023-11-27T18:13:14.415661+0000","last_became_peered":"2023-11-27T18:13:14.415661+0000","last_unstale":"2023-11-27T18:43:49.220670+0000","last_undegraded":"2023-11-27T18:43:49.220670+0000","last_fullsized":"2023-11-27T18:43:49.220670+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'25","last_scrub_stamp":"2023-11-27T18:43:49.220417+0000","last_deep_scrub":"32'25","last_deep_scrub_stamp":"2023-11-27T18:43:49.220417+0000","last_clean_scrub_stamp":"2023-11-27T18:43:49.220417+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:52:55.432524+0000","scrub_duration":0.0032154839999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"32'35","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:53.134216+0000","last_change":"2023-11-27T18:43:53.134235+0000","last_active":"2023-11-27T18:43:53.134216+0000","last_peered":"2023-11-27T18:43:53.134216+0000","last_clean":"2023-11-27T18:43:53.134216+0000","last_became_active":"2023-11-27T18:13:14.413542+0000","last_became_peered":"2023-11-27T18:13:14.413542+0000","last_unstale":"2023-11-27T18:43:53.134216+0000","last_undegraded":"2023-11-27T18:43:53.134216+0000","last_fullsized":"2023-11-27T18:43:53.134216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'35","last_scrub_stamp":"2023-11-27T18:43:53.134137+0000","last_deep_scrub":"32'35","last_deep_scrub_stamp":"2023-11-27T18:43:53.134137+0000","last_clean_scrub_stamp":"2023-11-27T18:43:53.134137+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:11:41.311566+0000","scrub_duration":0.0029978460000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"32'23","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:41.120056+0000","last_change":"2023-11-27T18:43:41.120113+0000","last_active":"2023-11-27T18:43:41.120056+0000","last_peered":"2023-11-27T18:43:41.120056+0000","last_clean":"2023-11-27T18:43:41.120056+0000","last_became_active":"2023-11-27T18:13:14.416556+0000","last_became_peered":"2023-11-27T18:13:14.416556+0000","last_unstale":"2023-11-27T18:43:41.120056+0000","last_undegraded":"2023-11-27T18:43:41.120056+0000","last_fullsized":"2023-11-27T18:43:41.120056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2023-11-27T18:43:41.119872+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2023-11-27T18:43:41.119872+0000","last_clean_scrub_stamp":"2023-11-27T18:43:41.119872+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:10:52.204187+0000","scrub_duration":0.0061959529999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"32'28","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:48.216828+0000","last_change":"2023-11-27T18:43:48.216899+0000","last_active":"2023-11-27T18:43:48.216828+0000","last_peered":"2023-11-27T18:43:48.216828+0000","last_clean":"2023-11-27T18:43:48.216828+0000","last_became_active":"2023-11-27T18:13:14.418823+0000","last_became_peered":"2023-11-27T18:13:14.418823+0000","last_unstale":"2023-11-27T18:43:48.216828+0000","last_undegraded":"2023-11-27T18:43:48.216828+0000","last_fullsized":"2023-11-27T18:43:48.216828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'28","last_scrub_stamp":"2023-11-27T18:43:48.216586+0000","last_deep_scrub":"32'28","last_deep_scrub_stamp":"2023-11-27T18:43:48.216586+0000","last_clean_scrub_stamp":"2023-11-27T18:43:48.216586+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:41:08.176550+0000","scrub_duration":0.0040263709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"32'26","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:35.369455+0000","last_change":"2023-11-27T18:13:14.368373+0000","last_active":"2023-11-27T18:43:35.369455+0000","last_peered":"2023-11-27T18:43:35.369455+0000","last_clean":"2023-11-27T18:43:35.369455+0000","last_became_active":"2023-11-27T18:13:14.368100+0000","last_became_peered":"2023-11-27T18:13:14.368100+0000","last_unstale":"2023-11-27T18:43:35.369455+0000","last_undegraded":"2023-11-27T18:43:35.369455+0000","last_fullsized":"2023-11-27T18:43:35.369455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"32'26","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:40.367319+0000","last_change":"2023-11-27T18:13:14.376812+0000","last_active":"2023-11-27T18:43:40.367319+0000","last_peered":"2023-11-27T18:43:40.367319+0000","last_clean":"2023-11-27T18:43:40.367319+0000","last_became_active":"2023-11-27T18:13:14.376559+0000","last_became_peered":"2023-11-27T18:13:14.376559+0000","last_unstale":"2023-11-27T18:43:40.367319+0000","last_undegraded":"2023-11-27T18:43:40.367319+0000","last_fullsized":"2023-11-27T18:43:40.367319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"32'32","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.008753+0000","last_change":"2023-11-27T18:13:14.367518+0000","last_active":"2023-11-27T18:43:23.008753+0000","last_peered":"2023-11-27T18:43:23.008753+0000","last_clean":"2023-11-27T18:43:23.008753+0000","last_became_active":"2023-11-27T18:13:14.367298+0000","last_became_peered":"2023-11-27T18:13:14.367298+0000","last_unstale":"2023-11-27T18:43:23.008753+0000","last_undegraded":"2023-11-27T18:43:23.008753+0000","last_fullsized":"2023-11-27T18:43:23.008753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"32'17","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.094887+0000","last_change":"2023-11-27T18:13:14.364130+0000","last_active":"2023-11-27T18:43:23.094887+0000","last_peered":"2023-11-27T18:43:23.094887+0000","last_clean":"2023-11-27T18:43:23.094887+0000","last_became_active":"2023-11-27T18:13:14.363776+0000","last_became_peered":"2023-11-27T18:13:14.363776+0000","last_unstale":"2023-11-27T18:43:23.094887+0000","last_undegraded":"2023-11-27T18:43:23.094887+0000","last_fullsized":"2023-11-27T18:43:23.094887+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"32'24","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.091753+0000","last_change":"2023-11-27T18:13:14.423459+0000","last_active":"2023-11-27T18:43:23.091753+0000","last_peered":"2023-11-27T18:43:23.091753+0000","last_clean":"2023-11-27T18:43:23.091753+0000","last_became_active":"2023-11-27T18:13:14.423099+0000","last_became_peered":"2023-11-27T18:13:14.423099+0000","last_unstale":"2023-11-27T18:43:23.091753+0000","last_undegraded":"2023-11-27T18:43:23.091753+0000","last_fullsized":"2023-11-27T18:43:23.091753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"32'32","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.094094+0000","last_change":"2023-11-27T18:13:14.420348+0000","last_active":"2023-11-27T18:43:23.094094+0000","last_peered":"2023-11-27T18:43:23.094094+0000","last_clean":"2023-11-27T18:43:23.094094+0000","last_became_active":"2023-11-27T18:13:14.419780+0000","last_became_peered":"2023-11-27T18:13:14.419780+0000","last_unstale":"2023-11-27T18:43:23.094094+0000","last_undegraded":"2023-11-27T18:43:23.094094+0000","last_fullsized":"2023-11-27T18:43:23.094094+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"32'29","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:47.417614+0000","last_change":"2023-11-27T18:43:47.417728+0000","last_active":"2023-11-27T18:43:47.417614+0000","last_peered":"2023-11-27T18:43:47.417614+0000","last_clean":"2023-11-27T18:43:47.417614+0000","last_became_active":"2023-11-27T18:13:15.909918+0000","last_became_peered":"2023-11-27T18:13:15.909918+0000","last_unstale":"2023-11-27T18:43:47.417614+0000","last_undegraded":"2023-11-27T18:43:47.417614+0000","last_fullsized":"2023-11-27T18:43:47.417614+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'29","last_scrub_stamp":"2023-11-27T18:43:47.417382+0000","last_deep_scrub":"32'29","last_deep_scrub_stamp":"2023-11-27T18:43:47.417382+0000","last_clean_scrub_stamp":"2023-11-27T18:43:47.417382+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:19:46.839575+0000","scrub_duration":0.0058622300000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"32'19","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.095292+0000","last_change":"2023-11-27T18:13:14.369974+0000","last_active":"2023-11-27T18:43:23.095292+0000","last_peered":"2023-11-27T18:43:23.095292+0000","last_clean":"2023-11-27T18:43:23.095292+0000","last_became_active":"2023-11-27T18:13:14.369285+0000","last_became_peered":"2023-11-27T18:13:14.369285+0000","last_unstale":"2023-11-27T18:43:23.095292+0000","last_undegraded":"2023-11-27T18:43:23.095292+0000","last_fullsized":"2023-11-27T18:43:23.095292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"32'20","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.069085+0000","last_change":"2023-11-27T18:13:14.385745+0000","last_active":"2023-11-27T18:43:23.069085+0000","last_peered":"2023-11-27T18:43:23.069085+0000","last_clean":"2023-11-27T18:43:23.069085+0000","last_became_active":"2023-11-27T18:13:14.385566+0000","last_became_peered":"2023-11-27T18:13:14.385566+0000","last_unstale":"2023-11-27T18:43:23.069085+0000","last_undegraded":"2023-11-27T18:43:23.069085+0000","last_fullsized":"2023-11-27T18:43:23.069085+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"32'26","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:48.437473+0000","last_change":"2023-11-27T18:43:48.437524+0000","last_active":"2023-11-27T18:43:48.437473+0000","last_peered":"2023-11-27T18:43:48.437473+0000","last_clean":"2023-11-27T18:43:48.437473+0000","last_became_active":"2023-11-27T18:13:15.848237+0000","last_became_peered":"2023-11-27T18:13:15.848237+0000","last_unstale":"2023-11-27T18:43:48.437473+0000","last_undegraded":"2023-11-27T18:43:48.437473+0000","last_fullsized":"2023-11-27T18:43:48.437473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'26","last_scrub_stamp":"2023-11-27T18:43:48.437293+0000","last_deep_scrub":"32'26","last_deep_scrub_stamp":"2023-11-27T18:43:48.437293+0000","last_clean_scrub_stamp":"2023-11-27T18:43:48.437293+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:36:07.906895+0000","scrub_duration":0.003956256,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"32'23","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.093613+0000","last_change":"2023-11-27T18:13:14.373247+0000","last_active":"2023-11-27T18:43:23.093613+0000","last_peered":"2023-11-27T18:43:23.093613+0000","last_clean":"2023-11-27T18:43:23.093613+0000","last_became_active":"2023-11-27T18:13:14.372974+0000","last_became_peered":"2023-11-27T18:13:14.372974+0000","last_unstale":"2023-11-27T18:43:23.093613+0000","last_undegraded":"2023-11-27T18:43:23.093613+0000","last_fullsized":"2023-11-27T18:43:23.093613+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"32'18","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:52.342162+0000","last_change":"2023-11-27T18:43:52.342216+0000","last_active":"2023-11-27T18:43:52.342162+0000","last_peered":"2023-11-27T18:43:52.342162+0000","last_clean":"2023-11-27T18:43:52.342162+0000","last_became_active":"2023-11-27T18:13:15.850353+0000","last_became_peered":"2023-11-27T18:13:15.850353+0000","last_unstale":"2023-11-27T18:43:52.342162+0000","last_undegraded":"2023-11-27T18:43:52.342162+0000","last_fullsized":"2023-11-27T18:43:52.342162+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2023-11-27T18:43:52.341952+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2023-11-27T18:43:52.341952+0000","last_clean_scrub_stamp":"2023-11-27T18:43:52.341952+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:32:31.049285+0000","scrub_duration":0.0042809079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"32'25","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.087567+0000","last_change":"2023-11-27T18:13:14.381126+0000","last_active":"2023-11-27T18:43:23.087567+0000","last_peered":"2023-11-27T18:43:23.087567+0000","last_clean":"2023-11-27T18:43:23.087567+0000","last_became_active":"2023-11-27T18:13:14.380714+0000","last_became_peered":"2023-11-27T18:13:14.380714+0000","last_unstale":"2023-11-27T18:43:23.087567+0000","last_undegraded":"2023-11-27T18:43:23.087567+0000","last_fullsized":"2023-11-27T18:43:23.087567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"32'19","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:47.103043+0000","last_change":"2023-11-27T18:43:47.103117+0000","last_active":"2023-11-27T18:43:47.103043+0000","last_peered":"2023-11-27T18:43:47.103043+0000","last_clean":"2023-11-27T18:43:47.103043+0000","last_became_active":"2023-11-27T18:13:14.367978+0000","last_became_peered":"2023-11-27T18:13:14.367978+0000","last_unstale":"2023-11-27T18:43:47.103043+0000","last_undegraded":"2023-11-27T18:43:47.103043+0000","last_fullsized":"2023-11-27T18:43:47.103043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'19","last_scrub_stamp":"2023-11-27T18:43:47.102851+0000","last_deep_scrub":"32'19","last_deep_scrub_stamp":"2023-11-27T18:43:47.102851+0000","last_clean_scrub_stamp":"2023-11-27T18:43:47.102851+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:06:22.873872+0000","scrub_duration":0.0033780609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"32'23","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:38.508776+0000","last_change":"2023-11-27T18:43:38.508875+0000","last_active":"2023-11-27T18:43:38.508776+0000","last_peered":"2023-11-27T18:43:38.508776+0000","last_clean":"2023-11-27T18:43:38.508776+0000","last_became_active":"2023-11-27T18:13:14.418928+0000","last_became_peered":"2023-11-27T18:13:14.418928+0000","last_unstale":"2023-11-27T18:43:38.508776+0000","last_undegraded":"2023-11-27T18:43:38.508776+0000","last_fullsized":"2023-11-27T18:43:38.508776+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2023-11-27T18:43:38.508560+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2023-11-27T18:43:38.508560+0000","last_clean_scrub_stamp":"2023-11-27T18:43:38.508560+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:08:35.190483+0000","scrub_duration":0.0073382730000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2386,"num_write_kb":255070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2569,"ondisk_log_size":2569,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1576,"ondisk_log_size":1576,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":24107291,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":549,"num_read_kb":581,"num_write":5694,"num_write_kb":26819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32874496,"data_stored":48214582,"data_compressed":4737124,"data_compressed_allocated":7356416,"data_compressed_original":22757376,"omap_allocated":0,"internal_metadata":0},"log_size":5261,"ondisk_log_size":5261,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67010,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719477117,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36008,"kb_used_data":4832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335832,"statfs":{"total":96636764160,"available":96599891968,"internally_reserved":0,"allocated":4947968,"data_stored":8056568,"data_compressed":850146,"data_compressed_allocated":1241088,"data_compressed_original":4562944,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.88300000000000001,"15min":0.85999999999999999},"min":{"1min":0.60399999999999998,"5min":0.55800000000000005,"15min":0.45400000000000001},"max":{"1min":1.373,"5min":1.373,"15min":1.4730000000000001},"last":1.1279999999999999},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.93500000000000005,"15min":0.93300000000000005},"min":{"1min":0.58499999999999996,"5min":0.49399999999999999,"15min":0.46000000000000002},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":1.0900000000000001}]},{"osd":1,"last update":"Mon Nov 27 18:43:38 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":0.995,"15min":0.96899999999999997},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.4790000000000001,"5min":1.51,"15min":1.51},"last":1.014},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.93899999999999995,"15min":0.92800000000000005},"min":{"1min":0.58899999999999997,"5min":0.55100000000000005,"15min":0.54000000000000004},"max":{"1min":1.1950000000000001,"5min":1.361,"15min":1.482},"last":0.84099999999999997}]},{"osd":2,"last update":"Mon Nov 27 18:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.98499999999999999,"15min":0.97299999999999998},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.53900000000000003},"max":{"1min":1.2170000000000001,"5min":1.4730000000000001,"15min":1.603},"last":1.0589999999999999},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92300000000000004,"15min":0.92700000000000005},"min":{"1min":0.59699999999999998,"5min":0.58299999999999996,"15min":0.52700000000000002},"max":{"1min":1.2549999999999999,"5min":1.389,"15min":1.389},"last":1.3640000000000001}]},{"osd":3,"last update":"Mon Nov 27 18:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.98799999999999999,"15min":0.97499999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.472},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.0389999999999999,"15min":1.0409999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.3049999999999999,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.96699999999999997}]},{"osd":4,"last update":"Mon Nov 27 18:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.90600000000000003,"15min":0.90200000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.518,"5min":1.518,"15min":1.518},"last":1.268},{"interface":"front","average":{"1min":1.036,"5min":1.018,"15min":1.0029999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.92600000000000005}]},{"osd":6,"last update":"Mon Nov 27 18:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":1.01,"15min":1.0029999999999999},"min":{"1min":0.505,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.3240000000000001,"5min":1.417,"15min":1.49},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.02,"5min":1.026,"15min":1.03},"min":{"1min":0.46899999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.4419999999999999,"5min":1.5049999999999999,"15min":1.605},"last":1.4750000000000001}]},{"osd":7,"last update":"Mon Nov 27 18:43:38 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.1459999999999999,"15min":1.125},"min":{"1min":0.73699999999999999,"5min":0.49299999999999999,"15min":0.47999999999999998},"max":{"1min":1.617,"5min":1.617,"15min":1.831},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.141,"5min":1.1779999999999999,"15min":1.1759999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.4790000000000001,"5min":1.6639999999999999,"15min":1.768},"last":1.1120000000000001}]}]},{"osd":7,"up_from":16,"seq":68719477117,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33280,"kb_used_data":2104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338560,"statfs":{"total":96636764160,"available":96602685440,"internally_reserved":0,"allocated":2154496,"data_stored":3272747,"data_compressed":386056,"data_compressed_allocated":532480,"data_compressed_original":1863680,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.88500000000000001,"15min":0.88},"min":{"1min":0.56899999999999995,"5min":0.54000000000000004,"15min":0.49399999999999999},"max":{"1min":1.3009999999999999,"5min":1.357,"15min":1.448},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.96799999999999997,"15min":0.93700000000000006},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.49299999999999999},"max":{"1min":1.2909999999999999,"5min":1.411,"15min":1.7110000000000001},"last":1.121}]},{"osd":1,"last update":"Mon Nov 27 18:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.91900000000000004,"15min":0.92600000000000005},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.343,"5min":1.379,"15min":1.379},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1,"15min":0.97799999999999998},"min":{"1min":0.65600000000000003,"5min":0.63100000000000001,"15min":0.54800000000000004},"max":{"1min":1.4259999999999999,"5min":1.4450000000000001,"15min":1.768},"last":0.98399999999999999}]},{"osd":2,"last update":"Mon Nov 27 18:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":1.0089999999999999,"15min":0.997},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.52000000000000002},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.6870000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.95399999999999996,"15min":0.93999999999999995},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.204,"5min":1.363,"15min":1.415},"last":1.163}]},{"osd":3,"last update":"Mon Nov 27 18:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.99099999999999999,"15min":0.97699999999999998},"min":{"1min":0.61899999999999999,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.2370000000000001,"5min":1.4370000000000001,"15min":1.4550000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.103,"15min":1.073},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.51300000000000001},"max":{"1min":1.4990000000000001,"5min":1.5649999999999999,"15min":1.5820000000000001},"last":1.216}]},{"osd":4,"last update":"Mon Nov 27 18:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":1.006,"15min":0.92900000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.4610000000000001,"5min":6.6539999999999999,"15min":6.6539999999999999},"last":1.0509999999999999},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.996,"15min":1},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.3240000000000001,"5min":1.5469999999999999,"15min":2.0649999999999999},"last":0.753}]},{"osd":5,"last update":"Mon Nov 27 18:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.099,"15min":1.0389999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35199999999999998},"max":{"1min":1.569,"5min":1.825,"15min":1.825},"last":0.87},{"interface":"front","average":{"1min":1.052,"5min":1.0449999999999999,"15min":1.0369999999999999},"min":{"1min":0.55900000000000005,"5min":0.53200000000000003,"15min":0.39200000000000002},"max":{"1min":1.361,"5min":1.679,"15min":1.679},"last":0.79200000000000004}]},{"osd":6,"last update":"Mon Nov 27 18:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.1120000000000001,"15min":1.0900000000000001},"min":{"1min":0.73999999999999999,"5min":0.45300000000000001,"15min":0.43099999999999999},"max":{"1min":1.431,"5min":1.732,"15min":1.956},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.159,"15min":1.149},"min":{"1min":0.48999999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.6479999999999999,"5min":1.7170000000000001,"15min":1.8839999999999999},"last":1.0860000000000001}]}]},{"osd":6,"up_from":16,"seq":68719477117,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30016,"kb_used_data":3000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341824,"statfs":{"total":96636764160,"available":96606027776,"internally_reserved":0,"allocated":3072000,"data_stored":4332626,"data_compressed":430585,"data_compressed_allocated":663552,"data_compressed_original":2125824,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.94799999999999995,"15min":0.93200000000000005},"min":{"1min":0.61499999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.256,"5min":1.375,"15min":1.956},"last":1.28},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.056,"15min":1.0349999999999999},"min":{"1min":0.69699999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.2090000000000001,"5min":1.5429999999999999,"15min":1.5629999999999999},"last":1.121}]},{"osd":1,"last update":"Mon Nov 27 18:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.90100000000000002,"15min":0.89100000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.51200000000000001},"max":{"1min":1.2829999999999999,"5min":1.4179999999999999,"15min":1.5229999999999999},"last":1.367},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.92600000000000005,"15min":0.92500000000000004},"min":{"1min":0.62,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.252,"5min":1.3839999999999999,"15min":2.2519999999999998},"last":0.71199999999999997}]},{"osd":2,"last update":"Mon Nov 27 18:43:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":0.97099999999999997,"15min":0.96599999999999997},"min":{"1min":0.747,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.214,"5min":2.2349999999999999,"15min":2.2349999999999999},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.081,"15min":1.056},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.52900000000000003},"max":{"1min":1.3959999999999999,"5min":3.6549999999999998,"15min":3.6549999999999998},"last":0.85899999999999999}]},{"osd":3,"last update":"Mon Nov 27 18:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":1.044,"15min":1.034},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.52800000000000002},"max":{"1min":1.24,"5min":1.7949999999999999,"15min":2.3050000000000002},"last":1.0029999999999999},{"interface":"front","average":{"1min":1,"5min":1.0740000000000001,"15min":1.0660000000000001},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.57699999999999996},"max":{"1min":1.2170000000000001,"5min":2.0750000000000002,"15min":2.097},"last":1.0489999999999999}]},{"osd":4,"last update":"Mon Nov 27 18:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.96599999999999997,"15min":0.96999999999999997},"min":{"1min":0.59499999999999997,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.3680000000000001,"5min":1.5309999999999999,"15min":1.712},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.016,"5min":1.097,"15min":1.0580000000000001},"min":{"1min":0.502,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.544,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.234}]},{"osd":5,"last update":"Mon Nov 27 18:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.0089999999999999,"15min":0.996},"min":{"1min":0.58999999999999997,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.399,"5min":1.879,"15min":2.173},"last":0.78000000000000003},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.1299999999999999,"15min":1.137},"min":{"1min":0.65900000000000003,"5min":0.59399999999999997,"15min":0.46500000000000002},"max":{"1min":1.339,"5min":3.7509999999999999,"15min":3.7509999999999999},"last":1.1910000000000001}]},{"osd":7,"last update":"Mon Nov 27 18:43:30 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.165,"15min":1.1559999999999999},"min":{"1min":0.56499999999999995,"5min":0.55300000000000005,"15min":0.40400000000000003},"max":{"1min":1.7470000000000001,"5min":1.962,"15min":2.351},"last":1.321},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.177,"15min":1.1619999999999999},"min":{"1min":0.80300000000000005,"5min":0.55800000000000005,"15min":0.499},"max":{"1min":1.613,"5min":2.1150000000000002,"15min":2.2250000000000001},"last":1.1619999999999999}]}]},{"osd":3,"up_from":16,"seq":68719477115,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58052,"kb_used_data":8828,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94313788,"statfs":{"total":96636764160,"available":96577318912,"internally_reserved":0,"allocated":9039872,"data_stored":12721816,"data_compressed":1205599,"data_compressed_allocated":1880064,"data_compressed_original":5767168,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:43:41 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.69299999999999995,"15min":0.72399999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":1.101,"5min":1.101,"15min":1.456},"last":0.5},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.76500000000000001,"15min":0.78600000000000003},"min":{"1min":0.36799999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.95899999999999996,"5min":1.387,"15min":1.387},"last":0.98099999999999998}]},{"osd":1,"last update":"Mon Nov 27 18:43:41 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.76600000000000001,"15min":0.78100000000000003},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.006,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.85199999999999998,"15min":0.90000000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.4690000000000001},"last":0.57599999999999996}]},{"osd":2,"last update":"Mon Nov 27 18:43:41 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.90200000000000002,"15min":0.91300000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.246,"5min":1.371,"15min":1.631},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.92700000000000005,"15min":0.94899999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.39000000000000001},"max":{"1min":1.3260000000000001,"5min":1.375,"15min":1.375},"last":0.64000000000000001}]},{"osd":4,"last update":"Mon Nov 27 18:43:41 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.98899999999999999,"15min":0.98999999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.2490000000000001,"5min":1.573,"15min":1.6439999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.93400000000000005,"5min":1.0109999999999999,"15min":1.048},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.60399999999999998},"max":{"1min":1.254,"5min":1.4950000000000001,"15min":1.605},"last":1.159}]},{"osd":5,"last update":"Mon Nov 27 18:43:41 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":1.056,"15min":1.081},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.29,"5min":1.472,"15min":1.766},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.052,"5min":1.155,"15min":1.181},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.381,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.92800000000000005}]},{"osd":6,"last update":"Mon Nov 27 18:43:41 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.1180000000000001,"15min":1.1000000000000001},"min":{"1min":0.65500000000000003,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.401,"5min":1.607,"15min":1.8720000000000001},"last":1.1160000000000001},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.1299999999999999,"15min":1.1699999999999999},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.367,"5min":1.7050000000000001,"15min":1.7270000000000001},"last":1.0700000000000001}]},{"osd":7,"last update":"Mon Nov 27 18:43:41 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.222,"15min":1.246},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.6830000000000001,"5min":1.915,"15min":1.915},"last":1.032},{"interface":"front","average":{"1min":1.105,"5min":1.175,"15min":1.171},"min":{"1min":0.621,"5min":0.496,"15min":0.496},"max":{"1min":1.6279999999999999,"5min":1.6839999999999999,"15min":1.9339999999999999},"last":1.214}]}]},{"osd":2,"up_from":16,"seq":68719477116,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33272,"kb_used_data":6256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94338568,"statfs":{"total":96636764160,"available":96602693632,"internally_reserved":0,"allocated":6406144,"data_stored":8527602,"data_compressed":750925,"data_compressed_allocated":1228800,"data_compressed_original":3559424,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:43:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.71099999999999997,"15min":0.71999999999999997},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.157,"5min":1.2729999999999999,"15min":1.2869999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.78300000000000003,"15min":0.81299999999999994},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.0860000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":0.78400000000000003}]},{"osd":1,"last update":"Mon Nov 27 18:43:45 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.81299999999999994,"15min":0.84299999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.109,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.86099999999999999,"15min":0.88400000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.3,"5min":2.6400000000000001,"15min":2.6400000000000001},"last":0.67500000000000004}]},{"osd":3,"last update":"Mon Nov 27 18:43:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.79200000000000004,"15min":0.81799999999999995},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.1180000000000001,"5min":1.4750000000000001,"15min":1.6259999999999999},"last":1.0640000000000001},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.94199999999999995,"15min":0.96499999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.256,"5min":1.554,"15min":1.554},"last":0.85099999999999998}]},{"osd":4,"last update":"Mon Nov 27 18:43:45 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":1.0269999999999999,"15min":1.0329999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.3819999999999999,"5min":1.49,"15min":1.5620000000000001},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.94499999999999995,"5min":1.02,"15min":1.0409999999999999},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.57799999999999996},"max":{"1min":1.23,"5min":1.861,"15min":1.861},"last":0.96199999999999997}]},{"osd":5,"last update":"Mon Nov 27 18:43:45 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":1.0649999999999999,"15min":1.079},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.337,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":1.03},{"interface":"front","average":{"1min":0.97699999999999998,"5min":1.04,"15min":1.0449999999999999},"min":{"1min":0.68300000000000005,"5min":0.55700000000000005,"15min":0.53000000000000003},"max":{"1min":1.403,"5min":1.5209999999999999,"15min":1.6859999999999999},"last":1.179}]},{"osd":6,"last update":"Mon Nov 27 18:43:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.105,"15min":1.109},"min":{"1min":0.58799999999999997,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.5229999999999999,"5min":1.585,"15min":1.7490000000000001},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.1619999999999999,"15min":1.1759999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.45,"5min":1.786,"15min":1.958},"last":1.113}]},{"osd":7,"last update":"Mon Nov 27 18:43:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.1779999999999999,"15min":1.1879999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.625},"max":{"1min":1.714,"5min":1.7869999999999999,"15min":1.8799999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.181,"15min":1.1779999999999999},"min":{"1min":0.70299999999999996,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.6080000000000001,"5min":3.4289999999999998,"15min":3.4289999999999998},"last":1.2709999999999999}]}]},{"osd":1,"up_from":16,"seq":68719477116,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44056,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327784,"statfs":{"total":96636764160,"available":96591650816,"internally_reserved":0,"allocated":409600,"data_stored":728760,"data_compressed":33505,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.67600000000000005,"15min":0.70999999999999996},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.91500000000000004,"5min":1.1080000000000001,"15min":1.2969999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.77400000000000002,"15min":0.81599999999999995},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.282,"5min":1.306,"15min":1.397},"last":0.95499999999999996}]},{"osd":2,"last update":"Mon Nov 27 18:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.73199999999999998,"15min":0.73899999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.36299999999999999},"max":{"1min":1.0760000000000001,"5min":1.1439999999999999,"15min":1.3480000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.755,"5min":0.83299999999999996,"15min":0.88},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.38500000000000001},"max":{"1min":1.252,"5min":1.4359999999999999,"15min":1.9610000000000001},"last":0.80500000000000005}]},{"osd":3,"last update":"Mon Nov 27 18:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.92300000000000004,"15min":0.96799999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.0880000000000001,"5min":1.3520000000000001,"15min":1.8009999999999999},"last":1.1830000000000001},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.90300000000000002,"15min":0.90500000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.3140000000000001,"5min":1.462,"15min":2.0960000000000001},"last":0.73799999999999999}]},{"osd":4,"last update":"Mon Nov 27 18:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.95299999999999996,"15min":0.94799999999999995},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.51800000000000002},"max":{"1min":1.2070000000000001,"5min":1.4370000000000001,"15min":1.4970000000000001},"last":0.875},{"interface":"front","average":{"1min":0.93799999999999994,"5min":1.0589999999999999,"15min":1.0900000000000001},"min":{"1min":0.629,"5min":0.629,"15min":0.61399999999999999},"max":{"1min":1.379,"5min":1.478,"15min":2.496},"last":1.0129999999999999}]},{"osd":5,"last update":"Mon Nov 27 18:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.048,"15min":1.0880000000000001},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.51500000000000001},"max":{"1min":1.327,"5min":1.534,"15min":2.1970000000000001},"last":1.0900000000000001},{"interface":"front","average":{"1min":0.97699999999999998,"5min":1.0489999999999999,"15min":1.0549999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.60599999999999998},"max":{"1min":1.3700000000000001,"5min":1.605,"15min":1.7529999999999999},"last":1.0580000000000001}]},{"osd":6,"last update":"Mon Nov 27 18:43:36 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.141,"15min":1.1890000000000001},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.503},"max":{"1min":1.502,"5min":1.6060000000000001,"15min":2.4319999999999999},"last":0.91500000000000004},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.1459999999999999,"15min":1.1759999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.52600000000000002},"max":{"1min":1.5269999999999999,"5min":1.7569999999999999,"15min":2.3700000000000001},"last":1.258}]},{"osd":7,"last update":"Mon Nov 27 18:43:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.167,"15min":1.206},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.55200000000000005},"max":{"1min":1.4510000000000001,"5min":1.6990000000000001,"15min":2.2879999999999998},"last":1.345},{"interface":"front","average":{"1min":1.028,"5min":1.1499999999999999,"15min":1.1579999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.319,"5min":1.7070000000000001,"15min":1.7170000000000001},"last":1.22}]}]},{"osd":0,"up_from":16,"seq":68719477117,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42672,"kb_used_data":3176,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329168,"statfs":{"total":96636764160,"available":96593068032,"internally_reserved":0,"allocated":3252224,"data_stored":4332682,"data_compressed":397480,"data_compressed_allocated":610304,"data_compressed_original":1900544,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 27 18:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.69599999999999995,"15min":0.71999999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.86199999999999999,"5min":1.2070000000000001,"15min":1.6599999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.82799999999999996,"15min":0.83999999999999997},"min":{"1min":0.47799999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2310000000000001,"5min":1.391,"15min":1.391},"last":0.747}]},{"osd":2,"last update":"Mon Nov 27 18:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.81499999999999995,"15min":0.85299999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1140000000000001,"5min":1.3799999999999999,"15min":1.405},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.749,"5min":0.84599999999999997,"15min":0.85899999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.145,"5min":1.4730000000000001,"15min":1.5629999999999999},"last":1.0029999999999999}]},{"osd":3,"last update":"Mon Nov 27 18:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.85899999999999999,"15min":0.86499999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.42099999999999999},"max":{"1min":1.3140000000000001,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.96099999999999997,"15min":0.96599999999999997},"min":{"1min":0.53000000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.3839999999999999,"5min":1.421,"15min":2.073},"last":0.80600000000000005}]},{"osd":4,"last update":"Mon Nov 27 18:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.96499999999999997,"15min":0.97299999999999998},"min":{"1min":0.69999999999999996,"5min":0.64400000000000002,"15min":0.57099999999999995},"max":{"1min":1.222,"5min":1.73,"15min":1.897},"last":1.0449999999999999},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.0349999999999999,"15min":1.0740000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.3140000000000001,"5min":1.4059999999999999,"15min":2.1899999999999999},"last":0.89200000000000002}]},{"osd":5,"last update":"Mon Nov 27 18:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":1.0760000000000001,"15min":1.085},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.56899999999999995},"max":{"1min":1.3380000000000001,"5min":1.5369999999999999,"15min":2.0270000000000001},"last":1.083},{"interface":"front","average":{"1min":0.97899999999999998,"5min":1.036,"15min":1.04},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.624},"max":{"1min":1.248,"5min":1.855,"15min":1.9870000000000001},"last":0.83299999999999996}]},{"osd":6,"last update":"Mon Nov 27 18:43:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.1379999999999999,"15min":1.1639999999999999},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.59599999999999997},"max":{"1min":1.4830000000000001,"5min":1.6399999999999999,"15min":2.254},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.071,"5min":1.143,"15min":1.1719999999999999},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.745},"max":{"1min":1.4159999999999999,"5min":1.5800000000000001,"15min":1.8440000000000001},"last":1.2170000000000001}]},{"osd":7,"last update":"Mon Nov 27 18:43:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1799999999999999,"15min":1.2},"min":{"1min":0.85499999999999998,"5min":0.76100000000000001,"15min":0.60799999999999998},"max":{"1min":1.454,"5min":1.591,"15min":2.1600000000000001},"last":1.157},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.151,"15min":1.155},"min":{"1min":0.84199999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.377,"5min":1.7849999999999999,"15min":2.117},"last":1.1200000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509821,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55512,"kb_used_data":6288,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94316328,"statfs":{"total":96636764160,"available":96579919872,"internally_reserved":0,"allocated":6438912,"data_stored":8528274,"data_compressed":749838,"data_compressed_allocated":1245184,"data_compressed_original":3551232,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.92100000000000004,"15min":0.88500000000000001},"min":{"1min":0.53700000000000003,"5min":0.47099999999999997,"15min":0.46300000000000002},"max":{"1min":1.385,"5min":1.385,"15min":1.675},"last":1.1639999999999999},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.89200000000000002,"15min":0.91200000000000003},"min":{"1min":0.498,"5min":0.373,"15min":0.373},"max":{"1min":1.0800000000000001,"5min":1.349,"15min":1.5449999999999999},"last":0.97599999999999998}]},{"osd":1,"last update":"Mon Nov 27 18:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.94899999999999995,"15min":0.93799999999999994},"min":{"1min":0.61899999999999999,"5min":0.55100000000000005,"15min":0.46100000000000002},"max":{"1min":1.25,"5min":1.4790000000000001,"15min":2.2759999999999998},"last":0.77900000000000003},{"interface":"front","average":{"1min":1.0049999999999999,"5min":0.97199999999999998,"15min":0.95699999999999996},"min":{"1min":0.67100000000000004,"5min":0.62,"15min":0.49399999999999999},"max":{"1min":1.331,"5min":1.371,"15min":1.569},"last":1.1140000000000001}]},{"osd":2,"last update":"Mon Nov 27 18:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.97299999999999998,"15min":0.96499999999999997},"min":{"1min":0.59599999999999997,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.222,"5min":1.5649999999999999,"15min":2.3730000000000002},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.069,"5min":1.006,"15min":1.002},"min":{"1min":0.77000000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.383,"5min":1.4770000000000001,"15min":1.7729999999999999},"last":1.0549999999999999}]},{"osd":3,"last update":"Mon Nov 27 18:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.96699999999999997,"15min":0.95899999999999996},"min":{"1min":0.58099999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.411,"5min":1.411,"15min":1.8300000000000001},"last":0.874},{"interface":"front","average":{"1min":1.006,"5min":1.018,"15min":1.044},"min":{"1min":0.745,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.2869999999999999,"5min":1.5169999999999999,"15min":2.2069999999999999},"last":1.008}]},{"osd":5,"last update":"Mon Nov 27 18:43:37 2023","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":0.95099999999999996,"15min":0.96899999999999997},"min":{"1min":0.69099999999999995,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.4039999999999999,"5min":1.4410000000000001,"15min":1.7290000000000001},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.96199999999999997,"15min":0.96599999999999997},"min":{"1min":0.60099999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.236,"5min":1.3799999999999999,"15min":1.7150000000000001},"last":0.71699999999999997}]},{"osd":6,"last update":"Mon Nov 27 18:43:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0640000000000001,"15min":1.038},"min":{"1min":0.64600000000000002,"5min":0.52200000000000002,"15min":0.48299999999999998},"max":{"1min":1.302,"5min":1.6579999999999999,"15min":2.4199999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":1.175,"5min":1.161,"15min":1.1419999999999999},"min":{"1min":0.69099999999999995,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.4750000000000001,"5min":1.591,"15min":1.8140000000000001},"last":1.2070000000000001}]},{"osd":7,"last update":"Mon Nov 27 18:43:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0700000000000001,"15min":1.0680000000000001},"min":{"1min":0.67000000000000004,"5min":0.46100000000000002,"15min":0.40400000000000003},"max":{"1min":1.5369999999999999,"5min":1.623,"15min":2.0419999999999998},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1559999999999999,"15min":1.1639999999999999},"min":{"1min":0.85899999999999999,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.3759999999999999,"5min":1.736,"15min":2.3279999999999998},"last":0.89700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33505,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33505,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2912256,"data_stored":4194360,"data_compressed":397480,"data_compressed_allocated":610304,"data_compressed_original":1900544,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6066176,"data_stored":8389280,"data_compressed":750925,"data_compressed_allocated":1228800,"data_compressed_original":3559424,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8699904,"data_stored":12583494,"data_compressed":1205599,"data_compressed_allocated":1880064,"data_compressed_original":5767168,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6098944,"data_stored":8389952,"data_compressed":749838,"data_compressed_allocated":1245184,"data_compressed_original":3551232,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4546560,"data_stored":7328697,"data_compressed":816641,"data_compressed_allocated":1196032,"data_compressed_original":3989504,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":2732032,"data_stored":4194304,"data_compressed":430585,"data_compressed_allocated":663552,"data_compressed_original":2125824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1814528,"data_stored":3134425,"data_compressed":386056,"data_compressed_allocated":532480,"data_compressed_original":1863680,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T18:44:02.781 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.781 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.781 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.781 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2023-11-27T18:13:10.491982+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=10, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.781 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.781 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.781 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.782 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2023-11-27T18:13:10.491982+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=10, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.782 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.782 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.782 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.782 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.782 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.782 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-27T18:13:10.491982+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=10, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.783 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.783 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.783 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.783 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-27T18:13:10.491982+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=10, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.783 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.783 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.783 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-27T18:13:10.491982+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=10, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.784 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.784 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.784 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.784 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-27T18:13:10.491982+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=10, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.784 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.784 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-27T18:13:10.491982+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=10, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.784 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.784 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.785 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.785 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.785 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.785 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.785 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.785 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.785 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.786 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.786 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.786 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2023-11-27T18:13:10.491982+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=10, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.786 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.786 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.786 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.786 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.786 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.787 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.787 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.787 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.787 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.787 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2023-11-27T18:13:10.491982+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=10, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.787 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.787 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2023-11-27T18:13:10.491982+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=10, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.788 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.788 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.788 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.788 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.788 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.788 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.789 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.789 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.789 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.789 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.789 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.789 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.789 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.789 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.790 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.790 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:02.790 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-27T18:44:10.777 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:44:10.780 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:44:22.791 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T18:44:22.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:22.914+0000 7fcd4bca6640 1 Processor -- start 2023-11-27T18:44:22.917 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:22.914+0000 7fcd4bca6640 1 -- start start 2023-11-27T18:44:22.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:22.914+0000 7fcd4bca6640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fcd44151560 0x7fcd4406f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:44:22.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:22.914+0000 7fcd4bca6640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcd44158160 0x7fcd4415a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:44:22.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:22.914+0000 7fcd4bca6640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd440c59f0 con 0x7fcd440c5d90 2023-11-27T18:44:22.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:22.914+0000 7fcd4bca6640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd440c3700 con 0x7fcd44151560 2023-11-27T18:44:22.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:22.914+0000 7fcd4bca6640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd44151940 con 0x7fcd44158160 2023-11-27T18:44:22.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:22.914+0000 7fcd49241640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcd44158160 0x7fcd4415a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:44:22.919 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:22.914+0000 7fcd49241640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcd44158160 0x7fcd4415a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.91:46626/0 (socket says 172.21.15.91:46626) 2023-11-27T18:44:22.919 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:22.914+0000 7fcd49241640 1 -- 172.21.15.91:0/3497887243 learned_addr learned my addr 172.21.15.91:0/3497887243 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:44:22.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:22.914+0000 7fcd49a42640 1 --2- 172.21.15.91:0/3497887243 >> v2:172.21.15.94:3300/0 conn(0x7fcd44151560 0x7fcd4406f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:44:22.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:22.922+0000 7fcd49241640 1 -- 172.21.15.91:0/3497887243 >> v2:172.21.15.94:3300/0 conn(0x7fcd44151560 msgr2=0x7fcd4406f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:44:22.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:22.922+0000 7fcd49241640 1 --2- 172.21.15.91:0/3497887243 >> v2:172.21.15.94:3300/0 conn(0x7fcd44151560 0x7fcd4406f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:44:22.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:22.922+0000 7fcd49241640 1 -- 172.21.15.91:0/3497887243 >> v1:172.21.15.91:6789/0 conn(0x7fcd440c5d90 legacy=0x7fcd440c7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:44:22.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:22.922+0000 7fcd49241640 1 -- 172.21.15.91:0/3497887243 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd44157cd0 con 0x7fcd44158160 2023-11-27T18:44:22.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:22.926+0000 7fcd49241640 1 --2- 172.21.15.91:0/3497887243 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcd44158160 0x7fcd4415a9f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcd40009870 tx=0x7fcd4001ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a66faaf340d5680 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:44:22.941 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:22.938+0000 7fcd48a40640 1 -- 172.21.15.91:0/3497887243 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd400a89b0 con 0x7fcd44158160 2023-11-27T18:44:22.941 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:22.938+0000 7fcd48a40640 1 -- 172.21.15.91:0/3497887243 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd400a8b10 con 0x7fcd44158160 2023-11-27T18:44:22.942 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:22.938+0000 7fcd48a40640 1 -- 172.21.15.91:0/3497887243 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd400a8ea0 con 0x7fcd44158160 2023-11-27T18:44:22.942 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:22.938+0000 7fcd4bca6640 1 -- 172.21.15.91:0/3497887243 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcd44158160 msgr2=0x7fcd4415a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:44:22.942 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:22.938+0000 7fcd4bca6640 1 --2- 172.21.15.91:0/3497887243 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcd44158160 0x7fcd4415a9f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcd40009870 tx=0x7fcd4001ecf0 comp rx=0 tx=0).stop 2023-11-27T18:44:22.943 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:22.938+0000 7fcd4bca6640 1 -- 172.21.15.91:0/3497887243 shutdown_connections 2023-11-27T18:44:22.943 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:22.938+0000 7fcd4bca6640 1 --2- 172.21.15.91:0/3497887243 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcd44158160 0x7fcd4415a9f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:44:22.943 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:22.938+0000 7fcd4bca6640 1 --2- 172.21.15.91:0/3497887243 >> v2:172.21.15.94:3300/0 conn(0x7fcd44151560 0x7fcd4406f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:44:22.943 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:22.938+0000 7fcd4bca6640 1 -- 172.21.15.91:0/3497887243 >> 172.21.15.91:0/3497887243 conn(0x7fcd440cbec0 msgr2=0x7fcd440cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:44:22.943 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:22.938+0000 7fcd4bca6640 1 -- 172.21.15.91:0/3497887243 shutdown_connections 2023-11-27T18:44:22.943 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:22.938+0000 7fcd4bca6640 1 -- 172.21.15.91:0/3497887243 wait complete. 2023-11-27T18:44:22.943 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:22.938+0000 7fcd4bca6640 1 Processor -- start 2023-11-27T18:44:22.944 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:22.938+0000 7fcd4bca6640 1 -- start start 2023-11-27T18:44:22.944 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:22.942+0000 7fcd4bca6640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcd440c5d90 0x7fcd44152700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:44:22.944 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:22.942+0000 7fcd4bca6640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcd44151560 0x7fcd441e0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:44:22.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:22.942+0000 7fcd4bca6640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcd44158160 0x7fcd441535d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:44:22.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:22.942+0000 7fcd4bca6640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd44153fb0 con 0x7fcd44151560 2023-11-27T18:44:22.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:22.942+0000 7fcd4bca6640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd44154d00 con 0x7fcd44158160 2023-11-27T18:44:22.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:22.942+0000 7fcd4bca6640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd441e0690 con 0x7fcd440c5d90 2023-11-27T18:44:22.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:22.942+0000 7fcd4a243640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcd44158160 0x7fcd441535d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:44:22.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:22.942+0000 7fcd4a243640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcd44158160 0x7fcd441535d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.91:58102/0 (socket says 172.21.15.91:58102) 2023-11-27T18:44:22.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:22.942+0000 7fcd4a243640 1 -- 172.21.15.91:0/2083577007 learned_addr learned my addr 172.21.15.91:0/2083577007 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:44:22.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:22.942+0000 7fcd49a42640 1 --2- 172.21.15.91:0/2083577007 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcd440c5d90 0x7fcd44152700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:44:22.957 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:22.954+0000 7fcd4a243640 1 -- 172.21.15.91:0/2083577007 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcd440c5d90 msgr2=0x7fcd44152700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:44:22.957 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:22.954+0000 7fcd4a243640 1 --2- 172.21.15.91:0/2083577007 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcd440c5d90 0x7fcd44152700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:44:22.957 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:22.954+0000 7fcd4a243640 1 -- 172.21.15.91:0/2083577007 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcd44151560 msgr2=0x7fcd441e0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:44:22.957 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:22.954+0000 7fcd4a243640 1 --2- 172.21.15.91:0/2083577007 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcd44151560 0x7fcd441e0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:44:22.957 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:22.954+0000 7fcd4a243640 1 -- 172.21.15.91:0/2083577007 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd400094d0 con 0x7fcd44158160 2023-11-27T18:44:22.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:22.962+0000 7fcd4a243640 1 --2- 172.21.15.91:0/2083577007 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcd44158160 0x7fcd441535d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c00c410 tx=0x7fcd3c00c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:44:22.975 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:22.970+0000 7fcd367fc640 1 -- 172.21.15.91:0/2083577007 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c003600 con 0x7fcd44158160 2023-11-27T18:44:22.975 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:22.970+0000 7fcd367fc640 1 -- 172.21.15.91:0/2083577007 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd3c003760 con 0x7fcd44158160 2023-11-27T18:44:22.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:22.970+0000 7fcd367fc640 1 -- 172.21.15.91:0/2083577007 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c003b50 con 0x7fcd44158160 2023-11-27T18:44:22.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:22.970+0000 7fcd4bca6640 1 -- 172.21.15.91:0/2083577007 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd441e0970 con 0x7fcd44158160 2023-11-27T18:44:22.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:22.970+0000 7fcd4bca6640 1 -- 172.21.15.91:0/2083577007 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd44154500 con 0x7fcd44158160 2023-11-27T18:44:22.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:22.974+0000 7fcd4bca6640 1 -- 172.21.15.91:0/2083577007 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd44067810 con 0x7fcd44158160 2023-11-27T18:44:23.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:23.022+0000 7fcd367fc640 1 -- 172.21.15.91:0/2083577007 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fcd3c003cb0 con 0x7fcd44158160 2023-11-27T18:44:23.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:23.022+0000 7fcd367fc640 1 --2- 172.21.15.91:0/2083577007 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fcd28066840 0x7fcd28068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:44:23.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:23.022+0000 7fcd49a42640 1 --2- 172.21.15.91:0/2083577007 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fcd28066840 0x7fcd28068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:44:23.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:23.026+0000 7fcd49a42640 1 --2- 172.21.15.91:0/2083577007 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fcd28066840 0x7fcd28068d00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fcd380113e0 tx=0x7fcd3800b040 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:44:23.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:23.342+0000 7fcd367fc640 1 -- 172.21.15.91:0/2083577007 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fcd3c054b40 con 0x7fcd44158160 2023-11-27T18:44:23.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:23.378+0000 7fcd367fc640 1 -- 172.21.15.91:0/2083577007 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fcd3c050e80 con 0x7fcd44158160 2023-11-27T18:44:23.548 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:23.546+0000 7fcd4bca6640 1 -- 172.21.15.91:0/2083577007 --> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcd440c8410 con 0x7fcd28066840 2023-11-27T18:44:23.575 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:23.570+0000 7fcd367fc640 1 -- 172.21.15.91:0/2083577007 <== mgr.4136 v2:172.21.15.91:6800/2814827118 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370707 (secure 0 0 0) 0x7fcd3800f040 con 0x7fcd28066840 2023-11-27T18:44:23.579 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:44:23.581 INFO:teuthology.orchestra.run.smithi091.stderr:dumped all 2023-11-27T18:44:23.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:23.578+0000 7fcd4bca6640 1 -- 172.21.15.91:0/2083577007 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fcd28066840 msgr2=0x7fcd28068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:44:23.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:23.578+0000 7fcd4bca6640 1 --2- 172.21.15.91:0/2083577007 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fcd28066840 0x7fcd28068d00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fcd380113e0 tx=0x7fcd3800b040 comp rx=0 tx=0).stop 2023-11-27T18:44:23.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:23.578+0000 7fcd4bca6640 1 -- 172.21.15.91:0/2083577007 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcd44158160 msgr2=0x7fcd441535d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:44:23.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:23.578+0000 7fcd4bca6640 1 --2- 172.21.15.91:0/2083577007 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcd44158160 0x7fcd441535d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c00c410 tx=0x7fcd3c00c8d0 comp rx=0 tx=0).stop 2023-11-27T18:44:23.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:23.578+0000 7fcd4bca6640 1 -- 172.21.15.91:0/2083577007 shutdown_connections 2023-11-27T18:44:23.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:23.578+0000 7fcd4bca6640 1 --2- 172.21.15.91:0/2083577007 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fcd28066840 0x7fcd28068d00 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:44:23.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:23.578+0000 7fcd4bca6640 1 --2- 172.21.15.91:0/2083577007 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcd44158160 0x7fcd441535d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:44:23.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:23.578+0000 7fcd4bca6640 1 --2- 172.21.15.91:0/2083577007 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcd44151560 0x7fcd441e0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:44:23.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:23.578+0000 7fcd4bca6640 1 --2- 172.21.15.91:0/2083577007 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcd440c5d90 0x7fcd44152700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:44:23.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:23.578+0000 7fcd4bca6640 1 -- 172.21.15.91:0/2083577007 >> 172.21.15.91:0/2083577007 conn(0x7fcd440cbec0 msgr2=0x7fcd440cc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:44:23.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:23.578+0000 7fcd4bca6640 1 -- 172.21.15.91:0/2083577007 shutdown_connections 2023-11-27T18:44:23.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:23.578+0000 7fcd4bca6640 1 -- 172.21.15.91:0/2083577007 wait complete. 2023-11-27T18:44:23.600 INFO:teuthology.orchestra.run.smithi091.stdout:{"pg_ready":true,"pg_map":{"version":980,"stamp":"2023-11-27T18:44:21.913183+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":24697659,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":665,"num_read_kb":681,"num_write":8239,"num_write_kb":284305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9527,"ondisk_log_size":9527,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":332868,"kb_used_data":34884,"kb_used_omap":12,"kb_used_meta":297907,"kb_avail":754641852,"statfs":{"total":773094113280,"available":772753256448,"internally_reserved":0,"allocated":35721216,"data_stored":50501075,"data_compressed":4804134,"data_compressed_allocated":7446528,"data_compressed_original":23904256,"omap_allocated":12751,"internal_metadata":305057329},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005269"},"pg_stats":[{"pgid":"2.1f","version":"32'715","reported_seq":759,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:47.848041+0000","last_change":"2023-11-27T18:43:47.848187+0000","last_active":"2023-11-27T18:43:47.848041+0000","last_peered":"2023-11-27T18:43:47.848041+0000","last_clean":"2023-11-27T18:43:47.848041+0000","last_became_active":"2023-11-27T18:13:12.298140+0000","last_became_peered":"2023-11-27T18:13:12.298140+0000","last_unstale":"2023-11-27T18:43:47.848041+0000","last_undegraded":"2023-11-27T18:43:47.848041+0000","last_fullsized":"2023-11-27T18:43:47.848041+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'715","last_scrub_stamp":"2023-11-27T18:43:47.847820+0000","last_deep_scrub":"32'715","last_deep_scrub_stamp":"2023-11-27T18:43:47.847820+0000","last_clean_scrub_stamp":"2023-11-27T18:43:47.847820+0000","objects_scrubbed":3,"log_size":715,"log_dups_size":0,"ondisk_log_size":715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:50:51.204330+0000","scrub_duration":0.035779559000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":710,"num_write_kb":4473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"32'16","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:03.898613+0000","last_change":"2023-11-27T18:44:03.898662+0000","last_active":"2023-11-27T18:44:03.898613+0000","last_peered":"2023-11-27T18:44:03.898613+0000","last_clean":"2023-11-27T18:44:03.898613+0000","last_became_active":"2023-11-27T18:13:14.416401+0000","last_became_peered":"2023-11-27T18:13:14.416401+0000","last_unstale":"2023-11-27T18:44:03.898613+0000","last_undegraded":"2023-11-27T18:44:03.898613+0000","last_fullsized":"2023-11-27T18:44:03.898613+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2023-11-27T18:44:03.898433+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2023-11-27T18:44:03.898433+0000","last_clean_scrub_stamp":"2023-11-27T18:44:03.898433+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:13:43.468400+0000","scrub_duration":0.0036775810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"32'75","reported_seq":113,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:00.111787+0000","last_change":"2023-11-27T18:44:00.111845+0000","last_active":"2023-11-27T18:44:00.111787+0000","last_peered":"2023-11-27T18:44:00.111787+0000","last_clean":"2023-11-27T18:44:00.111787+0000","last_became_active":"2023-11-27T18:13:20.915358+0000","last_became_peered":"2023-11-27T18:13:20.915358+0000","last_unstale":"2023-11-27T18:44:00.111787+0000","last_undegraded":"2023-11-27T18:44:00.111787+0000","last_fullsized":"2023-11-27T18:44:00.111787+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'75","last_scrub_stamp":"2023-11-27T18:44:00.111579+0000","last_deep_scrub":"32'75","last_deep_scrub_stamp":"2023-11-27T18:44:00.111579+0000","last_clean_scrub_stamp":"2023-11-27T18:44:00.111579+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:51:00.953217+0000","scrub_duration":0.0076916110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":3642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"32'325","reported_seq":369,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:57.075955+0000","last_change":"2023-11-27T18:43:57.076012+0000","last_active":"2023-11-27T18:43:57.075955+0000","last_peered":"2023-11-27T18:43:57.075955+0000","last_clean":"2023-11-27T18:43:57.075955+0000","last_became_active":"2023-11-27T18:13:12.304981+0000","last_became_peered":"2023-11-27T18:13:12.304981+0000","last_unstale":"2023-11-27T18:43:57.075955+0000","last_undegraded":"2023-11-27T18:43:57.075955+0000","last_fullsized":"2023-11-27T18:43:57.075955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'325","last_scrub_stamp":"2023-11-27T18:43:57.075766+0000","last_deep_scrub":"32'325","last_deep_scrub_stamp":"2023-11-27T18:43:57.075766+0000","last_clean_scrub_stamp":"2023-11-27T18:43:57.075766+0000","objects_scrubbed":1,"log_size":325,"log_dups_size":0,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:30:28.504144+0000","scrub_duration":0.022777430000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3006109,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":322,"num_write_kb":3093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"32'24","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:41.204294+0000","last_change":"2023-11-27T18:43:41.204401+0000","last_active":"2023-11-27T18:43:41.204294+0000","last_peered":"2023-11-27T18:43:41.204294+0000","last_clean":"2023-11-27T18:43:41.204294+0000","last_became_active":"2023-11-27T18:13:14.365787+0000","last_became_peered":"2023-11-27T18:13:14.365787+0000","last_unstale":"2023-11-27T18:43:41.204294+0000","last_undegraded":"2023-11-27T18:43:41.204294+0000","last_fullsized":"2023-11-27T18:43:41.204294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'24","last_scrub_stamp":"2023-11-27T18:43:41.204069+0000","last_deep_scrub":"32'24","last_deep_scrub_stamp":"2023-11-27T18:43:41.204069+0000","last_clean_scrub_stamp":"2023-11-27T18:43:41.204069+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:32:19.911402+0000","scrub_duration":0.0057151110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"32'88","reported_seq":118,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:24.473240+0000","last_change":"2023-11-27T18:13:20.915811+0000","last_active":"2023-11-27T18:42:24.473240+0000","last_peered":"2023-11-27T18:42:24.473240+0000","last_clean":"2023-11-27T18:42:24.473240+0000","last_became_active":"2023-11-27T18:13:20.914864+0000","last_became_peered":"2023-11-27T18:13:20.914864+0000","last_unstale":"2023-11-27T18:42:24.473240+0000","last_undegraded":"2023-11-27T18:42:24.473240+0000","last_fullsized":"2023-11-27T18:42:24.473240+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":6140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"32'10","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:59.514855+0000","last_change":"2023-11-27T18:43:59.514974+0000","last_active":"2023-11-27T18:43:59.514855+0000","last_peered":"2023-11-27T18:43:59.514855+0000","last_clean":"2023-11-27T18:43:59.514855+0000","last_became_active":"2023-11-27T18:13:12.272343+0000","last_became_peered":"2023-11-27T18:13:12.272343+0000","last_unstale":"2023-11-27T18:43:59.514855+0000","last_undegraded":"2023-11-27T18:43:59.514855+0000","last_fullsized":"2023-11-27T18:43:59.514855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2023-11-27T18:43:59.514566+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2023-11-27T18:43:59.514566+0000","last_clean_scrub_stamp":"2023-11-27T18:43:59.514566+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:30:30.942944+0000","scrub_duration":0.0069176309999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"32'21","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:44.441251+0000","last_change":"2023-11-27T18:43:44.441307+0000","last_active":"2023-11-27T18:43:44.441251+0000","last_peered":"2023-11-27T18:43:44.441251+0000","last_clean":"2023-11-27T18:43:44.441251+0000","last_became_active":"2023-11-27T18:13:15.803248+0000","last_became_peered":"2023-11-27T18:13:15.803248+0000","last_unstale":"2023-11-27T18:43:44.441251+0000","last_undegraded":"2023-11-27T18:43:44.441251+0000","last_fullsized":"2023-11-27T18:43:44.441251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2023-11-27T18:43:44.441030+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2023-11-27T18:43:44.441030+0000","last_clean_scrub_stamp":"2023-11-27T18:43:44.441030+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:32:54.895787+0000","scrub_duration":0.0033392019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"32'82","reported_seq":120,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:03.401769+0000","last_change":"2023-11-27T18:44:03.401823+0000","last_active":"2023-11-27T18:44:03.401769+0000","last_peered":"2023-11-27T18:44:03.401769+0000","last_clean":"2023-11-27T18:44:03.401769+0000","last_became_active":"2023-11-27T18:13:20.908285+0000","last_became_peered":"2023-11-27T18:13:20.908285+0000","last_unstale":"2023-11-27T18:44:03.401769+0000","last_undegraded":"2023-11-27T18:44:03.401769+0000","last_fullsized":"2023-11-27T18:44:03.401769+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'82","last_scrub_stamp":"2023-11-27T18:44:03.401550+0000","last_deep_scrub":"32'82","last_deep_scrub_stamp":"2023-11-27T18:44:03.401550+0000","last_clean_scrub_stamp":"2023-11-27T18:44:03.401550+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:32:52.048284+0000","scrub_duration":0.0084183120000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":10516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"32'5","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:46.597260+0000","last_change":"2023-11-27T18:43:46.597376+0000","last_active":"2023-11-27T18:43:46.597260+0000","last_peered":"2023-11-27T18:43:46.597260+0000","last_clean":"2023-11-27T18:43:46.597260+0000","last_became_active":"2023-11-27T18:13:12.274275+0000","last_became_peered":"2023-11-27T18:13:12.274275+0000","last_unstale":"2023-11-27T18:43:46.597260+0000","last_undegraded":"2023-11-27T18:43:46.597260+0000","last_fullsized":"2023-11-27T18:43:46.597260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2023-11-27T18:43:46.597014+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2023-11-27T18:43:46.597014+0000","last_clean_scrub_stamp":"2023-11-27T18:43:46.597014+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:38:25.702336+0000","scrub_duration":0.0064410480000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"32'37","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.019011+0000","last_change":"2023-11-27T18:13:14.422531+0000","last_active":"2023-11-27T18:43:23.019011+0000","last_peered":"2023-11-27T18:43:23.019011+0000","last_clean":"2023-11-27T18:43:23.019011+0000","last_became_active":"2023-11-27T18:13:14.421811+0000","last_became_peered":"2023-11-27T18:13:14.421811+0000","last_unstale":"2023-11-27T18:43:23.019011+0000","last_undegraded":"2023-11-27T18:43:23.019011+0000","last_fullsized":"2023-11-27T18:43:23.019011+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"32'74","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:12.502342+0000","last_change":"2023-11-27T18:44:12.502402+0000","last_active":"2023-11-27T18:44:12.502342+0000","last_peered":"2023-11-27T18:44:12.502342+0000","last_clean":"2023-11-27T18:44:12.502342+0000","last_became_active":"2023-11-27T18:13:20.906418+0000","last_became_peered":"2023-11-27T18:13:20.906418+0000","last_unstale":"2023-11-27T18:44:12.502342+0000","last_undegraded":"2023-11-27T18:44:12.502342+0000","last_fullsized":"2023-11-27T18:44:12.502342+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'74","last_scrub_stamp":"2023-11-27T18:44:12.502149+0000","last_deep_scrub":"32'74","last_deep_scrub_stamp":"2023-11-27T18:44:12.502149+0000","last_clean_scrub_stamp":"2023-11-27T18:44:12.502149+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:48:55.390213+0000","scrub_duration":0.0089182870000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":5836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"32'20","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:59.211521+0000","last_change":"2023-11-27T18:43:59.211572+0000","last_active":"2023-11-27T18:43:59.211521+0000","last_peered":"2023-11-27T18:43:59.211521+0000","last_clean":"2023-11-27T18:43:59.211521+0000","last_became_active":"2023-11-27T18:13:14.418640+0000","last_became_peered":"2023-11-27T18:13:14.418640+0000","last_unstale":"2023-11-27T18:43:59.211521+0000","last_undegraded":"2023-11-27T18:43:59.211521+0000","last_fullsized":"2023-11-27T18:43:59.211521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2023-11-27T18:43:59.211339+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2023-11-27T18:43:59.211339+0000","last_clean_scrub_stamp":"2023-11-27T18:43:59.211339+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:15:35.201396+0000","scrub_duration":0.0038460930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"32'688","reported_seq":723,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:06.998077+0000","last_change":"2023-11-27T18:13:12.306690+0000","last_active":"2023-11-27T18:43:06.998077+0000","last_peered":"2023-11-27T18:43:06.998077+0000","last_clean":"2023-11-27T18:43:06.998077+0000","last_became_active":"2023-11-27T18:13:12.306331+0000","last_became_peered":"2023-11-27T18:13:12.306331+0000","last_unstale":"2023-11-27T18:43:06.998077+0000","last_undegraded":"2023-11-27T18:43:06.998077+0000","last_fullsized":"2023-11-27T18:43:06.998077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":683,"num_write_kb":4455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'77","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:34.087162+0000","last_change":"2023-11-27T18:14:22.718298+0000","last_active":"2023-11-27T18:43:34.087162+0000","last_peered":"2023-11-27T18:43:34.087162+0000","last_clean":"2023-11-27T18:43:34.087162+0000","last_became_active":"2023-11-27T18:14:22.717105+0000","last_became_peered":"2023-11-27T18:14:22.717105+0000","last_unstale":"2023-11-27T18:43:34.087162+0000","last_undegraded":"2023-11-27T18:43:34.087162+0000","last_fullsized":"2023-11-27T18:43:34.087162+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":10073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7,5],"acting":[0,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"32'22","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:51.107667+0000","last_change":"2023-11-27T18:43:51.107717+0000","last_active":"2023-11-27T18:43:51.107667+0000","last_peered":"2023-11-27T18:43:51.107667+0000","last_clean":"2023-11-27T18:43:51.107667+0000","last_became_active":"2023-11-27T18:13:14.368117+0000","last_became_peered":"2023-11-27T18:13:14.368117+0000","last_unstale":"2023-11-27T18:43:51.107667+0000","last_undegraded":"2023-11-27T18:43:51.107667+0000","last_fullsized":"2023-11-27T18:43:51.107667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2023-11-27T18:43:51.107469+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2023-11-27T18:43:51.107469+0000","last_clean_scrub_stamp":"2023-11-27T18:43:51.107469+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:57:21.965939+0000","scrub_duration":0.0058469949999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"32'2","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:49.531217+0000","last_change":"2023-11-27T18:43:49.531318+0000","last_active":"2023-11-27T18:43:49.531217+0000","last_peered":"2023-11-27T18:43:49.531217+0000","last_clean":"2023-11-27T18:43:49.531217+0000","last_became_active":"2023-11-27T18:13:12.306644+0000","last_became_peered":"2023-11-27T18:13:12.306644+0000","last_unstale":"2023-11-27T18:43:49.531217+0000","last_undegraded":"2023-11-27T18:43:49.531217+0000","last_fullsized":"2023-11-27T18:43:49.531217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2023-11-27T18:43:49.530967+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2023-11-27T18:43:49.530967+0000","last_clean_scrub_stamp":"2023-11-27T18:43:49.530967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:08:46.212891+0000","scrub_duration":0.003406638,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"32'100","reported_seq":131,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:39.210348+0000","last_change":"2023-11-27T18:13:20.930173+0000","last_active":"2023-11-27T18:42:39.210348+0000","last_peered":"2023-11-27T18:42:39.210348+0000","last_clean":"2023-11-27T18:42:39.210348+0000","last_became_active":"2023-11-27T18:13:20.928830+0000","last_became_peered":"2023-11-27T18:13:20.928830+0000","last_unstale":"2023-11-27T18:42:39.210348+0000","last_undegraded":"2023-11-27T18:42:39.210348+0000","last_fullsized":"2023-11-27T18:42:39.210348+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":7369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"32'24","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:52.943762+0000","last_change":"2023-11-27T18:43:52.943813+0000","last_active":"2023-11-27T18:43:52.943762+0000","last_peered":"2023-11-27T18:43:52.943762+0000","last_clean":"2023-11-27T18:43:52.943762+0000","last_became_active":"2023-11-27T18:13:14.378391+0000","last_became_peered":"2023-11-27T18:13:14.378391+0000","last_unstale":"2023-11-27T18:43:52.943762+0000","last_undegraded":"2023-11-27T18:43:52.943762+0000","last_fullsized":"2023-11-27T18:43:52.943762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'24","last_scrub_stamp":"2023-11-27T18:43:52.943561+0000","last_deep_scrub":"32'24","last_deep_scrub_stamp":"2023-11-27T18:43:52.943561+0000","last_clean_scrub_stamp":"2023-11-27T18:43:52.943561+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:36:18.307587+0000","scrub_duration":0.003991362,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"32'4","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:45.824544+0000","last_change":"2023-11-27T18:43:45.824599+0000","last_active":"2023-11-27T18:43:45.824544+0000","last_peered":"2023-11-27T18:43:45.824544+0000","last_clean":"2023-11-27T18:43:45.824544+0000","last_became_active":"2023-11-27T18:13:12.269795+0000","last_became_peered":"2023-11-27T18:13:12.269795+0000","last_unstale":"2023-11-27T18:43:45.824544+0000","last_undegraded":"2023-11-27T18:43:45.824544+0000","last_fullsized":"2023-11-27T18:43:45.824544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2023-11-27T18:43:45.824352+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2023-11-27T18:43:45.824352+0000","last_clean_scrub_stamp":"2023-11-27T18:43:45.824352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:21:33.244186+0000","scrub_duration":0.0037706549999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'67","reported_seq":106,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:01.092727+0000","last_change":"2023-11-27T18:44:01.092826+0000","last_active":"2023-11-27T18:44:01.092727+0000","last_peered":"2023-11-27T18:44:01.092727+0000","last_clean":"2023-11-27T18:44:01.092727+0000","last_became_active":"2023-11-27T18:13:20.906609+0000","last_became_peered":"2023-11-27T18:13:20.906609+0000","last_unstale":"2023-11-27T18:44:01.092727+0000","last_undegraded":"2023-11-27T18:44:01.092727+0000","last_fullsized":"2023-11-27T18:44:01.092727+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'67","last_scrub_stamp":"2023-11-27T18:44:01.092415+0000","last_deep_scrub":"32'67","last_deep_scrub_stamp":"2023-11-27T18:44:01.092415+0000","last_clean_scrub_stamp":"2023-11-27T18:44:01.092415+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:12:10.051315+0000","scrub_duration":0.0085197999999999992,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":7315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"32'21","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:43.136981+0000","last_change":"2023-11-27T18:43:43.137113+0000","last_active":"2023-11-27T18:43:43.136981+0000","last_peered":"2023-11-27T18:43:43.136981+0000","last_clean":"2023-11-27T18:43:43.136981+0000","last_became_active":"2023-11-27T18:13:14.414888+0000","last_became_peered":"2023-11-27T18:13:14.414888+0000","last_unstale":"2023-11-27T18:43:43.136981+0000","last_undegraded":"2023-11-27T18:43:43.136981+0000","last_fullsized":"2023-11-27T18:43:43.136981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2023-11-27T18:43:43.136763+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2023-11-27T18:43:43.136763+0000","last_clean_scrub_stamp":"2023-11-27T18:43:43.136763+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:48:26.024827+0000","scrub_duration":0.003973931,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"32'5","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:43.558828+0000","last_change":"2023-11-27T18:43:43.558883+0000","last_active":"2023-11-27T18:43:43.558828+0000","last_peered":"2023-11-27T18:43:43.558828+0000","last_clean":"2023-11-27T18:43:43.558828+0000","last_became_active":"2023-11-27T18:13:12.273356+0000","last_became_peered":"2023-11-27T18:13:12.273356+0000","last_unstale":"2023-11-27T18:43:43.558828+0000","last_undegraded":"2023-11-27T18:43:43.558828+0000","last_fullsized":"2023-11-27T18:43:43.558828+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2023-11-27T18:43:43.558640+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2023-11-27T18:43:43.558640+0000","last_clean_scrub_stamp":"2023-11-27T18:43:43.558640+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:49:12.209206+0000","scrub_duration":0.0032465200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'85","reported_seq":124,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:15.565374+0000","last_change":"2023-11-27T18:44:15.565429+0000","last_active":"2023-11-27T18:44:15.565374+0000","last_peered":"2023-11-27T18:44:15.565374+0000","last_clean":"2023-11-27T18:44:15.565374+0000","last_became_active":"2023-11-27T18:13:20.934797+0000","last_became_peered":"2023-11-27T18:13:20.934797+0000","last_unstale":"2023-11-27T18:44:15.565374+0000","last_undegraded":"2023-11-27T18:44:15.565374+0000","last_fullsized":"2023-11-27T18:44:15.565374+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'85","last_scrub_stamp":"2023-11-27T18:44:15.565164+0000","last_deep_scrub":"32'85","last_deep_scrub_stamp":"2023-11-27T18:44:15.565164+0000","last_clean_scrub_stamp":"2023-11-27T18:44:15.565164+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:13:55.135131+0000","scrub_duration":0.010705322999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":5270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'29","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:57.924916+0000","last_change":"2023-11-27T18:43:57.925019+0000","last_active":"2023-11-27T18:43:57.924916+0000","last_peered":"2023-11-27T18:43:57.924916+0000","last_clean":"2023-11-27T18:43:57.924916+0000","last_became_active":"2023-11-27T18:13:14.376304+0000","last_became_peered":"2023-11-27T18:13:14.376304+0000","last_unstale":"2023-11-27T18:43:57.924916+0000","last_undegraded":"2023-11-27T18:43:57.924916+0000","last_fullsized":"2023-11-27T18:43:57.924916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'29","last_scrub_stamp":"2023-11-27T18:43:57.924629+0000","last_deep_scrub":"32'29","last_deep_scrub_stamp":"2023-11-27T18:43:57.924629+0000","last_clean_scrub_stamp":"2023-11-27T18:43:57.924629+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:29:06.838395+0000","scrub_duration":0.0035453020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"32'7","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:34.397301+0000","last_change":"2023-11-27T18:13:12.307806+0000","last_active":"2023-11-27T18:43:34.397301+0000","last_peered":"2023-11-27T18:43:34.397301+0000","last_clean":"2023-11-27T18:43:34.397301+0000","last_became_active":"2023-11-27T18:13:12.307492+0000","last_became_peered":"2023-11-27T18:13:12.307492+0000","last_unstale":"2023-11-27T18:43:34.397301+0000","last_undegraded":"2023-11-27T18:43:34.397301+0000","last_fullsized":"2023-11-27T18:43:34.397301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"32'53","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:02.443425+0000","last_change":"2023-11-27T18:44:02.443464+0000","last_active":"2023-11-27T18:44:02.443425+0000","last_peered":"2023-11-27T18:44:02.443425+0000","last_clean":"2023-11-27T18:44:02.443425+0000","last_became_active":"2023-11-27T18:13:20.917507+0000","last_became_peered":"2023-11-27T18:13:20.917507+0000","last_unstale":"2023-11-27T18:44:02.443425+0000","last_undegraded":"2023-11-27T18:44:02.443425+0000","last_fullsized":"2023-11-27T18:44:02.443425+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'53","last_scrub_stamp":"2023-11-27T18:44:02.443300+0000","last_deep_scrub":"32'53","last_deep_scrub_stamp":"2023-11-27T18:44:02.443300+0000","last_clean_scrub_stamp":"2023-11-27T18:44:02.443300+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:40:43.676662+0000","scrub_duration":0.0080949999999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":7028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"32'21","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:49.863843+0000","last_change":"2023-11-27T18:43:49.863898+0000","last_active":"2023-11-27T18:43:49.863843+0000","last_peered":"2023-11-27T18:43:49.863843+0000","last_clean":"2023-11-27T18:43:49.863843+0000","last_became_active":"2023-11-27T18:13:14.377289+0000","last_became_peered":"2023-11-27T18:13:14.377289+0000","last_unstale":"2023-11-27T18:43:49.863843+0000","last_undegraded":"2023-11-27T18:43:49.863843+0000","last_fullsized":"2023-11-27T18:43:49.863843+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2023-11-27T18:43:49.863644+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2023-11-27T18:43:49.863644+0000","last_clean_scrub_stamp":"2023-11-27T18:43:49.863644+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:01:22.274023+0000","scrub_duration":0.0055625429999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"32'327","reported_seq":371,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:40.843422+0000","last_change":"2023-11-27T18:43:40.843448+0000","last_active":"2023-11-27T18:43:40.843422+0000","last_peered":"2023-11-27T18:43:40.843422+0000","last_clean":"2023-11-27T18:43:40.843422+0000","last_became_active":"2023-11-27T18:13:12.267552+0000","last_became_peered":"2023-11-27T18:13:12.267552+0000","last_unstale":"2023-11-27T18:43:40.843422+0000","last_undegraded":"2023-11-27T18:43:40.843422+0000","last_fullsized":"2023-11-27T18:43:40.843422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'327","last_scrub_stamp":"2023-11-27T18:43:40.843323+0000","last_deep_scrub":"32'327","last_deep_scrub_stamp":"2023-11-27T18:43:40.843323+0000","last_clean_scrub_stamp":"2023-11-27T18:43:40.843323+0000","objects_scrubbed":1,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:56:06.018967+0000","scrub_duration":0.013467106,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"32'94","reported_seq":127,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:32.659768+0000","last_change":"2023-11-27T18:13:20.929780+0000","last_active":"2023-11-27T18:43:32.659768+0000","last_peered":"2023-11-27T18:43:32.659768+0000","last_clean":"2023-11-27T18:43:32.659768+0000","last_became_active":"2023-11-27T18:13:20.929370+0000","last_became_peered":"2023-11-27T18:13:20.929370+0000","last_unstale":"2023-11-27T18:43:32.659768+0000","last_undegraded":"2023-11-27T18:43:32.659768+0000","last_fullsized":"2023-11-27T18:43:32.659768+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":11915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"32'22","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:01.454919+0000","last_change":"2023-11-27T18:44:01.454972+0000","last_active":"2023-11-27T18:44:01.454919+0000","last_peered":"2023-11-27T18:44:01.454919+0000","last_clean":"2023-11-27T18:44:01.454919+0000","last_became_active":"2023-11-27T18:13:14.369472+0000","last_became_peered":"2023-11-27T18:13:14.369472+0000","last_unstale":"2023-11-27T18:44:01.454919+0000","last_undegraded":"2023-11-27T18:44:01.454919+0000","last_fullsized":"2023-11-27T18:44:01.454919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2023-11-27T18:44:01.454715+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2023-11-27T18:44:01.454715+0000","last_clean_scrub_stamp":"2023-11-27T18:44:01.454715+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:38:40.560038+0000","scrub_duration":0.0038928529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:03.762957+0000","last_change":"2023-11-27T18:13:12.310761+0000","last_active":"2023-11-27T18:43:03.762957+0000","last_peered":"2023-11-27T18:43:03.762957+0000","last_clean":"2023-11-27T18:43:03.762957+0000","last_became_active":"2023-11-27T18:13:12.310495+0000","last_became_peered":"2023-11-27T18:13:12.310495+0000","last_unstale":"2023-11-27T18:43:03.762957+0000","last_undegraded":"2023-11-27T18:43:03.762957+0000","last_fullsized":"2023-11-27T18:43:03.762957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"32'62","reported_seq":94,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:34.230933+0000","last_change":"2023-11-27T18:13:20.907638+0000","last_active":"2023-11-27T18:42:34.230933+0000","last_peered":"2023-11-27T18:42:34.230933+0000","last_clean":"2023-11-27T18:42:34.230933+0000","last_became_active":"2023-11-27T18:13:20.907229+0000","last_became_peered":"2023-11-27T18:13:20.907229+0000","last_unstale":"2023-11-27T18:42:34.230933+0000","last_undegraded":"2023-11-27T18:42:34.230933+0000","last_fullsized":"2023-11-27T18:42:34.230933+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":7408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"32'20","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:49.434941+0000","last_change":"2023-11-27T18:43:49.434991+0000","last_active":"2023-11-27T18:43:49.434941+0000","last_peered":"2023-11-27T18:43:49.434941+0000","last_clean":"2023-11-27T18:43:49.434941+0000","last_became_active":"2023-11-27T18:13:15.850263+0000","last_became_peered":"2023-11-27T18:13:15.850263+0000","last_unstale":"2023-11-27T18:43:49.434941+0000","last_undegraded":"2023-11-27T18:43:49.434941+0000","last_fullsized":"2023-11-27T18:43:49.434941+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2023-11-27T18:43:49.434748+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2023-11-27T18:43:49.434748+0000","last_clean_scrub_stamp":"2023-11-27T18:43:49.434748+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:46:15.277193+0000","scrub_duration":0.004346305,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:54.064395+0000","last_change":"2023-11-27T18:43:54.064497+0000","last_active":"2023-11-27T18:43:54.064395+0000","last_peered":"2023-11-27T18:43:54.064395+0000","last_clean":"2023-11-27T18:43:54.064395+0000","last_became_active":"2023-11-27T18:13:12.310138+0000","last_became_peered":"2023-11-27T18:13:12.310138+0000","last_unstale":"2023-11-27T18:43:54.064395+0000","last_undegraded":"2023-11-27T18:43:54.064395+0000","last_fullsized":"2023-11-27T18:43:54.064395+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2023-11-27T18:43:54.064090+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2023-11-27T18:43:54.064090+0000","last_clean_scrub_stamp":"2023-11-27T18:43:54.064090+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:32:42.710824+0000","scrub_duration":0.0045180919999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"32'81","reported_seq":113,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:34.230777+0000","last_change":"2023-11-27T18:13:20.896960+0000","last_active":"2023-11-27T18:42:34.230777+0000","last_peered":"2023-11-27T18:42:34.230777+0000","last_clean":"2023-11-27T18:42:34.230777+0000","last_became_active":"2023-11-27T18:13:20.896156+0000","last_became_peered":"2023-11-27T18:13:20.896156+0000","last_unstale":"2023-11-27T18:42:34.230777+0000","last_undegraded":"2023-11-27T18:42:34.230777+0000","last_fullsized":"2023-11-27T18:42:34.230777+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":6173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"32'22","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:41.582044+0000","last_change":"2023-11-27T18:43:41.582072+0000","last_active":"2023-11-27T18:43:41.582044+0000","last_peered":"2023-11-27T18:43:41.582044+0000","last_clean":"2023-11-27T18:43:41.582044+0000","last_became_active":"2023-11-27T18:13:14.421125+0000","last_became_peered":"2023-11-27T18:13:14.421125+0000","last_unstale":"2023-11-27T18:43:41.582044+0000","last_undegraded":"2023-11-27T18:43:41.582044+0000","last_fullsized":"2023-11-27T18:43:41.582044+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2023-11-27T18:43:41.581900+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2023-11-27T18:43:41.581900+0000","last_clean_scrub_stamp":"2023-11-27T18:43:41.581900+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:46:07.424345+0000","scrub_duration":0.0018251680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"32'5","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:16.048552+0000","last_change":"2023-11-27T18:44:16.048664+0000","last_active":"2023-11-27T18:44:16.048552+0000","last_peered":"2023-11-27T18:44:16.048552+0000","last_clean":"2023-11-27T18:44:16.048552+0000","last_became_active":"2023-11-27T18:13:12.301617+0000","last_became_peered":"2023-11-27T18:13:12.301617+0000","last_unstale":"2023-11-27T18:44:16.048552+0000","last_undegraded":"2023-11-27T18:44:16.048552+0000","last_fullsized":"2023-11-27T18:44:16.048552+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2023-11-27T18:44:16.048306+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2023-11-27T18:44:16.048306+0000","last_clean_scrub_stamp":"2023-11-27T18:44:16.048306+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:54:42.145821+0000","scrub_duration":0.0043585409999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'68","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:34.231054+0000","last_change":"2023-11-27T18:13:20.905013+0000","last_active":"2023-11-27T18:42:34.231054+0000","last_peered":"2023-11-27T18:42:34.231054+0000","last_clean":"2023-11-27T18:42:34.231054+0000","last_became_active":"2023-11-27T18:13:20.903019+0000","last_became_peered":"2023-11-27T18:13:20.903019+0000","last_unstale":"2023-11-27T18:42:34.231054+0000","last_undegraded":"2023-11-27T18:42:34.231054+0000","last_fullsized":"2023-11-27T18:42:34.231054+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":4275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"32'26","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:15.846601+0000","last_change":"2023-11-27T18:44:15.846651+0000","last_active":"2023-11-27T18:44:15.846601+0000","last_peered":"2023-11-27T18:44:15.846601+0000","last_clean":"2023-11-27T18:44:15.846601+0000","last_became_active":"2023-11-27T18:13:14.378644+0000","last_became_peered":"2023-11-27T18:13:14.378644+0000","last_unstale":"2023-11-27T18:44:15.846601+0000","last_undegraded":"2023-11-27T18:44:15.846601+0000","last_fullsized":"2023-11-27T18:44:15.846601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'26","last_scrub_stamp":"2023-11-27T18:44:15.846395+0000","last_deep_scrub":"32'26","last_deep_scrub_stamp":"2023-11-27T18:44:15.846395+0000","last_clean_scrub_stamp":"2023-11-27T18:44:15.846395+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:16:14.706577+0000","scrub_duration":0.0035380469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"32'556","reported_seq":1149,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:44.099692+0000","last_change":"2023-11-27T18:43:44.099800+0000","last_active":"2023-11-27T18:43:44.099692+0000","last_peered":"2023-11-27T18:43:44.099692+0000","last_clean":"2023-11-27T18:43:44.099692+0000","last_became_active":"2023-11-27T18:13:12.305380+0000","last_became_peered":"2023-11-27T18:13:12.305380+0000","last_unstale":"2023-11-27T18:43:44.099692+0000","last_undegraded":"2023-11-27T18:43:44.099692+0000","last_fullsized":"2023-11-27T18:43:44.099692+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'556","last_scrub_stamp":"2023-11-27T18:43:44.099467+0000","last_deep_scrub":"32'556","last_deep_scrub_stamp":"2023-11-27T18:43:44.099467+0000","last_clean_scrub_stamp":"2023-11-27T18:43:44.099467+0000","objects_scrubbed":1,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:29:30.687440+0000","scrub_duration":0.0048880249999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128192,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":549,"num_read_kb":581,"num_write":552,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"32'76","reported_seq":108,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:40.367654+0000","last_change":"2023-11-27T18:13:20.913672+0000","last_active":"2023-11-27T18:43:40.367654+0000","last_peered":"2023-11-27T18:43:40.367654+0000","last_clean":"2023-11-27T18:43:40.367654+0000","last_became_active":"2023-11-27T18:13:20.913137+0000","last_became_peered":"2023-11-27T18:13:20.913137+0000","last_unstale":"2023-11-27T18:43:40.367654+0000","last_undegraded":"2023-11-27T18:43:40.367654+0000","last_fullsized":"2023-11-27T18:43:40.367654+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":7407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"32'15","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:58.444576+0000","last_change":"2023-11-27T18:43:58.444628+0000","last_active":"2023-11-27T18:43:58.444576+0000","last_peered":"2023-11-27T18:43:58.444576+0000","last_clean":"2023-11-27T18:43:58.444576+0000","last_became_active":"2023-11-27T18:13:14.413413+0000","last_became_peered":"2023-11-27T18:13:14.413413+0000","last_unstale":"2023-11-27T18:43:58.444576+0000","last_undegraded":"2023-11-27T18:43:58.444576+0000","last_fullsized":"2023-11-27T18:43:58.444576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2023-11-27T18:43:58.444377+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2023-11-27T18:43:58.444377+0000","last_clean_scrub_stamp":"2023-11-27T18:43:58.444377+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:46:24.286822+0000","scrub_duration":0.003852397,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:10.127443+0000","last_change":"2023-11-27T18:44:10.127545+0000","last_active":"2023-11-27T18:44:10.127443+0000","last_peered":"2023-11-27T18:44:10.127443+0000","last_clean":"2023-11-27T18:44:10.127443+0000","last_became_active":"2023-11-27T18:13:12.315610+0000","last_became_peered":"2023-11-27T18:13:12.315610+0000","last_unstale":"2023-11-27T18:44:10.127443+0000","last_undegraded":"2023-11-27T18:44:10.127443+0000","last_fullsized":"2023-11-27T18:44:10.127443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2023-11-27T18:44:10.127224+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2023-11-27T18:44:10.127224+0000","last_clean_scrub_stamp":"2023-11-27T18:44:10.127224+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:50:06.266659+0000","scrub_duration":0.0045927720000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"32'85","reported_seq":117,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:39.204246+0000","last_change":"2023-11-27T18:13:20.912891+0000","last_active":"2023-11-27T18:43:39.204246+0000","last_peered":"2023-11-27T18:43:39.204246+0000","last_clean":"2023-11-27T18:43:39.204246+0000","last_became_active":"2023-11-27T18:13:20.912453+0000","last_became_peered":"2023-11-27T18:13:20.912453+0000","last_unstale":"2023-11-27T18:43:39.204246+0000","last_undegraded":"2023-11-27T18:43:39.204246+0000","last_fullsized":"2023-11-27T18:43:39.204246+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":10738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"32'21","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:38.774297+0000","last_change":"2023-11-27T18:43:38.774348+0000","last_active":"2023-11-27T18:43:38.774297+0000","last_peered":"2023-11-27T18:43:38.774297+0000","last_clean":"2023-11-27T18:43:38.774297+0000","last_became_active":"2023-11-27T18:13:14.414156+0000","last_became_peered":"2023-11-27T18:13:14.414156+0000","last_unstale":"2023-11-27T18:43:38.774297+0000","last_undegraded":"2023-11-27T18:43:38.774297+0000","last_fullsized":"2023-11-27T18:43:38.774297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2023-11-27T18:43:38.774109+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2023-11-27T18:43:38.774109+0000","last_clean_scrub_stamp":"2023-11-27T18:43:38.774109+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:37:26.401993+0000","scrub_duration":0.003067443,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"32'3","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:12.259812+0000","last_change":"2023-11-27T18:13:12.308337+0000","last_active":"2023-11-27T18:43:12.259812+0000","last_peered":"2023-11-27T18:43:12.259812+0000","last_clean":"2023-11-27T18:43:12.259812+0000","last_became_active":"2023-11-27T18:13:12.308050+0000","last_became_peered":"2023-11-27T18:13:12.308050+0000","last_unstale":"2023-11-27T18:43:12.259812+0000","last_undegraded":"2023-11-27T18:43:12.259812+0000","last_fullsized":"2023-11-27T18:43:12.259812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:10.491982+0000","last_clean_scrub_stamp":"2023-11-27T18:13:10.491982+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"32'119","reported_seq":198,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:35.406912+0000","last_change":"2023-11-27T18:43:35.406964+0000","last_active":"2023-11-27T18:43:35.406912+0000","last_peered":"2023-11-27T18:43:35.406912+0000","last_clean":"2023-11-27T18:43:35.406912+0000","last_became_active":"2023-11-27T18:12:38.370748+0000","last_became_peered":"2023-11-27T18:12:38.370748+0000","last_unstale":"2023-11-27T18:43:35.406912+0000","last_undegraded":"2023-11-27T18:43:35.406912+0000","last_fullsized":"2023-11-27T18:43:35.406912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2023-11-27T18:43:35.406767+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2023-11-27T18:43:35.406767+0000","last_clean_scrub_stamp":"2023-11-27T18:43:35.406767+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:03:00.314752+0000","scrub_duration":0.010946301,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'86","reported_seq":118,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:44.384201+0000","last_change":"2023-11-27T18:13:20.928359+0000","last_active":"2023-11-27T18:42:44.384201+0000","last_peered":"2023-11-27T18:42:44.384201+0000","last_clean":"2023-11-27T18:42:44.384201+0000","last_became_active":"2023-11-27T18:13:20.926559+0000","last_became_peered":"2023-11-27T18:13:20.926559+0000","last_unstale":"2023-11-27T18:42:44.384201+0000","last_undegraded":"2023-11-27T18:42:44.384201+0000","last_fullsized":"2023-11-27T18:42:44.384201+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":7930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"32'24","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.024334+0000","last_change":"2023-11-27T18:13:14.422275+0000","last_active":"2023-11-27T18:43:23.024334+0000","last_peered":"2023-11-27T18:43:23.024334+0000","last_clean":"2023-11-27T18:43:23.024334+0000","last_became_active":"2023-11-27T18:13:14.419636+0000","last_became_peered":"2023-11-27T18:13:14.419636+0000","last_unstale":"2023-11-27T18:43:23.024334+0000","last_undegraded":"2023-11-27T18:43:23.024334+0000","last_fullsized":"2023-11-27T18:43:23.024334+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"32'2","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:43.374000+0000","last_change":"2023-11-27T18:43:43.374050+0000","last_active":"2023-11-27T18:43:43.374000+0000","last_peered":"2023-11-27T18:43:43.374000+0000","last_clean":"2023-11-27T18:43:43.374000+0000","last_became_active":"2023-11-27T18:13:12.267764+0000","last_became_peered":"2023-11-27T18:13:12.267764+0000","last_unstale":"2023-11-27T18:43:43.374000+0000","last_undegraded":"2023-11-27T18:43:43.374000+0000","last_fullsized":"2023-11-27T18:43:43.374000+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2023-11-27T18:43:43.373801+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2023-11-27T18:43:43.373801+0000","last_clean_scrub_stamp":"2023-11-27T18:43:43.373801+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:57:29.602489+0000","scrub_duration":0.0042106540000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"32'73","reported_seq":113,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:04.359448+0000","last_change":"2023-11-27T18:44:04.359503+0000","last_active":"2023-11-27T18:44:04.359448+0000","last_peered":"2023-11-27T18:44:04.359448+0000","last_clean":"2023-11-27T18:44:04.359448+0000","last_became_active":"2023-11-27T18:13:20.914157+0000","last_became_peered":"2023-11-27T18:13:20.914157+0000","last_unstale":"2023-11-27T18:44:04.359448+0000","last_undegraded":"2023-11-27T18:44:04.359448+0000","last_fullsized":"2023-11-27T18:44:04.359448+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'73","last_scrub_stamp":"2023-11-27T18:44:04.359245+0000","last_deep_scrub":"32'73","last_deep_scrub_stamp":"2023-11-27T18:44:04.359245+0000","last_clean_scrub_stamp":"2023-11-27T18:44:04.359245+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:30:35.787623+0000","scrub_duration":0.0096271519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":5275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'24","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:04.449331+0000","last_change":"2023-11-27T18:44:04.449383+0000","last_active":"2023-11-27T18:44:04.449331+0000","last_peered":"2023-11-27T18:44:04.449331+0000","last_clean":"2023-11-27T18:44:04.449331+0000","last_became_active":"2023-11-27T18:13:14.363285+0000","last_became_peered":"2023-11-27T18:13:14.363285+0000","last_unstale":"2023-11-27T18:44:04.449331+0000","last_undegraded":"2023-11-27T18:44:04.449331+0000","last_fullsized":"2023-11-27T18:44:04.449331+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'24","last_scrub_stamp":"2023-11-27T18:44:04.449134+0000","last_deep_scrub":"32'24","last_deep_scrub_stamp":"2023-11-27T18:44:04.449134+0000","last_clean_scrub_stamp":"2023-11-27T18:44:04.449134+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:31:02.404937+0000","scrub_duration":0.0036982669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:59.020721+0000","last_change":"2023-11-27T18:43:59.020774+0000","last_active":"2023-11-27T18:43:59.020721+0000","last_peered":"2023-11-27T18:43:59.020721+0000","last_clean":"2023-11-27T18:43:59.020721+0000","last_became_active":"2023-11-27T18:13:12.312038+0000","last_became_peered":"2023-11-27T18:13:12.312038+0000","last_unstale":"2023-11-27T18:43:59.020721+0000","last_undegraded":"2023-11-27T18:43:59.020721+0000","last_fullsized":"2023-11-27T18:43:59.020721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2023-11-27T18:43:59.020532+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2023-11-27T18:43:59.020532+0000","last_clean_scrub_stamp":"2023-11-27T18:43:59.020532+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:11:10.104848+0000","scrub_duration":0.007309444,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"32'90","reported_seq":129,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:18.938151+0000","last_change":"2023-11-27T18:44:18.938261+0000","last_active":"2023-11-27T18:44:18.938151+0000","last_peered":"2023-11-27T18:44:18.938151+0000","last_clean":"2023-11-27T18:44:18.938151+0000","last_became_active":"2023-11-27T18:13:20.912734+0000","last_became_peered":"2023-11-27T18:13:20.912734+0000","last_unstale":"2023-11-27T18:44:18.938151+0000","last_undegraded":"2023-11-27T18:44:18.938151+0000","last_fullsized":"2023-11-27T18:44:18.938151+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'90","last_scrub_stamp":"2023-11-27T18:44:18.937834+0000","last_deep_scrub":"32'90","last_deep_scrub_stamp":"2023-11-27T18:44:18.937834+0000","last_clean_scrub_stamp":"2023-11-27T18:44:18.937834+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:36:32.564575+0000","scrub_duration":0.010434255,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":13642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"32'25","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.094908+0000","last_change":"2023-11-27T18:13:14.364027+0000","last_active":"2023-11-27T18:43:23.094908+0000","last_peered":"2023-11-27T18:43:23.094908+0000","last_clean":"2023-11-27T18:43:23.094908+0000","last_became_active":"2023-11-27T18:13:14.363772+0000","last_became_peered":"2023-11-27T18:13:14.363772+0000","last_unstale":"2023-11-27T18:43:23.094908+0000","last_undegraded":"2023-11-27T18:43:23.094908+0000","last_fullsized":"2023-11-27T18:43:23.094908+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"32'5","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:44.804789+0000","last_change":"2023-11-27T18:43:44.804824+0000","last_active":"2023-11-27T18:43:44.804789+0000","last_peered":"2023-11-27T18:43:44.804789+0000","last_clean":"2023-11-27T18:43:44.804789+0000","last_became_active":"2023-11-27T18:13:12.304400+0000","last_became_peered":"2023-11-27T18:13:12.304400+0000","last_unstale":"2023-11-27T18:43:44.804789+0000","last_undegraded":"2023-11-27T18:43:44.804789+0000","last_fullsized":"2023-11-27T18:43:44.804789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2023-11-27T18:43:44.804676+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2023-11-27T18:43:44.804676+0000","last_clean_scrub_stamp":"2023-11-27T18:43:44.804676+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:34:25.156520+0000","scrub_duration":0.005907214,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"32'60","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:36.903818+0000","last_change":"2023-11-27T18:13:20.922959+0000","last_active":"2023-11-27T18:43:36.903818+0000","last_peered":"2023-11-27T18:43:36.903818+0000","last_clean":"2023-11-27T18:43:36.903818+0000","last_became_active":"2023-11-27T18:13:20.918984+0000","last_became_peered":"2023-11-27T18:13:20.918984+0000","last_unstale":"2023-11-27T18:43:36.903818+0000","last_undegraded":"2023-11-27T18:43:36.903818+0000","last_fullsized":"2023-11-27T18:43:36.903818+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":5801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"32'17","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:00.411633+0000","last_change":"2023-11-27T18:44:00.411686+0000","last_active":"2023-11-27T18:44:00.411633+0000","last_peered":"2023-11-27T18:44:00.411633+0000","last_clean":"2023-11-27T18:44:00.411633+0000","last_became_active":"2023-11-27T18:13:15.852339+0000","last_became_peered":"2023-11-27T18:13:15.852339+0000","last_unstale":"2023-11-27T18:44:00.411633+0000","last_undegraded":"2023-11-27T18:44:00.411633+0000","last_fullsized":"2023-11-27T18:44:00.411633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'17","last_scrub_stamp":"2023-11-27T18:44:00.411434+0000","last_deep_scrub":"32'17","last_deep_scrub_stamp":"2023-11-27T18:44:00.411434+0000","last_clean_scrub_stamp":"2023-11-27T18:44:00.411434+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:55:07.805364+0000","scrub_duration":0.0033991469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"32'8","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:53.554964+0000","last_change":"2023-11-27T18:43:53.555022+0000","last_active":"2023-11-27T18:43:53.554964+0000","last_peered":"2023-11-27T18:43:53.554964+0000","last_clean":"2023-11-27T18:43:53.554964+0000","last_became_active":"2023-11-27T18:13:12.310921+0000","last_became_peered":"2023-11-27T18:13:12.310921+0000","last_unstale":"2023-11-27T18:43:53.554964+0000","last_undegraded":"2023-11-27T18:43:53.554964+0000","last_fullsized":"2023-11-27T18:43:53.554964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2023-11-27T18:43:53.554762+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2023-11-27T18:43:53.554762+0000","last_clean_scrub_stamp":"2023-11-27T18:43:53.554762+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:55:00.948692+0000","scrub_duration":0.0077624699999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"32'108","reported_seq":148,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:48.434011+0000","last_change":"2023-11-27T18:43:48.434127+0000","last_active":"2023-11-27T18:43:48.434011+0000","last_peered":"2023-11-27T18:43:48.434011+0000","last_clean":"2023-11-27T18:43:48.434011+0000","last_became_active":"2023-11-27T18:13:20.924209+0000","last_became_peered":"2023-11-27T18:13:20.924209+0000","last_unstale":"2023-11-27T18:43:48.434011+0000","last_undegraded":"2023-11-27T18:43:48.434011+0000","last_fullsized":"2023-11-27T18:43:48.434011+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'108","last_scrub_stamp":"2023-11-27T18:43:48.433759+0000","last_deep_scrub":"32'108","last_deep_scrub_stamp":"2023-11-27T18:43:48.433759+0000","last_clean_scrub_stamp":"2023-11-27T18:43:48.433759+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:01:47.609449+0000","scrub_duration":0.0086909529999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":10743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"32'21","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:44.098293+0000","last_change":"2023-11-27T18:43:44.098343+0000","last_active":"2023-11-27T18:43:44.098293+0000","last_peered":"2023-11-27T18:43:44.098293+0000","last_clean":"2023-11-27T18:43:44.098293+0000","last_became_active":"2023-11-27T18:13:14.421377+0000","last_became_peered":"2023-11-27T18:13:14.421377+0000","last_unstale":"2023-11-27T18:43:44.098293+0000","last_undegraded":"2023-11-27T18:43:44.098293+0000","last_fullsized":"2023-11-27T18:43:44.098293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2023-11-27T18:43:44.098079+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2023-11-27T18:43:44.098079+0000","last_clean_scrub_stamp":"2023-11-27T18:43:44.098079+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:35:06.114321+0000","scrub_duration":0.0038697369999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"32'16","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:39.823098+0000","last_change":"2023-11-27T18:43:39.823170+0000","last_active":"2023-11-27T18:43:39.823098+0000","last_peered":"2023-11-27T18:43:39.823098+0000","last_clean":"2023-11-27T18:43:39.823098+0000","last_became_active":"2023-11-27T18:13:12.177997+0000","last_became_peered":"2023-11-27T18:13:12.177997+0000","last_unstale":"2023-11-27T18:43:39.823098+0000","last_undegraded":"2023-11-27T18:43:39.823098+0000","last_fullsized":"2023-11-27T18:43:39.823098+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2023-11-27T18:43:39.822860+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2023-11-27T18:43:39.822860+0000","last_clean_scrub_stamp":"2023-11-27T18:43:39.822860+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:51:20.471317+0000","scrub_duration":0.0097847799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"32'95","reported_seq":125,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:23.002477+0000","last_change":"2023-11-27T18:13:20.914541+0000","last_active":"2023-11-27T18:42:23.002477+0000","last_peered":"2023-11-27T18:42:23.002477+0000","last_clean":"2023-11-27T18:42:23.002477+0000","last_became_active":"2023-11-27T18:13:20.914144+0000","last_became_peered":"2023-11-27T18:13:20.914144+0000","last_unstale":"2023-11-27T18:42:23.002477+0000","last_undegraded":"2023-11-27T18:42:23.002477+0000","last_fullsized":"2023-11-27T18:42:23.002477+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":5846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"32'23","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:40.431950+0000","last_change":"2023-11-27T18:43:40.431969+0000","last_active":"2023-11-27T18:43:40.431950+0000","last_peered":"2023-11-27T18:43:40.431950+0000","last_clean":"2023-11-27T18:43:40.431950+0000","last_became_active":"2023-11-27T18:13:15.801804+0000","last_became_peered":"2023-11-27T18:13:15.801804+0000","last_unstale":"2023-11-27T18:43:40.431950+0000","last_undegraded":"2023-11-27T18:43:40.431950+0000","last_fullsized":"2023-11-27T18:43:40.431950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2023-11-27T18:43:40.431874+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2023-11-27T18:43:40.431874+0000","last_clean_scrub_stamp":"2023-11-27T18:43:40.431874+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:16:45.688555+0000","scrub_duration":0.002873408,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"32'5","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:57.545050+0000","last_change":"2023-11-27T18:43:57.545160+0000","last_active":"2023-11-27T18:43:57.545050+0000","last_peered":"2023-11-27T18:43:57.545050+0000","last_clean":"2023-11-27T18:43:57.545050+0000","last_became_active":"2023-11-27T18:13:12.300585+0000","last_became_peered":"2023-11-27T18:13:12.300585+0000","last_unstale":"2023-11-27T18:43:57.545050+0000","last_undegraded":"2023-11-27T18:43:57.545050+0000","last_fullsized":"2023-11-27T18:43:57.545050+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2023-11-27T18:43:57.544819+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2023-11-27T18:43:57.544819+0000","last_clean_scrub_stamp":"2023-11-27T18:43:57.544819+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:33:15.951006+0000","scrub_duration":0.0033027500000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"32'85","reported_seq":115,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:23.839221+0000","last_change":"2023-11-27T18:13:20.915245+0000","last_active":"2023-11-27T18:42:23.839221+0000","last_peered":"2023-11-27T18:42:23.839221+0000","last_clean":"2023-11-27T18:42:23.839221+0000","last_became_active":"2023-11-27T18:13:20.914216+0000","last_became_peered":"2023-11-27T18:13:20.914216+0000","last_unstale":"2023-11-27T18:42:23.839221+0000","last_undegraded":"2023-11-27T18:42:23.839221+0000","last_fullsized":"2023-11-27T18:42:23.839221+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":6050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"32'39","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:34.397067+0000","last_change":"2023-11-27T18:14:22.518196+0000","last_active":"2023-11-27T18:43:34.397067+0000","last_peered":"2023-11-27T18:43:34.397067+0000","last_clean":"2023-11-27T18:43:34.397067+0000","last_became_active":"2023-11-27T18:14:22.517527+0000","last_became_peered":"2023-11-27T18:14:22.517527+0000","last_unstale":"2023-11-27T18:43:34.397067+0000","last_undegraded":"2023-11-27T18:43:34.397067+0000","last_fullsized":"2023-11-27T18:43:34.397067+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"32'5","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:00.195175+0000","last_change":"2023-11-27T18:44:00.195227+0000","last_active":"2023-11-27T18:44:00.195175+0000","last_peered":"2023-11-27T18:44:00.195175+0000","last_clean":"2023-11-27T18:44:00.195175+0000","last_became_active":"2023-11-27T18:13:12.304777+0000","last_became_peered":"2023-11-27T18:13:12.304777+0000","last_unstale":"2023-11-27T18:44:00.195175+0000","last_undegraded":"2023-11-27T18:44:00.195175+0000","last_fullsized":"2023-11-27T18:44:00.195175+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2023-11-27T18:44:00.194991+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2023-11-27T18:44:00.194991+0000","last_clean_scrub_stamp":"2023-11-27T18:44:00.194991+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:46:55.415546+0000","scrub_duration":0.0035181409999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"32'64","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:40.367692+0000","last_change":"2023-11-27T18:13:20.904088+0000","last_active":"2023-11-27T18:43:40.367692+0000","last_peered":"2023-11-27T18:43:40.367692+0000","last_clean":"2023-11-27T18:43:40.367692+0000","last_became_active":"2023-11-27T18:13:20.902282+0000","last_became_peered":"2023-11-27T18:13:20.902282+0000","last_unstale":"2023-11-27T18:43:40.367692+0000","last_undegraded":"2023-11-27T18:43:40.367692+0000","last_fullsized":"2023-11-27T18:43:40.367692+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":6349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"32'27","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:13.318208+0000","last_change":"2023-11-27T18:44:13.318253+0000","last_active":"2023-11-27T18:44:13.318208+0000","last_peered":"2023-11-27T18:44:13.318208+0000","last_clean":"2023-11-27T18:44:13.318208+0000","last_became_active":"2023-11-27T18:13:14.415004+0000","last_became_peered":"2023-11-27T18:13:14.415004+0000","last_unstale":"2023-11-27T18:44:13.318208+0000","last_undegraded":"2023-11-27T18:44:13.318208+0000","last_fullsized":"2023-11-27T18:44:13.318208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'27","last_scrub_stamp":"2023-11-27T18:44:13.318061+0000","last_deep_scrub":"32'27","last_deep_scrub_stamp":"2023-11-27T18:44:13.318061+0000","last_clean_scrub_stamp":"2023-11-27T18:44:13.318061+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:33:31.724248+0000","scrub_duration":0.0035498249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"32'7","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:43.077245+0000","last_change":"2023-11-27T18:43:43.077303+0000","last_active":"2023-11-27T18:43:43.077245+0000","last_peered":"2023-11-27T18:43:43.077245+0000","last_clean":"2023-11-27T18:43:43.077245+0000","last_became_active":"2023-11-27T18:13:12.268237+0000","last_became_peered":"2023-11-27T18:13:12.268237+0000","last_unstale":"2023-11-27T18:43:43.077245+0000","last_undegraded":"2023-11-27T18:43:43.077245+0000","last_fullsized":"2023-11-27T18:43:43.077245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2023-11-27T18:43:43.077057+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2023-11-27T18:43:43.077057+0000","last_clean_scrub_stamp":"2023-11-27T18:43:43.077057+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:43:39.542648+0000","scrub_duration":0.0087600239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"32'82","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:24.615247+0000","last_change":"2023-11-27T18:13:20.900393+0000","last_active":"2023-11-27T18:42:24.615247+0000","last_peered":"2023-11-27T18:42:24.615247+0000","last_clean":"2023-11-27T18:42:24.615247+0000","last_became_active":"2023-11-27T18:13:20.899358+0000","last_became_peered":"2023-11-27T18:13:20.899358+0000","last_unstale":"2023-11-27T18:42:24.615247+0000","last_undegraded":"2023-11-27T18:42:24.615247+0000","last_fullsized":"2023-11-27T18:42:24.615247+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":8446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"32'23","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:08.498015+0000","last_change":"2023-11-27T18:44:08.498067+0000","last_active":"2023-11-27T18:44:08.498015+0000","last_peered":"2023-11-27T18:44:08.498015+0000","last_clean":"2023-11-27T18:44:08.498015+0000","last_became_active":"2023-11-27T18:13:14.371637+0000","last_became_peered":"2023-11-27T18:13:14.371637+0000","last_unstale":"2023-11-27T18:44:08.498015+0000","last_undegraded":"2023-11-27T18:44:08.498015+0000","last_fullsized":"2023-11-27T18:44:08.498015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2023-11-27T18:44:08.497806+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2023-11-27T18:44:08.497806+0000","last_clean_scrub_stamp":"2023-11-27T18:44:08.497806+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:53:14.709913+0000","scrub_duration":0.0041375810000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"32'875","reported_seq":918,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:43.474525+0000","last_change":"2023-11-27T18:43:43.474525+0000","last_active":"2023-11-27T18:43:43.474525+0000","last_peered":"2023-11-27T18:43:43.474525+0000","last_clean":"2023-11-27T18:43:43.474525+0000","last_became_active":"2023-11-27T18:13:12.248077+0000","last_became_peered":"2023-11-27T18:13:12.248077+0000","last_unstale":"2023-11-27T18:43:43.474525+0000","last_undegraded":"2023-11-27T18:43:43.474525+0000","last_fullsized":"2023-11-27T18:43:43.474525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'875","last_scrub_stamp":"2023-11-27T18:43:43.474251+0000","last_deep_scrub":"32'875","last_deep_scrub_stamp":"2023-11-27T18:43:43.474251+0000","last_clean_scrub_stamp":"2023-11-27T18:43:43.474251+0000","objects_scrubbed":4,"log_size":875,"log_dups_size":0,"ondisk_log_size":875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:21:15.277979+0000","scrub_duration":0.045304398000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":867,"num_write_kb":4596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"32'83","reported_seq":122,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:08.889040+0000","last_change":"2023-11-27T18:44:08.889093+0000","last_active":"2023-11-27T18:44:08.889040+0000","last_peered":"2023-11-27T18:44:08.889040+0000","last_clean":"2023-11-27T18:44:08.889040+0000","last_became_active":"2023-11-27T18:13:20.918381+0000","last_became_peered":"2023-11-27T18:13:20.918381+0000","last_unstale":"2023-11-27T18:44:08.889040+0000","last_undegraded":"2023-11-27T18:44:08.889040+0000","last_fullsized":"2023-11-27T18:44:08.889040+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'83","last_scrub_stamp":"2023-11-27T18:44:08.888853+0000","last_deep_scrub":"32'83","last_deep_scrub_stamp":"2023-11-27T18:44:08.888853+0000","last_clean_scrub_stamp":"2023-11-27T18:44:08.888853+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:07:18.255198+0000","scrub_duration":0.0092657209999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":11273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"32'25","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:38.063922+0000","last_change":"2023-11-27T18:43:38.063922+0000","last_active":"2023-11-27T18:43:38.063922+0000","last_peered":"2023-11-27T18:43:38.063922+0000","last_clean":"2023-11-27T18:43:38.063922+0000","last_became_active":"2023-11-27T18:13:14.415026+0000","last_became_peered":"2023-11-27T18:13:14.415026+0000","last_unstale":"2023-11-27T18:43:38.063922+0000","last_undegraded":"2023-11-27T18:43:38.063922+0000","last_fullsized":"2023-11-27T18:43:38.063922+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'25","last_scrub_stamp":"2023-11-27T18:43:38.063802+0000","last_deep_scrub":"32'25","last_deep_scrub_stamp":"2023-11-27T18:43:38.063802+0000","last_clean_scrub_stamp":"2023-11-27T18:43:38.063802+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:55:14.604318+0000","scrub_duration":0.0021425820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"32'401","reported_seq":443,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:46.071879+0000","last_change":"2023-11-27T18:43:46.071950+0000","last_active":"2023-11-27T18:43:46.071879+0000","last_peered":"2023-11-27T18:43:46.071879+0000","last_clean":"2023-11-27T18:43:46.071879+0000","last_became_active":"2023-11-27T18:13:12.180112+0000","last_became_peered":"2023-11-27T18:13:12.180112+0000","last_unstale":"2023-11-27T18:43:46.071879+0000","last_undegraded":"2023-11-27T18:43:46.071879+0000","last_fullsized":"2023-11-27T18:43:46.071879+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'401","last_scrub_stamp":"2023-11-27T18:43:46.071689+0000","last_deep_scrub":"32'401","last_deep_scrub_stamp":"2023-11-27T18:43:46.071689+0000","last_clean_scrub_stamp":"2023-11-27T18:43:46.071689+0000","objects_scrubbed":2,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:53:59.905538+0000","scrub_duration":0.0074079840000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":397,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"32'109","reported_seq":148,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:07.393509+0000","last_change":"2023-11-27T18:44:07.393565+0000","last_active":"2023-11-27T18:44:07.393509+0000","last_peered":"2023-11-27T18:44:07.393509+0000","last_clean":"2023-11-27T18:44:07.393509+0000","last_became_active":"2023-11-27T18:13:20.921675+0000","last_became_peered":"2023-11-27T18:13:20.921675+0000","last_unstale":"2023-11-27T18:44:07.393509+0000","last_undegraded":"2023-11-27T18:44:07.393509+0000","last_fullsized":"2023-11-27T18:44:07.393509+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'109","last_scrub_stamp":"2023-11-27T18:44:07.393308+0000","last_deep_scrub":"32'109","last_deep_scrub_stamp":"2023-11-27T18:44:07.393308+0000","last_clean_scrub_stamp":"2023-11-27T18:44:07.393308+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:11:18.477624+0000","scrub_duration":0.0094143639999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":15987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"32'29","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:00.974054+0000","last_change":"2023-11-27T18:44:00.974174+0000","last_active":"2023-11-27T18:44:00.974054+0000","last_peered":"2023-11-27T18:44:00.974054+0000","last_clean":"2023-11-27T18:44:00.974054+0000","last_became_active":"2023-11-27T18:13:14.415142+0000","last_became_peered":"2023-11-27T18:13:14.415142+0000","last_unstale":"2023-11-27T18:44:00.974054+0000","last_undegraded":"2023-11-27T18:44:00.974054+0000","last_fullsized":"2023-11-27T18:44:00.974054+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'29","last_scrub_stamp":"2023-11-27T18:44:00.973707+0000","last_deep_scrub":"32'29","last_deep_scrub_stamp":"2023-11-27T18:44:00.973707+0000","last_clean_scrub_stamp":"2023-11-27T18:44:00.973707+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:05:00.131288+0000","scrub_duration":0.0069063780000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:54.529500+0000","last_change":"2023-11-27T18:43:54.529597+0000","last_active":"2023-11-27T18:43:54.529500+0000","last_peered":"2023-11-27T18:43:54.529500+0000","last_clean":"2023-11-27T18:43:54.529500+0000","last_became_active":"2023-11-27T18:13:12.273400+0000","last_became_peered":"2023-11-27T18:13:12.273400+0000","last_unstale":"2023-11-27T18:43:54.529500+0000","last_undegraded":"2023-11-27T18:43:54.529500+0000","last_fullsized":"2023-11-27T18:43:54.529500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2023-11-27T18:43:54.529213+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2023-11-27T18:43:54.529213+0000","last_clean_scrub_stamp":"2023-11-27T18:43:54.529213+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:42:29.722428+0000","scrub_duration":0.0039019240000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"32'83","reported_seq":122,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:54.129517+0000","last_change":"2023-11-27T18:43:54.129623+0000","last_active":"2023-11-27T18:43:54.129517+0000","last_peered":"2023-11-27T18:43:54.129517+0000","last_clean":"2023-11-27T18:43:54.129517+0000","last_became_active":"2023-11-27T18:13:20.912063+0000","last_became_peered":"2023-11-27T18:13:20.912063+0000","last_unstale":"2023-11-27T18:43:54.129517+0000","last_undegraded":"2023-11-27T18:43:54.129517+0000","last_fullsized":"2023-11-27T18:43:54.129517+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'83","last_scrub_stamp":"2023-11-27T18:43:54.129288+0000","last_deep_scrub":"32'83","last_deep_scrub_stamp":"2023-11-27T18:43:54.129288+0000","last_clean_scrub_stamp":"2023-11-27T18:43:54.129288+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:31:56.018013+0000","scrub_duration":0.010352907999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":11074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"32'29","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:57.411434+0000","last_change":"2023-11-27T18:43:57.411534+0000","last_active":"2023-11-27T18:43:57.411434+0000","last_peered":"2023-11-27T18:43:57.411434+0000","last_clean":"2023-11-27T18:43:57.411434+0000","last_became_active":"2023-11-27T18:13:15.911255+0000","last_became_peered":"2023-11-27T18:13:15.911255+0000","last_unstale":"2023-11-27T18:43:57.411434+0000","last_undegraded":"2023-11-27T18:43:57.411434+0000","last_fullsized":"2023-11-27T18:43:57.411434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'29","last_scrub_stamp":"2023-11-27T18:43:57.411145+0000","last_deep_scrub":"32'29","last_deep_scrub_stamp":"2023-11-27T18:43:57.411145+0000","last_clean_scrub_stamp":"2023-11-27T18:43:57.411145+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:14:36.787565+0000","scrub_duration":0.0040442129999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"32'6","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:39.424073+0000","last_change":"2023-11-27T18:43:39.424093+0000","last_active":"2023-11-27T18:43:39.424073+0000","last_peered":"2023-11-27T18:43:39.424073+0000","last_clean":"2023-11-27T18:43:39.424073+0000","last_became_active":"2023-11-27T18:13:12.167740+0000","last_became_peered":"2023-11-27T18:13:12.167740+0000","last_unstale":"2023-11-27T18:43:39.424073+0000","last_undegraded":"2023-11-27T18:43:39.424073+0000","last_fullsized":"2023-11-27T18:43:39.424073+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2023-11-27T18:43:39.423989+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2023-11-27T18:43:39.423989+0000","last_clean_scrub_stamp":"2023-11-27T18:43:39.423989+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:46:23.132083+0000","scrub_duration":0.0030606299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"32'75","reported_seq":114,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:03.908541+0000","last_change":"2023-11-27T18:44:03.908593+0000","last_active":"2023-11-27T18:44:03.908541+0000","last_peered":"2023-11-27T18:44:03.908541+0000","last_clean":"2023-11-27T18:44:03.908541+0000","last_became_active":"2023-11-27T18:13:20.914607+0000","last_became_peered":"2023-11-27T18:13:20.914607+0000","last_unstale":"2023-11-27T18:44:03.908541+0000","last_undegraded":"2023-11-27T18:44:03.908541+0000","last_fullsized":"2023-11-27T18:44:03.908541+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'75","last_scrub_stamp":"2023-11-27T18:44:03.908354+0000","last_deep_scrub":"32'75","last_deep_scrub_stamp":"2023-11-27T18:44:03.908354+0000","last_clean_scrub_stamp":"2023-11-27T18:44:03.908354+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:26:01.993815+0000","scrub_duration":0.0078989079999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":8428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"32'67","reported_seq":108,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:05.871166+0000","last_change":"2023-11-27T18:44:05.871279+0000","last_active":"2023-11-27T18:44:05.871166+0000","last_peered":"2023-11-27T18:44:05.871166+0000","last_clean":"2023-11-27T18:44:05.871166+0000","last_became_active":"2023-11-27T18:13:20.930060+0000","last_became_peered":"2023-11-27T18:13:20.930060+0000","last_unstale":"2023-11-27T18:44:05.871166+0000","last_undegraded":"2023-11-27T18:44:05.871166+0000","last_fullsized":"2023-11-27T18:44:05.871166+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'67","last_scrub_stamp":"2023-11-27T18:44:05.870841+0000","last_deep_scrub":"32'67","last_deep_scrub_stamp":"2023-11-27T18:44:05.870841+0000","last_clean_scrub_stamp":"2023-11-27T18:44:05.870841+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:35:49.956028+0000","scrub_duration":0.0086515519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":4718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"32'28","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:48.824402+0000","last_change":"2023-11-27T18:43:48.824454+0000","last_active":"2023-11-27T18:43:48.824402+0000","last_peered":"2023-11-27T18:43:48.824402+0000","last_clean":"2023-11-27T18:43:48.824402+0000","last_became_active":"2023-11-27T18:13:14.379936+0000","last_became_peered":"2023-11-27T18:13:14.379936+0000","last_unstale":"2023-11-27T18:43:48.824402+0000","last_undegraded":"2023-11-27T18:43:48.824402+0000","last_fullsized":"2023-11-27T18:43:48.824402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'28","last_scrub_stamp":"2023-11-27T18:43:48.824202+0000","last_deep_scrub":"32'28","last_deep_scrub_stamp":"2023-11-27T18:43:48.824202+0000","last_clean_scrub_stamp":"2023-11-27T18:43:48.824202+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:33:23.140569+0000","scrub_duration":0.0037596090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:02.194552+0000","last_change":"2023-11-27T18:44:02.194594+0000","last_active":"2023-11-27T18:44:02.194552+0000","last_peered":"2023-11-27T18:44:02.194552+0000","last_clean":"2023-11-27T18:44:02.194552+0000","last_became_active":"2023-11-27T18:13:12.300624+0000","last_became_peered":"2023-11-27T18:13:12.300624+0000","last_unstale":"2023-11-27T18:44:02.194552+0000","last_undegraded":"2023-11-27T18:44:02.194552+0000","last_fullsized":"2023-11-27T18:44:02.194552+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2023-11-27T18:44:02.194405+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2023-11-27T18:44:02.194405+0000","last_clean_scrub_stamp":"2023-11-27T18:44:02.194405+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:36:15.821146+0000","scrub_duration":0.002438207,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"32'93","reported_seq":125,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:34.381876+0000","last_change":"2023-11-27T18:13:20.919870+0000","last_active":"2023-11-27T18:42:34.381876+0000","last_peered":"2023-11-27T18:42:34.381876+0000","last_clean":"2023-11-27T18:42:34.381876+0000","last_became_active":"2023-11-27T18:13:20.918816+0000","last_became_peered":"2023-11-27T18:13:20.918816+0000","last_unstale":"2023-11-27T18:42:34.381876+0000","last_undegraded":"2023-11-27T18:42:34.381876+0000","last_fullsized":"2023-11-27T18:42:34.381876+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":12357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'29","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:00.013136+0000","last_change":"2023-11-27T18:44:00.013177+0000","last_active":"2023-11-27T18:44:00.013136+0000","last_peered":"2023-11-27T18:44:00.013136+0000","last_clean":"2023-11-27T18:44:00.013136+0000","last_became_active":"2023-11-27T18:13:14.368880+0000","last_became_peered":"2023-11-27T18:13:14.368880+0000","last_unstale":"2023-11-27T18:44:00.013136+0000","last_undegraded":"2023-11-27T18:44:00.013136+0000","last_fullsized":"2023-11-27T18:44:00.013136+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'29","last_scrub_stamp":"2023-11-27T18:44:00.012994+0000","last_deep_scrub":"32'29","last_deep_scrub_stamp":"2023-11-27T18:44:00.012994+0000","last_clean_scrub_stamp":"2023-11-27T18:44:00.012994+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:11:00.650657+0000","scrub_duration":0.0025903329999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:45.456179+0000","last_change":"2023-11-27T18:43:45.456272+0000","last_active":"2023-11-27T18:43:45.456179+0000","last_peered":"2023-11-27T18:43:45.456179+0000","last_clean":"2023-11-27T18:43:45.456179+0000","last_became_active":"2023-11-27T18:13:12.269755+0000","last_became_peered":"2023-11-27T18:13:12.269755+0000","last_unstale":"2023-11-27T18:43:45.456179+0000","last_undegraded":"2023-11-27T18:43:45.456179+0000","last_fullsized":"2023-11-27T18:43:45.456179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2023-11-27T18:43:45.455903+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2023-11-27T18:43:45.455903+0000","last_clean_scrub_stamp":"2023-11-27T18:43:45.455903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:48:41.926518+0000","scrub_duration":0.0043083679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"32'664","reported_seq":706,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:06.184206+0000","last_change":"2023-11-27T18:44:06.184265+0000","last_active":"2023-11-27T18:44:06.184206+0000","last_peered":"2023-11-27T18:44:06.184206+0000","last_clean":"2023-11-27T18:44:06.184206+0000","last_became_active":"2023-11-27T18:13:12.307299+0000","last_became_peered":"2023-11-27T18:13:12.307299+0000","last_unstale":"2023-11-27T18:44:06.184206+0000","last_undegraded":"2023-11-27T18:44:06.184206+0000","last_fullsized":"2023-11-27T18:44:06.184206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'664","last_scrub_stamp":"2023-11-27T18:44:06.184010+0000","last_deep_scrub":"32'664","last_deep_scrub_stamp":"2023-11-27T18:44:06.184010+0000","last_clean_scrub_stamp":"2023-11-27T18:44:06.184010+0000","objects_scrubbed":1,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:22:51.239130+0000","scrub_duration":0.037709518999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":658,"num_write_kb":4457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"32'24","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:56.906458+0000","last_change":"2023-11-27T18:43:56.906562+0000","last_active":"2023-11-27T18:43:56.906458+0000","last_peered":"2023-11-27T18:43:56.906458+0000","last_clean":"2023-11-27T18:43:56.906458+0000","last_became_active":"2023-11-27T18:13:14.378635+0000","last_became_peered":"2023-11-27T18:13:14.378635+0000","last_unstale":"2023-11-27T18:43:56.906458+0000","last_undegraded":"2023-11-27T18:43:56.906458+0000","last_fullsized":"2023-11-27T18:43:56.906458+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'24","last_scrub_stamp":"2023-11-27T18:43:56.906221+0000","last_deep_scrub":"32'24","last_deep_scrub_stamp":"2023-11-27T18:43:56.906221+0000","last_clean_scrub_stamp":"2023-11-27T18:43:56.906221+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:37:13.969082+0000","scrub_duration":0.0049891079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"32'56","reported_seq":94,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:14.983391+0000","last_change":"2023-11-27T18:44:14.983450+0000","last_active":"2023-11-27T18:44:14.983391+0000","last_peered":"2023-11-27T18:44:14.983391+0000","last_clean":"2023-11-27T18:44:14.983391+0000","last_became_active":"2023-11-27T18:13:20.902571+0000","last_became_peered":"2023-11-27T18:13:20.902571+0000","last_unstale":"2023-11-27T18:44:14.983391+0000","last_undegraded":"2023-11-27T18:44:14.983391+0000","last_fullsized":"2023-11-27T18:44:14.983391+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'56","last_scrub_stamp":"2023-11-27T18:44:14.983184+0000","last_deep_scrub":"32'56","last_deep_scrub_stamp":"2023-11-27T18:44:14.983184+0000","last_clean_scrub_stamp":"2023-11-27T18:44:14.983184+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:04:26.840047+0000","scrub_duration":0.0072933249999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":3581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"32'593","reported_seq":634,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:53.084392+0000","last_change":"2023-11-27T18:43:53.084442+0000","last_active":"2023-11-27T18:43:53.084392+0000","last_peered":"2023-11-27T18:43:53.084392+0000","last_clean":"2023-11-27T18:43:53.084392+0000","last_became_active":"2023-11-27T18:13:12.303988+0000","last_became_peered":"2023-11-27T18:13:12.303988+0000","last_unstale":"2023-11-27T18:43:53.084392+0000","last_undegraded":"2023-11-27T18:43:53.084392+0000","last_fullsized":"2023-11-27T18:43:53.084392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'593","last_scrub_stamp":"2023-11-27T18:43:53.084250+0000","last_deep_scrub":"32'593","last_deep_scrub_stamp":"2023-11-27T18:43:53.084250+0000","last_clean_scrub_stamp":"2023-11-27T18:43:53.084250+0000","objects_scrubbed":1,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:42:28.277464+0000","scrub_duration":0.035525191999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":588,"num_write_kb":4406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"32'22","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:45.471070+0000","last_change":"2023-11-27T18:43:45.471121+0000","last_active":"2023-11-27T18:43:45.471070+0000","last_peered":"2023-11-27T18:43:45.471070+0000","last_clean":"2023-11-27T18:43:45.471070+0000","last_became_active":"2023-11-27T18:13:15.802420+0000","last_became_peered":"2023-11-27T18:13:15.802420+0000","last_unstale":"2023-11-27T18:43:45.471070+0000","last_undegraded":"2023-11-27T18:43:45.471070+0000","last_fullsized":"2023-11-27T18:43:45.471070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2023-11-27T18:43:45.470886+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2023-11-27T18:43:45.470886+0000","last_clean_scrub_stamp":"2023-11-27T18:43:45.470886+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:31:10.801503+0000","scrub_duration":0.0041067050000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"32'93","reported_seq":117,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:22.951779+0000","last_change":"2023-11-27T18:14:22.716310+0000","last_active":"2023-11-27T18:42:22.951779+0000","last_peered":"2023-11-27T18:42:22.951779+0000","last_clean":"2023-11-27T18:42:22.951779+0000","last_became_active":"2023-11-27T18:14:22.715684+0000","last_became_peered":"2023-11-27T18:14:22.715684+0000","last_unstale":"2023-11-27T18:42:22.951779+0000","last_undegraded":"2023-11-27T18:42:22.951779+0000","last_fullsized":"2023-11-27T18:42:22.951779+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":6465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,0],"acting":[2,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"32'34","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:46.457046+0000","last_change":"2023-11-27T18:43:46.457142+0000","last_active":"2023-11-27T18:43:46.457046+0000","last_peered":"2023-11-27T18:43:46.457046+0000","last_clean":"2023-11-27T18:43:46.457046+0000","last_became_active":"2023-11-27T18:13:15.848503+0000","last_became_peered":"2023-11-27T18:13:15.848503+0000","last_unstale":"2023-11-27T18:43:46.457046+0000","last_undegraded":"2023-11-27T18:43:46.457046+0000","last_fullsized":"2023-11-27T18:43:46.457046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'34","last_scrub_stamp":"2023-11-27T18:43:46.456824+0000","last_deep_scrub":"32'34","last_deep_scrub_stamp":"2023-11-27T18:43:46.456824+0000","last_clean_scrub_stamp":"2023-11-27T18:43:46.456824+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:08:43.138748+0000","scrub_duration":0.0043843550000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"32'28","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:49.064038+0000","last_change":"2023-11-27T18:43:49.064091+0000","last_active":"2023-11-27T18:43:49.064038+0000","last_peered":"2023-11-27T18:43:49.064038+0000","last_clean":"2023-11-27T18:43:49.064038+0000","last_became_active":"2023-11-27T18:13:14.336072+0000","last_became_peered":"2023-11-27T18:13:14.336072+0000","last_unstale":"2023-11-27T18:43:49.064038+0000","last_undegraded":"2023-11-27T18:43:49.064038+0000","last_fullsized":"2023-11-27T18:43:49.064038+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'28","last_scrub_stamp":"2023-11-27T18:43:49.063835+0000","last_deep_scrub":"32'28","last_deep_scrub_stamp":"2023-11-27T18:43:49.063835+0000","last_clean_scrub_stamp":"2023-11-27T18:43:49.063835+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:47:03.229458+0000","scrub_duration":0.0039140190000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"32'27","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:23.017035+0000","last_change":"2023-11-27T18:13:14.421713+0000","last_active":"2023-11-27T18:43:23.017035+0000","last_peered":"2023-11-27T18:43:23.017035+0000","last_clean":"2023-11-27T18:43:23.017035+0000","last_became_active":"2023-11-27T18:13:14.418679+0000","last_became_peered":"2023-11-27T18:13:14.418679+0000","last_unstale":"2023-11-27T18:43:23.017035+0000","last_undegraded":"2023-11-27T18:43:23.017035+0000","last_fullsized":"2023-11-27T18:43:23.017035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"32'22","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:17.905840+0000","last_change":"2023-11-27T18:44:17.905891+0000","last_active":"2023-11-27T18:44:17.905840+0000","last_peered":"2023-11-27T18:44:17.905840+0000","last_clean":"2023-11-27T18:44:17.905840+0000","last_became_active":"2023-11-27T18:13:14.376292+0000","last_became_peered":"2023-11-27T18:13:14.376292+0000","last_unstale":"2023-11-27T18:44:17.905840+0000","last_undegraded":"2023-11-27T18:44:17.905840+0000","last_fullsized":"2023-11-27T18:44:17.905840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2023-11-27T18:44:17.905641+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2023-11-27T18:44:17.905641+0000","last_clean_scrub_stamp":"2023-11-27T18:44:17.905641+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:37:27.730059+0000","scrub_duration":0.0045156429999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"32'16","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:00.501536+0000","last_change":"2023-11-27T18:44:00.501586+0000","last_active":"2023-11-27T18:44:00.501536+0000","last_peered":"2023-11-27T18:44:00.501536+0000","last_clean":"2023-11-27T18:44:00.501536+0000","last_became_active":"2023-11-27T18:13:14.366983+0000","last_became_peered":"2023-11-27T18:13:14.366983+0000","last_unstale":"2023-11-27T18:44:00.501536+0000","last_undegraded":"2023-11-27T18:44:00.501536+0000","last_fullsized":"2023-11-27T18:44:00.501536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2023-11-27T18:44:00.501340+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2023-11-27T18:44:00.501340+0000","last_clean_scrub_stamp":"2023-11-27T18:44:00.501340+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:49:29.151906+0000","scrub_duration":0.004046137,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"32'22","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:07.334877+0000","last_change":"2023-11-27T18:44:07.334964+0000","last_active":"2023-11-27T18:44:07.334877+0000","last_peered":"2023-11-27T18:44:07.334877+0000","last_clean":"2023-11-27T18:44:07.334877+0000","last_became_active":"2023-11-27T18:13:14.375466+0000","last_became_peered":"2023-11-27T18:13:14.375466+0000","last_unstale":"2023-11-27T18:44:07.334877+0000","last_undegraded":"2023-11-27T18:44:07.334877+0000","last_fullsized":"2023-11-27T18:44:07.334877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2023-11-27T18:44:07.334684+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2023-11-27T18:44:07.334684+0000","last_clean_scrub_stamp":"2023-11-27T18:44:07.334684+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:26:11.770623+0000","scrub_duration":0.003893086,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"32'33","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:54.330470+0000","last_change":"2023-11-27T18:43:54.330520+0000","last_active":"2023-11-27T18:43:54.330470+0000","last_peered":"2023-11-27T18:43:54.330470+0000","last_clean":"2023-11-27T18:43:54.330470+0000","last_became_active":"2023-11-27T18:13:15.910418+0000","last_became_peered":"2023-11-27T18:13:15.910418+0000","last_unstale":"2023-11-27T18:43:54.330470+0000","last_undegraded":"2023-11-27T18:43:54.330470+0000","last_fullsized":"2023-11-27T18:43:54.330470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'33","last_scrub_stamp":"2023-11-27T18:43:54.330345+0000","last_deep_scrub":"32'33","last_deep_scrub_stamp":"2023-11-27T18:43:54.330345+0000","last_clean_scrub_stamp":"2023-11-27T18:43:54.330345+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:38:33.435667+0000","scrub_duration":0.003384789,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"32'19","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:40.213006+0000","last_change":"2023-11-27T18:43:40.213056+0000","last_active":"2023-11-27T18:43:40.213006+0000","last_peered":"2023-11-27T18:43:40.213006+0000","last_clean":"2023-11-27T18:43:40.213006+0000","last_became_active":"2023-11-27T18:13:14.366249+0000","last_became_peered":"2023-11-27T18:13:14.366249+0000","last_unstale":"2023-11-27T18:43:40.213006+0000","last_undegraded":"2023-11-27T18:43:40.213006+0000","last_fullsized":"2023-11-27T18:43:40.213006+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'19","last_scrub_stamp":"2023-11-27T18:43:40.212814+0000","last_deep_scrub":"32'19","last_deep_scrub_stamp":"2023-11-27T18:43:40.212814+0000","last_clean_scrub_stamp":"2023-11-27T18:43:40.212814+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:43:45.456072+0000","scrub_duration":0.0037923340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"32'19","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:57.205712+0000","last_change":"2023-11-27T18:43:57.205768+0000","last_active":"2023-11-27T18:43:57.205712+0000","last_peered":"2023-11-27T18:43:57.205712+0000","last_clean":"2023-11-27T18:43:57.205712+0000","last_became_active":"2023-11-27T18:13:14.414873+0000","last_became_peered":"2023-11-27T18:13:14.414873+0000","last_unstale":"2023-11-27T18:43:57.205712+0000","last_undegraded":"2023-11-27T18:43:57.205712+0000","last_fullsized":"2023-11-27T18:43:57.205712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'19","last_scrub_stamp":"2023-11-27T18:43:57.205511+0000","last_deep_scrub":"32'19","last_deep_scrub_stamp":"2023-11-27T18:43:57.205511+0000","last_clean_scrub_stamp":"2023-11-27T18:43:57.205511+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:15:56.065694+0000","scrub_duration":0.0041963039999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'30","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:42.178276+0000","last_change":"2023-11-27T18:43:42.178327+0000","last_active":"2023-11-27T18:43:42.178276+0000","last_peered":"2023-11-27T18:43:42.178276+0000","last_clean":"2023-11-27T18:43:42.178276+0000","last_became_active":"2023-11-27T18:13:14.416072+0000","last_became_peered":"2023-11-27T18:13:14.416072+0000","last_unstale":"2023-11-27T18:43:42.178276+0000","last_undegraded":"2023-11-27T18:43:42.178276+0000","last_fullsized":"2023-11-27T18:43:42.178276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'30","last_scrub_stamp":"2023-11-27T18:43:42.178083+0000","last_deep_scrub":"32'30","last_deep_scrub_stamp":"2023-11-27T18:43:42.178083+0000","last_clean_scrub_stamp":"2023-11-27T18:43:42.178083+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:38:21.283406+0000","scrub_duration":0.0037760110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"32'25","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:43.469664+0000","last_change":"2023-11-27T18:43:43.469763+0000","last_active":"2023-11-27T18:43:43.469664+0000","last_peered":"2023-11-27T18:43:43.469664+0000","last_clean":"2023-11-27T18:43:43.469664+0000","last_became_active":"2023-11-27T18:13:15.800699+0000","last_became_peered":"2023-11-27T18:13:15.800699+0000","last_unstale":"2023-11-27T18:43:43.469664+0000","last_undegraded":"2023-11-27T18:43:43.469664+0000","last_fullsized":"2023-11-27T18:43:43.469664+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'25","last_scrub_stamp":"2023-11-27T18:43:43.469354+0000","last_deep_scrub":"32'25","last_deep_scrub_stamp":"2023-11-27T18:43:43.469354+0000","last_clean_scrub_stamp":"2023-11-27T18:43:43.469354+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:06:57.450424+0000","scrub_duration":0.0036779529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"32'35","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:54.929069+0000","last_change":"2023-11-27T18:43:54.929176+0000","last_active":"2023-11-27T18:43:54.929069+0000","last_peered":"2023-11-27T18:43:54.929069+0000","last_clean":"2023-11-27T18:43:54.929069+0000","last_became_active":"2023-11-27T18:13:14.413567+0000","last_became_peered":"2023-11-27T18:13:14.413567+0000","last_unstale":"2023-11-27T18:43:54.929069+0000","last_undegraded":"2023-11-27T18:43:54.929069+0000","last_fullsized":"2023-11-27T18:43:54.929069+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'35","last_scrub_stamp":"2023-11-27T18:43:54.928847+0000","last_deep_scrub":"32'35","last_deep_scrub_stamp":"2023-11-27T18:43:54.928847+0000","last_clean_scrub_stamp":"2023-11-27T18:43:54.928847+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:04:35.264476+0000","scrub_duration":0.0070704210000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"32'26","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:39.551227+0000","last_change":"2023-11-27T18:43:39.551329+0000","last_active":"2023-11-27T18:43:39.551227+0000","last_peered":"2023-11-27T18:43:39.551227+0000","last_clean":"2023-11-27T18:43:39.551227+0000","last_became_active":"2023-11-27T18:13:14.362805+0000","last_became_peered":"2023-11-27T18:13:14.362805+0000","last_unstale":"2023-11-27T18:43:39.551227+0000","last_undegraded":"2023-11-27T18:43:39.551227+0000","last_fullsized":"2023-11-27T18:43:39.551227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'26","last_scrub_stamp":"2023-11-27T18:43:39.551003+0000","last_deep_scrub":"32'26","last_deep_scrub_stamp":"2023-11-27T18:43:39.551003+0000","last_clean_scrub_stamp":"2023-11-27T18:43:39.551003+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:35:59.020605+0000","scrub_duration":0.0038830560000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"32'25","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:49.220670+0000","last_change":"2023-11-27T18:43:49.220754+0000","last_active":"2023-11-27T18:43:49.220670+0000","last_peered":"2023-11-27T18:43:49.220670+0000","last_clean":"2023-11-27T18:43:49.220670+0000","last_became_active":"2023-11-27T18:13:14.415661+0000","last_became_peered":"2023-11-27T18:13:14.415661+0000","last_unstale":"2023-11-27T18:43:49.220670+0000","last_undegraded":"2023-11-27T18:43:49.220670+0000","last_fullsized":"2023-11-27T18:43:49.220670+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'25","last_scrub_stamp":"2023-11-27T18:43:49.220417+0000","last_deep_scrub":"32'25","last_deep_scrub_stamp":"2023-11-27T18:43:49.220417+0000","last_clean_scrub_stamp":"2023-11-27T18:43:49.220417+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:52:55.432524+0000","scrub_duration":0.0032154839999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"32'35","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:53.134216+0000","last_change":"2023-11-27T18:43:53.134235+0000","last_active":"2023-11-27T18:43:53.134216+0000","last_peered":"2023-11-27T18:43:53.134216+0000","last_clean":"2023-11-27T18:43:53.134216+0000","last_became_active":"2023-11-27T18:13:14.413542+0000","last_became_peered":"2023-11-27T18:13:14.413542+0000","last_unstale":"2023-11-27T18:43:53.134216+0000","last_undegraded":"2023-11-27T18:43:53.134216+0000","last_fullsized":"2023-11-27T18:43:53.134216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'35","last_scrub_stamp":"2023-11-27T18:43:53.134137+0000","last_deep_scrub":"32'35","last_deep_scrub_stamp":"2023-11-27T18:43:53.134137+0000","last_clean_scrub_stamp":"2023-11-27T18:43:53.134137+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:11:41.311566+0000","scrub_duration":0.0029978460000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"32'23","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:41.120056+0000","last_change":"2023-11-27T18:43:41.120113+0000","last_active":"2023-11-27T18:43:41.120056+0000","last_peered":"2023-11-27T18:43:41.120056+0000","last_clean":"2023-11-27T18:43:41.120056+0000","last_became_active":"2023-11-27T18:13:14.416556+0000","last_became_peered":"2023-11-27T18:13:14.416556+0000","last_unstale":"2023-11-27T18:43:41.120056+0000","last_undegraded":"2023-11-27T18:43:41.120056+0000","last_fullsized":"2023-11-27T18:43:41.120056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2023-11-27T18:43:41.119872+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2023-11-27T18:43:41.119872+0000","last_clean_scrub_stamp":"2023-11-27T18:43:41.119872+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:10:52.204187+0000","scrub_duration":0.0061959529999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"32'28","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:48.216828+0000","last_change":"2023-11-27T18:43:48.216899+0000","last_active":"2023-11-27T18:43:48.216828+0000","last_peered":"2023-11-27T18:43:48.216828+0000","last_clean":"2023-11-27T18:43:48.216828+0000","last_became_active":"2023-11-27T18:13:14.418823+0000","last_became_peered":"2023-11-27T18:13:14.418823+0000","last_unstale":"2023-11-27T18:43:48.216828+0000","last_undegraded":"2023-11-27T18:43:48.216828+0000","last_fullsized":"2023-11-27T18:43:48.216828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'28","last_scrub_stamp":"2023-11-27T18:43:48.216586+0000","last_deep_scrub":"32'28","last_deep_scrub_stamp":"2023-11-27T18:43:48.216586+0000","last_clean_scrub_stamp":"2023-11-27T18:43:48.216586+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:41:08.176550+0000","scrub_duration":0.0040263709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"32'26","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:06.889016+0000","last_change":"2023-11-27T18:44:06.889118+0000","last_active":"2023-11-27T18:44:06.889016+0000","last_peered":"2023-11-27T18:44:06.889016+0000","last_clean":"2023-11-27T18:44:06.889016+0000","last_became_active":"2023-11-27T18:13:14.368100+0000","last_became_peered":"2023-11-27T18:13:14.368100+0000","last_unstale":"2023-11-27T18:44:06.889016+0000","last_undegraded":"2023-11-27T18:44:06.889016+0000","last_fullsized":"2023-11-27T18:44:06.889016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'26","last_scrub_stamp":"2023-11-27T18:44:06.888797+0000","last_deep_scrub":"32'26","last_deep_scrub_stamp":"2023-11-27T18:44:06.888797+0000","last_clean_scrub_stamp":"2023-11-27T18:44:06.888797+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:41:26.848761+0000","scrub_duration":0.0044410040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"32'26","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:08.359034+0000","last_change":"2023-11-27T18:44:08.359106+0000","last_active":"2023-11-27T18:44:08.359034+0000","last_peered":"2023-11-27T18:44:08.359034+0000","last_clean":"2023-11-27T18:44:08.359034+0000","last_became_active":"2023-11-27T18:13:14.376559+0000","last_became_peered":"2023-11-27T18:13:14.376559+0000","last_unstale":"2023-11-27T18:44:08.359034+0000","last_undegraded":"2023-11-27T18:44:08.359034+0000","last_fullsized":"2023-11-27T18:44:08.359034+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'26","last_scrub_stamp":"2023-11-27T18:44:08.358811+0000","last_deep_scrub":"32'26","last_deep_scrub_stamp":"2023-11-27T18:44:08.358811+0000","last_clean_scrub_stamp":"2023-11-27T18:44:08.358811+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:55:15.752741+0000","scrub_duration":0.0033520529999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"32'32","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:14.351291+0000","last_change":"2023-11-27T18:44:14.351358+0000","last_active":"2023-11-27T18:44:14.351291+0000","last_peered":"2023-11-27T18:44:14.351291+0000","last_clean":"2023-11-27T18:44:14.351291+0000","last_became_active":"2023-11-27T18:13:14.367298+0000","last_became_peered":"2023-11-27T18:13:14.367298+0000","last_unstale":"2023-11-27T18:44:14.351291+0000","last_undegraded":"2023-11-27T18:44:14.351291+0000","last_fullsized":"2023-11-27T18:44:14.351291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'32","last_scrub_stamp":"2023-11-27T18:44:14.351059+0000","last_deep_scrub":"32'32","last_deep_scrub_stamp":"2023-11-27T18:44:14.351059+0000","last_clean_scrub_stamp":"2023-11-27T18:44:14.351059+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:52:32.289440+0000","scrub_duration":0.0044719979999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"32'17","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:10.472508+0000","last_change":"2023-11-27T18:44:10.472560+0000","last_active":"2023-11-27T18:44:10.472508+0000","last_peered":"2023-11-27T18:44:10.472508+0000","last_clean":"2023-11-27T18:44:10.472508+0000","last_became_active":"2023-11-27T18:13:14.363776+0000","last_became_peered":"2023-11-27T18:13:14.363776+0000","last_unstale":"2023-11-27T18:44:10.472508+0000","last_undegraded":"2023-11-27T18:44:10.472508+0000","last_fullsized":"2023-11-27T18:44:10.472508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'17","last_scrub_stamp":"2023-11-27T18:44:10.472316+0000","last_deep_scrub":"32'17","last_deep_scrub_stamp":"2023-11-27T18:44:10.472316+0000","last_clean_scrub_stamp":"2023-11-27T18:44:10.472316+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:39:02.921131+0000","scrub_duration":0.0035518479999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"32'24","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:02.481910+0000","last_change":"2023-11-27T18:44:02.481993+0000","last_active":"2023-11-27T18:44:02.481910+0000","last_peered":"2023-11-27T18:44:02.481910+0000","last_clean":"2023-11-27T18:44:02.481910+0000","last_became_active":"2023-11-27T18:13:14.423099+0000","last_became_peered":"2023-11-27T18:13:14.423099+0000","last_unstale":"2023-11-27T18:44:02.481910+0000","last_undegraded":"2023-11-27T18:44:02.481910+0000","last_fullsized":"2023-11-27T18:44:02.481910+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'24","last_scrub_stamp":"2023-11-27T18:44:02.481722+0000","last_deep_scrub":"32'24","last_deep_scrub_stamp":"2023-11-27T18:44:02.481722+0000","last_clean_scrub_stamp":"2023-11-27T18:44:02.481722+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:05:01.639303+0000","scrub_duration":0.0029840750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"32'32","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:13.535923+0000","last_change":"2023-11-27T18:44:13.535973+0000","last_active":"2023-11-27T18:44:13.535923+0000","last_peered":"2023-11-27T18:44:13.535923+0000","last_clean":"2023-11-27T18:44:13.535923+0000","last_became_active":"2023-11-27T18:13:14.419780+0000","last_became_peered":"2023-11-27T18:13:14.419780+0000","last_unstale":"2023-11-27T18:44:13.535923+0000","last_undegraded":"2023-11-27T18:44:13.535923+0000","last_fullsized":"2023-11-27T18:44:13.535923+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'32","last_scrub_stamp":"2023-11-27T18:44:13.535729+0000","last_deep_scrub":"32'32","last_deep_scrub_stamp":"2023-11-27T18:44:13.535729+0000","last_clean_scrub_stamp":"2023-11-27T18:44:13.535729+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:33:45.089867+0000","scrub_duration":0.003331957,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"32'29","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:47.417614+0000","last_change":"2023-11-27T18:43:47.417728+0000","last_active":"2023-11-27T18:43:47.417614+0000","last_peered":"2023-11-27T18:43:47.417614+0000","last_clean":"2023-11-27T18:43:47.417614+0000","last_became_active":"2023-11-27T18:13:15.909918+0000","last_became_peered":"2023-11-27T18:13:15.909918+0000","last_unstale":"2023-11-27T18:43:47.417614+0000","last_undegraded":"2023-11-27T18:43:47.417614+0000","last_fullsized":"2023-11-27T18:43:47.417614+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'29","last_scrub_stamp":"2023-11-27T18:43:47.417382+0000","last_deep_scrub":"32'29","last_deep_scrub_stamp":"2023-11-27T18:43:47.417382+0000","last_clean_scrub_stamp":"2023-11-27T18:43:47.417382+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:19:46.839575+0000","scrub_duration":0.0058622300000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"32'19","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:16.893374+0000","last_change":"2023-11-27T18:44:16.893423+0000","last_active":"2023-11-27T18:44:16.893374+0000","last_peered":"2023-11-27T18:44:16.893374+0000","last_clean":"2023-11-27T18:44:16.893374+0000","last_became_active":"2023-11-27T18:13:14.369285+0000","last_became_peered":"2023-11-27T18:13:14.369285+0000","last_unstale":"2023-11-27T18:44:16.893374+0000","last_undegraded":"2023-11-27T18:44:16.893374+0000","last_fullsized":"2023-11-27T18:44:16.893374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'19","last_scrub_stamp":"2023-11-27T18:44:16.893184+0000","last_deep_scrub":"32'19","last_deep_scrub_stamp":"2023-11-27T18:44:16.893184+0000","last_clean_scrub_stamp":"2023-11-27T18:44:16.893184+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:38:51.524388+0000","scrub_duration":0.0035687570000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"32'20","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:00.467317+0000","last_change":"2023-11-27T18:44:00.467368+0000","last_active":"2023-11-27T18:44:00.467317+0000","last_peered":"2023-11-27T18:44:00.467317+0000","last_clean":"2023-11-27T18:44:00.467317+0000","last_became_active":"2023-11-27T18:13:14.385566+0000","last_became_peered":"2023-11-27T18:13:14.385566+0000","last_unstale":"2023-11-27T18:44:00.467317+0000","last_undegraded":"2023-11-27T18:44:00.467317+0000","last_fullsized":"2023-11-27T18:44:00.467317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2023-11-27T18:44:00.467139+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2023-11-27T18:44:00.467139+0000","last_clean_scrub_stamp":"2023-11-27T18:44:00.467139+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:06:04.634187+0000","scrub_duration":0.003836959,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"32'26","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:48.437473+0000","last_change":"2023-11-27T18:43:48.437524+0000","last_active":"2023-11-27T18:43:48.437473+0000","last_peered":"2023-11-27T18:43:48.437473+0000","last_clean":"2023-11-27T18:43:48.437473+0000","last_became_active":"2023-11-27T18:13:15.848237+0000","last_became_peered":"2023-11-27T18:13:15.848237+0000","last_unstale":"2023-11-27T18:43:48.437473+0000","last_undegraded":"2023-11-27T18:43:48.437473+0000","last_fullsized":"2023-11-27T18:43:48.437473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'26","last_scrub_stamp":"2023-11-27T18:43:48.437293+0000","last_deep_scrub":"32'26","last_deep_scrub_stamp":"2023-11-27T18:43:48.437293+0000","last_clean_scrub_stamp":"2023-11-27T18:43:48.437293+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:36:07.906895+0000","scrub_duration":0.003956256,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"32'23","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:01.434220+0000","last_change":"2023-11-27T18:44:01.434271+0000","last_active":"2023-11-27T18:44:01.434220+0000","last_peered":"2023-11-27T18:44:01.434220+0000","last_clean":"2023-11-27T18:44:01.434220+0000","last_became_active":"2023-11-27T18:13:14.372974+0000","last_became_peered":"2023-11-27T18:13:14.372974+0000","last_unstale":"2023-11-27T18:44:01.434220+0000","last_undegraded":"2023-11-27T18:44:01.434220+0000","last_fullsized":"2023-11-27T18:44:01.434220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2023-11-27T18:44:01.434016+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2023-11-27T18:44:01.434016+0000","last_clean_scrub_stamp":"2023-11-27T18:44:01.434016+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:11:02.071680+0000","scrub_duration":0.0043765549999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"32'18","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:52.342162+0000","last_change":"2023-11-27T18:43:52.342216+0000","last_active":"2023-11-27T18:43:52.342162+0000","last_peered":"2023-11-27T18:43:52.342162+0000","last_clean":"2023-11-27T18:43:52.342162+0000","last_became_active":"2023-11-27T18:13:15.850353+0000","last_became_peered":"2023-11-27T18:13:15.850353+0000","last_unstale":"2023-11-27T18:43:52.342162+0000","last_undegraded":"2023-11-27T18:43:52.342162+0000","last_fullsized":"2023-11-27T18:43:52.342162+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2023-11-27T18:43:52.341952+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2023-11-27T18:43:52.341952+0000","last_clean_scrub_stamp":"2023-11-27T18:43:52.341952+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:32:31.049285+0000","scrub_duration":0.0042809079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"32'25","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:08.852959+0000","last_change":"2023-11-27T18:44:08.853010+0000","last_active":"2023-11-27T18:44:08.852959+0000","last_peered":"2023-11-27T18:44:08.852959+0000","last_clean":"2023-11-27T18:44:08.852959+0000","last_became_active":"2023-11-27T18:13:14.380714+0000","last_became_peered":"2023-11-27T18:13:14.380714+0000","last_unstale":"2023-11-27T18:44:08.852959+0000","last_undegraded":"2023-11-27T18:44:08.852959+0000","last_fullsized":"2023-11-27T18:44:08.852959+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'25","last_scrub_stamp":"2023-11-27T18:44:08.852772+0000","last_deep_scrub":"32'25","last_deep_scrub_stamp":"2023-11-27T18:44:08.852772+0000","last_clean_scrub_stamp":"2023-11-27T18:44:08.852772+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:53:15.064879+0000","scrub_duration":0.0037987149999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"32'19","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:47.103043+0000","last_change":"2023-11-27T18:43:47.103117+0000","last_active":"2023-11-27T18:43:47.103043+0000","last_peered":"2023-11-27T18:43:47.103043+0000","last_clean":"2023-11-27T18:43:47.103043+0000","last_became_active":"2023-11-27T18:13:14.367978+0000","last_became_peered":"2023-11-27T18:13:14.367978+0000","last_unstale":"2023-11-27T18:43:47.103043+0000","last_undegraded":"2023-11-27T18:43:47.103043+0000","last_fullsized":"2023-11-27T18:43:47.103043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'19","last_scrub_stamp":"2023-11-27T18:43:47.102851+0000","last_deep_scrub":"32'19","last_deep_scrub_stamp":"2023-11-27T18:43:47.102851+0000","last_clean_scrub_stamp":"2023-11-27T18:43:47.102851+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:06:22.873872+0000","scrub_duration":0.0033780609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"32'23","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:38.508776+0000","last_change":"2023-11-27T18:43:38.508875+0000","last_active":"2023-11-27T18:43:38.508776+0000","last_peered":"2023-11-27T18:43:38.508776+0000","last_clean":"2023-11-27T18:43:38.508776+0000","last_became_active":"2023-11-27T18:13:14.418928+0000","last_became_peered":"2023-11-27T18:13:14.418928+0000","last_unstale":"2023-11-27T18:43:38.508776+0000","last_undegraded":"2023-11-27T18:43:38.508776+0000","last_fullsized":"2023-11-27T18:43:38.508776+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2023-11-27T18:43:38.508560+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2023-11-27T18:43:38.508560+0000","last_clean_scrub_stamp":"2023-11-27T18:43:38.508560+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:08:35.190483+0000","scrub_duration":0.0073382730000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2386,"num_write_kb":255070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2569,"ondisk_log_size":2569,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1576,"ondisk_log_size":1576,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":24107291,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":549,"num_read_kb":581,"num_write":5694,"num_write_kb":26819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32874496,"data_stored":48214582,"data_compressed":4737124,"data_compressed_allocated":7356416,"data_compressed_original":22757376,"omap_allocated":0,"internal_metadata":0},"log_size":5263,"ondisk_log_size":5263,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67010,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719477121,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36008,"kb_used_data":4832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335832,"statfs":{"total":96636764160,"available":96599891968,"internally_reserved":0,"allocated":4947968,"data_stored":8056568,"data_compressed":850146,"data_compressed_allocated":1241088,"data_compressed_original":4562944,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.88300000000000001,"15min":0.85999999999999999},"min":{"1min":0.60399999999999998,"5min":0.55800000000000005,"15min":0.45400000000000001},"max":{"1min":1.373,"5min":1.373,"15min":1.4730000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.93500000000000005,"15min":0.93300000000000005},"min":{"1min":0.58499999999999996,"5min":0.49399999999999999,"15min":0.46000000000000002},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.871}]},{"osd":1,"last update":"Mon Nov 27 18:43:38 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":0.995,"15min":0.96899999999999997},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.4790000000000001,"5min":1.51,"15min":1.51},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.93899999999999995,"15min":0.92800000000000005},"min":{"1min":0.58899999999999997,"5min":0.55100000000000005,"15min":0.54000000000000004},"max":{"1min":1.1950000000000001,"5min":1.361,"15min":1.482},"last":1.04}]},{"osd":2,"last update":"Mon Nov 27 18:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.98499999999999999,"15min":0.97299999999999998},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.53900000000000003},"max":{"1min":1.2170000000000001,"5min":1.4730000000000001,"15min":1.603},"last":1.196},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92300000000000004,"15min":0.92700000000000005},"min":{"1min":0.59699999999999998,"5min":0.58299999999999996,"15min":0.52700000000000002},"max":{"1min":1.2549999999999999,"5min":1.389,"15min":1.389},"last":0.82199999999999995}]},{"osd":3,"last update":"Mon Nov 27 18:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.98799999999999999,"15min":0.97499999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.472},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.0389999999999999,"15min":1.0409999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.3049999999999999,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":1.329}]},{"osd":4,"last update":"Mon Nov 27 18:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.90600000000000003,"15min":0.90200000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.518,"5min":1.518,"15min":1.518},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.036,"5min":1.018,"15min":1.0029999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":1.141}]},{"osd":6,"last update":"Mon Nov 27 18:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":1.01,"15min":1.0029999999999999},"min":{"1min":0.505,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.3240000000000001,"5min":1.417,"15min":1.49},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.02,"5min":1.026,"15min":1.03},"min":{"1min":0.46899999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.4419999999999999,"5min":1.5049999999999999,"15min":1.605},"last":1.111}]},{"osd":7,"last update":"Mon Nov 27 18:43:38 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.1459999999999999,"15min":1.125},"min":{"1min":0.73699999999999999,"5min":0.49299999999999999,"15min":0.47999999999999998},"max":{"1min":1.617,"5min":1.617,"15min":1.831},"last":1.248},{"interface":"front","average":{"1min":1.141,"5min":1.1779999999999999,"15min":1.1759999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.4790000000000001,"5min":1.6639999999999999,"15min":1.768},"last":1.377}]}]},{"osd":7,"up_from":16,"seq":68719477121,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33280,"kb_used_data":2104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338560,"statfs":{"total":96636764160,"available":96602685440,"internally_reserved":0,"allocated":2154496,"data_stored":3272747,"data_compressed":386056,"data_compressed_allocated":532480,"data_compressed_original":1863680,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.88500000000000001,"15min":0.88},"min":{"1min":0.56899999999999995,"5min":0.54000000000000004,"15min":0.49399999999999999},"max":{"1min":1.3009999999999999,"5min":1.357,"15min":1.448},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.96799999999999997,"15min":0.93700000000000006},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.49299999999999999},"max":{"1min":1.2909999999999999,"5min":1.411,"15min":1.7110000000000001},"last":0.80900000000000005}]},{"osd":1,"last update":"Mon Nov 27 18:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.91900000000000004,"15min":0.92600000000000005},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.343,"5min":1.379,"15min":1.379},"last":0.752},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1,"15min":0.97799999999999998},"min":{"1min":0.65600000000000003,"5min":0.63100000000000001,"15min":0.54800000000000004},"max":{"1min":1.4259999999999999,"5min":1.4450000000000001,"15min":1.768},"last":1.143}]},{"osd":2,"last update":"Mon Nov 27 18:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":1.0089999999999999,"15min":0.997},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.52000000000000002},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.6870000000000001},"last":1.0640000000000001},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.95399999999999996,"15min":0.93999999999999995},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.204,"5min":1.363,"15min":1.415},"last":1.087}]},{"osd":3,"last update":"Mon Nov 27 18:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.99099999999999999,"15min":0.97699999999999998},"min":{"1min":0.61899999999999999,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.2370000000000001,"5min":1.4370000000000001,"15min":1.4550000000000001},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.103,"15min":1.073},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.51300000000000001},"max":{"1min":1.4990000000000001,"5min":1.5649999999999999,"15min":1.5820000000000001},"last":0.92500000000000004}]},{"osd":4,"last update":"Mon Nov 27 18:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":1.006,"15min":0.92900000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.4610000000000001,"5min":6.6539999999999999,"15min":6.6539999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.996,"15min":1},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.3240000000000001,"5min":1.5469999999999999,"15min":2.0649999999999999},"last":0.85899999999999999}]},{"osd":5,"last update":"Mon Nov 27 18:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.099,"15min":1.0389999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35199999999999998},"max":{"1min":1.569,"5min":1.825,"15min":1.825},"last":1.008},{"interface":"front","average":{"1min":1.052,"5min":1.0449999999999999,"15min":1.0369999999999999},"min":{"1min":0.55900000000000005,"5min":0.53200000000000003,"15min":0.39200000000000002},"max":{"1min":1.361,"5min":1.679,"15min":1.679},"last":1.2769999999999999}]},{"osd":6,"last update":"Mon Nov 27 18:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.1120000000000001,"15min":1.0900000000000001},"min":{"1min":0.73999999999999999,"5min":0.45300000000000001,"15min":0.43099999999999999},"max":{"1min":1.431,"5min":1.732,"15min":1.956},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.159,"15min":1.149},"min":{"1min":0.48999999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.6479999999999999,"5min":1.7170000000000001,"15min":1.8839999999999999},"last":1.0409999999999999}]}]},{"osd":6,"up_from":16,"seq":68719477121,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30016,"kb_used_data":3000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341824,"statfs":{"total":96636764160,"available":96606027776,"internally_reserved":0,"allocated":3072000,"data_stored":4332626,"data_compressed":430585,"data_compressed_allocated":663552,"data_compressed_original":2125824,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.94799999999999995,"15min":0.93200000000000005},"min":{"1min":0.61499999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.256,"5min":1.375,"15min":1.956},"last":1.073},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.056,"15min":1.0349999999999999},"min":{"1min":0.69699999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.2090000000000001,"5min":1.5429999999999999,"15min":1.5629999999999999},"last":0.85999999999999999}]},{"osd":1,"last update":"Mon Nov 27 18:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.90100000000000002,"15min":0.89100000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.51200000000000001},"max":{"1min":1.2829999999999999,"5min":1.4179999999999999,"15min":1.5229999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.92600000000000005,"15min":0.92500000000000004},"min":{"1min":0.62,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.252,"5min":1.3839999999999999,"15min":2.2519999999999998},"last":1.046}]},{"osd":2,"last update":"Mon Nov 27 18:43:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":0.97099999999999997,"15min":0.96599999999999997},"min":{"1min":0.747,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.214,"5min":2.2349999999999999,"15min":2.2349999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.081,"15min":1.056},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.52900000000000003},"max":{"1min":1.3959999999999999,"5min":3.6549999999999998,"15min":3.6549999999999998},"last":0.90700000000000003}]},{"osd":3,"last update":"Mon Nov 27 18:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":1.044,"15min":1.034},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.52800000000000002},"max":{"1min":1.24,"5min":1.7949999999999999,"15min":2.3050000000000002},"last":0.70499999999999996},{"interface":"front","average":{"1min":1,"5min":1.0740000000000001,"15min":1.0660000000000001},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.57699999999999996},"max":{"1min":1.2170000000000001,"5min":2.0750000000000002,"15min":2.097},"last":1.1000000000000001}]},{"osd":4,"last update":"Mon Nov 27 18:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.96599999999999997,"15min":0.96999999999999997},"min":{"1min":0.59499999999999997,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.3680000000000001,"5min":1.5309999999999999,"15min":1.712},"last":1.014},{"interface":"front","average":{"1min":1.016,"5min":1.097,"15min":1.0580000000000001},"min":{"1min":0.502,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.544,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.93100000000000005}]},{"osd":5,"last update":"Mon Nov 27 18:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.0089999999999999,"15min":0.996},"min":{"1min":0.58999999999999997,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.399,"5min":1.879,"15min":2.173},"last":1.21},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.1299999999999999,"15min":1.137},"min":{"1min":0.65900000000000003,"5min":0.59399999999999997,"15min":0.46500000000000002},"max":{"1min":1.339,"5min":3.7509999999999999,"15min":3.7509999999999999},"last":1.1910000000000001}]},{"osd":7,"last update":"Mon Nov 27 18:43:30 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.165,"15min":1.1559999999999999},"min":{"1min":0.56499999999999995,"5min":0.55300000000000005,"15min":0.40400000000000003},"max":{"1min":1.7470000000000001,"5min":1.962,"15min":2.351},"last":1.165},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.177,"15min":1.1619999999999999},"min":{"1min":0.80300000000000005,"5min":0.55800000000000005,"15min":0.499},"max":{"1min":1.613,"5min":2.1150000000000002,"15min":2.2250000000000001},"last":1.514}]}]},{"osd":3,"up_from":16,"seq":68719477119,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58052,"kb_used_data":8828,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94313788,"statfs":{"total":96636764160,"available":96577318912,"internally_reserved":0,"allocated":9039872,"data_stored":12721816,"data_compressed":1205599,"data_compressed_allocated":1880064,"data_compressed_original":5767168,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:43:41 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.69299999999999995,"15min":0.72399999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":1.101,"5min":1.101,"15min":1.456},"last":1.026},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.76500000000000001,"15min":0.78600000000000003},"min":{"1min":0.36799999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.95899999999999996,"5min":1.387,"15min":1.387},"last":0.64100000000000001}]},{"osd":1,"last update":"Mon Nov 27 18:43:41 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.76600000000000001,"15min":0.78100000000000003},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.006,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.85199999999999998,"15min":0.90000000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.4690000000000001},"last":0.84399999999999997}]},{"osd":2,"last update":"Mon Nov 27 18:43:41 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.90200000000000002,"15min":0.91300000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.246,"5min":1.371,"15min":1.631},"last":1.002},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.92700000000000005,"15min":0.94899999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.39000000000000001},"max":{"1min":1.3260000000000001,"5min":1.375,"15min":1.375},"last":0.97099999999999997}]},{"osd":4,"last update":"Mon Nov 27 18:43:41 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.98899999999999999,"15min":0.98999999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.2490000000000001,"5min":1.573,"15min":1.6439999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.93400000000000005,"5min":1.0109999999999999,"15min":1.048},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.60399999999999998},"max":{"1min":1.254,"5min":1.4950000000000001,"15min":1.605},"last":1.075}]},{"osd":5,"last update":"Mon Nov 27 18:43:41 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":1.056,"15min":1.081},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.29,"5min":1.472,"15min":1.766},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.052,"5min":1.155,"15min":1.181},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.381,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.103}]},{"osd":6,"last update":"Mon Nov 27 18:43:41 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.1180000000000001,"15min":1.1000000000000001},"min":{"1min":0.65500000000000003,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.401,"5min":1.607,"15min":1.8720000000000001},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.1299999999999999,"15min":1.1699999999999999},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.367,"5min":1.7050000000000001,"15min":1.7270000000000001},"last":1.1559999999999999}]},{"osd":7,"last update":"Mon Nov 27 18:43:41 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.222,"15min":1.246},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.6830000000000001,"5min":1.915,"15min":1.915},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.105,"5min":1.175,"15min":1.171},"min":{"1min":0.621,"5min":0.496,"15min":0.496},"max":{"1min":1.6279999999999999,"5min":1.6839999999999999,"15min":1.9339999999999999},"last":1.131}]}]},{"osd":2,"up_from":16,"seq":68719477120,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33272,"kb_used_data":6256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94338568,"statfs":{"total":96636764160,"available":96602693632,"internally_reserved":0,"allocated":6406144,"data_stored":8527602,"data_compressed":750925,"data_compressed_allocated":1228800,"data_compressed_original":3559424,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:43:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.71099999999999997,"15min":0.71999999999999997},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.157,"5min":1.2729999999999999,"15min":1.2869999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.78300000000000003,"15min":0.81299999999999994},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.0860000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":0.76200000000000001}]},{"osd":1,"last update":"Mon Nov 27 18:43:45 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.81299999999999994,"15min":0.84299999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.109,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.86099999999999999,"15min":0.88400000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.3,"5min":2.6400000000000001,"15min":2.6400000000000001},"last":0.91400000000000003}]},{"osd":3,"last update":"Mon Nov 27 18:43:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.79200000000000004,"15min":0.81799999999999995},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.1180000000000001,"5min":1.4750000000000001,"15min":1.6259999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.94199999999999995,"15min":0.96499999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.256,"5min":1.554,"15min":1.554},"last":1.141}]},{"osd":4,"last update":"Mon Nov 27 18:43:45 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":1.0269999999999999,"15min":1.0329999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.3819999999999999,"5min":1.49,"15min":1.5620000000000001},"last":1.401},{"interface":"front","average":{"1min":0.94499999999999995,"5min":1.02,"15min":1.0409999999999999},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.57799999999999996},"max":{"1min":1.23,"5min":1.861,"15min":1.861},"last":1.1679999999999999}]},{"osd":5,"last update":"Mon Nov 27 18:43:45 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":1.0649999999999999,"15min":1.079},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.337,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":1.0860000000000001},{"interface":"front","average":{"1min":0.97699999999999998,"5min":1.04,"15min":1.0449999999999999},"min":{"1min":0.68300000000000005,"5min":0.55700000000000005,"15min":0.53000000000000003},"max":{"1min":1.403,"5min":1.5209999999999999,"15min":1.6859999999999999},"last":1.2490000000000001}]},{"osd":6,"last update":"Mon Nov 27 18:43:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.105,"15min":1.109},"min":{"1min":0.58799999999999997,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.5229999999999999,"5min":1.585,"15min":1.7490000000000001},"last":1.3089999999999999},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.1619999999999999,"15min":1.1759999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.45,"5min":1.786,"15min":1.958},"last":1.3500000000000001}]},{"osd":7,"last update":"Mon Nov 27 18:43:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.1779999999999999,"15min":1.1879999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.625},"max":{"1min":1.714,"5min":1.7869999999999999,"15min":1.8799999999999999},"last":1.5109999999999999},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.181,"15min":1.1779999999999999},"min":{"1min":0.70299999999999996,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.6080000000000001,"5min":3.4289999999999998,"15min":3.4289999999999998},"last":1.3779999999999999}]}]},{"osd":1,"up_from":16,"seq":68719477120,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44056,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327784,"statfs":{"total":96636764160,"available":96591650816,"internally_reserved":0,"allocated":409600,"data_stored":728760,"data_compressed":33505,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.67600000000000005,"15min":0.70999999999999996},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.91500000000000004,"5min":1.1080000000000001,"15min":1.2969999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.77400000000000002,"15min":0.81599999999999995},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.282,"5min":1.306,"15min":1.397},"last":0.63500000000000001}]},{"osd":2,"last update":"Mon Nov 27 18:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.73199999999999998,"15min":0.73899999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.36299999999999999},"max":{"1min":1.0760000000000001,"5min":1.1439999999999999,"15min":1.3480000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.83299999999999996,"15min":0.88},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.38500000000000001},"max":{"1min":1.252,"5min":1.4359999999999999,"15min":1.9610000000000001},"last":0.83199999999999996}]},{"osd":3,"last update":"Mon Nov 27 18:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.92300000000000004,"15min":0.96799999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.0880000000000001,"5min":1.3520000000000001,"15min":1.8009999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.90300000000000002,"15min":0.90500000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.3140000000000001,"5min":1.462,"15min":2.0960000000000001},"last":0.75800000000000001}]},{"osd":4,"last update":"Mon Nov 27 18:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.95299999999999996,"15min":0.94799999999999995},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.51800000000000002},"max":{"1min":1.2070000000000001,"5min":1.4370000000000001,"15min":1.4970000000000001},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.93799999999999994,"5min":1.0589999999999999,"15min":1.0900000000000001},"min":{"1min":0.629,"5min":0.629,"15min":0.61399999999999999},"max":{"1min":1.379,"5min":1.478,"15min":2.496},"last":1.006}]},{"osd":5,"last update":"Mon Nov 27 18:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.048,"15min":1.0880000000000001},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.51500000000000001},"max":{"1min":1.327,"5min":1.534,"15min":2.1970000000000001},"last":1.024},{"interface":"front","average":{"1min":0.97699999999999998,"5min":1.0489999999999999,"15min":1.0549999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.60599999999999998},"max":{"1min":1.3700000000000001,"5min":1.605,"15min":1.7529999999999999},"last":0.93300000000000005}]},{"osd":6,"last update":"Mon Nov 27 18:43:36 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.141,"15min":1.1890000000000001},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.503},"max":{"1min":1.502,"5min":1.6060000000000001,"15min":2.4319999999999999},"last":1.256},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.1459999999999999,"15min":1.1759999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.52600000000000002},"max":{"1min":1.5269999999999999,"5min":1.7569999999999999,"15min":2.3700000000000001},"last":0.879}]},{"osd":7,"last update":"Mon Nov 27 18:43:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.167,"15min":1.206},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.55200000000000005},"max":{"1min":1.4510000000000001,"5min":1.6990000000000001,"15min":2.2879999999999998},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.028,"5min":1.1499999999999999,"15min":1.1579999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.319,"5min":1.7070000000000001,"15min":1.7170000000000001},"last":1.0660000000000001}]}]},{"osd":0,"up_from":16,"seq":68719477121,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42672,"kb_used_data":3176,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329168,"statfs":{"total":96636764160,"available":96593068032,"internally_reserved":0,"allocated":3252224,"data_stored":4332682,"data_compressed":397480,"data_compressed_allocated":610304,"data_compressed_original":1900544,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 27 18:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.69599999999999995,"15min":0.71999999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.86199999999999999,"5min":1.2070000000000001,"15min":1.6599999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.82799999999999996,"15min":0.83999999999999997},"min":{"1min":0.47799999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2310000000000001,"5min":1.391,"15min":1.391},"last":0.91500000000000004}]},{"osd":2,"last update":"Mon Nov 27 18:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.81499999999999995,"15min":0.85299999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1140000000000001,"5min":1.3799999999999999,"15min":1.405},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.749,"5min":0.84599999999999997,"15min":0.85899999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.145,"5min":1.4730000000000001,"15min":1.5629999999999999},"last":0.66600000000000004}]},{"osd":3,"last update":"Mon Nov 27 18:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.85899999999999999,"15min":0.86499999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.42099999999999999},"max":{"1min":1.3140000000000001,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.96099999999999997,"15min":0.96599999999999997},"min":{"1min":0.53000000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.3839999999999999,"5min":1.421,"15min":2.073},"last":1.1619999999999999}]},{"osd":4,"last update":"Mon Nov 27 18:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.96499999999999997,"15min":0.97299999999999998},"min":{"1min":0.69999999999999996,"5min":0.64400000000000002,"15min":0.57099999999999995},"max":{"1min":1.222,"5min":1.73,"15min":1.897},"last":0.871},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.0349999999999999,"15min":1.0740000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.3140000000000001,"5min":1.4059999999999999,"15min":2.1899999999999999},"last":0.99199999999999999}]},{"osd":5,"last update":"Mon Nov 27 18:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":1.0760000000000001,"15min":1.085},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.56899999999999995},"max":{"1min":1.3380000000000001,"5min":1.5369999999999999,"15min":2.0270000000000001},"last":1.2090000000000001},{"interface":"front","average":{"1min":0.97899999999999998,"5min":1.036,"15min":1.04},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.624},"max":{"1min":1.248,"5min":1.855,"15min":1.9870000000000001},"last":0.95899999999999996}]},{"osd":6,"last update":"Mon Nov 27 18:43:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.1379999999999999,"15min":1.1639999999999999},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.59599999999999997},"max":{"1min":1.4830000000000001,"5min":1.6399999999999999,"15min":2.254},"last":1.26},{"interface":"front","average":{"1min":1.071,"5min":1.143,"15min":1.1719999999999999},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.745},"max":{"1min":1.4159999999999999,"5min":1.5800000000000001,"15min":1.8440000000000001},"last":1.3009999999999999}]},{"osd":7,"last update":"Mon Nov 27 18:43:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1799999999999999,"15min":1.2},"min":{"1min":0.85499999999999998,"5min":0.76100000000000001,"15min":0.60799999999999998},"max":{"1min":1.454,"5min":1.591,"15min":2.1600000000000001},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.151,"15min":1.155},"min":{"1min":0.84199999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.377,"5min":1.7849999999999999,"15min":2.117},"last":1.048}]}]},{"osd":4,"up_from":15,"seq":64424509825,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55512,"kb_used_data":6288,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94316328,"statfs":{"total":96636764160,"available":96579919872,"internally_reserved":0,"allocated":6438912,"data_stored":8528274,"data_compressed":749838,"data_compressed_allocated":1245184,"data_compressed_original":3551232,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.92100000000000004,"15min":0.88500000000000001},"min":{"1min":0.53700000000000003,"5min":0.47099999999999997,"15min":0.46300000000000002},"max":{"1min":1.385,"5min":1.385,"15min":1.675},"last":0.87},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.89200000000000002,"15min":0.91200000000000003},"min":{"1min":0.498,"5min":0.373,"15min":0.373},"max":{"1min":1.0800000000000001,"5min":1.349,"15min":1.5449999999999999},"last":0.997}]},{"osd":1,"last update":"Mon Nov 27 18:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.94899999999999995,"15min":0.93799999999999994},"min":{"1min":0.61899999999999999,"5min":0.55100000000000005,"15min":0.46100000000000002},"max":{"1min":1.25,"5min":1.4790000000000001,"15min":2.2759999999999998},"last":1.036},{"interface":"front","average":{"1min":1.0049999999999999,"5min":0.97199999999999998,"15min":0.95699999999999996},"min":{"1min":0.67100000000000004,"5min":0.62,"15min":0.49399999999999999},"max":{"1min":1.331,"5min":1.371,"15min":1.569},"last":0.63800000000000001}]},{"osd":2,"last update":"Mon Nov 27 18:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.97299999999999998,"15min":0.96499999999999997},"min":{"1min":0.59599999999999997,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.222,"5min":1.5649999999999999,"15min":2.3730000000000002},"last":0.77500000000000002},{"interface":"front","average":{"1min":1.069,"5min":1.006,"15min":1.002},"min":{"1min":0.77000000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.383,"5min":1.4770000000000001,"15min":1.7729999999999999},"last":0.93500000000000005}]},{"osd":3,"last update":"Mon Nov 27 18:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.96699999999999997,"15min":0.95899999999999996},"min":{"1min":0.58099999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.411,"5min":1.411,"15min":1.8300000000000001},"last":1.069},{"interface":"front","average":{"1min":1.006,"5min":1.018,"15min":1.044},"min":{"1min":0.745,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.2869999999999999,"5min":1.5169999999999999,"15min":2.2069999999999999},"last":0.96399999999999997}]},{"osd":5,"last update":"Mon Nov 27 18:43:37 2023","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":0.95099999999999996,"15min":0.96899999999999997},"min":{"1min":0.69099999999999995,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.4039999999999999,"5min":1.4410000000000001,"15min":1.7290000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.96199999999999997,"15min":0.96599999999999997},"min":{"1min":0.60099999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.236,"5min":1.3799999999999999,"15min":1.7150000000000001},"last":0.89300000000000002}]},{"osd":6,"last update":"Mon Nov 27 18:43:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0640000000000001,"15min":1.038},"min":{"1min":0.64600000000000002,"5min":0.52200000000000002,"15min":0.48299999999999998},"max":{"1min":1.302,"5min":1.6579999999999999,"15min":2.4199999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":1.175,"5min":1.161,"15min":1.1419999999999999},"min":{"1min":0.69099999999999995,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.4750000000000001,"5min":1.591,"15min":1.8140000000000001},"last":0.80600000000000005}]},{"osd":7,"last update":"Mon Nov 27 18:43:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0700000000000001,"15min":1.0680000000000001},"min":{"1min":0.67000000000000004,"5min":0.46100000000000002,"15min":0.40400000000000003},"max":{"1min":1.5369999999999999,"5min":1.623,"15min":2.0419999999999998},"last":0.72799999999999998},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1559999999999999,"15min":1.1639999999999999},"min":{"1min":0.85899999999999999,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.3759999999999999,"5min":1.736,"15min":2.3279999999999998},"last":0.83899999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33505,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33505,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2912256,"data_stored":4194360,"data_compressed":397480,"data_compressed_allocated":610304,"data_compressed_original":1900544,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6066176,"data_stored":8389280,"data_compressed":750925,"data_compressed_allocated":1228800,"data_compressed_original":3559424,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8699904,"data_stored":12583494,"data_compressed":1205599,"data_compressed_allocated":1880064,"data_compressed_original":5767168,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6098944,"data_stored":8389952,"data_compressed":749838,"data_compressed_allocated":1245184,"data_compressed_original":3551232,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4546560,"data_stored":7328697,"data_compressed":816641,"data_compressed_allocated":1196032,"data_compressed_original":3989504,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":2732032,"data_stored":4194304,"data_compressed":430585,"data_compressed_allocated":663552,"data_compressed_original":2125824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1814528,"data_stored":3134425,"data_compressed":386056,"data_compressed_allocated":532480,"data_compressed_original":1863680,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T18:44:23.606 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:23.606 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:23.607 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2023-11-27T18:13:10.491982+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=10, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:23.607 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:23.607 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:23.607 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-27T18:13:10.491982+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=10, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:23.607 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:23.607 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-27T18:13:10.491982+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=10, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:23.608 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:23.608 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:23.608 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:23.608 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:23.608 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:23.608 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-27T18:13:10.491982+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=10, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:23.608 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:23.609 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:23.609 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:23.609 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:23.609 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:23.609 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:23.609 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:23.609 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:23.610 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:23.610 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:23.610 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:23.610 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:23.611 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-27T18:44:27.303 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:32:48.381 38308== Warning: unimplemented fcntl command: 1036 2023-11-27T18:44:27.312 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:32:48.390 38308== Warning: unimplemented fcntl command: 1036 2023-11-27T18:44:27.507 INFO:tasks.ceph.mon.b.smithi094.stderr:==00:00:32:48.533 38305== Warning: unimplemented fcntl command: 1036 2023-11-27T18:44:27.513 INFO:tasks.ceph.mon.b.smithi094.stderr:==00:00:32:48.539 38305== Warning: unimplemented fcntl command: 1036 2023-11-27T18:44:27.527 INFO:tasks.ceph.mon.c.smithi094.stderr:==00:00:32:48.553 38307== Warning: unimplemented fcntl command: 1036 2023-11-27T18:44:27.539 INFO:tasks.ceph.mon.c.smithi094.stderr:==00:00:32:48.565 38307== Warning: unimplemented fcntl command: 1036 2023-11-27T18:44:27.569 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:32:48.647 38308== Warning: unimplemented fcntl command: 1036 2023-11-27T18:44:27.772 INFO:tasks.ceph.mon.b.smithi094.stderr:==00:00:32:48.796 38305== Warning: unimplemented fcntl command: 1036 2023-11-27T18:44:27.802 INFO:tasks.ceph.mon.c.smithi094.stderr:==00:00:32:48.829 38307== Warning: unimplemented fcntl command: 1036 2023-11-27T18:44:40.896 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:44:40.899 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:44:43.612 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T18:44:43.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:43.738+0000 7f23441bd640 1 Processor -- start 2023-11-27T18:44:43.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:43.738+0000 7f23441bd640 1 -- start start 2023-11-27T18:44:43.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:43.742+0000 7f23441bd640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f233c151820 0x7f233c070e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:44:43.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:43.742+0000 7f23441bd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f233c0c85c0 0x7f233c06cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:44:43.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:43.742+0000 7f23441bd640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f233c072b70 con 0x7f233c0c5f10 2023-11-27T18:44:43.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:43.742+0000 7f23441bd640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f233c0c2d20 con 0x7f233c0c85c0 2023-11-27T18:44:43.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:43.742+0000 7f23441bd640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f233c071350 con 0x7f233c151820 2023-11-27T18:44:43.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:43.742+0000 7f2341758640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f233c0c85c0 0x7f233c06cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:44:43.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:43.742+0000 7f234275a640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f233c0c5f10 0x7f233c06d0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.91:33004/0 (socket says 172.21.15.91:33004) 2023-11-27T18:44:43.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:43.742+0000 7f234275a640 1 -- 172.21.15.91:0/3002390160 learned_addr learned my addr 172.21.15.91:0/3002390160 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:44:43.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:43.746+0000 7f2341f59640 1 --2- 172.21.15.91:0/3002390160 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f233c151820 0x7f233c070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:44:43.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:43.754+0000 7f2341f59640 1 -- 172.21.15.91:0/3002390160 >> v2:172.21.15.94:3300/0 conn(0x7f233c0c85c0 msgr2=0x7f233c06cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:44:43.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:43.754+0000 7f2341f59640 1 --2- 172.21.15.91:0/3002390160 >> v2:172.21.15.94:3300/0 conn(0x7f233c0c85c0 0x7f233c06cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:44:43.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:43.754+0000 7f2341f59640 1 -- 172.21.15.91:0/3002390160 >> v1:172.21.15.94:6789/0 conn(0x7f233c0c5f10 legacy=0x7f233c06d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:44:43.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:43.754+0000 7f2341f59640 1 -- 172.21.15.91:0/3002390160 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f233c0c6490 con 0x7f233c151820 2023-11-27T18:44:43.766 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:43.762+0000 7f2341f59640 1 --2- 172.21.15.91:0/3002390160 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f233c151820 0x7f233c070e10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f23380097c0 tx=0x7f233801ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9c9bbc26f67997c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:44:43.779 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:43.774+0000 7f2340f57640 1 -- 172.21.15.91:0/3002390160 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23380a8970 con 0x7f233c151820 2023-11-27T18:44:43.779 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:43.774+0000 7f2340f57640 1 -- 172.21.15.91:0/3002390160 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23380a8ad0 con 0x7f233c151820 2023-11-27T18:44:43.779 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:43.774+0000 7f2340f57640 1 -- 172.21.15.91:0/3002390160 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23380a8e60 con 0x7f233c151820 2023-11-27T18:44:43.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:43.774+0000 7f23441bd640 1 -- 172.21.15.91:0/3002390160 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f233c151820 msgr2=0x7f233c070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:44:43.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:43.774+0000 7f23441bd640 1 --2- 172.21.15.91:0/3002390160 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f233c151820 0x7f233c070e10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f23380097c0 tx=0x7f233801ec70 comp rx=0 tx=0).stop 2023-11-27T18:44:43.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:43.774+0000 7f23441bd640 1 -- 172.21.15.91:0/3002390160 shutdown_connections 2023-11-27T18:44:43.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:43.774+0000 7f23441bd640 1 --2- 172.21.15.91:0/3002390160 >> v2:172.21.15.94:3300/0 conn(0x7f233c0c85c0 0x7f233c06cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:44:43.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:43.774+0000 7f23441bd640 1 --2- 172.21.15.91:0/3002390160 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f233c151820 0x7f233c070e10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:44:43.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:43.774+0000 7f23441bd640 1 -- 172.21.15.91:0/3002390160 >> 172.21.15.91:0/3002390160 conn(0x7f233c0c79b0 msgr2=0x7f233c0c7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:44:43.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:43.774+0000 7f23441bd640 1 -- 172.21.15.91:0/3002390160 shutdown_connections 2023-11-27T18:44:43.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:43.774+0000 7f23441bd640 1 -- 172.21.15.91:0/3002390160 wait complete. 2023-11-27T18:44:43.781 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:43.778+0000 7f23441bd640 1 Processor -- start 2023-11-27T18:44:43.781 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:43.778+0000 7f23441bd640 1 -- start start 2023-11-27T18:44:43.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:43.778+0000 7f23441bd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f233c0c5f10 0x7f233c14e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:44:43.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:43.778+0000 7f23441bd640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f233c0c85c0 0x7f233c156450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:44:43.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:43.778+0000 7f23441bd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f233c151820 0x7f233c156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:44:43.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:43.778+0000 7f23441bd640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233c156030 con 0x7f233c0c5f10 2023-11-27T18:44:43.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:43.778+0000 7f23441bd640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233c157b00 con 0x7f233c151820 2023-11-27T18:44:43.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:43.778+0000 7f23441bd640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f233c157d50 con 0x7f233c0c85c0 2023-11-27T18:44:43.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:43.778+0000 7f2341f59640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f233c0c5f10 0x7f233c14e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:44:43.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:43.778+0000 7f2341f59640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f233c0c5f10 0x7f233c14e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44302/0 (socket says 172.21.15.91:44302) 2023-11-27T18:44:43.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:43.778+0000 7f2341f59640 1 -- 172.21.15.91:0/4011322360 learned_addr learned my addr 172.21.15.91:0/4011322360 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:44:43.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:43.778+0000 7f234275a640 1 --2- 172.21.15.91:0/4011322360 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f233c151820 0x7f233c156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:44:43.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:43.782+0000 7f2341758640 1 --2- 172.21.15.91:0/4011322360 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f233c0c85c0 0x7f233c156450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:44:43.787 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:43.782+0000 7f2341f59640 1 -- 172.21.15.91:0/4011322360 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f233c0c85c0 msgr2=0x7f233c156450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:44:43.787 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:43.782+0000 7f2341f59640 1 --2- 172.21.15.91:0/4011322360 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f233c0c85c0 0x7f233c156450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:44:43.787 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:43.782+0000 7f2341f59640 1 -- 172.21.15.91:0/4011322360 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f233c151820 msgr2=0x7f233c156990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:44:43.787 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:43.782+0000 7f2341f59640 1 --2- 172.21.15.91:0/4011322360 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f233c151820 0x7f233c156990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:44:43.787 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:43.782+0000 7f2341f59640 1 -- 172.21.15.91:0/4011322360 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2338009420 con 0x7f233c0c5f10 2023-11-27T18:44:43.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:43.786+0000 7f2341f59640 1 --2- 172.21.15.91:0/4011322360 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f233c0c5f10 0x7f233c14e3d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f233801c8a0 tx=0x7f233801ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:44:43.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:43.790+0000 7f23327fc640 1 -- 172.21.15.91:0/4011322360 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23380b0d90 con 0x7f233c0c5f10 2023-11-27T18:44:43.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:43.790+0000 7f23327fc640 1 -- 172.21.15.91:0/4011322360 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23380b9400 con 0x7f233c0c5f10 2023-11-27T18:44:43.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:43.790+0000 7f23327fc640 1 -- 172.21.15.91:0/4011322360 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23380b97b0 con 0x7f233c0c5f10 2023-11-27T18:44:43.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:43.790+0000 7f23441bd640 1 -- 172.21.15.91:0/4011322360 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f233c1ecf10 con 0x7f233c0c5f10 2023-11-27T18:44:43.794 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:43.790+0000 7f23441bd640 1 -- 172.21.15.91:0/4011322360 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f233c1ed1d0 con 0x7f233c0c5f10 2023-11-27T18:44:43.794 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:43.790+0000 7f23441bd640 1 -- 172.21.15.91:0/4011322360 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f233c1562a0 con 0x7f233c0c5f10 2023-11-27T18:44:44.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:44.074+0000 7f23327fc640 1 -- 172.21.15.91:0/4011322360 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f23380b7040 con 0x7f233c0c5f10 2023-11-27T18:44:44.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:44.074+0000 7f23327fc640 1 --2- 172.21.15.91:0/4011322360 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f2320066840 0x7f2320068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:44:44.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:44.074+0000 7f2341758640 1 --2- 172.21.15.91:0/4011322360 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f2320066840 0x7f2320068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:44:44.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:44.074+0000 7f2341758640 1 --2- 172.21.15.91:0/4011322360 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f2320066840 0x7f2320068d00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f233c1ee040 tx=0x7f232c009190 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:44:44.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:44.106+0000 7f23327fc640 1 -- 172.21.15.91:0/4011322360 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f23380f33a0 con 0x7f233c0c5f10 2023-11-27T18:44:44.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:44.110+0000 7f23327fc640 1 -- 172.21.15.91:0/4011322360 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f23380ef720 con 0x7f233c0c5f10 2023-11-27T18:44:44.313 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:44.310+0000 7f23441bd640 1 -- 172.21.15.91:0/4011322360 --> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f233c0c6a10 con 0x7f2320066840 2023-11-27T18:44:44.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:44.338+0000 7f23327fc640 1 -- 172.21.15.91:0/4011322360 <== mgr.4136 v2:172.21.15.91:6800/2814827118 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371971 (secure 0 0 0) 0x7f232c011a30 con 0x7f2320066840 2023-11-27T18:44:44.347 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:44:44.350 INFO:teuthology.orchestra.run.smithi091.stderr:dumped all 2023-11-27T18:44:44.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:44.342+0000 7f23441bd640 1 -- 172.21.15.91:0/4011322360 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f2320066840 msgr2=0x7f2320068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:44:44.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:44.342+0000 7f23441bd640 1 --2- 172.21.15.91:0/4011322360 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f2320066840 0x7f2320068d00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f233c1ee040 tx=0x7f232c009190 comp rx=0 tx=0).stop 2023-11-27T18:44:44.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:44.342+0000 7f23441bd640 1 -- 172.21.15.91:0/4011322360 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f233c0c5f10 msgr2=0x7f233c14e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:44:44.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:44.342+0000 7f23441bd640 1 --2- 172.21.15.91:0/4011322360 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f233c0c5f10 0x7f233c14e3d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f233801c8a0 tx=0x7f233801ba10 comp rx=0 tx=0).stop 2023-11-27T18:44:44.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:44.342+0000 7f23441bd640 1 -- 172.21.15.91:0/4011322360 shutdown_connections 2023-11-27T18:44:44.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:44.342+0000 7f23441bd640 1 --2- 172.21.15.91:0/4011322360 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f2320066840 0x7f2320068d00 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:44:44.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:44.342+0000 7f23441bd640 1 --2- 172.21.15.91:0/4011322360 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f233c0c85c0 0x7f233c156450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:44:44.352 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:44.342+0000 7f23441bd640 1 --2- 172.21.15.91:0/4011322360 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f233c151820 0x7f233c156990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:44:44.352 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:44.342+0000 7f23441bd640 1 --2- 172.21.15.91:0/4011322360 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f233c0c5f10 0x7f233c14e3d0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:44:44.352 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:44.342+0000 7f23441bd640 1 -- 172.21.15.91:0/4011322360 >> 172.21.15.91:0/4011322360 conn(0x7f233c0c79b0 msgr2=0x7f233c071fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:44:44.352 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:44.342+0000 7f23441bd640 1 -- 172.21.15.91:0/4011322360 shutdown_connections 2023-11-27T18:44:44.352 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:44:44.342+0000 7f23441bd640 1 -- 172.21.15.91:0/4011322360 wait complete. 2023-11-27T18:44:44.367 INFO:teuthology.orchestra.run.smithi091.stdout:{"pg_ready":true,"pg_map":{"version":991,"stamp":"2023-11-27T18:44:43.923141+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":24697659,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":665,"num_read_kb":681,"num_write":8239,"num_write_kb":284305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9530,"ondisk_log_size":9530,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":332868,"kb_used_data":34884,"kb_used_omap":12,"kb_used_meta":297907,"kb_avail":754641852,"statfs":{"total":773094113280,"available":772753256448,"internally_reserved":0,"allocated":35721216,"data_stored":50501075,"data_compressed":4804134,"data_compressed_allocated":7446528,"data_compressed_original":23904256,"omap_allocated":12751,"internal_metadata":305057329},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005583"},"pg_stats":[{"pgid":"2.1f","version":"32'715","reported_seq":760,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:47.848187+0000","last_change":"2023-11-27T18:43:47.848187+0000","last_active":"2023-11-27T18:43:47.848187+0000","last_peered":"2023-11-27T18:43:47.848187+0000","last_clean":"2023-11-27T18:43:47.848187+0000","last_became_active":"2023-11-27T18:13:12.298140+0000","last_became_peered":"2023-11-27T18:13:12.298140+0000","last_unstale":"2023-11-27T18:43:47.848187+0000","last_undegraded":"2023-11-27T18:43:47.848187+0000","last_fullsized":"2023-11-27T18:43:47.848187+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'715","last_scrub_stamp":"2023-11-27T18:43:47.847820+0000","last_deep_scrub":"32'715","last_deep_scrub_stamp":"2023-11-27T18:43:47.847820+0000","last_clean_scrub_stamp":"2023-11-27T18:43:47.847820+0000","objects_scrubbed":3,"log_size":715,"log_dups_size":0,"ondisk_log_size":715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:50:51.204330+0000","scrub_duration":0.035779559000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":710,"num_write_kb":4473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"32'16","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:03.898613+0000","last_change":"2023-11-27T18:44:03.898662+0000","last_active":"2023-11-27T18:44:03.898613+0000","last_peered":"2023-11-27T18:44:03.898613+0000","last_clean":"2023-11-27T18:44:03.898613+0000","last_became_active":"2023-11-27T18:13:14.416401+0000","last_became_peered":"2023-11-27T18:13:14.416401+0000","last_unstale":"2023-11-27T18:44:03.898613+0000","last_undegraded":"2023-11-27T18:44:03.898613+0000","last_fullsized":"2023-11-27T18:44:03.898613+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2023-11-27T18:44:03.898433+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2023-11-27T18:44:03.898433+0000","last_clean_scrub_stamp":"2023-11-27T18:44:03.898433+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:13:43.468400+0000","scrub_duration":0.0036775810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"32'75","reported_seq":113,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:00.111787+0000","last_change":"2023-11-27T18:44:00.111845+0000","last_active":"2023-11-27T18:44:00.111787+0000","last_peered":"2023-11-27T18:44:00.111787+0000","last_clean":"2023-11-27T18:44:00.111787+0000","last_became_active":"2023-11-27T18:13:20.915358+0000","last_became_peered":"2023-11-27T18:13:20.915358+0000","last_unstale":"2023-11-27T18:44:00.111787+0000","last_undegraded":"2023-11-27T18:44:00.111787+0000","last_fullsized":"2023-11-27T18:44:00.111787+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'75","last_scrub_stamp":"2023-11-27T18:44:00.111579+0000","last_deep_scrub":"32'75","last_deep_scrub_stamp":"2023-11-27T18:44:00.111579+0000","last_clean_scrub_stamp":"2023-11-27T18:44:00.111579+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:51:00.953217+0000","scrub_duration":0.0076916110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":3642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"32'325","reported_seq":369,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:57.075955+0000","last_change":"2023-11-27T18:43:57.076012+0000","last_active":"2023-11-27T18:43:57.075955+0000","last_peered":"2023-11-27T18:43:57.075955+0000","last_clean":"2023-11-27T18:43:57.075955+0000","last_became_active":"2023-11-27T18:13:12.304981+0000","last_became_peered":"2023-11-27T18:13:12.304981+0000","last_unstale":"2023-11-27T18:43:57.075955+0000","last_undegraded":"2023-11-27T18:43:57.075955+0000","last_fullsized":"2023-11-27T18:43:57.075955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'325","last_scrub_stamp":"2023-11-27T18:43:57.075766+0000","last_deep_scrub":"32'325","last_deep_scrub_stamp":"2023-11-27T18:43:57.075766+0000","last_clean_scrub_stamp":"2023-11-27T18:43:57.075766+0000","objects_scrubbed":1,"log_size":325,"log_dups_size":0,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:30:28.504144+0000","scrub_duration":0.022777430000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3006109,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":322,"num_write_kb":3093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"32'24","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:41.204401+0000","last_change":"2023-11-27T18:43:41.204401+0000","last_active":"2023-11-27T18:43:41.204401+0000","last_peered":"2023-11-27T18:43:41.204401+0000","last_clean":"2023-11-27T18:43:41.204401+0000","last_became_active":"2023-11-27T18:13:14.365787+0000","last_became_peered":"2023-11-27T18:13:14.365787+0000","last_unstale":"2023-11-27T18:43:41.204401+0000","last_undegraded":"2023-11-27T18:43:41.204401+0000","last_fullsized":"2023-11-27T18:43:41.204401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'24","last_scrub_stamp":"2023-11-27T18:43:41.204069+0000","last_deep_scrub":"32'24","last_deep_scrub_stamp":"2023-11-27T18:43:41.204069+0000","last_clean_scrub_stamp":"2023-11-27T18:43:41.204069+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:32:19.911402+0000","scrub_duration":0.0057151110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"32'88","reported_seq":126,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:20.556027+0000","last_change":"2023-11-27T18:44:20.556081+0000","last_active":"2023-11-27T18:44:20.556027+0000","last_peered":"2023-11-27T18:44:20.556027+0000","last_clean":"2023-11-27T18:44:20.556027+0000","last_became_active":"2023-11-27T18:13:20.914864+0000","last_became_peered":"2023-11-27T18:13:20.914864+0000","last_unstale":"2023-11-27T18:44:20.556027+0000","last_undegraded":"2023-11-27T18:44:20.556027+0000","last_fullsized":"2023-11-27T18:44:20.556027+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'88","last_scrub_stamp":"2023-11-27T18:44:20.555825+0000","last_deep_scrub":"32'88","last_deep_scrub_stamp":"2023-11-27T18:44:20.555825+0000","last_clean_scrub_stamp":"2023-11-27T18:44:20.555825+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:41:40.515790+0000","scrub_duration":0.0094880950000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":6140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"32'10","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:59.514855+0000","last_change":"2023-11-27T18:43:59.514974+0000","last_active":"2023-11-27T18:43:59.514855+0000","last_peered":"2023-11-27T18:43:59.514855+0000","last_clean":"2023-11-27T18:43:59.514855+0000","last_became_active":"2023-11-27T18:13:12.272343+0000","last_became_peered":"2023-11-27T18:13:12.272343+0000","last_unstale":"2023-11-27T18:43:59.514855+0000","last_undegraded":"2023-11-27T18:43:59.514855+0000","last_fullsized":"2023-11-27T18:43:59.514855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2023-11-27T18:43:59.514566+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2023-11-27T18:43:59.514566+0000","last_clean_scrub_stamp":"2023-11-27T18:43:59.514566+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:30:30.942944+0000","scrub_duration":0.0069176309999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"32'21","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:44.441251+0000","last_change":"2023-11-27T18:43:44.441307+0000","last_active":"2023-11-27T18:43:44.441251+0000","last_peered":"2023-11-27T18:43:44.441251+0000","last_clean":"2023-11-27T18:43:44.441251+0000","last_became_active":"2023-11-27T18:13:15.803248+0000","last_became_peered":"2023-11-27T18:13:15.803248+0000","last_unstale":"2023-11-27T18:43:44.441251+0000","last_undegraded":"2023-11-27T18:43:44.441251+0000","last_fullsized":"2023-11-27T18:43:44.441251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2023-11-27T18:43:44.441030+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2023-11-27T18:43:44.441030+0000","last_clean_scrub_stamp":"2023-11-27T18:43:44.441030+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:32:54.895787+0000","scrub_duration":0.0033392019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"32'82","reported_seq":120,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:03.401769+0000","last_change":"2023-11-27T18:44:03.401823+0000","last_active":"2023-11-27T18:44:03.401769+0000","last_peered":"2023-11-27T18:44:03.401769+0000","last_clean":"2023-11-27T18:44:03.401769+0000","last_became_active":"2023-11-27T18:13:20.908285+0000","last_became_peered":"2023-11-27T18:13:20.908285+0000","last_unstale":"2023-11-27T18:44:03.401769+0000","last_undegraded":"2023-11-27T18:44:03.401769+0000","last_fullsized":"2023-11-27T18:44:03.401769+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'82","last_scrub_stamp":"2023-11-27T18:44:03.401550+0000","last_deep_scrub":"32'82","last_deep_scrub_stamp":"2023-11-27T18:44:03.401550+0000","last_clean_scrub_stamp":"2023-11-27T18:44:03.401550+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:32:52.048284+0000","scrub_duration":0.0084183120000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":10516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"32'5","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:46.597260+0000","last_change":"2023-11-27T18:43:46.597376+0000","last_active":"2023-11-27T18:43:46.597260+0000","last_peered":"2023-11-27T18:43:46.597260+0000","last_clean":"2023-11-27T18:43:46.597260+0000","last_became_active":"2023-11-27T18:13:12.274275+0000","last_became_peered":"2023-11-27T18:13:12.274275+0000","last_unstale":"2023-11-27T18:43:46.597260+0000","last_undegraded":"2023-11-27T18:43:46.597260+0000","last_fullsized":"2023-11-27T18:43:46.597260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2023-11-27T18:43:46.597014+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2023-11-27T18:43:46.597014+0000","last_clean_scrub_stamp":"2023-11-27T18:43:46.597014+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:38:25.702336+0000","scrub_duration":0.0064410480000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"32'37","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:37.644099+0000","last_change":"2023-11-27T18:44:37.644150+0000","last_active":"2023-11-27T18:44:37.644099+0000","last_peered":"2023-11-27T18:44:37.644099+0000","last_clean":"2023-11-27T18:44:37.644099+0000","last_became_active":"2023-11-27T18:13:14.421811+0000","last_became_peered":"2023-11-27T18:13:14.421811+0000","last_unstale":"2023-11-27T18:44:37.644099+0000","last_undegraded":"2023-11-27T18:44:37.644099+0000","last_fullsized":"2023-11-27T18:44:37.644099+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2023-11-27T18:44:37.643897+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2023-11-27T18:44:37.643897+0000","last_clean_scrub_stamp":"2023-11-27T18:44:37.643897+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:18:11.992529+0000","scrub_duration":0.00355968,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"32'74","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:12.502342+0000","last_change":"2023-11-27T18:44:12.502402+0000","last_active":"2023-11-27T18:44:12.502342+0000","last_peered":"2023-11-27T18:44:12.502342+0000","last_clean":"2023-11-27T18:44:12.502342+0000","last_became_active":"2023-11-27T18:13:20.906418+0000","last_became_peered":"2023-11-27T18:13:20.906418+0000","last_unstale":"2023-11-27T18:44:12.502342+0000","last_undegraded":"2023-11-27T18:44:12.502342+0000","last_fullsized":"2023-11-27T18:44:12.502342+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'74","last_scrub_stamp":"2023-11-27T18:44:12.502149+0000","last_deep_scrub":"32'74","last_deep_scrub_stamp":"2023-11-27T18:44:12.502149+0000","last_clean_scrub_stamp":"2023-11-27T18:44:12.502149+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:48:55.390213+0000","scrub_duration":0.0089182870000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":5836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"32'20","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:59.211521+0000","last_change":"2023-11-27T18:43:59.211572+0000","last_active":"2023-11-27T18:43:59.211521+0000","last_peered":"2023-11-27T18:43:59.211521+0000","last_clean":"2023-11-27T18:43:59.211521+0000","last_became_active":"2023-11-27T18:13:14.418640+0000","last_became_peered":"2023-11-27T18:13:14.418640+0000","last_unstale":"2023-11-27T18:43:59.211521+0000","last_undegraded":"2023-11-27T18:43:59.211521+0000","last_fullsized":"2023-11-27T18:43:59.211521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2023-11-27T18:43:59.211339+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2023-11-27T18:43:59.211339+0000","last_clean_scrub_stamp":"2023-11-27T18:43:59.211339+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:15:35.201396+0000","scrub_duration":0.0038460930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"32'690","reported_seq":733,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:21.035426+0000","last_change":"2023-11-27T18:44:21.035487+0000","last_active":"2023-11-27T18:44:21.035426+0000","last_peered":"2023-11-27T18:44:21.035426+0000","last_clean":"2023-11-27T18:44:21.035426+0000","last_became_active":"2023-11-27T18:13:12.306331+0000","last_became_peered":"2023-11-27T18:13:12.306331+0000","last_unstale":"2023-11-27T18:44:21.035426+0000","last_undegraded":"2023-11-27T18:44:21.035426+0000","last_fullsized":"2023-11-27T18:44:21.035426+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'690","last_scrub_stamp":"2023-11-27T18:44:21.035230+0000","last_deep_scrub":"32'690","last_deep_scrub_stamp":"2023-11-27T18:44:21.035230+0000","last_clean_scrub_stamp":"2023-11-27T18:44:21.035230+0000","objects_scrubbed":2,"log_size":690,"log_dups_size":0,"ondisk_log_size":690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:21:59.592660+0000","scrub_duration":0.039521944000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":683,"num_write_kb":4455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'77","reported_seq":111,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:25.693876+0000","last_change":"2023-11-27T18:44:25.694004+0000","last_active":"2023-11-27T18:44:25.693876+0000","last_peered":"2023-11-27T18:44:25.693876+0000","last_clean":"2023-11-27T18:44:25.693876+0000","last_became_active":"2023-11-27T18:14:22.717105+0000","last_became_peered":"2023-11-27T18:14:22.717105+0000","last_unstale":"2023-11-27T18:44:25.693876+0000","last_undegraded":"2023-11-27T18:44:25.693876+0000","last_fullsized":"2023-11-27T18:44:25.693876+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'77","last_scrub_stamp":"2023-11-27T18:44:25.693646+0000","last_deep_scrub":"32'77","last_deep_scrub_stamp":"2023-11-27T18:44:25.693646+0000","last_clean_scrub_stamp":"2023-11-27T18:44:25.693646+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:36:39.320387+0000","scrub_duration":0.0098094340000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":10073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7,5],"acting":[0,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"32'22","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:51.107667+0000","last_change":"2023-11-27T18:43:51.107717+0000","last_active":"2023-11-27T18:43:51.107667+0000","last_peered":"2023-11-27T18:43:51.107667+0000","last_clean":"2023-11-27T18:43:51.107667+0000","last_became_active":"2023-11-27T18:13:14.368117+0000","last_became_peered":"2023-11-27T18:13:14.368117+0000","last_unstale":"2023-11-27T18:43:51.107667+0000","last_undegraded":"2023-11-27T18:43:51.107667+0000","last_fullsized":"2023-11-27T18:43:51.107667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2023-11-27T18:43:51.107469+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2023-11-27T18:43:51.107469+0000","last_clean_scrub_stamp":"2023-11-27T18:43:51.107469+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:57:21.965939+0000","scrub_duration":0.0058469949999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"32'2","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:49.531217+0000","last_change":"2023-11-27T18:43:49.531318+0000","last_active":"2023-11-27T18:43:49.531217+0000","last_peered":"2023-11-27T18:43:49.531217+0000","last_clean":"2023-11-27T18:43:49.531217+0000","last_became_active":"2023-11-27T18:13:12.306644+0000","last_became_peered":"2023-11-27T18:13:12.306644+0000","last_unstale":"2023-11-27T18:43:49.531217+0000","last_undegraded":"2023-11-27T18:43:49.531217+0000","last_fullsized":"2023-11-27T18:43:49.531217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2023-11-27T18:43:49.530967+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2023-11-27T18:43:49.530967+0000","last_clean_scrub_stamp":"2023-11-27T18:43:49.530967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:08:46.212891+0000","scrub_duration":0.003406638,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"32'100","reported_seq":139,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:23.732457+0000","last_change":"2023-11-27T18:44:23.732513+0000","last_active":"2023-11-27T18:44:23.732457+0000","last_peered":"2023-11-27T18:44:23.732457+0000","last_clean":"2023-11-27T18:44:23.732457+0000","last_became_active":"2023-11-27T18:13:20.928830+0000","last_became_peered":"2023-11-27T18:13:20.928830+0000","last_unstale":"2023-11-27T18:44:23.732457+0000","last_undegraded":"2023-11-27T18:44:23.732457+0000","last_fullsized":"2023-11-27T18:44:23.732457+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'100","last_scrub_stamp":"2023-11-27T18:44:23.732242+0000","last_deep_scrub":"32'100","last_deep_scrub_stamp":"2023-11-27T18:44:23.732242+0000","last_clean_scrub_stamp":"2023-11-27T18:44:23.732242+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:37:33.556660+0000","scrub_duration":0.0098060309999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":7369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"32'24","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:52.943762+0000","last_change":"2023-11-27T18:43:52.943813+0000","last_active":"2023-11-27T18:43:52.943762+0000","last_peered":"2023-11-27T18:43:52.943762+0000","last_clean":"2023-11-27T18:43:52.943762+0000","last_became_active":"2023-11-27T18:13:14.378391+0000","last_became_peered":"2023-11-27T18:13:14.378391+0000","last_unstale":"2023-11-27T18:43:52.943762+0000","last_undegraded":"2023-11-27T18:43:52.943762+0000","last_fullsized":"2023-11-27T18:43:52.943762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'24","last_scrub_stamp":"2023-11-27T18:43:52.943561+0000","last_deep_scrub":"32'24","last_deep_scrub_stamp":"2023-11-27T18:43:52.943561+0000","last_clean_scrub_stamp":"2023-11-27T18:43:52.943561+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:36:18.307587+0000","scrub_duration":0.003991362,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"32'4","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:45.824544+0000","last_change":"2023-11-27T18:43:45.824599+0000","last_active":"2023-11-27T18:43:45.824544+0000","last_peered":"2023-11-27T18:43:45.824544+0000","last_clean":"2023-11-27T18:43:45.824544+0000","last_became_active":"2023-11-27T18:13:12.269795+0000","last_became_peered":"2023-11-27T18:13:12.269795+0000","last_unstale":"2023-11-27T18:43:45.824544+0000","last_undegraded":"2023-11-27T18:43:45.824544+0000","last_fullsized":"2023-11-27T18:43:45.824544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2023-11-27T18:43:45.824352+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2023-11-27T18:43:45.824352+0000","last_clean_scrub_stamp":"2023-11-27T18:43:45.824352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:21:33.244186+0000","scrub_duration":0.0037706549999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'67","reported_seq":106,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:01.092727+0000","last_change":"2023-11-27T18:44:01.092826+0000","last_active":"2023-11-27T18:44:01.092727+0000","last_peered":"2023-11-27T18:44:01.092727+0000","last_clean":"2023-11-27T18:44:01.092727+0000","last_became_active":"2023-11-27T18:13:20.906609+0000","last_became_peered":"2023-11-27T18:13:20.906609+0000","last_unstale":"2023-11-27T18:44:01.092727+0000","last_undegraded":"2023-11-27T18:44:01.092727+0000","last_fullsized":"2023-11-27T18:44:01.092727+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'67","last_scrub_stamp":"2023-11-27T18:44:01.092415+0000","last_deep_scrub":"32'67","last_deep_scrub_stamp":"2023-11-27T18:44:01.092415+0000","last_clean_scrub_stamp":"2023-11-27T18:44:01.092415+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:12:10.051315+0000","scrub_duration":0.0085197999999999992,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":7315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"32'21","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:43.136981+0000","last_change":"2023-11-27T18:43:43.137113+0000","last_active":"2023-11-27T18:43:43.136981+0000","last_peered":"2023-11-27T18:43:43.136981+0000","last_clean":"2023-11-27T18:43:43.136981+0000","last_became_active":"2023-11-27T18:13:14.414888+0000","last_became_peered":"2023-11-27T18:13:14.414888+0000","last_unstale":"2023-11-27T18:43:43.136981+0000","last_undegraded":"2023-11-27T18:43:43.136981+0000","last_fullsized":"2023-11-27T18:43:43.136981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2023-11-27T18:43:43.136763+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2023-11-27T18:43:43.136763+0000","last_clean_scrub_stamp":"2023-11-27T18:43:43.136763+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:48:26.024827+0000","scrub_duration":0.003973931,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"32'5","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:43.558828+0000","last_change":"2023-11-27T18:43:43.558883+0000","last_active":"2023-11-27T18:43:43.558828+0000","last_peered":"2023-11-27T18:43:43.558828+0000","last_clean":"2023-11-27T18:43:43.558828+0000","last_became_active":"2023-11-27T18:13:12.273356+0000","last_became_peered":"2023-11-27T18:13:12.273356+0000","last_unstale":"2023-11-27T18:43:43.558828+0000","last_undegraded":"2023-11-27T18:43:43.558828+0000","last_fullsized":"2023-11-27T18:43:43.558828+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2023-11-27T18:43:43.558640+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2023-11-27T18:43:43.558640+0000","last_clean_scrub_stamp":"2023-11-27T18:43:43.558640+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:49:12.209206+0000","scrub_duration":0.0032465200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'85","reported_seq":124,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:15.565374+0000","last_change":"2023-11-27T18:44:15.565429+0000","last_active":"2023-11-27T18:44:15.565374+0000","last_peered":"2023-11-27T18:44:15.565374+0000","last_clean":"2023-11-27T18:44:15.565374+0000","last_became_active":"2023-11-27T18:13:20.934797+0000","last_became_peered":"2023-11-27T18:13:20.934797+0000","last_unstale":"2023-11-27T18:44:15.565374+0000","last_undegraded":"2023-11-27T18:44:15.565374+0000","last_fullsized":"2023-11-27T18:44:15.565374+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'85","last_scrub_stamp":"2023-11-27T18:44:15.565164+0000","last_deep_scrub":"32'85","last_deep_scrub_stamp":"2023-11-27T18:44:15.565164+0000","last_clean_scrub_stamp":"2023-11-27T18:44:15.565164+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:13:55.135131+0000","scrub_duration":0.010705322999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":5270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'29","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:57.924916+0000","last_change":"2023-11-27T18:43:57.925019+0000","last_active":"2023-11-27T18:43:57.924916+0000","last_peered":"2023-11-27T18:43:57.924916+0000","last_clean":"2023-11-27T18:43:57.924916+0000","last_became_active":"2023-11-27T18:13:14.376304+0000","last_became_peered":"2023-11-27T18:13:14.376304+0000","last_unstale":"2023-11-27T18:43:57.924916+0000","last_undegraded":"2023-11-27T18:43:57.924916+0000","last_fullsized":"2023-11-27T18:43:57.924916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'29","last_scrub_stamp":"2023-11-27T18:43:57.924629+0000","last_deep_scrub":"32'29","last_deep_scrub_stamp":"2023-11-27T18:43:57.924629+0000","last_clean_scrub_stamp":"2023-11-27T18:43:57.924629+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:29:06.838395+0000","scrub_duration":0.0035453020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"32'8","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:31.723821+0000","last_change":"2023-11-27T18:44:31.723883+0000","last_active":"2023-11-27T18:44:31.723821+0000","last_peered":"2023-11-27T18:44:31.723821+0000","last_clean":"2023-11-27T18:44:31.723821+0000","last_became_active":"2023-11-27T18:13:12.307492+0000","last_became_peered":"2023-11-27T18:13:12.307492+0000","last_unstale":"2023-11-27T18:44:31.723821+0000","last_undegraded":"2023-11-27T18:44:31.723821+0000","last_fullsized":"2023-11-27T18:44:31.723821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2023-11-27T18:44:31.723615+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2023-11-27T18:44:31.723615+0000","last_clean_scrub_stamp":"2023-11-27T18:44:31.723615+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:15:43.578095+0000","scrub_duration":0.0069494530000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"32'53","reported_seq":94,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:02.443464+0000","last_change":"2023-11-27T18:44:02.443464+0000","last_active":"2023-11-27T18:44:02.443464+0000","last_peered":"2023-11-27T18:44:02.443464+0000","last_clean":"2023-11-27T18:44:02.443464+0000","last_became_active":"2023-11-27T18:13:20.917507+0000","last_became_peered":"2023-11-27T18:13:20.917507+0000","last_unstale":"2023-11-27T18:44:02.443464+0000","last_undegraded":"2023-11-27T18:44:02.443464+0000","last_fullsized":"2023-11-27T18:44:02.443464+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'53","last_scrub_stamp":"2023-11-27T18:44:02.443300+0000","last_deep_scrub":"32'53","last_deep_scrub_stamp":"2023-11-27T18:44:02.443300+0000","last_clean_scrub_stamp":"2023-11-27T18:44:02.443300+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:40:43.676662+0000","scrub_duration":0.0080949999999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":7028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"32'21","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:49.863843+0000","last_change":"2023-11-27T18:43:49.863898+0000","last_active":"2023-11-27T18:43:49.863843+0000","last_peered":"2023-11-27T18:43:49.863843+0000","last_clean":"2023-11-27T18:43:49.863843+0000","last_became_active":"2023-11-27T18:13:14.377289+0000","last_became_peered":"2023-11-27T18:13:14.377289+0000","last_unstale":"2023-11-27T18:43:49.863843+0000","last_undegraded":"2023-11-27T18:43:49.863843+0000","last_fullsized":"2023-11-27T18:43:49.863843+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2023-11-27T18:43:49.863644+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2023-11-27T18:43:49.863644+0000","last_clean_scrub_stamp":"2023-11-27T18:43:49.863644+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:01:22.274023+0000","scrub_duration":0.0055625429999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"32'327","reported_seq":371,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:40.843422+0000","last_change":"2023-11-27T18:43:40.843448+0000","last_active":"2023-11-27T18:43:40.843422+0000","last_peered":"2023-11-27T18:43:40.843422+0000","last_clean":"2023-11-27T18:43:40.843422+0000","last_became_active":"2023-11-27T18:13:12.267552+0000","last_became_peered":"2023-11-27T18:13:12.267552+0000","last_unstale":"2023-11-27T18:43:40.843422+0000","last_undegraded":"2023-11-27T18:43:40.843422+0000","last_fullsized":"2023-11-27T18:43:40.843422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'327","last_scrub_stamp":"2023-11-27T18:43:40.843323+0000","last_deep_scrub":"32'327","last_deep_scrub_stamp":"2023-11-27T18:43:40.843323+0000","last_clean_scrub_stamp":"2023-11-27T18:43:40.843323+0000","objects_scrubbed":1,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:56:06.018967+0000","scrub_duration":0.013467106,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"32'94","reported_seq":135,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:20.902014+0000","last_change":"2023-11-27T18:44:20.902129+0000","last_active":"2023-11-27T18:44:20.902014+0000","last_peered":"2023-11-27T18:44:20.902014+0000","last_clean":"2023-11-27T18:44:20.902014+0000","last_became_active":"2023-11-27T18:13:20.929370+0000","last_became_peered":"2023-11-27T18:13:20.929370+0000","last_unstale":"2023-11-27T18:44:20.902014+0000","last_undegraded":"2023-11-27T18:44:20.902014+0000","last_fullsized":"2023-11-27T18:44:20.902014+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'94","last_scrub_stamp":"2023-11-27T18:44:20.901767+0000","last_deep_scrub":"32'94","last_deep_scrub_stamp":"2023-11-27T18:44:20.901767+0000","last_clean_scrub_stamp":"2023-11-27T18:44:20.901767+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:39:51.079315+0000","scrub_duration":0.0092412929999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":11915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"32'22","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:01.454972+0000","last_change":"2023-11-27T18:44:01.454972+0000","last_active":"2023-11-27T18:44:01.454972+0000","last_peered":"2023-11-27T18:44:01.454972+0000","last_clean":"2023-11-27T18:44:01.454972+0000","last_became_active":"2023-11-27T18:13:14.369472+0000","last_became_peered":"2023-11-27T18:13:14.369472+0000","last_unstale":"2023-11-27T18:44:01.454972+0000","last_undegraded":"2023-11-27T18:44:01.454972+0000","last_fullsized":"2023-11-27T18:44:01.454972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2023-11-27T18:44:01.454715+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2023-11-27T18:44:01.454715+0000","last_clean_scrub_stamp":"2023-11-27T18:44:01.454715+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:38:40.560038+0000","scrub_duration":0.0038928529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:29.713697+0000","last_change":"2023-11-27T18:44:29.713697+0000","last_active":"2023-11-27T18:44:29.713697+0000","last_peered":"2023-11-27T18:44:29.713697+0000","last_clean":"2023-11-27T18:44:29.713697+0000","last_became_active":"2023-11-27T18:13:12.310495+0000","last_became_peered":"2023-11-27T18:13:12.310495+0000","last_unstale":"2023-11-27T18:44:29.713697+0000","last_undegraded":"2023-11-27T18:44:29.713697+0000","last_fullsized":"2023-11-27T18:44:29.713697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2023-11-27T18:44:29.713443+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2023-11-27T18:44:29.713443+0000","last_clean_scrub_stamp":"2023-11-27T18:44:29.713443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:34:09.203249+0000","scrub_duration":0.0040309719999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"32'62","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:19.291759+0000","last_change":"2023-11-27T18:44:19.291759+0000","last_active":"2023-11-27T18:44:19.291759+0000","last_peered":"2023-11-27T18:44:19.291759+0000","last_clean":"2023-11-27T18:44:19.291759+0000","last_became_active":"2023-11-27T18:13:20.907229+0000","last_became_peered":"2023-11-27T18:13:20.907229+0000","last_unstale":"2023-11-27T18:44:19.291759+0000","last_undegraded":"2023-11-27T18:44:19.291759+0000","last_fullsized":"2023-11-27T18:44:19.291759+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'62","last_scrub_stamp":"2023-11-27T18:44:19.291514+0000","last_deep_scrub":"32'62","last_deep_scrub_stamp":"2023-11-27T18:44:19.291514+0000","last_clean_scrub_stamp":"2023-11-27T18:44:19.291514+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:06:23.458563+0000","scrub_duration":0.0078187329999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":7408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"32'20","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:49.434991+0000","last_change":"2023-11-27T18:43:49.434991+0000","last_active":"2023-11-27T18:43:49.434991+0000","last_peered":"2023-11-27T18:43:49.434991+0000","last_clean":"2023-11-27T18:43:49.434991+0000","last_became_active":"2023-11-27T18:13:15.850263+0000","last_became_peered":"2023-11-27T18:13:15.850263+0000","last_unstale":"2023-11-27T18:43:49.434991+0000","last_undegraded":"2023-11-27T18:43:49.434991+0000","last_fullsized":"2023-11-27T18:43:49.434991+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2023-11-27T18:43:49.434748+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2023-11-27T18:43:49.434748+0000","last_clean_scrub_stamp":"2023-11-27T18:43:49.434748+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:46:15.277193+0000","scrub_duration":0.004346305,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"32'4","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:54.064497+0000","last_change":"2023-11-27T18:43:54.064497+0000","last_active":"2023-11-27T18:43:54.064497+0000","last_peered":"2023-11-27T18:43:54.064497+0000","last_clean":"2023-11-27T18:43:54.064497+0000","last_became_active":"2023-11-27T18:13:12.310138+0000","last_became_peered":"2023-11-27T18:13:12.310138+0000","last_unstale":"2023-11-27T18:43:54.064497+0000","last_undegraded":"2023-11-27T18:43:54.064497+0000","last_fullsized":"2023-11-27T18:43:54.064497+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2023-11-27T18:43:54.064090+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2023-11-27T18:43:54.064090+0000","last_clean_scrub_stamp":"2023-11-27T18:43:54.064090+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:32:42.710824+0000","scrub_duration":0.0045180919999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"32'81","reported_seq":122,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:20.310080+0000","last_change":"2023-11-27T18:44:20.310080+0000","last_active":"2023-11-27T18:44:20.310080+0000","last_peered":"2023-11-27T18:44:20.310080+0000","last_clean":"2023-11-27T18:44:20.310080+0000","last_became_active":"2023-11-27T18:13:20.896156+0000","last_became_peered":"2023-11-27T18:13:20.896156+0000","last_unstale":"2023-11-27T18:44:20.310080+0000","last_undegraded":"2023-11-27T18:44:20.310080+0000","last_fullsized":"2023-11-27T18:44:20.310080+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'81","last_scrub_stamp":"2023-11-27T18:44:20.309827+0000","last_deep_scrub":"32'81","last_deep_scrub_stamp":"2023-11-27T18:44:20.309827+0000","last_clean_scrub_stamp":"2023-11-27T18:44:20.309827+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:40:12.238112+0000","scrub_duration":0.0079776129999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":6173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"32'22","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:41.582072+0000","last_change":"2023-11-27T18:43:41.582072+0000","last_active":"2023-11-27T18:43:41.582072+0000","last_peered":"2023-11-27T18:43:41.582072+0000","last_clean":"2023-11-27T18:43:41.582072+0000","last_became_active":"2023-11-27T18:13:14.421125+0000","last_became_peered":"2023-11-27T18:13:14.421125+0000","last_unstale":"2023-11-27T18:43:41.582072+0000","last_undegraded":"2023-11-27T18:43:41.582072+0000","last_fullsized":"2023-11-27T18:43:41.582072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2023-11-27T18:43:41.581900+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2023-11-27T18:43:41.581900+0000","last_clean_scrub_stamp":"2023-11-27T18:43:41.581900+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:46:07.424345+0000","scrub_duration":0.0018251680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"32'5","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:16.048664+0000","last_change":"2023-11-27T18:44:16.048664+0000","last_active":"2023-11-27T18:44:16.048664+0000","last_peered":"2023-11-27T18:44:16.048664+0000","last_clean":"2023-11-27T18:44:16.048664+0000","last_became_active":"2023-11-27T18:13:12.301617+0000","last_became_peered":"2023-11-27T18:13:12.301617+0000","last_unstale":"2023-11-27T18:44:16.048664+0000","last_undegraded":"2023-11-27T18:44:16.048664+0000","last_fullsized":"2023-11-27T18:44:16.048664+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2023-11-27T18:44:16.048306+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2023-11-27T18:44:16.048306+0000","last_clean_scrub_stamp":"2023-11-27T18:44:16.048306+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:54:42.145821+0000","scrub_duration":0.0043585409999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'68","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:22.381445+0000","last_change":"2023-11-27T18:44:22.381445+0000","last_active":"2023-11-27T18:44:22.381445+0000","last_peered":"2023-11-27T18:44:22.381445+0000","last_clean":"2023-11-27T18:44:22.381445+0000","last_became_active":"2023-11-27T18:13:20.903019+0000","last_became_peered":"2023-11-27T18:13:20.903019+0000","last_unstale":"2023-11-27T18:44:22.381445+0000","last_undegraded":"2023-11-27T18:44:22.381445+0000","last_fullsized":"2023-11-27T18:44:22.381445+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'68","last_scrub_stamp":"2023-11-27T18:44:22.381185+0000","last_deep_scrub":"32'68","last_deep_scrub_stamp":"2023-11-27T18:44:22.381185+0000","last_clean_scrub_stamp":"2023-11-27T18:44:22.381185+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:05:21.538766+0000","scrub_duration":0.0091788240000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":4275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"32'26","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:15.846601+0000","last_change":"2023-11-27T18:44:15.846651+0000","last_active":"2023-11-27T18:44:15.846601+0000","last_peered":"2023-11-27T18:44:15.846601+0000","last_clean":"2023-11-27T18:44:15.846601+0000","last_became_active":"2023-11-27T18:13:14.378644+0000","last_became_peered":"2023-11-27T18:13:14.378644+0000","last_unstale":"2023-11-27T18:44:15.846601+0000","last_undegraded":"2023-11-27T18:44:15.846601+0000","last_fullsized":"2023-11-27T18:44:15.846601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'26","last_scrub_stamp":"2023-11-27T18:44:15.846395+0000","last_deep_scrub":"32'26","last_deep_scrub_stamp":"2023-11-27T18:44:15.846395+0000","last_clean_scrub_stamp":"2023-11-27T18:44:15.846395+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:16:14.706577+0000","scrub_duration":0.0035380469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"32'556","reported_seq":1150,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:44.099800+0000","last_change":"2023-11-27T18:43:44.099800+0000","last_active":"2023-11-27T18:43:44.099800+0000","last_peered":"2023-11-27T18:43:44.099800+0000","last_clean":"2023-11-27T18:43:44.099800+0000","last_became_active":"2023-11-27T18:13:12.305380+0000","last_became_peered":"2023-11-27T18:13:12.305380+0000","last_unstale":"2023-11-27T18:43:44.099800+0000","last_undegraded":"2023-11-27T18:43:44.099800+0000","last_fullsized":"2023-11-27T18:43:44.099800+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'556","last_scrub_stamp":"2023-11-27T18:43:44.099467+0000","last_deep_scrub":"32'556","last_deep_scrub_stamp":"2023-11-27T18:43:44.099467+0000","last_clean_scrub_stamp":"2023-11-27T18:43:44.099467+0000","objects_scrubbed":1,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:29:30.687440+0000","scrub_duration":0.0048880249999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128192,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":549,"num_read_kb":581,"num_write":552,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"32'76","reported_seq":116,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:27.382806+0000","last_change":"2023-11-27T18:44:27.382862+0000","last_active":"2023-11-27T18:44:27.382806+0000","last_peered":"2023-11-27T18:44:27.382806+0000","last_clean":"2023-11-27T18:44:27.382806+0000","last_became_active":"2023-11-27T18:13:20.913137+0000","last_became_peered":"2023-11-27T18:13:20.913137+0000","last_unstale":"2023-11-27T18:44:27.382806+0000","last_undegraded":"2023-11-27T18:44:27.382806+0000","last_fullsized":"2023-11-27T18:44:27.382806+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'76","last_scrub_stamp":"2023-11-27T18:44:27.382613+0000","last_deep_scrub":"32'76","last_deep_scrub_stamp":"2023-11-27T18:44:27.382613+0000","last_clean_scrub_stamp":"2023-11-27T18:44:27.382613+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:33:51.180861+0000","scrub_duration":0.0074036980000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":7407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"32'15","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:58.444628+0000","last_change":"2023-11-27T18:43:58.444628+0000","last_active":"2023-11-27T18:43:58.444628+0000","last_peered":"2023-11-27T18:43:58.444628+0000","last_clean":"2023-11-27T18:43:58.444628+0000","last_became_active":"2023-11-27T18:13:14.413413+0000","last_became_peered":"2023-11-27T18:13:14.413413+0000","last_unstale":"2023-11-27T18:43:58.444628+0000","last_undegraded":"2023-11-27T18:43:58.444628+0000","last_fullsized":"2023-11-27T18:43:58.444628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2023-11-27T18:43:58.444377+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2023-11-27T18:43:58.444377+0000","last_clean_scrub_stamp":"2023-11-27T18:43:58.444377+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:46:24.286822+0000","scrub_duration":0.003852397,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:10.127443+0000","last_change":"2023-11-27T18:44:10.127545+0000","last_active":"2023-11-27T18:44:10.127443+0000","last_peered":"2023-11-27T18:44:10.127443+0000","last_clean":"2023-11-27T18:44:10.127443+0000","last_became_active":"2023-11-27T18:13:12.315610+0000","last_became_peered":"2023-11-27T18:13:12.315610+0000","last_unstale":"2023-11-27T18:44:10.127443+0000","last_undegraded":"2023-11-27T18:44:10.127443+0000","last_fullsized":"2023-11-27T18:44:10.127443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2023-11-27T18:44:10.127224+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2023-11-27T18:44:10.127224+0000","last_clean_scrub_stamp":"2023-11-27T18:44:10.127224+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:50:06.266659+0000","scrub_duration":0.0045927720000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"32'85","reported_seq":125,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:23.925337+0000","last_change":"2023-11-27T18:44:23.925402+0000","last_active":"2023-11-27T18:44:23.925337+0000","last_peered":"2023-11-27T18:44:23.925337+0000","last_clean":"2023-11-27T18:44:23.925337+0000","last_became_active":"2023-11-27T18:13:20.912453+0000","last_became_peered":"2023-11-27T18:13:20.912453+0000","last_unstale":"2023-11-27T18:44:23.925337+0000","last_undegraded":"2023-11-27T18:44:23.925337+0000","last_fullsized":"2023-11-27T18:44:23.925337+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'85","last_scrub_stamp":"2023-11-27T18:44:23.925116+0000","last_deep_scrub":"32'85","last_deep_scrub_stamp":"2023-11-27T18:44:23.925116+0000","last_clean_scrub_stamp":"2023-11-27T18:44:23.925116+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:25:08.143647+0000","scrub_duration":0.0082730440000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":10738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"32'21","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:38.774348+0000","last_change":"2023-11-27T18:43:38.774348+0000","last_active":"2023-11-27T18:43:38.774348+0000","last_peered":"2023-11-27T18:43:38.774348+0000","last_clean":"2023-11-27T18:43:38.774348+0000","last_became_active":"2023-11-27T18:13:14.414156+0000","last_became_peered":"2023-11-27T18:13:14.414156+0000","last_unstale":"2023-11-27T18:43:38.774348+0000","last_undegraded":"2023-11-27T18:43:38.774348+0000","last_fullsized":"2023-11-27T18:43:38.774348+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2023-11-27T18:43:38.774109+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2023-11-27T18:43:38.774109+0000","last_clean_scrub_stamp":"2023-11-27T18:43:38.774109+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:37:26.401993+0000","scrub_duration":0.003067443,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"32'3","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:20.021203+0000","last_change":"2023-11-27T18:44:20.021203+0000","last_active":"2023-11-27T18:44:20.021203+0000","last_peered":"2023-11-27T18:44:20.021203+0000","last_clean":"2023-11-27T18:44:20.021203+0000","last_became_active":"2023-11-27T18:13:12.308050+0000","last_became_peered":"2023-11-27T18:13:12.308050+0000","last_unstale":"2023-11-27T18:44:20.021203+0000","last_undegraded":"2023-11-27T18:44:20.021203+0000","last_fullsized":"2023-11-27T18:44:20.021203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2023-11-27T18:44:20.020928+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2023-11-27T18:44:20.020928+0000","last_clean_scrub_stamp":"2023-11-27T18:44:20.020928+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:41:44.074226+0000","scrub_duration":0.003879857,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"32'119","reported_seq":198,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:35.406912+0000","last_change":"2023-11-27T18:43:35.406964+0000","last_active":"2023-11-27T18:43:35.406912+0000","last_peered":"2023-11-27T18:43:35.406912+0000","last_clean":"2023-11-27T18:43:35.406912+0000","last_became_active":"2023-11-27T18:12:38.370748+0000","last_became_peered":"2023-11-27T18:12:38.370748+0000","last_unstale":"2023-11-27T18:43:35.406912+0000","last_undegraded":"2023-11-27T18:43:35.406912+0000","last_fullsized":"2023-11-27T18:43:35.406912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2023-11-27T18:43:35.406767+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2023-11-27T18:43:35.406767+0000","last_clean_scrub_stamp":"2023-11-27T18:43:35.406767+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:03:00.314752+0000","scrub_duration":0.010946301,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'86","reported_seq":118,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:44.384201+0000","last_change":"2023-11-27T18:13:20.928359+0000","last_active":"2023-11-27T18:42:44.384201+0000","last_peered":"2023-11-27T18:42:44.384201+0000","last_clean":"2023-11-27T18:42:44.384201+0000","last_became_active":"2023-11-27T18:13:20.926559+0000","last_became_peered":"2023-11-27T18:13:20.926559+0000","last_unstale":"2023-11-27T18:42:44.384201+0000","last_undegraded":"2023-11-27T18:42:44.384201+0000","last_fullsized":"2023-11-27T18:42:44.384201+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":7930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"32'24","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:35.676275+0000","last_change":"2023-11-27T18:44:35.676327+0000","last_active":"2023-11-27T18:44:35.676275+0000","last_peered":"2023-11-27T18:44:35.676275+0000","last_clean":"2023-11-27T18:44:35.676275+0000","last_became_active":"2023-11-27T18:13:14.419636+0000","last_became_peered":"2023-11-27T18:13:14.419636+0000","last_unstale":"2023-11-27T18:44:35.676275+0000","last_undegraded":"2023-11-27T18:44:35.676275+0000","last_fullsized":"2023-11-27T18:44:35.676275+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'24","last_scrub_stamp":"2023-11-27T18:44:35.676071+0000","last_deep_scrub":"32'24","last_deep_scrub_stamp":"2023-11-27T18:44:35.676071+0000","last_clean_scrub_stamp":"2023-11-27T18:44:35.676071+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:07:47.911622+0000","scrub_duration":0.00342597,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"32'2","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:43.374000+0000","last_change":"2023-11-27T18:43:43.374050+0000","last_active":"2023-11-27T18:43:43.374000+0000","last_peered":"2023-11-27T18:43:43.374000+0000","last_clean":"2023-11-27T18:43:43.374000+0000","last_became_active":"2023-11-27T18:13:12.267764+0000","last_became_peered":"2023-11-27T18:13:12.267764+0000","last_unstale":"2023-11-27T18:43:43.374000+0000","last_undegraded":"2023-11-27T18:43:43.374000+0000","last_fullsized":"2023-11-27T18:43:43.374000+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2023-11-27T18:43:43.373801+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2023-11-27T18:43:43.373801+0000","last_clean_scrub_stamp":"2023-11-27T18:43:43.373801+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:57:29.602489+0000","scrub_duration":0.0042106540000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"32'73","reported_seq":113,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:04.359448+0000","last_change":"2023-11-27T18:44:04.359503+0000","last_active":"2023-11-27T18:44:04.359448+0000","last_peered":"2023-11-27T18:44:04.359448+0000","last_clean":"2023-11-27T18:44:04.359448+0000","last_became_active":"2023-11-27T18:13:20.914157+0000","last_became_peered":"2023-11-27T18:13:20.914157+0000","last_unstale":"2023-11-27T18:44:04.359448+0000","last_undegraded":"2023-11-27T18:44:04.359448+0000","last_fullsized":"2023-11-27T18:44:04.359448+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'73","last_scrub_stamp":"2023-11-27T18:44:04.359245+0000","last_deep_scrub":"32'73","last_deep_scrub_stamp":"2023-11-27T18:44:04.359245+0000","last_clean_scrub_stamp":"2023-11-27T18:44:04.359245+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:30:35.787623+0000","scrub_duration":0.0096271519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":5275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'24","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:04.449331+0000","last_change":"2023-11-27T18:44:04.449383+0000","last_active":"2023-11-27T18:44:04.449331+0000","last_peered":"2023-11-27T18:44:04.449331+0000","last_clean":"2023-11-27T18:44:04.449331+0000","last_became_active":"2023-11-27T18:13:14.363285+0000","last_became_peered":"2023-11-27T18:13:14.363285+0000","last_unstale":"2023-11-27T18:44:04.449331+0000","last_undegraded":"2023-11-27T18:44:04.449331+0000","last_fullsized":"2023-11-27T18:44:04.449331+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'24","last_scrub_stamp":"2023-11-27T18:44:04.449134+0000","last_deep_scrub":"32'24","last_deep_scrub_stamp":"2023-11-27T18:44:04.449134+0000","last_clean_scrub_stamp":"2023-11-27T18:44:04.449134+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:31:02.404937+0000","scrub_duration":0.0036982669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:59.020721+0000","last_change":"2023-11-27T18:43:59.020774+0000","last_active":"2023-11-27T18:43:59.020721+0000","last_peered":"2023-11-27T18:43:59.020721+0000","last_clean":"2023-11-27T18:43:59.020721+0000","last_became_active":"2023-11-27T18:13:12.312038+0000","last_became_peered":"2023-11-27T18:13:12.312038+0000","last_unstale":"2023-11-27T18:43:59.020721+0000","last_undegraded":"2023-11-27T18:43:59.020721+0000","last_fullsized":"2023-11-27T18:43:59.020721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2023-11-27T18:43:59.020532+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2023-11-27T18:43:59.020532+0000","last_clean_scrub_stamp":"2023-11-27T18:43:59.020532+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:11:10.104848+0000","scrub_duration":0.007309444,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"32'90","reported_seq":129,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:18.938151+0000","last_change":"2023-11-27T18:44:18.938261+0000","last_active":"2023-11-27T18:44:18.938151+0000","last_peered":"2023-11-27T18:44:18.938151+0000","last_clean":"2023-11-27T18:44:18.938151+0000","last_became_active":"2023-11-27T18:13:20.912734+0000","last_became_peered":"2023-11-27T18:13:20.912734+0000","last_unstale":"2023-11-27T18:44:18.938151+0000","last_undegraded":"2023-11-27T18:44:18.938151+0000","last_fullsized":"2023-11-27T18:44:18.938151+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'90","last_scrub_stamp":"2023-11-27T18:44:18.937834+0000","last_deep_scrub":"32'90","last_deep_scrub_stamp":"2023-11-27T18:44:18.937834+0000","last_clean_scrub_stamp":"2023-11-27T18:44:18.937834+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:36:32.564575+0000","scrub_duration":0.010434255,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":13642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"32'25","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:19.606681+0000","last_change":"2023-11-27T18:44:19.606734+0000","last_active":"2023-11-27T18:44:19.606681+0000","last_peered":"2023-11-27T18:44:19.606681+0000","last_clean":"2023-11-27T18:44:19.606681+0000","last_became_active":"2023-11-27T18:13:14.363772+0000","last_became_peered":"2023-11-27T18:13:14.363772+0000","last_unstale":"2023-11-27T18:44:19.606681+0000","last_undegraded":"2023-11-27T18:44:19.606681+0000","last_fullsized":"2023-11-27T18:44:19.606681+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'25","last_scrub_stamp":"2023-11-27T18:44:19.606489+0000","last_deep_scrub":"32'25","last_deep_scrub_stamp":"2023-11-27T18:44:19.606489+0000","last_clean_scrub_stamp":"2023-11-27T18:44:19.606489+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:15:55.596546+0000","scrub_duration":0.0048144879999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"32'5","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:44.804824+0000","last_change":"2023-11-27T18:43:44.804824+0000","last_active":"2023-11-27T18:43:44.804824+0000","last_peered":"2023-11-27T18:43:44.804824+0000","last_clean":"2023-11-27T18:43:44.804824+0000","last_became_active":"2023-11-27T18:13:12.304400+0000","last_became_peered":"2023-11-27T18:13:12.304400+0000","last_unstale":"2023-11-27T18:43:44.804824+0000","last_undegraded":"2023-11-27T18:43:44.804824+0000","last_fullsized":"2023-11-27T18:43:44.804824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2023-11-27T18:43:44.804676+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2023-11-27T18:43:44.804676+0000","last_clean_scrub_stamp":"2023-11-27T18:43:44.804676+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:34:25.156520+0000","scrub_duration":0.005907214,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"32'60","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:38.700459+0000","last_change":"2023-11-27T18:44:38.700513+0000","last_active":"2023-11-27T18:44:38.700459+0000","last_peered":"2023-11-27T18:44:38.700459+0000","last_clean":"2023-11-27T18:44:38.700459+0000","last_became_active":"2023-11-27T18:13:20.918984+0000","last_became_peered":"2023-11-27T18:13:20.918984+0000","last_unstale":"2023-11-27T18:44:38.700459+0000","last_undegraded":"2023-11-27T18:44:38.700459+0000","last_fullsized":"2023-11-27T18:44:38.700459+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'60","last_scrub_stamp":"2023-11-27T18:44:38.700253+0000","last_deep_scrub":"32'60","last_deep_scrub_stamp":"2023-11-27T18:44:38.700253+0000","last_clean_scrub_stamp":"2023-11-27T18:44:38.700253+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:35:59.976977+0000","scrub_duration":0.010648087000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":5801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"32'17","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:00.411633+0000","last_change":"2023-11-27T18:44:00.411686+0000","last_active":"2023-11-27T18:44:00.411633+0000","last_peered":"2023-11-27T18:44:00.411633+0000","last_clean":"2023-11-27T18:44:00.411633+0000","last_became_active":"2023-11-27T18:13:15.852339+0000","last_became_peered":"2023-11-27T18:13:15.852339+0000","last_unstale":"2023-11-27T18:44:00.411633+0000","last_undegraded":"2023-11-27T18:44:00.411633+0000","last_fullsized":"2023-11-27T18:44:00.411633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'17","last_scrub_stamp":"2023-11-27T18:44:00.411434+0000","last_deep_scrub":"32'17","last_deep_scrub_stamp":"2023-11-27T18:44:00.411434+0000","last_clean_scrub_stamp":"2023-11-27T18:44:00.411434+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:55:07.805364+0000","scrub_duration":0.0033991469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"32'8","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:53.554964+0000","last_change":"2023-11-27T18:43:53.555022+0000","last_active":"2023-11-27T18:43:53.554964+0000","last_peered":"2023-11-27T18:43:53.554964+0000","last_clean":"2023-11-27T18:43:53.554964+0000","last_became_active":"2023-11-27T18:13:12.310921+0000","last_became_peered":"2023-11-27T18:13:12.310921+0000","last_unstale":"2023-11-27T18:43:53.554964+0000","last_undegraded":"2023-11-27T18:43:53.554964+0000","last_fullsized":"2023-11-27T18:43:53.554964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2023-11-27T18:43:53.554762+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2023-11-27T18:43:53.554762+0000","last_clean_scrub_stamp":"2023-11-27T18:43:53.554762+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:55:00.948692+0000","scrub_duration":0.0077624699999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"32'108","reported_seq":148,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:48.434011+0000","last_change":"2023-11-27T18:43:48.434127+0000","last_active":"2023-11-27T18:43:48.434011+0000","last_peered":"2023-11-27T18:43:48.434011+0000","last_clean":"2023-11-27T18:43:48.434011+0000","last_became_active":"2023-11-27T18:13:20.924209+0000","last_became_peered":"2023-11-27T18:13:20.924209+0000","last_unstale":"2023-11-27T18:43:48.434011+0000","last_undegraded":"2023-11-27T18:43:48.434011+0000","last_fullsized":"2023-11-27T18:43:48.434011+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'108","last_scrub_stamp":"2023-11-27T18:43:48.433759+0000","last_deep_scrub":"32'108","last_deep_scrub_stamp":"2023-11-27T18:43:48.433759+0000","last_clean_scrub_stamp":"2023-11-27T18:43:48.433759+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:01:47.609449+0000","scrub_duration":0.0086909529999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":10743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"32'21","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:44.098293+0000","last_change":"2023-11-27T18:43:44.098343+0000","last_active":"2023-11-27T18:43:44.098293+0000","last_peered":"2023-11-27T18:43:44.098293+0000","last_clean":"2023-11-27T18:43:44.098293+0000","last_became_active":"2023-11-27T18:13:14.421377+0000","last_became_peered":"2023-11-27T18:13:14.421377+0000","last_unstale":"2023-11-27T18:43:44.098293+0000","last_undegraded":"2023-11-27T18:43:44.098293+0000","last_fullsized":"2023-11-27T18:43:44.098293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2023-11-27T18:43:44.098079+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2023-11-27T18:43:44.098079+0000","last_clean_scrub_stamp":"2023-11-27T18:43:44.098079+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:35:06.114321+0000","scrub_duration":0.0038697369999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"32'16","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:39.823098+0000","last_change":"2023-11-27T18:43:39.823170+0000","last_active":"2023-11-27T18:43:39.823098+0000","last_peered":"2023-11-27T18:43:39.823098+0000","last_clean":"2023-11-27T18:43:39.823098+0000","last_became_active":"2023-11-27T18:13:12.177997+0000","last_became_peered":"2023-11-27T18:13:12.177997+0000","last_unstale":"2023-11-27T18:43:39.823098+0000","last_undegraded":"2023-11-27T18:43:39.823098+0000","last_fullsized":"2023-11-27T18:43:39.823098+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2023-11-27T18:43:39.822860+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2023-11-27T18:43:39.822860+0000","last_clean_scrub_stamp":"2023-11-27T18:43:39.822860+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:51:20.471317+0000","scrub_duration":0.0097847799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"32'95","reported_seq":133,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:22.901016+0000","last_change":"2023-11-27T18:44:22.901078+0000","last_active":"2023-11-27T18:44:22.901016+0000","last_peered":"2023-11-27T18:44:22.901016+0000","last_clean":"2023-11-27T18:44:22.901016+0000","last_became_active":"2023-11-27T18:13:20.914144+0000","last_became_peered":"2023-11-27T18:13:20.914144+0000","last_unstale":"2023-11-27T18:44:22.901016+0000","last_undegraded":"2023-11-27T18:44:22.901016+0000","last_fullsized":"2023-11-27T18:44:22.901016+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'95","last_scrub_stamp":"2023-11-27T18:44:22.900794+0000","last_deep_scrub":"32'95","last_deep_scrub_stamp":"2023-11-27T18:44:22.900794+0000","last_clean_scrub_stamp":"2023-11-27T18:44:22.900794+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:23:07.955913+0000","scrub_duration":0.008362721,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":5846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"32'23","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:40.431950+0000","last_change":"2023-11-27T18:43:40.431969+0000","last_active":"2023-11-27T18:43:40.431950+0000","last_peered":"2023-11-27T18:43:40.431950+0000","last_clean":"2023-11-27T18:43:40.431950+0000","last_became_active":"2023-11-27T18:13:15.801804+0000","last_became_peered":"2023-11-27T18:13:15.801804+0000","last_unstale":"2023-11-27T18:43:40.431950+0000","last_undegraded":"2023-11-27T18:43:40.431950+0000","last_fullsized":"2023-11-27T18:43:40.431950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2023-11-27T18:43:40.431874+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2023-11-27T18:43:40.431874+0000","last_clean_scrub_stamp":"2023-11-27T18:43:40.431874+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:16:45.688555+0000","scrub_duration":0.002873408,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"32'5","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:57.545050+0000","last_change":"2023-11-27T18:43:57.545160+0000","last_active":"2023-11-27T18:43:57.545050+0000","last_peered":"2023-11-27T18:43:57.545050+0000","last_clean":"2023-11-27T18:43:57.545050+0000","last_became_active":"2023-11-27T18:13:12.300585+0000","last_became_peered":"2023-11-27T18:13:12.300585+0000","last_unstale":"2023-11-27T18:43:57.545050+0000","last_undegraded":"2023-11-27T18:43:57.545050+0000","last_fullsized":"2023-11-27T18:43:57.545050+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2023-11-27T18:43:57.544819+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2023-11-27T18:43:57.544819+0000","last_clean_scrub_stamp":"2023-11-27T18:43:57.544819+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:33:15.951006+0000","scrub_duration":0.0033027500000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"32'85","reported_seq":123,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:26.923498+0000","last_change":"2023-11-27T18:44:26.923608+0000","last_active":"2023-11-27T18:44:26.923498+0000","last_peered":"2023-11-27T18:44:26.923498+0000","last_clean":"2023-11-27T18:44:26.923498+0000","last_became_active":"2023-11-27T18:13:20.914216+0000","last_became_peered":"2023-11-27T18:13:20.914216+0000","last_unstale":"2023-11-27T18:44:26.923498+0000","last_undegraded":"2023-11-27T18:44:26.923498+0000","last_fullsized":"2023-11-27T18:44:26.923498+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'85","last_scrub_stamp":"2023-11-27T18:44:26.923259+0000","last_deep_scrub":"32'85","last_deep_scrub_stamp":"2023-11-27T18:44:26.923259+0000","last_clean_scrub_stamp":"2023-11-27T18:44:26.923259+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:33:53.863173+0000","scrub_duration":0.0090487410000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":6050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"32'39","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:34.397067+0000","last_change":"2023-11-27T18:14:22.518196+0000","last_active":"2023-11-27T18:43:34.397067+0000","last_peered":"2023-11-27T18:43:34.397067+0000","last_clean":"2023-11-27T18:43:34.397067+0000","last_became_active":"2023-11-27T18:14:22.517527+0000","last_became_peered":"2023-11-27T18:14:22.517527+0000","last_unstale":"2023-11-27T18:43:34.397067+0000","last_undegraded":"2023-11-27T18:43:34.397067+0000","last_fullsized":"2023-11-27T18:43:34.397067+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:11.696161+0000","last_clean_scrub_stamp":"2023-11-27T18:13:11.696161+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"32'5","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:00.195175+0000","last_change":"2023-11-27T18:44:00.195227+0000","last_active":"2023-11-27T18:44:00.195175+0000","last_peered":"2023-11-27T18:44:00.195175+0000","last_clean":"2023-11-27T18:44:00.195175+0000","last_became_active":"2023-11-27T18:13:12.304777+0000","last_became_peered":"2023-11-27T18:13:12.304777+0000","last_unstale":"2023-11-27T18:44:00.195175+0000","last_undegraded":"2023-11-27T18:44:00.195175+0000","last_fullsized":"2023-11-27T18:44:00.195175+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2023-11-27T18:44:00.194991+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2023-11-27T18:44:00.194991+0000","last_clean_scrub_stamp":"2023-11-27T18:44:00.194991+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:46:55.415546+0000","scrub_duration":0.0035181409999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"32'64","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:26.427944+0000","last_change":"2023-11-27T18:44:26.427998+0000","last_active":"2023-11-27T18:44:26.427944+0000","last_peered":"2023-11-27T18:44:26.427944+0000","last_clean":"2023-11-27T18:44:26.427944+0000","last_became_active":"2023-11-27T18:13:20.902282+0000","last_became_peered":"2023-11-27T18:13:20.902282+0000","last_unstale":"2023-11-27T18:44:26.427944+0000","last_undegraded":"2023-11-27T18:44:26.427944+0000","last_fullsized":"2023-11-27T18:44:26.427944+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'64","last_scrub_stamp":"2023-11-27T18:44:26.427738+0000","last_deep_scrub":"32'64","last_deep_scrub_stamp":"2023-11-27T18:44:26.427738+0000","last_clean_scrub_stamp":"2023-11-27T18:44:26.427738+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:28:07.913582+0000","scrub_duration":0.010060662,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":6349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"32'27","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:13.318208+0000","last_change":"2023-11-27T18:44:13.318253+0000","last_active":"2023-11-27T18:44:13.318208+0000","last_peered":"2023-11-27T18:44:13.318208+0000","last_clean":"2023-11-27T18:44:13.318208+0000","last_became_active":"2023-11-27T18:13:14.415004+0000","last_became_peered":"2023-11-27T18:13:14.415004+0000","last_unstale":"2023-11-27T18:44:13.318208+0000","last_undegraded":"2023-11-27T18:44:13.318208+0000","last_fullsized":"2023-11-27T18:44:13.318208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'27","last_scrub_stamp":"2023-11-27T18:44:13.318061+0000","last_deep_scrub":"32'27","last_deep_scrub_stamp":"2023-11-27T18:44:13.318061+0000","last_clean_scrub_stamp":"2023-11-27T18:44:13.318061+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:33:31.724248+0000","scrub_duration":0.0035498249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"32'7","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:43.077245+0000","last_change":"2023-11-27T18:43:43.077303+0000","last_active":"2023-11-27T18:43:43.077245+0000","last_peered":"2023-11-27T18:43:43.077245+0000","last_clean":"2023-11-27T18:43:43.077245+0000","last_became_active":"2023-11-27T18:13:12.268237+0000","last_became_peered":"2023-11-27T18:13:12.268237+0000","last_unstale":"2023-11-27T18:43:43.077245+0000","last_undegraded":"2023-11-27T18:43:43.077245+0000","last_fullsized":"2023-11-27T18:43:43.077245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2023-11-27T18:43:43.077057+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2023-11-27T18:43:43.077057+0000","last_clean_scrub_stamp":"2023-11-27T18:43:43.077057+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:43:39.542648+0000","scrub_duration":0.0087600239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"32'82","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:42:24.615247+0000","last_change":"2023-11-27T18:13:20.900393+0000","last_active":"2023-11-27T18:42:24.615247+0000","last_peered":"2023-11-27T18:42:24.615247+0000","last_clean":"2023-11-27T18:42:24.615247+0000","last_became_active":"2023-11-27T18:13:20.899358+0000","last_became_peered":"2023-11-27T18:13:20.899358+0000","last_unstale":"2023-11-27T18:42:24.615247+0000","last_undegraded":"2023-11-27T18:42:24.615247+0000","last_fullsized":"2023-11-27T18:42:24.615247+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":8446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"32'23","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:08.498067+0000","last_change":"2023-11-27T18:44:08.498067+0000","last_active":"2023-11-27T18:44:08.498067+0000","last_peered":"2023-11-27T18:44:08.498067+0000","last_clean":"2023-11-27T18:44:08.498067+0000","last_became_active":"2023-11-27T18:13:14.371637+0000","last_became_peered":"2023-11-27T18:13:14.371637+0000","last_unstale":"2023-11-27T18:44:08.498067+0000","last_undegraded":"2023-11-27T18:44:08.498067+0000","last_fullsized":"2023-11-27T18:44:08.498067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2023-11-27T18:44:08.497806+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2023-11-27T18:44:08.497806+0000","last_clean_scrub_stamp":"2023-11-27T18:44:08.497806+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:53:14.709913+0000","scrub_duration":0.0041375810000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"32'875","reported_seq":918,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:43.474525+0000","last_change":"2023-11-27T18:43:43.474525+0000","last_active":"2023-11-27T18:43:43.474525+0000","last_peered":"2023-11-27T18:43:43.474525+0000","last_clean":"2023-11-27T18:43:43.474525+0000","last_became_active":"2023-11-27T18:13:12.248077+0000","last_became_peered":"2023-11-27T18:13:12.248077+0000","last_unstale":"2023-11-27T18:43:43.474525+0000","last_undegraded":"2023-11-27T18:43:43.474525+0000","last_fullsized":"2023-11-27T18:43:43.474525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'875","last_scrub_stamp":"2023-11-27T18:43:43.474251+0000","last_deep_scrub":"32'875","last_deep_scrub_stamp":"2023-11-27T18:43:43.474251+0000","last_clean_scrub_stamp":"2023-11-27T18:43:43.474251+0000","objects_scrubbed":4,"log_size":875,"log_dups_size":0,"ondisk_log_size":875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:21:15.277979+0000","scrub_duration":0.045304398000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":867,"num_write_kb":4596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"32'83","reported_seq":122,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:08.889040+0000","last_change":"2023-11-27T18:44:08.889093+0000","last_active":"2023-11-27T18:44:08.889040+0000","last_peered":"2023-11-27T18:44:08.889040+0000","last_clean":"2023-11-27T18:44:08.889040+0000","last_became_active":"2023-11-27T18:13:20.918381+0000","last_became_peered":"2023-11-27T18:13:20.918381+0000","last_unstale":"2023-11-27T18:44:08.889040+0000","last_undegraded":"2023-11-27T18:44:08.889040+0000","last_fullsized":"2023-11-27T18:44:08.889040+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'83","last_scrub_stamp":"2023-11-27T18:44:08.888853+0000","last_deep_scrub":"32'83","last_deep_scrub_stamp":"2023-11-27T18:44:08.888853+0000","last_clean_scrub_stamp":"2023-11-27T18:44:08.888853+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:07:18.255198+0000","scrub_duration":0.0092657209999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":11273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"32'25","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:38.063922+0000","last_change":"2023-11-27T18:43:38.063922+0000","last_active":"2023-11-27T18:43:38.063922+0000","last_peered":"2023-11-27T18:43:38.063922+0000","last_clean":"2023-11-27T18:43:38.063922+0000","last_became_active":"2023-11-27T18:13:14.415026+0000","last_became_peered":"2023-11-27T18:13:14.415026+0000","last_unstale":"2023-11-27T18:43:38.063922+0000","last_undegraded":"2023-11-27T18:43:38.063922+0000","last_fullsized":"2023-11-27T18:43:38.063922+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'25","last_scrub_stamp":"2023-11-27T18:43:38.063802+0000","last_deep_scrub":"32'25","last_deep_scrub_stamp":"2023-11-27T18:43:38.063802+0000","last_clean_scrub_stamp":"2023-11-27T18:43:38.063802+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:55:14.604318+0000","scrub_duration":0.0021425820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"32'401","reported_seq":444,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:46.071950+0000","last_change":"2023-11-27T18:43:46.071950+0000","last_active":"2023-11-27T18:43:46.071950+0000","last_peered":"2023-11-27T18:43:46.071950+0000","last_clean":"2023-11-27T18:43:46.071950+0000","last_became_active":"2023-11-27T18:13:12.180112+0000","last_became_peered":"2023-11-27T18:13:12.180112+0000","last_unstale":"2023-11-27T18:43:46.071950+0000","last_undegraded":"2023-11-27T18:43:46.071950+0000","last_fullsized":"2023-11-27T18:43:46.071950+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'401","last_scrub_stamp":"2023-11-27T18:43:46.071689+0000","last_deep_scrub":"32'401","last_deep_scrub_stamp":"2023-11-27T18:43:46.071689+0000","last_clean_scrub_stamp":"2023-11-27T18:43:46.071689+0000","objects_scrubbed":2,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:53:59.905538+0000","scrub_duration":0.0074079840000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":397,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"32'109","reported_seq":148,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:07.393509+0000","last_change":"2023-11-27T18:44:07.393565+0000","last_active":"2023-11-27T18:44:07.393509+0000","last_peered":"2023-11-27T18:44:07.393509+0000","last_clean":"2023-11-27T18:44:07.393509+0000","last_became_active":"2023-11-27T18:13:20.921675+0000","last_became_peered":"2023-11-27T18:13:20.921675+0000","last_unstale":"2023-11-27T18:44:07.393509+0000","last_undegraded":"2023-11-27T18:44:07.393509+0000","last_fullsized":"2023-11-27T18:44:07.393509+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'109","last_scrub_stamp":"2023-11-27T18:44:07.393308+0000","last_deep_scrub":"32'109","last_deep_scrub_stamp":"2023-11-27T18:44:07.393308+0000","last_clean_scrub_stamp":"2023-11-27T18:44:07.393308+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:11:18.477624+0000","scrub_duration":0.0094143639999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":15987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"32'29","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:00.974174+0000","last_change":"2023-11-27T18:44:00.974174+0000","last_active":"2023-11-27T18:44:00.974174+0000","last_peered":"2023-11-27T18:44:00.974174+0000","last_clean":"2023-11-27T18:44:00.974174+0000","last_became_active":"2023-11-27T18:13:14.415142+0000","last_became_peered":"2023-11-27T18:13:14.415142+0000","last_unstale":"2023-11-27T18:44:00.974174+0000","last_undegraded":"2023-11-27T18:44:00.974174+0000","last_fullsized":"2023-11-27T18:44:00.974174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'29","last_scrub_stamp":"2023-11-27T18:44:00.973707+0000","last_deep_scrub":"32'29","last_deep_scrub_stamp":"2023-11-27T18:44:00.973707+0000","last_clean_scrub_stamp":"2023-11-27T18:44:00.973707+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:05:00.131288+0000","scrub_duration":0.0069063780000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"32'2","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:54.529597+0000","last_change":"2023-11-27T18:43:54.529597+0000","last_active":"2023-11-27T18:43:54.529597+0000","last_peered":"2023-11-27T18:43:54.529597+0000","last_clean":"2023-11-27T18:43:54.529597+0000","last_became_active":"2023-11-27T18:13:12.273400+0000","last_became_peered":"2023-11-27T18:13:12.273400+0000","last_unstale":"2023-11-27T18:43:54.529597+0000","last_undegraded":"2023-11-27T18:43:54.529597+0000","last_fullsized":"2023-11-27T18:43:54.529597+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2023-11-27T18:43:54.529213+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2023-11-27T18:43:54.529213+0000","last_clean_scrub_stamp":"2023-11-27T18:43:54.529213+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:42:29.722428+0000","scrub_duration":0.0039019240000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"32'83","reported_seq":122,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:54.129517+0000","last_change":"2023-11-27T18:43:54.129623+0000","last_active":"2023-11-27T18:43:54.129517+0000","last_peered":"2023-11-27T18:43:54.129517+0000","last_clean":"2023-11-27T18:43:54.129517+0000","last_became_active":"2023-11-27T18:13:20.912063+0000","last_became_peered":"2023-11-27T18:13:20.912063+0000","last_unstale":"2023-11-27T18:43:54.129517+0000","last_undegraded":"2023-11-27T18:43:54.129517+0000","last_fullsized":"2023-11-27T18:43:54.129517+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'83","last_scrub_stamp":"2023-11-27T18:43:54.129288+0000","last_deep_scrub":"32'83","last_deep_scrub_stamp":"2023-11-27T18:43:54.129288+0000","last_clean_scrub_stamp":"2023-11-27T18:43:54.129288+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:31:56.018013+0000","scrub_duration":0.010352907999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":11074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"32'29","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:57.411534+0000","last_change":"2023-11-27T18:43:57.411534+0000","last_active":"2023-11-27T18:43:57.411534+0000","last_peered":"2023-11-27T18:43:57.411534+0000","last_clean":"2023-11-27T18:43:57.411534+0000","last_became_active":"2023-11-27T18:13:15.911255+0000","last_became_peered":"2023-11-27T18:13:15.911255+0000","last_unstale":"2023-11-27T18:43:57.411534+0000","last_undegraded":"2023-11-27T18:43:57.411534+0000","last_fullsized":"2023-11-27T18:43:57.411534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'29","last_scrub_stamp":"2023-11-27T18:43:57.411145+0000","last_deep_scrub":"32'29","last_deep_scrub_stamp":"2023-11-27T18:43:57.411145+0000","last_clean_scrub_stamp":"2023-11-27T18:43:57.411145+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:14:36.787565+0000","scrub_duration":0.0040442129999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:39.424093+0000","last_change":"2023-11-27T18:43:39.424093+0000","last_active":"2023-11-27T18:43:39.424093+0000","last_peered":"2023-11-27T18:43:39.424093+0000","last_clean":"2023-11-27T18:43:39.424093+0000","last_became_active":"2023-11-27T18:13:12.167740+0000","last_became_peered":"2023-11-27T18:13:12.167740+0000","last_unstale":"2023-11-27T18:43:39.424093+0000","last_undegraded":"2023-11-27T18:43:39.424093+0000","last_fullsized":"2023-11-27T18:43:39.424093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2023-11-27T18:43:39.423989+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2023-11-27T18:43:39.423989+0000","last_clean_scrub_stamp":"2023-11-27T18:43:39.423989+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:46:23.132083+0000","scrub_duration":0.0030606299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"32'75","reported_seq":114,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:03.908541+0000","last_change":"2023-11-27T18:44:03.908593+0000","last_active":"2023-11-27T18:44:03.908541+0000","last_peered":"2023-11-27T18:44:03.908541+0000","last_clean":"2023-11-27T18:44:03.908541+0000","last_became_active":"2023-11-27T18:13:20.914607+0000","last_became_peered":"2023-11-27T18:13:20.914607+0000","last_unstale":"2023-11-27T18:44:03.908541+0000","last_undegraded":"2023-11-27T18:44:03.908541+0000","last_fullsized":"2023-11-27T18:44:03.908541+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'75","last_scrub_stamp":"2023-11-27T18:44:03.908354+0000","last_deep_scrub":"32'75","last_deep_scrub_stamp":"2023-11-27T18:44:03.908354+0000","last_clean_scrub_stamp":"2023-11-27T18:44:03.908354+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:26:01.993815+0000","scrub_duration":0.0078989079999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":8428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"32'67","reported_seq":108,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:05.871166+0000","last_change":"2023-11-27T18:44:05.871279+0000","last_active":"2023-11-27T18:44:05.871166+0000","last_peered":"2023-11-27T18:44:05.871166+0000","last_clean":"2023-11-27T18:44:05.871166+0000","last_became_active":"2023-11-27T18:13:20.930060+0000","last_became_peered":"2023-11-27T18:13:20.930060+0000","last_unstale":"2023-11-27T18:44:05.871166+0000","last_undegraded":"2023-11-27T18:44:05.871166+0000","last_fullsized":"2023-11-27T18:44:05.871166+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'67","last_scrub_stamp":"2023-11-27T18:44:05.870841+0000","last_deep_scrub":"32'67","last_deep_scrub_stamp":"2023-11-27T18:44:05.870841+0000","last_clean_scrub_stamp":"2023-11-27T18:44:05.870841+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:35:49.956028+0000","scrub_duration":0.0086515519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":4718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"32'28","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:48.824402+0000","last_change":"2023-11-27T18:43:48.824454+0000","last_active":"2023-11-27T18:43:48.824402+0000","last_peered":"2023-11-27T18:43:48.824402+0000","last_clean":"2023-11-27T18:43:48.824402+0000","last_became_active":"2023-11-27T18:13:14.379936+0000","last_became_peered":"2023-11-27T18:13:14.379936+0000","last_unstale":"2023-11-27T18:43:48.824402+0000","last_undegraded":"2023-11-27T18:43:48.824402+0000","last_fullsized":"2023-11-27T18:43:48.824402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'28","last_scrub_stamp":"2023-11-27T18:43:48.824202+0000","last_deep_scrub":"32'28","last_deep_scrub_stamp":"2023-11-27T18:43:48.824202+0000","last_clean_scrub_stamp":"2023-11-27T18:43:48.824202+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:33:23.140569+0000","scrub_duration":0.0037596090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:02.194594+0000","last_change":"2023-11-27T18:44:02.194594+0000","last_active":"2023-11-27T18:44:02.194594+0000","last_peered":"2023-11-27T18:44:02.194594+0000","last_clean":"2023-11-27T18:44:02.194594+0000","last_became_active":"2023-11-27T18:13:12.300624+0000","last_became_peered":"2023-11-27T18:13:12.300624+0000","last_unstale":"2023-11-27T18:44:02.194594+0000","last_undegraded":"2023-11-27T18:44:02.194594+0000","last_fullsized":"2023-11-27T18:44:02.194594+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2023-11-27T18:44:02.194405+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2023-11-27T18:44:02.194405+0000","last_clean_scrub_stamp":"2023-11-27T18:44:02.194405+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:36:15.821146+0000","scrub_duration":0.002438207,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"32'93","reported_seq":126,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:36.903779+0000","last_change":"2023-11-27T18:13:20.919870+0000","last_active":"2023-11-27T18:43:36.903779+0000","last_peered":"2023-11-27T18:43:36.903779+0000","last_clean":"2023-11-27T18:43:36.903779+0000","last_became_active":"2023-11-27T18:13:20.918816+0000","last_became_peered":"2023-11-27T18:13:20.918816+0000","last_unstale":"2023-11-27T18:43:36.903779+0000","last_undegraded":"2023-11-27T18:43:36.903779+0000","last_fullsized":"2023-11-27T18:43:36.903779+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T18:13:19.384586+0000","last_clean_scrub_stamp":"2023-11-27T18:13:19.384586+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":12357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'29","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:00.013177+0000","last_change":"2023-11-27T18:44:00.013177+0000","last_active":"2023-11-27T18:44:00.013177+0000","last_peered":"2023-11-27T18:44:00.013177+0000","last_clean":"2023-11-27T18:44:00.013177+0000","last_became_active":"2023-11-27T18:13:14.368880+0000","last_became_peered":"2023-11-27T18:13:14.368880+0000","last_unstale":"2023-11-27T18:44:00.013177+0000","last_undegraded":"2023-11-27T18:44:00.013177+0000","last_fullsized":"2023-11-27T18:44:00.013177+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'29","last_scrub_stamp":"2023-11-27T18:44:00.012994+0000","last_deep_scrub":"32'29","last_deep_scrub_stamp":"2023-11-27T18:44:00.012994+0000","last_clean_scrub_stamp":"2023-11-27T18:44:00.012994+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:11:00.650657+0000","scrub_duration":0.0025903329999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:45.456179+0000","last_change":"2023-11-27T18:43:45.456272+0000","last_active":"2023-11-27T18:43:45.456179+0000","last_peered":"2023-11-27T18:43:45.456179+0000","last_clean":"2023-11-27T18:43:45.456179+0000","last_became_active":"2023-11-27T18:13:12.269755+0000","last_became_peered":"2023-11-27T18:13:12.269755+0000","last_unstale":"2023-11-27T18:43:45.456179+0000","last_undegraded":"2023-11-27T18:43:45.456179+0000","last_fullsized":"2023-11-27T18:43:45.456179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2023-11-27T18:43:45.455903+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2023-11-27T18:43:45.455903+0000","last_clean_scrub_stamp":"2023-11-27T18:43:45.455903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:48:41.926518+0000","scrub_duration":0.0043083679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"32'664","reported_seq":706,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:06.184206+0000","last_change":"2023-11-27T18:44:06.184265+0000","last_active":"2023-11-27T18:44:06.184206+0000","last_peered":"2023-11-27T18:44:06.184206+0000","last_clean":"2023-11-27T18:44:06.184206+0000","last_became_active":"2023-11-27T18:13:12.307299+0000","last_became_peered":"2023-11-27T18:13:12.307299+0000","last_unstale":"2023-11-27T18:44:06.184206+0000","last_undegraded":"2023-11-27T18:44:06.184206+0000","last_fullsized":"2023-11-27T18:44:06.184206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'664","last_scrub_stamp":"2023-11-27T18:44:06.184010+0000","last_deep_scrub":"32'664","last_deep_scrub_stamp":"2023-11-27T18:44:06.184010+0000","last_clean_scrub_stamp":"2023-11-27T18:44:06.184010+0000","objects_scrubbed":1,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:22:51.239130+0000","scrub_duration":0.037709518999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":658,"num_write_kb":4457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"32'24","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:56.906458+0000","last_change":"2023-11-27T18:43:56.906562+0000","last_active":"2023-11-27T18:43:56.906458+0000","last_peered":"2023-11-27T18:43:56.906458+0000","last_clean":"2023-11-27T18:43:56.906458+0000","last_became_active":"2023-11-27T18:13:14.378635+0000","last_became_peered":"2023-11-27T18:13:14.378635+0000","last_unstale":"2023-11-27T18:43:56.906458+0000","last_undegraded":"2023-11-27T18:43:56.906458+0000","last_fullsized":"2023-11-27T18:43:56.906458+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'24","last_scrub_stamp":"2023-11-27T18:43:56.906221+0000","last_deep_scrub":"32'24","last_deep_scrub_stamp":"2023-11-27T18:43:56.906221+0000","last_clean_scrub_stamp":"2023-11-27T18:43:56.906221+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:37:13.969082+0000","scrub_duration":0.0049891079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"32'56","reported_seq":94,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:14.983391+0000","last_change":"2023-11-27T18:44:14.983450+0000","last_active":"2023-11-27T18:44:14.983391+0000","last_peered":"2023-11-27T18:44:14.983391+0000","last_clean":"2023-11-27T18:44:14.983391+0000","last_became_active":"2023-11-27T18:13:20.902571+0000","last_became_peered":"2023-11-27T18:13:20.902571+0000","last_unstale":"2023-11-27T18:44:14.983391+0000","last_undegraded":"2023-11-27T18:44:14.983391+0000","last_fullsized":"2023-11-27T18:44:14.983391+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'56","last_scrub_stamp":"2023-11-27T18:44:14.983184+0000","last_deep_scrub":"32'56","last_deep_scrub_stamp":"2023-11-27T18:44:14.983184+0000","last_clean_scrub_stamp":"2023-11-27T18:44:14.983184+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:04:26.840047+0000","scrub_duration":0.0072933249999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":3581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"32'593","reported_seq":634,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:53.084392+0000","last_change":"2023-11-27T18:43:53.084442+0000","last_active":"2023-11-27T18:43:53.084392+0000","last_peered":"2023-11-27T18:43:53.084392+0000","last_clean":"2023-11-27T18:43:53.084392+0000","last_became_active":"2023-11-27T18:13:12.303988+0000","last_became_peered":"2023-11-27T18:13:12.303988+0000","last_unstale":"2023-11-27T18:43:53.084392+0000","last_undegraded":"2023-11-27T18:43:53.084392+0000","last_fullsized":"2023-11-27T18:43:53.084392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'593","last_scrub_stamp":"2023-11-27T18:43:53.084250+0000","last_deep_scrub":"32'593","last_deep_scrub_stamp":"2023-11-27T18:43:53.084250+0000","last_clean_scrub_stamp":"2023-11-27T18:43:53.084250+0000","objects_scrubbed":1,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:42:28.277464+0000","scrub_duration":0.035525191999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":588,"num_write_kb":4406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"32'22","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:45.471070+0000","last_change":"2023-11-27T18:43:45.471121+0000","last_active":"2023-11-27T18:43:45.471070+0000","last_peered":"2023-11-27T18:43:45.471070+0000","last_clean":"2023-11-27T18:43:45.471070+0000","last_became_active":"2023-11-27T18:13:15.802420+0000","last_became_peered":"2023-11-27T18:13:15.802420+0000","last_unstale":"2023-11-27T18:43:45.471070+0000","last_undegraded":"2023-11-27T18:43:45.471070+0000","last_fullsized":"2023-11-27T18:43:45.471070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2023-11-27T18:43:45.470886+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2023-11-27T18:43:45.470886+0000","last_clean_scrub_stamp":"2023-11-27T18:43:45.470886+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:31:10.801503+0000","scrub_duration":0.0041067050000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"32'93","reported_seq":126,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:22.515614+0000","last_change":"2023-11-27T18:44:22.515614+0000","last_active":"2023-11-27T18:44:22.515614+0000","last_peered":"2023-11-27T18:44:22.515614+0000","last_clean":"2023-11-27T18:44:22.515614+0000","last_became_active":"2023-11-27T18:14:22.715684+0000","last_became_peered":"2023-11-27T18:14:22.715684+0000","last_unstale":"2023-11-27T18:44:22.515614+0000","last_undegraded":"2023-11-27T18:44:22.515614+0000","last_fullsized":"2023-11-27T18:44:22.515614+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'93","last_scrub_stamp":"2023-11-27T18:44:22.515282+0000","last_deep_scrub":"32'93","last_deep_scrub_stamp":"2023-11-27T18:44:22.515282+0000","last_clean_scrub_stamp":"2023-11-27T18:44:22.515282+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:53:28.727389+0000","scrub_duration":0.0093497249999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":6465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,0],"acting":[2,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"32'34","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:46.457142+0000","last_change":"2023-11-27T18:43:46.457142+0000","last_active":"2023-11-27T18:43:46.457142+0000","last_peered":"2023-11-27T18:43:46.457142+0000","last_clean":"2023-11-27T18:43:46.457142+0000","last_became_active":"2023-11-27T18:13:15.848503+0000","last_became_peered":"2023-11-27T18:13:15.848503+0000","last_unstale":"2023-11-27T18:43:46.457142+0000","last_undegraded":"2023-11-27T18:43:46.457142+0000","last_fullsized":"2023-11-27T18:43:46.457142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'34","last_scrub_stamp":"2023-11-27T18:43:46.456824+0000","last_deep_scrub":"32'34","last_deep_scrub_stamp":"2023-11-27T18:43:46.456824+0000","last_clean_scrub_stamp":"2023-11-27T18:43:46.456824+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:08:43.138748+0000","scrub_duration":0.0043843550000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"32'28","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:49.064091+0000","last_change":"2023-11-27T18:43:49.064091+0000","last_active":"2023-11-27T18:43:49.064091+0000","last_peered":"2023-11-27T18:43:49.064091+0000","last_clean":"2023-11-27T18:43:49.064091+0000","last_became_active":"2023-11-27T18:13:14.336072+0000","last_became_peered":"2023-11-27T18:13:14.336072+0000","last_unstale":"2023-11-27T18:43:49.064091+0000","last_undegraded":"2023-11-27T18:43:49.064091+0000","last_fullsized":"2023-11-27T18:43:49.064091+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'28","last_scrub_stamp":"2023-11-27T18:43:49.063835+0000","last_deep_scrub":"32'28","last_deep_scrub_stamp":"2023-11-27T18:43:49.063835+0000","last_clean_scrub_stamp":"2023-11-27T18:43:49.063835+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:47:03.229458+0000","scrub_duration":0.0039140190000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"32'27","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:33.671193+0000","last_change":"2023-11-27T18:44:33.671295+0000","last_active":"2023-11-27T18:44:33.671193+0000","last_peered":"2023-11-27T18:44:33.671193+0000","last_clean":"2023-11-27T18:44:33.671193+0000","last_became_active":"2023-11-27T18:13:14.418679+0000","last_became_peered":"2023-11-27T18:13:14.418679+0000","last_unstale":"2023-11-27T18:44:33.671193+0000","last_undegraded":"2023-11-27T18:44:33.671193+0000","last_fullsized":"2023-11-27T18:44:33.671193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'27","last_scrub_stamp":"2023-11-27T18:44:33.670971+0000","last_deep_scrub":"32'27","last_deep_scrub_stamp":"2023-11-27T18:44:33.670971+0000","last_clean_scrub_stamp":"2023-11-27T18:44:33.670971+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:47:21.515528+0000","scrub_duration":0.0043623430000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"32'22","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:17.905891+0000","last_change":"2023-11-27T18:44:17.905891+0000","last_active":"2023-11-27T18:44:17.905891+0000","last_peered":"2023-11-27T18:44:17.905891+0000","last_clean":"2023-11-27T18:44:17.905891+0000","last_became_active":"2023-11-27T18:13:14.376292+0000","last_became_peered":"2023-11-27T18:13:14.376292+0000","last_unstale":"2023-11-27T18:44:17.905891+0000","last_undegraded":"2023-11-27T18:44:17.905891+0000","last_fullsized":"2023-11-27T18:44:17.905891+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2023-11-27T18:44:17.905641+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2023-11-27T18:44:17.905641+0000","last_clean_scrub_stamp":"2023-11-27T18:44:17.905641+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:37:27.730059+0000","scrub_duration":0.0045156429999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"32'16","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:00.501536+0000","last_change":"2023-11-27T18:44:00.501586+0000","last_active":"2023-11-27T18:44:00.501536+0000","last_peered":"2023-11-27T18:44:00.501536+0000","last_clean":"2023-11-27T18:44:00.501536+0000","last_became_active":"2023-11-27T18:13:14.366983+0000","last_became_peered":"2023-11-27T18:13:14.366983+0000","last_unstale":"2023-11-27T18:44:00.501536+0000","last_undegraded":"2023-11-27T18:44:00.501536+0000","last_fullsized":"2023-11-27T18:44:00.501536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2023-11-27T18:44:00.501340+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2023-11-27T18:44:00.501340+0000","last_clean_scrub_stamp":"2023-11-27T18:44:00.501340+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:49:29.151906+0000","scrub_duration":0.004046137,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"32'22","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:07.334877+0000","last_change":"2023-11-27T18:44:07.334964+0000","last_active":"2023-11-27T18:44:07.334877+0000","last_peered":"2023-11-27T18:44:07.334877+0000","last_clean":"2023-11-27T18:44:07.334877+0000","last_became_active":"2023-11-27T18:13:14.375466+0000","last_became_peered":"2023-11-27T18:13:14.375466+0000","last_unstale":"2023-11-27T18:44:07.334877+0000","last_undegraded":"2023-11-27T18:44:07.334877+0000","last_fullsized":"2023-11-27T18:44:07.334877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2023-11-27T18:44:07.334684+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2023-11-27T18:44:07.334684+0000","last_clean_scrub_stamp":"2023-11-27T18:44:07.334684+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:26:11.770623+0000","scrub_duration":0.003893086,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"32'33","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:54.330470+0000","last_change":"2023-11-27T18:43:54.330520+0000","last_active":"2023-11-27T18:43:54.330470+0000","last_peered":"2023-11-27T18:43:54.330470+0000","last_clean":"2023-11-27T18:43:54.330470+0000","last_became_active":"2023-11-27T18:13:15.910418+0000","last_became_peered":"2023-11-27T18:13:15.910418+0000","last_unstale":"2023-11-27T18:43:54.330470+0000","last_undegraded":"2023-11-27T18:43:54.330470+0000","last_fullsized":"2023-11-27T18:43:54.330470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'33","last_scrub_stamp":"2023-11-27T18:43:54.330345+0000","last_deep_scrub":"32'33","last_deep_scrub_stamp":"2023-11-27T18:43:54.330345+0000","last_clean_scrub_stamp":"2023-11-27T18:43:54.330345+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:38:33.435667+0000","scrub_duration":0.003384789,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"32'19","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:40.213006+0000","last_change":"2023-11-27T18:43:40.213056+0000","last_active":"2023-11-27T18:43:40.213006+0000","last_peered":"2023-11-27T18:43:40.213006+0000","last_clean":"2023-11-27T18:43:40.213006+0000","last_became_active":"2023-11-27T18:13:14.366249+0000","last_became_peered":"2023-11-27T18:13:14.366249+0000","last_unstale":"2023-11-27T18:43:40.213006+0000","last_undegraded":"2023-11-27T18:43:40.213006+0000","last_fullsized":"2023-11-27T18:43:40.213006+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'19","last_scrub_stamp":"2023-11-27T18:43:40.212814+0000","last_deep_scrub":"32'19","last_deep_scrub_stamp":"2023-11-27T18:43:40.212814+0000","last_clean_scrub_stamp":"2023-11-27T18:43:40.212814+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:43:45.456072+0000","scrub_duration":0.0037923340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"32'19","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:57.205712+0000","last_change":"2023-11-27T18:43:57.205768+0000","last_active":"2023-11-27T18:43:57.205712+0000","last_peered":"2023-11-27T18:43:57.205712+0000","last_clean":"2023-11-27T18:43:57.205712+0000","last_became_active":"2023-11-27T18:13:14.414873+0000","last_became_peered":"2023-11-27T18:13:14.414873+0000","last_unstale":"2023-11-27T18:43:57.205712+0000","last_undegraded":"2023-11-27T18:43:57.205712+0000","last_fullsized":"2023-11-27T18:43:57.205712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'19","last_scrub_stamp":"2023-11-27T18:43:57.205511+0000","last_deep_scrub":"32'19","last_deep_scrub_stamp":"2023-11-27T18:43:57.205511+0000","last_clean_scrub_stamp":"2023-11-27T18:43:57.205511+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:15:56.065694+0000","scrub_duration":0.0041963039999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'30","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:42.178276+0000","last_change":"2023-11-27T18:43:42.178327+0000","last_active":"2023-11-27T18:43:42.178276+0000","last_peered":"2023-11-27T18:43:42.178276+0000","last_clean":"2023-11-27T18:43:42.178276+0000","last_became_active":"2023-11-27T18:13:14.416072+0000","last_became_peered":"2023-11-27T18:13:14.416072+0000","last_unstale":"2023-11-27T18:43:42.178276+0000","last_undegraded":"2023-11-27T18:43:42.178276+0000","last_fullsized":"2023-11-27T18:43:42.178276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'30","last_scrub_stamp":"2023-11-27T18:43:42.178083+0000","last_deep_scrub":"32'30","last_deep_scrub_stamp":"2023-11-27T18:43:42.178083+0000","last_clean_scrub_stamp":"2023-11-27T18:43:42.178083+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:38:21.283406+0000","scrub_duration":0.0037760110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"32'25","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:43.469664+0000","last_change":"2023-11-27T18:43:43.469763+0000","last_active":"2023-11-27T18:43:43.469664+0000","last_peered":"2023-11-27T18:43:43.469664+0000","last_clean":"2023-11-27T18:43:43.469664+0000","last_became_active":"2023-11-27T18:13:15.800699+0000","last_became_peered":"2023-11-27T18:13:15.800699+0000","last_unstale":"2023-11-27T18:43:43.469664+0000","last_undegraded":"2023-11-27T18:43:43.469664+0000","last_fullsized":"2023-11-27T18:43:43.469664+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'25","last_scrub_stamp":"2023-11-27T18:43:43.469354+0000","last_deep_scrub":"32'25","last_deep_scrub_stamp":"2023-11-27T18:43:43.469354+0000","last_clean_scrub_stamp":"2023-11-27T18:43:43.469354+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:06:57.450424+0000","scrub_duration":0.0036779529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"32'35","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:54.929176+0000","last_change":"2023-11-27T18:43:54.929176+0000","last_active":"2023-11-27T18:43:54.929176+0000","last_peered":"2023-11-27T18:43:54.929176+0000","last_clean":"2023-11-27T18:43:54.929176+0000","last_became_active":"2023-11-27T18:13:14.413567+0000","last_became_peered":"2023-11-27T18:13:14.413567+0000","last_unstale":"2023-11-27T18:43:54.929176+0000","last_undegraded":"2023-11-27T18:43:54.929176+0000","last_fullsized":"2023-11-27T18:43:54.929176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'35","last_scrub_stamp":"2023-11-27T18:43:54.928847+0000","last_deep_scrub":"32'35","last_deep_scrub_stamp":"2023-11-27T18:43:54.928847+0000","last_clean_scrub_stamp":"2023-11-27T18:43:54.928847+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:04:35.264476+0000","scrub_duration":0.0070704210000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"32'26","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:39.551227+0000","last_change":"2023-11-27T18:43:39.551329+0000","last_active":"2023-11-27T18:43:39.551227+0000","last_peered":"2023-11-27T18:43:39.551227+0000","last_clean":"2023-11-27T18:43:39.551227+0000","last_became_active":"2023-11-27T18:13:14.362805+0000","last_became_peered":"2023-11-27T18:13:14.362805+0000","last_unstale":"2023-11-27T18:43:39.551227+0000","last_undegraded":"2023-11-27T18:43:39.551227+0000","last_fullsized":"2023-11-27T18:43:39.551227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'26","last_scrub_stamp":"2023-11-27T18:43:39.551003+0000","last_deep_scrub":"32'26","last_deep_scrub_stamp":"2023-11-27T18:43:39.551003+0000","last_clean_scrub_stamp":"2023-11-27T18:43:39.551003+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:35:59.020605+0000","scrub_duration":0.0038830560000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"32'25","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:49.220670+0000","last_change":"2023-11-27T18:43:49.220754+0000","last_active":"2023-11-27T18:43:49.220670+0000","last_peered":"2023-11-27T18:43:49.220670+0000","last_clean":"2023-11-27T18:43:49.220670+0000","last_became_active":"2023-11-27T18:13:14.415661+0000","last_became_peered":"2023-11-27T18:13:14.415661+0000","last_unstale":"2023-11-27T18:43:49.220670+0000","last_undegraded":"2023-11-27T18:43:49.220670+0000","last_fullsized":"2023-11-27T18:43:49.220670+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'25","last_scrub_stamp":"2023-11-27T18:43:49.220417+0000","last_deep_scrub":"32'25","last_deep_scrub_stamp":"2023-11-27T18:43:49.220417+0000","last_clean_scrub_stamp":"2023-11-27T18:43:49.220417+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:52:55.432524+0000","scrub_duration":0.0032154839999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"32'35","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:53.134216+0000","last_change":"2023-11-27T18:43:53.134235+0000","last_active":"2023-11-27T18:43:53.134216+0000","last_peered":"2023-11-27T18:43:53.134216+0000","last_clean":"2023-11-27T18:43:53.134216+0000","last_became_active":"2023-11-27T18:13:14.413542+0000","last_became_peered":"2023-11-27T18:13:14.413542+0000","last_unstale":"2023-11-27T18:43:53.134216+0000","last_undegraded":"2023-11-27T18:43:53.134216+0000","last_fullsized":"2023-11-27T18:43:53.134216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'35","last_scrub_stamp":"2023-11-27T18:43:53.134137+0000","last_deep_scrub":"32'35","last_deep_scrub_stamp":"2023-11-27T18:43:53.134137+0000","last_clean_scrub_stamp":"2023-11-27T18:43:53.134137+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:11:41.311566+0000","scrub_duration":0.0029978460000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"32'23","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:41.120056+0000","last_change":"2023-11-27T18:43:41.120113+0000","last_active":"2023-11-27T18:43:41.120056+0000","last_peered":"2023-11-27T18:43:41.120056+0000","last_clean":"2023-11-27T18:43:41.120056+0000","last_became_active":"2023-11-27T18:13:14.416556+0000","last_became_peered":"2023-11-27T18:13:14.416556+0000","last_unstale":"2023-11-27T18:43:41.120056+0000","last_undegraded":"2023-11-27T18:43:41.120056+0000","last_fullsized":"2023-11-27T18:43:41.120056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2023-11-27T18:43:41.119872+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2023-11-27T18:43:41.119872+0000","last_clean_scrub_stamp":"2023-11-27T18:43:41.119872+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:10:52.204187+0000","scrub_duration":0.0061959529999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"32'28","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:48.216828+0000","last_change":"2023-11-27T18:43:48.216899+0000","last_active":"2023-11-27T18:43:48.216828+0000","last_peered":"2023-11-27T18:43:48.216828+0000","last_clean":"2023-11-27T18:43:48.216828+0000","last_became_active":"2023-11-27T18:13:14.418823+0000","last_became_peered":"2023-11-27T18:13:14.418823+0000","last_unstale":"2023-11-27T18:43:48.216828+0000","last_undegraded":"2023-11-27T18:43:48.216828+0000","last_fullsized":"2023-11-27T18:43:48.216828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'28","last_scrub_stamp":"2023-11-27T18:43:48.216586+0000","last_deep_scrub":"32'28","last_deep_scrub_stamp":"2023-11-27T18:43:48.216586+0000","last_clean_scrub_stamp":"2023-11-27T18:43:48.216586+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:41:08.176550+0000","scrub_duration":0.0040263709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"32'26","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:06.889016+0000","last_change":"2023-11-27T18:44:06.889118+0000","last_active":"2023-11-27T18:44:06.889016+0000","last_peered":"2023-11-27T18:44:06.889016+0000","last_clean":"2023-11-27T18:44:06.889016+0000","last_became_active":"2023-11-27T18:13:14.368100+0000","last_became_peered":"2023-11-27T18:13:14.368100+0000","last_unstale":"2023-11-27T18:44:06.889016+0000","last_undegraded":"2023-11-27T18:44:06.889016+0000","last_fullsized":"2023-11-27T18:44:06.889016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'26","last_scrub_stamp":"2023-11-27T18:44:06.888797+0000","last_deep_scrub":"32'26","last_deep_scrub_stamp":"2023-11-27T18:44:06.888797+0000","last_clean_scrub_stamp":"2023-11-27T18:44:06.888797+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:41:26.848761+0000","scrub_duration":0.0044410040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"32'26","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:08.359034+0000","last_change":"2023-11-27T18:44:08.359106+0000","last_active":"2023-11-27T18:44:08.359034+0000","last_peered":"2023-11-27T18:44:08.359034+0000","last_clean":"2023-11-27T18:44:08.359034+0000","last_became_active":"2023-11-27T18:13:14.376559+0000","last_became_peered":"2023-11-27T18:13:14.376559+0000","last_unstale":"2023-11-27T18:44:08.359034+0000","last_undegraded":"2023-11-27T18:44:08.359034+0000","last_fullsized":"2023-11-27T18:44:08.359034+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'26","last_scrub_stamp":"2023-11-27T18:44:08.358811+0000","last_deep_scrub":"32'26","last_deep_scrub_stamp":"2023-11-27T18:44:08.358811+0000","last_clean_scrub_stamp":"2023-11-27T18:44:08.358811+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:55:15.752741+0000","scrub_duration":0.0033520529999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"32'32","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:14.351358+0000","last_change":"2023-11-27T18:44:14.351358+0000","last_active":"2023-11-27T18:44:14.351358+0000","last_peered":"2023-11-27T18:44:14.351358+0000","last_clean":"2023-11-27T18:44:14.351358+0000","last_became_active":"2023-11-27T18:13:14.367298+0000","last_became_peered":"2023-11-27T18:13:14.367298+0000","last_unstale":"2023-11-27T18:44:14.351358+0000","last_undegraded":"2023-11-27T18:44:14.351358+0000","last_fullsized":"2023-11-27T18:44:14.351358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'32","last_scrub_stamp":"2023-11-27T18:44:14.351059+0000","last_deep_scrub":"32'32","last_deep_scrub_stamp":"2023-11-27T18:44:14.351059+0000","last_clean_scrub_stamp":"2023-11-27T18:44:14.351059+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:52:32.289440+0000","scrub_duration":0.0044719979999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"32'17","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:10.472560+0000","last_change":"2023-11-27T18:44:10.472560+0000","last_active":"2023-11-27T18:44:10.472560+0000","last_peered":"2023-11-27T18:44:10.472560+0000","last_clean":"2023-11-27T18:44:10.472560+0000","last_became_active":"2023-11-27T18:13:14.363776+0000","last_became_peered":"2023-11-27T18:13:14.363776+0000","last_unstale":"2023-11-27T18:44:10.472560+0000","last_undegraded":"2023-11-27T18:44:10.472560+0000","last_fullsized":"2023-11-27T18:44:10.472560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'17","last_scrub_stamp":"2023-11-27T18:44:10.472316+0000","last_deep_scrub":"32'17","last_deep_scrub_stamp":"2023-11-27T18:44:10.472316+0000","last_clean_scrub_stamp":"2023-11-27T18:44:10.472316+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:39:02.921131+0000","scrub_duration":0.0035518479999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"32'24","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:02.481993+0000","last_change":"2023-11-27T18:44:02.481993+0000","last_active":"2023-11-27T18:44:02.481993+0000","last_peered":"2023-11-27T18:44:02.481993+0000","last_clean":"2023-11-27T18:44:02.481993+0000","last_became_active":"2023-11-27T18:13:14.423099+0000","last_became_peered":"2023-11-27T18:13:14.423099+0000","last_unstale":"2023-11-27T18:44:02.481993+0000","last_undegraded":"2023-11-27T18:44:02.481993+0000","last_fullsized":"2023-11-27T18:44:02.481993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'24","last_scrub_stamp":"2023-11-27T18:44:02.481722+0000","last_deep_scrub":"32'24","last_deep_scrub_stamp":"2023-11-27T18:44:02.481722+0000","last_clean_scrub_stamp":"2023-11-27T18:44:02.481722+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:05:01.639303+0000","scrub_duration":0.0029840750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"32'32","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:13.535973+0000","last_change":"2023-11-27T18:44:13.535973+0000","last_active":"2023-11-27T18:44:13.535973+0000","last_peered":"2023-11-27T18:44:13.535973+0000","last_clean":"2023-11-27T18:44:13.535973+0000","last_became_active":"2023-11-27T18:13:14.419780+0000","last_became_peered":"2023-11-27T18:13:14.419780+0000","last_unstale":"2023-11-27T18:44:13.535973+0000","last_undegraded":"2023-11-27T18:44:13.535973+0000","last_fullsized":"2023-11-27T18:44:13.535973+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'32","last_scrub_stamp":"2023-11-27T18:44:13.535729+0000","last_deep_scrub":"32'32","last_deep_scrub_stamp":"2023-11-27T18:44:13.535729+0000","last_clean_scrub_stamp":"2023-11-27T18:44:13.535729+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:33:45.089867+0000","scrub_duration":0.003331957,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"32'29","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:47.417614+0000","last_change":"2023-11-27T18:43:47.417728+0000","last_active":"2023-11-27T18:43:47.417614+0000","last_peered":"2023-11-27T18:43:47.417614+0000","last_clean":"2023-11-27T18:43:47.417614+0000","last_became_active":"2023-11-27T18:13:15.909918+0000","last_became_peered":"2023-11-27T18:13:15.909918+0000","last_unstale":"2023-11-27T18:43:47.417614+0000","last_undegraded":"2023-11-27T18:43:47.417614+0000","last_fullsized":"2023-11-27T18:43:47.417614+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'29","last_scrub_stamp":"2023-11-27T18:43:47.417382+0000","last_deep_scrub":"32'29","last_deep_scrub_stamp":"2023-11-27T18:43:47.417382+0000","last_clean_scrub_stamp":"2023-11-27T18:43:47.417382+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:19:46.839575+0000","scrub_duration":0.0058622300000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"32'19","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:16.893374+0000","last_change":"2023-11-27T18:44:16.893423+0000","last_active":"2023-11-27T18:44:16.893374+0000","last_peered":"2023-11-27T18:44:16.893374+0000","last_clean":"2023-11-27T18:44:16.893374+0000","last_became_active":"2023-11-27T18:13:14.369285+0000","last_became_peered":"2023-11-27T18:13:14.369285+0000","last_unstale":"2023-11-27T18:44:16.893374+0000","last_undegraded":"2023-11-27T18:44:16.893374+0000","last_fullsized":"2023-11-27T18:44:16.893374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'19","last_scrub_stamp":"2023-11-27T18:44:16.893184+0000","last_deep_scrub":"32'19","last_deep_scrub_stamp":"2023-11-27T18:44:16.893184+0000","last_clean_scrub_stamp":"2023-11-27T18:44:16.893184+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:38:51.524388+0000","scrub_duration":0.0035687570000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"32'20","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:00.467317+0000","last_change":"2023-11-27T18:44:00.467368+0000","last_active":"2023-11-27T18:44:00.467317+0000","last_peered":"2023-11-27T18:44:00.467317+0000","last_clean":"2023-11-27T18:44:00.467317+0000","last_became_active":"2023-11-27T18:13:14.385566+0000","last_became_peered":"2023-11-27T18:13:14.385566+0000","last_unstale":"2023-11-27T18:44:00.467317+0000","last_undegraded":"2023-11-27T18:44:00.467317+0000","last_fullsized":"2023-11-27T18:44:00.467317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2023-11-27T18:44:00.467139+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2023-11-27T18:44:00.467139+0000","last_clean_scrub_stamp":"2023-11-27T18:44:00.467139+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:06:04.634187+0000","scrub_duration":0.003836959,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"32'26","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:48.437473+0000","last_change":"2023-11-27T18:43:48.437524+0000","last_active":"2023-11-27T18:43:48.437473+0000","last_peered":"2023-11-27T18:43:48.437473+0000","last_clean":"2023-11-27T18:43:48.437473+0000","last_became_active":"2023-11-27T18:13:15.848237+0000","last_became_peered":"2023-11-27T18:13:15.848237+0000","last_unstale":"2023-11-27T18:43:48.437473+0000","last_undegraded":"2023-11-27T18:43:48.437473+0000","last_fullsized":"2023-11-27T18:43:48.437473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'26","last_scrub_stamp":"2023-11-27T18:43:48.437293+0000","last_deep_scrub":"32'26","last_deep_scrub_stamp":"2023-11-27T18:43:48.437293+0000","last_clean_scrub_stamp":"2023-11-27T18:43:48.437293+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:36:07.906895+0000","scrub_duration":0.003956256,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"32'23","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:01.434220+0000","last_change":"2023-11-27T18:44:01.434271+0000","last_active":"2023-11-27T18:44:01.434220+0000","last_peered":"2023-11-27T18:44:01.434220+0000","last_clean":"2023-11-27T18:44:01.434220+0000","last_became_active":"2023-11-27T18:13:14.372974+0000","last_became_peered":"2023-11-27T18:13:14.372974+0000","last_unstale":"2023-11-27T18:44:01.434220+0000","last_undegraded":"2023-11-27T18:44:01.434220+0000","last_fullsized":"2023-11-27T18:44:01.434220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2023-11-27T18:44:01.434016+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2023-11-27T18:44:01.434016+0000","last_clean_scrub_stamp":"2023-11-27T18:44:01.434016+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:11:02.071680+0000","scrub_duration":0.0043765549999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"32'18","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:52.342162+0000","last_change":"2023-11-27T18:43:52.342216+0000","last_active":"2023-11-27T18:43:52.342162+0000","last_peered":"2023-11-27T18:43:52.342162+0000","last_clean":"2023-11-27T18:43:52.342162+0000","last_became_active":"2023-11-27T18:13:15.850353+0000","last_became_peered":"2023-11-27T18:13:15.850353+0000","last_unstale":"2023-11-27T18:43:52.342162+0000","last_undegraded":"2023-11-27T18:43:52.342162+0000","last_fullsized":"2023-11-27T18:43:52.342162+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2023-11-27T18:43:52.341952+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2023-11-27T18:43:52.341952+0000","last_clean_scrub_stamp":"2023-11-27T18:43:52.341952+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:32:31.049285+0000","scrub_duration":0.0042809079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"32'25","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:08.853010+0000","last_change":"2023-11-27T18:44:08.853010+0000","last_active":"2023-11-27T18:44:08.853010+0000","last_peered":"2023-11-27T18:44:08.853010+0000","last_clean":"2023-11-27T18:44:08.853010+0000","last_became_active":"2023-11-27T18:13:14.380714+0000","last_became_peered":"2023-11-27T18:13:14.380714+0000","last_unstale":"2023-11-27T18:44:08.853010+0000","last_undegraded":"2023-11-27T18:44:08.853010+0000","last_fullsized":"2023-11-27T18:44:08.853010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'25","last_scrub_stamp":"2023-11-27T18:44:08.852772+0000","last_deep_scrub":"32'25","last_deep_scrub_stamp":"2023-11-27T18:44:08.852772+0000","last_clean_scrub_stamp":"2023-11-27T18:44:08.852772+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:53:15.064879+0000","scrub_duration":0.0037987149999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"32'19","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:47.103117+0000","last_change":"2023-11-27T18:43:47.103117+0000","last_active":"2023-11-27T18:43:47.103117+0000","last_peered":"2023-11-27T18:43:47.103117+0000","last_clean":"2023-11-27T18:43:47.103117+0000","last_became_active":"2023-11-27T18:13:14.367978+0000","last_became_peered":"2023-11-27T18:13:14.367978+0000","last_unstale":"2023-11-27T18:43:47.103117+0000","last_undegraded":"2023-11-27T18:43:47.103117+0000","last_fullsized":"2023-11-27T18:43:47.103117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'19","last_scrub_stamp":"2023-11-27T18:43:47.102851+0000","last_deep_scrub":"32'19","last_deep_scrub_stamp":"2023-11-27T18:43:47.102851+0000","last_clean_scrub_stamp":"2023-11-27T18:43:47.102851+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:06:22.873872+0000","scrub_duration":0.0033780609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"32'23","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:38.508875+0000","last_change":"2023-11-27T18:43:38.508875+0000","last_active":"2023-11-27T18:43:38.508875+0000","last_peered":"2023-11-27T18:43:38.508875+0000","last_clean":"2023-11-27T18:43:38.508875+0000","last_became_active":"2023-11-27T18:13:14.418928+0000","last_became_peered":"2023-11-27T18:13:14.418928+0000","last_unstale":"2023-11-27T18:43:38.508875+0000","last_undegraded":"2023-11-27T18:43:38.508875+0000","last_fullsized":"2023-11-27T18:43:38.508875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2023-11-27T18:43:38.508560+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2023-11-27T18:43:38.508560+0000","last_clean_scrub_stamp":"2023-11-27T18:43:38.508560+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:08:35.190483+0000","scrub_duration":0.0073382730000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2386,"num_write_kb":255070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2569,"ondisk_log_size":2569,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1576,"ondisk_log_size":1576,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":24107291,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":549,"num_read_kb":581,"num_write":5694,"num_write_kb":26819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32874496,"data_stored":48214582,"data_compressed":4737124,"data_compressed_allocated":7356416,"data_compressed_original":22757376,"omap_allocated":0,"internal_metadata":0},"log_size":5266,"ondisk_log_size":5266,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67010,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719477125,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36008,"kb_used_data":4832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335832,"statfs":{"total":96636764160,"available":96599891968,"internally_reserved":0,"allocated":4947968,"data_stored":8056568,"data_compressed":850146,"data_compressed_allocated":1241088,"data_compressed_original":4562944,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:44:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":0.90900000000000003,"15min":0.86399999999999999},"min":{"1min":0.68200000000000005,"5min":0.55800000000000005,"15min":0.45400000000000001},"max":{"1min":1.448,"5min":1.448,"15min":1.4730000000000001},"last":1.1259999999999999},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.92300000000000004,"15min":0.92900000000000005},"min":{"1min":0.55100000000000005,"5min":0.49399999999999999,"15min":0.46000000000000002},"max":{"1min":1.2889999999999999,"5min":1.536,"15min":1.536},"last":0.77500000000000002}]},{"osd":1,"last update":"Mon Nov 27 18:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.98099999999999998,"15min":0.96299999999999997},"min":{"1min":0.63200000000000001,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2769999999999999,"5min":1.51,"15min":1.51},"last":1.004},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92500000000000004,"15min":0.92700000000000005},"min":{"1min":0.68600000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2589999999999999,"5min":1.361,"15min":1.482},"last":1.198}]},{"osd":2,"last update":"Mon Nov 27 18:44:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":0.996,"15min":0.97499999999999998},"min":{"1min":0.73999999999999999,"5min":0.54100000000000004,"15min":0.53900000000000003},"max":{"1min":1.325,"5min":1.4730000000000001,"15min":1.603},"last":1.325},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.92200000000000004,"15min":0.92700000000000005},"min":{"1min":0.70899999999999996,"5min":0.58299999999999996,"15min":0.52700000000000002},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.389},"last":0.95299999999999996}]},{"osd":3,"last update":"Mon Nov 27 18:44:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.98799999999999999,"15min":0.97399999999999998},"min":{"1min":0.66200000000000003,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.2669999999999999,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.88},{"interface":"front","average":{"1min":1.024,"5min":1.0349999999999999,"15min":1.0409999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.3859999999999999,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":1.3859999999999999}]},{"osd":4,"last update":"Mon Nov 27 18:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.90800000000000003,"15min":0.90600000000000003},"min":{"1min":0.57199999999999995,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.3500000000000001,"5min":1.518,"15min":1.518},"last":1.052},{"interface":"front","average":{"1min":1.002,"5min":1.0169999999999999,"15min":1.0029999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.339,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":1.2909999999999999}]},{"osd":6,"last update":"Mon Nov 27 18:44:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.016,"15min":1.004},"min":{"1min":0.60599999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.403,"5min":1.417,"15min":1.49},"last":1.087},{"interface":"front","average":{"1min":1.177,"5min":1.048,"15min":1.042},"min":{"1min":0.81599999999999995,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.476,"5min":1.476,"15min":1.605},"last":1.2470000000000001}]},{"osd":7,"last update":"Mon Nov 27 18:44:40 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.1459999999999999,"15min":1.125},"min":{"1min":0.751,"5min":0.49299999999999999,"15min":0.47999999999999998},"max":{"1min":1.397,"5min":1.617,"15min":1.831},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.169,"15min":1.177},"min":{"1min":0.64400000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.454,"5min":1.6639999999999999,"15min":1.768},"last":1.4370000000000001}]}]},{"osd":7,"up_from":16,"seq":68719477125,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33280,"kb_used_data":2104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338560,"statfs":{"total":96636764160,"available":96602685440,"internally_reserved":0,"allocated":2154496,"data_stored":3272747,"data_compressed":386056,"data_compressed_allocated":532480,"data_compressed_original":1863680,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:44:27 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.88,"15min":0.88100000000000001},"min":{"1min":0.54600000000000004,"5min":0.54000000000000004,"15min":0.49399999999999999},"max":{"1min":1.1519999999999999,"5min":1.357,"15min":1.4199999999999999},"last":1.292},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.96699999999999997,"15min":0.93799999999999994},"min":{"1min":0.66100000000000003,"5min":0.54500000000000004,"15min":0.49299999999999999},"max":{"1min":1.294,"5min":1.411,"15min":1.7110000000000001},"last":0.84099999999999997}]},{"osd":1,"last update":"Mon Nov 27 18:44:27 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.88700000000000001,"15min":0.92000000000000004},"min":{"1min":0.53600000000000003,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.1859999999999999,"5min":1.379,"15min":1.379},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.012,"15min":0.98599999999999999},"min":{"1min":0.76000000000000001,"5min":0.65600000000000003,"15min":0.54800000000000004},"max":{"1min":1.4299999999999999,"5min":1.4450000000000001,"15min":1.768},"last":1.107}]},{"osd":2,"last update":"Mon Nov 27 18:44:27 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.99299999999999999,"15min":0.99399999999999999},"min":{"1min":0.61699999999999999,"5min":0.57399999999999995,"15min":0.52000000000000002},"max":{"1min":1.2749999999999999,"5min":1.4119999999999999,"15min":1.6870000000000001},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.0189999999999999,"5min":0.95899999999999996,"15min":0.94299999999999995},"min":{"1min":0.748,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.415},"last":1.075}]},{"osd":3,"last update":"Mon Nov 27 18:44:27 2023","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":0.98199999999999998,"15min":0.97699999999999998},"min":{"1min":0.72199999999999998,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.2849999999999999,"5min":1.323,"15min":1.4550000000000001},"last":1.026},{"interface":"front","average":{"1min":1.093,"5min":1.0820000000000001,"15min":1.075},"min":{"1min":0.85599999999999998,"5min":0.57299999999999995,"15min":0.51300000000000001},"max":{"1min":1.3799999999999999,"5min":1.4990000000000001,"15min":1.5820000000000001},"last":0.99299999999999999}]},{"osd":4,"last update":"Mon Nov 27 18:44:27 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.98799999999999999,"15min":0.92600000000000005},"min":{"1min":0.53900000000000003,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.319,"5min":6.6539999999999999,"15min":6.6539999999999999},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.95699999999999996,"15min":0.98999999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.2989999999999999,"5min":1.456,"15min":2.0649999999999999},"last":0.68300000000000005}]},{"osd":5,"last update":"Mon Nov 27 18:44:27 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":1.0629999999999999,"15min":1.0409999999999999},"min":{"1min":0.55800000000000005,"5min":0.35699999999999998,"15min":0.35199999999999998},"max":{"1min":1.4079999999999999,"5min":1.825,"15min":1.825},"last":0.72899999999999998},{"interface":"front","average":{"1min":1.018,"5min":1.0249999999999999,"15min":1.0329999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.39200000000000002},"max":{"1min":1.4279999999999999,"5min":1.591,"15min":1.679},"last":0.78500000000000003}]},{"osd":6,"last update":"Mon Nov 27 18:44:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.0780000000000001,"15min":1.081},"min":{"1min":0.71399999999999997,"5min":0.45300000000000001,"15min":0.43099999999999999},"max":{"1min":1.2869999999999999,"5min":1.5089999999999999,"15min":1.956},"last":1.141},{"interface":"front","average":{"1min":1.135,"5min":1.125,"15min":1.1499999999999999},"min":{"1min":0.68400000000000005,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.411,"5min":1.7170000000000001,"15min":1.8839999999999999},"last":1.1970000000000001}]}]},{"osd":6,"up_from":16,"seq":68719477125,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30016,"kb_used_data":3000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341824,"statfs":{"total":96636764160,"available":96606027776,"internally_reserved":0,"allocated":3072000,"data_stored":4332626,"data_compressed":430585,"data_compressed_allocated":663552,"data_compressed_original":2125824,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:44:30 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.96699999999999997,"15min":0.93300000000000005},"min":{"1min":0.63900000000000001,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.28,"5min":1.375,"15min":1.956},"last":1.101},{"interface":"front","average":{"1min":1.016,"5min":1.0589999999999999,"15min":1.036},"min":{"1min":0.79600000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.232,"5min":1.534,"15min":1.5629999999999999},"last":1.2290000000000001}]},{"osd":1,"last update":"Mon Nov 27 18:44:30 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.90200000000000002,"15min":0.89100000000000001},"min":{"1min":0.57099999999999995,"5min":0.52200000000000002,"15min":0.51200000000000001},"max":{"1min":1.367,"5min":1.4179999999999999,"15min":1.5229999999999999},"last":1.1990000000000001},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.92300000000000004,"15min":0.92500000000000004},"min":{"1min":0.60099999999999998,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.1619999999999999,"5min":1.3819999999999999,"15min":1.5629999999999999},"last":0.93300000000000005}]},{"osd":2,"last update":"Mon Nov 27 18:44:30 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.97799999999999998,"15min":0.95999999999999996},"min":{"1min":0.81599999999999995,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.141,"5min":2.2349999999999999,"15min":2.2349999999999999},"last":0.996},{"interface":"front","average":{"1min":1.026,"5min":1.071,"15min":1.056},"min":{"1min":0.70799999999999996,"5min":0.65500000000000003,"15min":0.52900000000000003},"max":{"1min":1.232,"5min":3.6549999999999998,"15min":3.6549999999999998},"last":1.0269999999999999}]},{"osd":3,"last update":"Mon Nov 27 18:44:30 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":1.036,"15min":1.0269999999999999},"min":{"1min":0.67500000000000004,"5min":0.64400000000000002,"15min":0.52800000000000002},"max":{"1min":1.2270000000000001,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":1.391},{"interface":"front","average":{"1min":1.081,"5min":1.0800000000000001,"15min":1.0640000000000001},"min":{"1min":0.748,"5min":0.63500000000000001,"15min":0.57699999999999996},"max":{"1min":1.228,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.0700000000000001}]},{"osd":4,"last update":"Mon Nov 27 18:44:30 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.97199999999999998,"15min":0.96599999999999997},"min":{"1min":0.66600000000000004,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.2769999999999999,"5min":1.5309999999999999,"15min":1.712},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.96399999999999997,"5min":1.0720000000000001,"15min":1.0529999999999999},"min":{"1min":0.55600000000000005,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.3120000000000001,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.125}]},{"osd":5,"last update":"Mon Nov 27 18:44:30 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":1.008,"15min":0.99299999999999999},"min":{"1min":0.70399999999999996,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.294,"5min":1.879,"15min":1.879},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.123,"15min":1.133},"min":{"1min":0.85999999999999999,"5min":0.59399999999999997,"15min":0.46500000000000002},"max":{"1min":1.331,"5min":3.7509999999999999,"15min":3.7509999999999999},"last":1.2669999999999999}]},{"osd":7,"last update":"Mon Nov 27 18:44:30 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.161,"15min":1.151},"min":{"1min":0.64700000000000002,"5min":0.55300000000000005,"15min":0.40400000000000003},"max":{"1min":1.4630000000000001,"5min":1.962,"15min":1.962},"last":1.3140000000000001},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.1839999999999999,"15min":1.159},"min":{"1min":0.68100000000000005,"5min":0.55800000000000005,"15min":0.499},"max":{"1min":1.514,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":1.1739999999999999}]}]},{"osd":3,"up_from":16,"seq":68719477123,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58052,"kb_used_data":8828,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94313788,"statfs":{"total":96636764160,"available":96577318912,"internally_reserved":0,"allocated":9039872,"data_stored":12721816,"data_compressed":1205599,"data_compressed_allocated":1880064,"data_compressed_original":5767168,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:43:41 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.69299999999999995,"15min":0.72399999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":1.101,"5min":1.101,"15min":1.456},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.76500000000000001,"15min":0.78600000000000003},"min":{"1min":0.36799999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.95899999999999996,"5min":1.387,"15min":1.387},"last":0.55500000000000005}]},{"osd":1,"last update":"Mon Nov 27 18:43:41 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.76600000000000001,"15min":0.78100000000000003},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.006,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.85199999999999998,"15min":0.90000000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.4690000000000001},"last":0.86799999999999999}]},{"osd":2,"last update":"Mon Nov 27 18:43:41 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.90200000000000002,"15min":0.91300000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.246,"5min":1.371,"15min":1.631},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.92700000000000005,"15min":0.94899999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.39000000000000001},"max":{"1min":1.3260000000000001,"5min":1.375,"15min":1.375},"last":0.67000000000000004}]},{"osd":4,"last update":"Mon Nov 27 18:43:41 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.98899999999999999,"15min":0.98999999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.2490000000000001,"5min":1.573,"15min":1.6439999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.93400000000000005,"5min":1.0109999999999999,"15min":1.048},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.60399999999999998},"max":{"1min":1.254,"5min":1.4950000000000001,"15min":1.605},"last":0.94799999999999995}]},{"osd":5,"last update":"Mon Nov 27 18:43:41 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":1.056,"15min":1.081},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.29,"5min":1.472,"15min":1.766},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.052,"5min":1.155,"15min":1.181},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.381,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.1200000000000001}]},{"osd":6,"last update":"Mon Nov 27 18:43:41 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.1180000000000001,"15min":1.1000000000000001},"min":{"1min":0.65500000000000003,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.401,"5min":1.607,"15min":1.8720000000000001},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.1299999999999999,"15min":1.1699999999999999},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.367,"5min":1.7050000000000001,"15min":1.7270000000000001},"last":0.83599999999999997}]},{"osd":7,"last update":"Mon Nov 27 18:43:41 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.222,"15min":1.246},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.6830000000000001,"5min":1.915,"15min":1.915},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.105,"5min":1.175,"15min":1.171},"min":{"1min":0.621,"5min":0.496,"15min":0.496},"max":{"1min":1.6279999999999999,"5min":1.6839999999999999,"15min":1.9339999999999999},"last":0.996}]}]},{"osd":2,"up_from":16,"seq":68719477124,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33272,"kb_used_data":6256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94338568,"statfs":{"total":96636764160,"available":96602693632,"internally_reserved":0,"allocated":6406144,"data_stored":8527602,"data_compressed":750925,"data_compressed_allocated":1228800,"data_compressed_original":3559424,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:43:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.71099999999999997,"15min":0.71999999999999997},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.157,"5min":1.2729999999999999,"15min":1.2869999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.78300000000000003,"15min":0.81299999999999994},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.0860000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":0.72499999999999998}]},{"osd":1,"last update":"Mon Nov 27 18:43:45 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.81299999999999994,"15min":0.84299999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.109,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.86099999999999999,"15min":0.88400000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.3,"5min":2.6400000000000001,"15min":2.6400000000000001},"last":0.82599999999999996}]},{"osd":3,"last update":"Mon Nov 27 18:43:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.79200000000000004,"15min":0.81799999999999995},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.1180000000000001,"5min":1.4750000000000001,"15min":1.6259999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.94199999999999995,"15min":0.96499999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.256,"5min":1.554,"15min":1.554},"last":0.92500000000000004}]},{"osd":4,"last update":"Mon Nov 27 18:43:45 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":1.0269999999999999,"15min":1.0329999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.3819999999999999,"5min":1.49,"15min":1.5620000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.94499999999999995,"5min":1.02,"15min":1.0409999999999999},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.57799999999999996},"max":{"1min":1.23,"5min":1.861,"15min":1.861},"last":0.96399999999999997}]},{"osd":5,"last update":"Mon Nov 27 18:43:45 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":1.0649999999999999,"15min":1.079},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.337,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":1.1120000000000001},{"interface":"front","average":{"1min":0.97699999999999998,"5min":1.04,"15min":1.0449999999999999},"min":{"1min":0.68300000000000005,"5min":0.55700000000000005,"15min":0.53000000000000003},"max":{"1min":1.403,"5min":1.5209999999999999,"15min":1.6859999999999999},"last":1.1359999999999999}]},{"osd":6,"last update":"Mon Nov 27 18:43:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.105,"15min":1.109},"min":{"1min":0.58799999999999997,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.5229999999999999,"5min":1.585,"15min":1.7490000000000001},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.1619999999999999,"15min":1.1759999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.45,"5min":1.786,"15min":1.958},"last":1.2210000000000001}]},{"osd":7,"last update":"Mon Nov 27 18:43:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.1779999999999999,"15min":1.1879999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.625},"max":{"1min":1.714,"5min":1.7869999999999999,"15min":1.8799999999999999},"last":1.02},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.181,"15min":1.1779999999999999},"min":{"1min":0.70299999999999996,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.6080000000000001,"5min":3.4289999999999998,"15min":3.4289999999999998},"last":1.2470000000000001}]}]},{"osd":1,"up_from":16,"seq":68719477124,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44056,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327784,"statfs":{"total":96636764160,"available":96591650816,"internally_reserved":0,"allocated":409600,"data_stored":728760,"data_compressed":33505,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.70799999999999996},"min":{"1min":0.51600000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.2969999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.76200000000000001,"15min":0.81499999999999995},"min":{"1min":0.58699999999999997,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.1319999999999999,"5min":1.282,"15min":1.397},"last":0.80900000000000005}]},{"osd":2,"last update":"Mon Nov 27 18:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.73599999999999999,"15min":0.74299999999999999},"min":{"1min":0.57699999999999996,"5min":0.37,"15min":0.36299999999999999},"max":{"1min":1.0469999999999999,"5min":1.1439999999999999,"15min":1.3480000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83499999999999996,"15min":0.874},"min":{"1min":0.63400000000000001,"5min":0.41699999999999998,"15min":0.38500000000000001},"max":{"1min":1.105,"5min":1.4359999999999999,"15min":1.9610000000000001},"last":0.90400000000000003}]},{"osd":3,"last update":"Mon Nov 27 18:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.93300000000000005,"15min":0.96699999999999997},"min":{"1min":0.76800000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.3260000000000001,"5min":1.341,"15min":1.8009999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.879,"15min":0.89600000000000002},"min":{"1min":0.45000000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.0960000000000001,"5min":1.462,"15min":2.0960000000000001},"last":1.1559999999999999}]},{"osd":4,"last update":"Mon Nov 27 18:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.93500000000000005,"15min":0.94999999999999996},"min":{"1min":0.64400000000000002,"5min":0.56899999999999995,"15min":0.51800000000000002},"max":{"1min":1.254,"5min":1.425,"15min":1.4970000000000001},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.141,"5min":1.054,"15min":1.095},"min":{"1min":0.94199999999999995,"5min":0.629,"15min":0.61399999999999999},"max":{"1min":1.411,"5min":1.478,"15min":2.496},"last":1.1910000000000001}]},{"osd":5,"last update":"Mon Nov 27 18:44:37 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.0409999999999999,"15min":1.0820000000000001},"min":{"1min":0.67000000000000004,"5min":0.58299999999999996,"15min":0.51500000000000001},"max":{"1min":1.28,"5min":1.534,"15min":2.1970000000000001},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.04,"15min":1.056},"min":{"1min":0.754,"5min":0.61199999999999999,"15min":0.60599999999999998},"max":{"1min":1.4350000000000001,"5min":1.605,"15min":1.7529999999999999},"last":1.1180000000000001}]},{"osd":6,"last update":"Mon Nov 27 18:44:37 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.123,"15min":1.1870000000000001},"min":{"1min":0.91400000000000003,"5min":0.60499999999999998,"15min":0.503},"max":{"1min":1.3220000000000001,"5min":1.6060000000000001,"15min":2.4319999999999999},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.1299999999999999,"15min":1.169},"min":{"1min":0.879,"5min":0.61599999999999999,"15min":0.53900000000000003},"max":{"1min":1.337,"5min":1.5660000000000001,"15min":2.3700000000000001},"last":1.3520000000000001}]},{"osd":7,"last update":"Mon Nov 27 18:44:37 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.1619999999999999,"15min":1.202},"min":{"1min":0.88800000000000001,"5min":0.64300000000000002,"15min":0.56799999999999995},"max":{"1min":1.429,"5min":1.6160000000000001,"15min":2.2879999999999998},"last":1.272},{"interface":"front","average":{"1min":1.125,"5min":1.127,"15min":1.161},"min":{"1min":0.85099999999999998,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.395,"5min":1.7070000000000001,"15min":1.7170000000000001},"last":1.304}]}]},{"osd":0,"up_from":16,"seq":68719477125,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42672,"kb_used_data":3176,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329168,"statfs":{"total":96636764160,"available":96593068032,"internally_reserved":0,"allocated":3252224,"data_stored":4332682,"data_compressed":397480,"data_compressed_allocated":610304,"data_compressed_original":1900544,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 27 18:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.69599999999999995,"15min":0.71999999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.86199999999999999,"5min":1.2070000000000001,"15min":1.6599999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.82799999999999996,"15min":0.83999999999999997},"min":{"1min":0.47799999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2310000000000001,"5min":1.391,"15min":1.391},"last":0.66100000000000003}]},{"osd":2,"last update":"Mon Nov 27 18:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.81499999999999995,"15min":0.85299999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1140000000000001,"5min":1.3799999999999999,"15min":1.405},"last":0.872},{"interface":"front","average":{"1min":0.749,"5min":0.84599999999999997,"15min":0.85899999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.145,"5min":1.4730000000000001,"15min":1.5629999999999999},"last":1.105}]},{"osd":3,"last update":"Mon Nov 27 18:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.85899999999999999,"15min":0.86499999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.42099999999999999},"max":{"1min":1.3140000000000001,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.96099999999999997,"15min":0.96599999999999997},"min":{"1min":0.53000000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.3839999999999999,"5min":1.421,"15min":2.073},"last":0.93000000000000005}]},{"osd":4,"last update":"Mon Nov 27 18:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.96499999999999997,"15min":0.97299999999999998},"min":{"1min":0.69999999999999996,"5min":0.64400000000000002,"15min":0.57099999999999995},"max":{"1min":1.222,"5min":1.73,"15min":1.897},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.0349999999999999,"15min":1.0740000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.3140000000000001,"5min":1.4059999999999999,"15min":2.1899999999999999},"last":1.0669999999999999}]},{"osd":5,"last update":"Mon Nov 27 18:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":1.0760000000000001,"15min":1.085},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.56899999999999995},"max":{"1min":1.3380000000000001,"5min":1.5369999999999999,"15min":2.0270000000000001},"last":1.25},{"interface":"front","average":{"1min":0.97899999999999998,"5min":1.036,"15min":1.04},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.624},"max":{"1min":1.248,"5min":1.855,"15min":1.9870000000000001},"last":0.90300000000000002}]},{"osd":6,"last update":"Mon Nov 27 18:43:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.1379999999999999,"15min":1.1639999999999999},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.59599999999999997},"max":{"1min":1.4830000000000001,"5min":1.6399999999999999,"15min":2.254},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.071,"5min":1.143,"15min":1.1719999999999999},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.745},"max":{"1min":1.4159999999999999,"5min":1.5800000000000001,"15min":1.8440000000000001},"last":0.94999999999999996}]},{"osd":7,"last update":"Mon Nov 27 18:43:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1799999999999999,"15min":1.2},"min":{"1min":0.85499999999999998,"5min":0.76100000000000001,"15min":0.60799999999999998},"max":{"1min":1.454,"5min":1.591,"15min":2.1600000000000001},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.151,"15min":1.155},"min":{"1min":0.84199999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.377,"5min":1.7849999999999999,"15min":2.117},"last":1.1479999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509830,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55512,"kb_used_data":6288,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94316328,"statfs":{"total":96636764160,"available":96579919872,"internally_reserved":0,"allocated":6438912,"data_stored":8528274,"data_compressed":749838,"data_compressed_allocated":1245184,"data_compressed_original":3551232,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:44:41 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.90500000000000003,"15min":0.88900000000000001},"min":{"1min":0.55500000000000005,"5min":0.53700000000000003,"15min":0.46300000000000002},"max":{"1min":1.204,"5min":1.385,"15min":1.675},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.91500000000000004,"15min":0.91400000000000003},"min":{"1min":0.62,"5min":0.498,"15min":0.373},"max":{"1min":1.2989999999999999,"5min":1.325,"15min":1.506},"last":1.0800000000000001}]},{"osd":1,"last update":"Mon Nov 27 18:44:41 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.94999999999999996,"15min":0.94199999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.242,"5min":1.4790000000000001,"15min":2.2759999999999998},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.0049999999999999,"5min":0.98099999999999998,"15min":0.95699999999999996},"min":{"1min":0.63800000000000001,"5min":0.62,"15min":0.49399999999999999},"max":{"1min":1.411,"5min":1.411,"15min":1.569},"last":0.85699999999999998}]},{"osd":2,"last update":"Mon Nov 27 18:44:41 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.95899999999999996,"15min":0.96399999999999997},"min":{"1min":0.76600000000000001,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.21,"5min":1.5649999999999999,"15min":2.3730000000000002},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0289999999999999,"15min":1.0089999999999999},"min":{"1min":0.624,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.256,"5min":1.4770000000000001,"15min":1.7729999999999999},"last":1.157}]},{"osd":3,"last update":"Mon Nov 27 18:44:41 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.96499999999999997,"15min":0.95499999999999996},"min":{"1min":0.64400000000000002,"5min":0.58099999999999996,"15min":0.53900000000000003},"max":{"1min":1.228,"5min":1.411,"15min":1.7130000000000001},"last":1.228},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.01,"15min":1.0429999999999999},"min":{"1min":0.82299999999999995,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.1910000000000001,"5min":1.5169999999999999,"15min":2.2069999999999999},"last":1.1140000000000001}]},{"osd":5,"last update":"Mon Nov 27 18:44:41 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.97099999999999997,"15min":0.96999999999999997},"min":{"1min":0.50800000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.3280000000000001,"5min":1.4410000000000001,"15min":1.7290000000000001},"last":1.048},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97399999999999998,"15min":0.96199999999999997},"min":{"1min":0.65600000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.248,"5min":1.3799999999999999,"15min":1.6659999999999999},"last":1.0009999999999999}]},{"osd":6,"last update":"Mon Nov 27 18:44:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0660000000000001,"15min":1.032},"min":{"1min":0.66900000000000004,"5min":0.52200000000000002,"15min":0.48299999999999998},"max":{"1min":1.304,"5min":1.6579999999999999,"15min":2.4199999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.171,"15min":1.145},"min":{"1min":0.65800000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.464,"5min":1.591,"15min":1.8140000000000001},"last":0.93200000000000005}]},{"osd":7,"last update":"Mon Nov 27 18:44:41 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.0720000000000001,"15min":1.0629999999999999},"min":{"1min":0.72799999999999998,"5min":0.46100000000000002,"15min":0.40400000000000003},"max":{"1min":1.294,"5min":1.623,"15min":2.0419999999999998},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.131,"5min":1.1599999999999999,"15min":1.1639999999999999},"min":{"1min":0.83899999999999997,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.357,"5min":1.736,"15min":2.3279999999999998},"last":1.194}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33505,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33505,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2912256,"data_stored":4194360,"data_compressed":397480,"data_compressed_allocated":610304,"data_compressed_original":1900544,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6066176,"data_stored":8389280,"data_compressed":750925,"data_compressed_allocated":1228800,"data_compressed_original":3559424,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8699904,"data_stored":12583494,"data_compressed":1205599,"data_compressed_allocated":1880064,"data_compressed_original":5767168,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6098944,"data_stored":8389952,"data_compressed":749838,"data_compressed_allocated":1245184,"data_compressed_original":3551232,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4546560,"data_stored":7328697,"data_compressed":816641,"data_compressed_allocated":1196032,"data_compressed_original":3989504,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":2732032,"data_stored":4194304,"data_compressed":430585,"data_compressed_allocated":663552,"data_compressed_original":2125824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1814528,"data_stored":3134425,"data_compressed":386056,"data_compressed_allocated":532480,"data_compressed_original":1863680,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T18:44:44.374 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:44.374 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-11-27T18:13:11.696161+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:44.375 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:44.375 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-11-27T18:13:19.384586+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=13, tm_sec=19, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=18, tm_min=43, tm_sec=32, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T18:44:44.376 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-27T18:45:04.376 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T18:45:10.144 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.145+0000 7fde9dd9e640 1 Processor -- start 2023-11-27T18:45:10.144 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.145+0000 7fde9dd9e640 1 -- start start 2023-11-27T18:45:10.145 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.145+0000 7fde9dd9e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fde980cbac0 0x7fde980c6f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:10.145 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.145+0000 7fde9dd9e640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde9814e180 con 0x7fde980cc460 2023-11-27T18:45:10.145 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.145+0000 7fde9dd9e640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde9806b300 con 0x7fde9806a520 2023-11-27T18:45:10.145 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.145+0000 7fde9dd9e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde980c7dc0 con 0x7fde980cbac0 2023-11-27T18:45:10.145 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.145+0000 7fde8ffff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fde980cbac0 0x7fde980c6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:45:10.146 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.145+0000 7fde8ffff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fde980cbac0 0x7fde980c6f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:55340/0 (socket says 172.21.15.91:55340) 2023-11-27T18:45:10.146 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.145+0000 7fde8ffff640 1 -- 172.21.15.91:0/1356946181 learned_addr learned my addr 172.21.15.91:0/1356946181 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:45:10.149 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.149+0000 7fde8ffff640 1 -- 172.21.15.91:0/1356946181 >> v1:172.21.15.94:6789/0 conn(0x7fde9806a520 legacy=0x7fde980c5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:45:10.149 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.149+0000 7fde8ffff640 1 -- 172.21.15.91:0/1356946181 >> v1:172.21.15.91:6789/0 conn(0x7fde980cc460 legacy=0x7fde98157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:10.149 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.149+0000 7fde8ffff640 1 -- 172.21.15.91:0/1356946181 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde9806aa60 con 0x7fde980cbac0 2023-11-27T18:45:10.154 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.153+0000 7fde8ffff640 1 --2- 172.21.15.91:0/1356946181 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fde980cbac0 0x7fde980c6f90 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fde80009870 tx=0x7fde8001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abc2a822c250fed8 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:45:10.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.161+0000 7fde96ffd640 1 -- 172.21.15.91:0/1356946181 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde800a89f0 con 0x7fde980cbac0 2023-11-27T18:45:10.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.161+0000 7fde96ffd640 1 -- 172.21.15.91:0/1356946181 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde800a8b50 con 0x7fde980cbac0 2023-11-27T18:45:10.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.161+0000 7fde96ffd640 1 -- 172.21.15.91:0/1356946181 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde800b0440 con 0x7fde980cbac0 2023-11-27T18:45:10.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.161+0000 7fde9dd9e640 1 -- 172.21.15.91:0/1356946181 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fde980cbac0 msgr2=0x7fde980c6f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:10.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.161+0000 7fde9dd9e640 1 --2- 172.21.15.91:0/1356946181 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fde980cbac0 0x7fde980c6f90 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fde80009870 tx=0x7fde8001ecf0 comp rx=0 tx=0).stop 2023-11-27T18:45:10.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.161+0000 7fde9dd9e640 1 -- 172.21.15.91:0/1356946181 shutdown_connections 2023-11-27T18:45:10.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.161+0000 7fde9dd9e640 1 --2- 172.21.15.91:0/1356946181 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fde980cbac0 0x7fde980c6f90 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:10.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.161+0000 7fde9dd9e640 1 -- 172.21.15.91:0/1356946181 >> 172.21.15.91:0/1356946181 conn(0x7fde9806f9c0 msgr2=0x7fde9806fdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:45:10.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.161+0000 7fde9dd9e640 1 -- 172.21.15.91:0/1356946181 shutdown_connections 2023-11-27T18:45:10.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.161+0000 7fde9dd9e640 1 -- 172.21.15.91:0/1356946181 wait complete. 2023-11-27T18:45:10.162 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.161+0000 7fde9dd9e640 1 Processor -- start 2023-11-27T18:45:10.162 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.161+0000 7fde9dd9e640 1 -- start start 2023-11-27T18:45:10.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.161+0000 7fde9dd9e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fde9806a520 0x7fde981f05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:10.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.161+0000 7fde9dd9e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde980cbac0 0x7fde9806e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:10.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.161+0000 7fde9dd9e640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fde980cc460 0x7fde981493d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:10.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.161+0000 7fde9dd9e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde9814bcb0 con 0x7fde9806a520 2023-11-27T18:45:10.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.161+0000 7fde9dd9e640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde980c4960 con 0x7fde980cbac0 2023-11-27T18:45:10.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.161+0000 7fde9dd9e640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde98156810 con 0x7fde980cc460 2023-11-27T18:45:10.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.165+0000 7fde977fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fde9806a520 0x7fde981f05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:45:10.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.165+0000 7fde977fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fde9806a520 0x7fde981f05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:55342/0 (socket says 172.21.15.91:55342) 2023-11-27T18:45:10.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.165+0000 7fde977fe640 1 -- 172.21.15.91:0/3090213275 learned_addr learned my addr 172.21.15.91:0/3090213275 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:45:10.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.169+0000 7fde977fe640 1 -- 172.21.15.91:0/3090213275 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fde980cc460 msgr2=0x7fde981493d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:10.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.169+0000 7fde977fe640 1 --2- 172.21.15.91:0/3090213275 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fde980cc460 0x7fde981493d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:10.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.169+0000 7fde977fe640 1 -- 172.21.15.91:0/3090213275 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde980cbac0 msgr2=0x7fde9806e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:10.170 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.169+0000 7fde977fe640 1 --2- 172.21.15.91:0/3090213275 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde980cbac0 0x7fde9806e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:10.170 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.169+0000 7fde977fe640 1 -- 172.21.15.91:0/3090213275 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde800094d0 con 0x7fde9806a520 2023-11-27T18:45:10.170 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.169+0000 7fde977fe640 1 --2- 172.21.15.91:0/3090213275 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fde9806a520 0x7fde981f05d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fde8800c3c0 tx=0x7fde8800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:45:10.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.173+0000 7fde94ff9640 1 -- 172.21.15.91:0/3090213275 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde880052d0 con 0x7fde9806a520 2023-11-27T18:45:10.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.173+0000 7fde94ff9640 1 -- 172.21.15.91:0/3090213275 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde88005430 con 0x7fde9806a520 2023-11-27T18:45:10.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.173+0000 7fde94ff9640 1 -- 172.21.15.91:0/3090213275 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde88003840 con 0x7fde9806a520 2023-11-27T18:45:10.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.173+0000 7fde9dd9e640 1 -- 172.21.15.91:0/3090213275 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde981f0b10 con 0x7fde9806a520 2023-11-27T18:45:10.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.173+0000 7fde9dd9e640 1 -- 172.21.15.91:0/3090213275 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde98156ee0 con 0x7fde9806a520 2023-11-27T18:45:10.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.173+0000 7fde9dd9e640 1 -- 172.21.15.91:0/3090213275 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde980680a0 con 0x7fde9806a520 2023-11-27T18:45:10.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.197+0000 7fde94ff9640 1 -- 172.21.15.91:0/3090213275 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fde880039a0 con 0x7fde9806a520 2023-11-27T18:45:10.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.197+0000 7fde94ff9640 1 --2- 172.21.15.91:0/3090213275 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fde780667f0 0x7fde78068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:10.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.197+0000 7fde8ffff640 1 --2- 172.21.15.91:0/3090213275 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fde780667f0 0x7fde78068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:45:10.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.197+0000 7fde8ffff640 1 --2- 172.21.15.91:0/3090213275 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fde780667f0 0x7fde78068cb0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fde800b2000 tx=0x7fde80004740 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:45:10.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.197+0000 7fde94ff9640 1 -- 172.21.15.91:0/3090213275 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fde88055170 con 0x7fde9806a520 2023-11-27T18:45:10.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.461+0000 7fde94ff9640 1 -- 172.21.15.91:0/3090213275 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fde88050db0 con 0x7fde9806a520 2023-11-27T18:45:10.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.621+0000 7fde9dd9e640 1 -- 172.21.15.91:0/3090213275 --> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fde98157420 con 0x7fde780667f0 2023-11-27T18:45:10.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.649+0000 7fde94ff9640 1 -- 172.21.15.91:0/3090213275 <== mgr.4136 v2:172.21.15.91:6800/2814827118 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+372013 (secure 0 0 0) 0x7fde800b0440 con 0x7fde780667f0 2023-11-27T18:45:10.651 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:45:10.654 INFO:teuthology.orchestra.run.smithi091.stderr:dumped all 2023-11-27T18:45:10.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.653+0000 7fde9dd9e640 1 -- 172.21.15.91:0/3090213275 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fde780667f0 msgr2=0x7fde78068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:10.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.653+0000 7fde9dd9e640 1 --2- 172.21.15.91:0/3090213275 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fde780667f0 0x7fde78068cb0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fde800b2000 tx=0x7fde80004740 comp rx=0 tx=0).stop 2023-11-27T18:45:10.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.653+0000 7fde9dd9e640 1 -- 172.21.15.91:0/3090213275 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fde9806a520 msgr2=0x7fde981f05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:10.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.653+0000 7fde9dd9e640 1 --2- 172.21.15.91:0/3090213275 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fde9806a520 0x7fde981f05d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fde8800c3c0 tx=0x7fde8800c880 comp rx=0 tx=0).stop 2023-11-27T18:45:10.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.653+0000 7fde9dd9e640 1 -- 172.21.15.91:0/3090213275 shutdown_connections 2023-11-27T18:45:10.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.653+0000 7fde9dd9e640 1 --2- 172.21.15.91:0/3090213275 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fde780667f0 0x7fde78068cb0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:10.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.653+0000 7fde9dd9e640 1 --2- 172.21.15.91:0/3090213275 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fde980cc460 0x7fde981493d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:10.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.653+0000 7fde9dd9e640 1 --2- 172.21.15.91:0/3090213275 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde980cbac0 0x7fde9806e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:10.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.653+0000 7fde9dd9e640 1 --2- 172.21.15.91:0/3090213275 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fde9806a520 0x7fde981f05d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:10.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.653+0000 7fde9dd9e640 1 -- 172.21.15.91:0/3090213275 >> 172.21.15.91:0/3090213275 conn(0x7fde9806f9c0 msgr2=0x7fde980c9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:45:10.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.653+0000 7fde9dd9e640 1 -- 172.21.15.91:0/3090213275 shutdown_connections 2023-11-27T18:45:10.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.653+0000 7fde9dd9e640 1 -- 172.21.15.91:0/3090213275 wait complete. 2023-11-27T18:45:10.672 INFO:teuthology.orchestra.run.smithi091.stdout:{"pg_ready":true,"pg_map":{"version":1004,"stamp":"2023-11-27T18:45:09.934137+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":24697659,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":665,"num_read_kb":681,"num_write":8239,"num_write_kb":284305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9530,"ondisk_log_size":9530,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":332868,"kb_used_data":34884,"kb_used_omap":12,"kb_used_meta":297907,"kb_avail":754641852,"statfs":{"total":773094113280,"available":772753256448,"internally_reserved":0,"allocated":35721216,"data_stored":50501075,"data_compressed":4804134,"data_compressed_allocated":7446528,"data_compressed_original":23904256,"omap_allocated":12751,"internal_metadata":305057329},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004949"},"pg_stats":[{"pgid":"2.1f","version":"32'715","reported_seq":760,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:47.848187+0000","last_change":"2023-11-27T18:43:47.848187+0000","last_active":"2023-11-27T18:43:47.848187+0000","last_peered":"2023-11-27T18:43:47.848187+0000","last_clean":"2023-11-27T18:43:47.848187+0000","last_became_active":"2023-11-27T18:13:12.298140+0000","last_became_peered":"2023-11-27T18:13:12.298140+0000","last_unstale":"2023-11-27T18:43:47.848187+0000","last_undegraded":"2023-11-27T18:43:47.848187+0000","last_fullsized":"2023-11-27T18:43:47.848187+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'715","last_scrub_stamp":"2023-11-27T18:43:47.847820+0000","last_deep_scrub":"32'715","last_deep_scrub_stamp":"2023-11-27T18:43:47.847820+0000","last_clean_scrub_stamp":"2023-11-27T18:43:47.847820+0000","objects_scrubbed":3,"log_size":715,"log_dups_size":0,"ondisk_log_size":715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:50:51.204330+0000","scrub_duration":0.035779559000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":710,"num_write_kb":4473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"32'16","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:03.898613+0000","last_change":"2023-11-27T18:44:03.898662+0000","last_active":"2023-11-27T18:44:03.898613+0000","last_peered":"2023-11-27T18:44:03.898613+0000","last_clean":"2023-11-27T18:44:03.898613+0000","last_became_active":"2023-11-27T18:13:14.416401+0000","last_became_peered":"2023-11-27T18:13:14.416401+0000","last_unstale":"2023-11-27T18:44:03.898613+0000","last_undegraded":"2023-11-27T18:44:03.898613+0000","last_fullsized":"2023-11-27T18:44:03.898613+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2023-11-27T18:44:03.898433+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2023-11-27T18:44:03.898433+0000","last_clean_scrub_stamp":"2023-11-27T18:44:03.898433+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:13:43.468400+0000","scrub_duration":0.0036775810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"32'75","reported_seq":114,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:00.111845+0000","last_change":"2023-11-27T18:44:00.111845+0000","last_active":"2023-11-27T18:44:00.111845+0000","last_peered":"2023-11-27T18:44:00.111845+0000","last_clean":"2023-11-27T18:44:00.111845+0000","last_became_active":"2023-11-27T18:13:20.915358+0000","last_became_peered":"2023-11-27T18:13:20.915358+0000","last_unstale":"2023-11-27T18:44:00.111845+0000","last_undegraded":"2023-11-27T18:44:00.111845+0000","last_fullsized":"2023-11-27T18:44:00.111845+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'75","last_scrub_stamp":"2023-11-27T18:44:00.111579+0000","last_deep_scrub":"32'75","last_deep_scrub_stamp":"2023-11-27T18:44:00.111579+0000","last_clean_scrub_stamp":"2023-11-27T18:44:00.111579+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:51:00.953217+0000","scrub_duration":0.0076916110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":3642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"32'325","reported_seq":369,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:57.075955+0000","last_change":"2023-11-27T18:43:57.076012+0000","last_active":"2023-11-27T18:43:57.075955+0000","last_peered":"2023-11-27T18:43:57.075955+0000","last_clean":"2023-11-27T18:43:57.075955+0000","last_became_active":"2023-11-27T18:13:12.304981+0000","last_became_peered":"2023-11-27T18:13:12.304981+0000","last_unstale":"2023-11-27T18:43:57.075955+0000","last_undegraded":"2023-11-27T18:43:57.075955+0000","last_fullsized":"2023-11-27T18:43:57.075955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'325","last_scrub_stamp":"2023-11-27T18:43:57.075766+0000","last_deep_scrub":"32'325","last_deep_scrub_stamp":"2023-11-27T18:43:57.075766+0000","last_clean_scrub_stamp":"2023-11-27T18:43:57.075766+0000","objects_scrubbed":1,"log_size":325,"log_dups_size":0,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:30:28.504144+0000","scrub_duration":0.022777430000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3006109,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":322,"num_write_kb":3093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"32'24","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:41.204401+0000","last_change":"2023-11-27T18:43:41.204401+0000","last_active":"2023-11-27T18:43:41.204401+0000","last_peered":"2023-11-27T18:43:41.204401+0000","last_clean":"2023-11-27T18:43:41.204401+0000","last_became_active":"2023-11-27T18:13:14.365787+0000","last_became_peered":"2023-11-27T18:13:14.365787+0000","last_unstale":"2023-11-27T18:43:41.204401+0000","last_undegraded":"2023-11-27T18:43:41.204401+0000","last_fullsized":"2023-11-27T18:43:41.204401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'24","last_scrub_stamp":"2023-11-27T18:43:41.204069+0000","last_deep_scrub":"32'24","last_deep_scrub_stamp":"2023-11-27T18:43:41.204069+0000","last_clean_scrub_stamp":"2023-11-27T18:43:41.204069+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:32:19.911402+0000","scrub_duration":0.0057151110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"32'88","reported_seq":127,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:20.556081+0000","last_change":"2023-11-27T18:44:20.556081+0000","last_active":"2023-11-27T18:44:20.556081+0000","last_peered":"2023-11-27T18:44:20.556081+0000","last_clean":"2023-11-27T18:44:20.556081+0000","last_became_active":"2023-11-27T18:13:20.914864+0000","last_became_peered":"2023-11-27T18:13:20.914864+0000","last_unstale":"2023-11-27T18:44:20.556081+0000","last_undegraded":"2023-11-27T18:44:20.556081+0000","last_fullsized":"2023-11-27T18:44:20.556081+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'88","last_scrub_stamp":"2023-11-27T18:44:20.555825+0000","last_deep_scrub":"32'88","last_deep_scrub_stamp":"2023-11-27T18:44:20.555825+0000","last_clean_scrub_stamp":"2023-11-27T18:44:20.555825+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:41:40.515790+0000","scrub_duration":0.0094880950000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":6140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"32'10","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:59.514855+0000","last_change":"2023-11-27T18:43:59.514974+0000","last_active":"2023-11-27T18:43:59.514855+0000","last_peered":"2023-11-27T18:43:59.514855+0000","last_clean":"2023-11-27T18:43:59.514855+0000","last_became_active":"2023-11-27T18:13:12.272343+0000","last_became_peered":"2023-11-27T18:13:12.272343+0000","last_unstale":"2023-11-27T18:43:59.514855+0000","last_undegraded":"2023-11-27T18:43:59.514855+0000","last_fullsized":"2023-11-27T18:43:59.514855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2023-11-27T18:43:59.514566+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2023-11-27T18:43:59.514566+0000","last_clean_scrub_stamp":"2023-11-27T18:43:59.514566+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:30:30.942944+0000","scrub_duration":0.0069176309999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"32'21","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:44.441251+0000","last_change":"2023-11-27T18:43:44.441307+0000","last_active":"2023-11-27T18:43:44.441251+0000","last_peered":"2023-11-27T18:43:44.441251+0000","last_clean":"2023-11-27T18:43:44.441251+0000","last_became_active":"2023-11-27T18:13:15.803248+0000","last_became_peered":"2023-11-27T18:13:15.803248+0000","last_unstale":"2023-11-27T18:43:44.441251+0000","last_undegraded":"2023-11-27T18:43:44.441251+0000","last_fullsized":"2023-11-27T18:43:44.441251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2023-11-27T18:43:44.441030+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2023-11-27T18:43:44.441030+0000","last_clean_scrub_stamp":"2023-11-27T18:43:44.441030+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:32:54.895787+0000","scrub_duration":0.0033392019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"32'82","reported_seq":120,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:03.401769+0000","last_change":"2023-11-27T18:44:03.401823+0000","last_active":"2023-11-27T18:44:03.401769+0000","last_peered":"2023-11-27T18:44:03.401769+0000","last_clean":"2023-11-27T18:44:03.401769+0000","last_became_active":"2023-11-27T18:13:20.908285+0000","last_became_peered":"2023-11-27T18:13:20.908285+0000","last_unstale":"2023-11-27T18:44:03.401769+0000","last_undegraded":"2023-11-27T18:44:03.401769+0000","last_fullsized":"2023-11-27T18:44:03.401769+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'82","last_scrub_stamp":"2023-11-27T18:44:03.401550+0000","last_deep_scrub":"32'82","last_deep_scrub_stamp":"2023-11-27T18:44:03.401550+0000","last_clean_scrub_stamp":"2023-11-27T18:44:03.401550+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:32:52.048284+0000","scrub_duration":0.0084183120000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":10516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"32'5","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:46.597260+0000","last_change":"2023-11-27T18:43:46.597376+0000","last_active":"2023-11-27T18:43:46.597260+0000","last_peered":"2023-11-27T18:43:46.597260+0000","last_clean":"2023-11-27T18:43:46.597260+0000","last_became_active":"2023-11-27T18:13:12.274275+0000","last_became_peered":"2023-11-27T18:13:12.274275+0000","last_unstale":"2023-11-27T18:43:46.597260+0000","last_undegraded":"2023-11-27T18:43:46.597260+0000","last_fullsized":"2023-11-27T18:43:46.597260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2023-11-27T18:43:46.597014+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2023-11-27T18:43:46.597014+0000","last_clean_scrub_stamp":"2023-11-27T18:43:46.597014+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:38:25.702336+0000","scrub_duration":0.0064410480000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"32'37","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:37.644099+0000","last_change":"2023-11-27T18:44:37.644150+0000","last_active":"2023-11-27T18:44:37.644099+0000","last_peered":"2023-11-27T18:44:37.644099+0000","last_clean":"2023-11-27T18:44:37.644099+0000","last_became_active":"2023-11-27T18:13:14.421811+0000","last_became_peered":"2023-11-27T18:13:14.421811+0000","last_unstale":"2023-11-27T18:44:37.644099+0000","last_undegraded":"2023-11-27T18:44:37.644099+0000","last_fullsized":"2023-11-27T18:44:37.644099+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2023-11-27T18:44:37.643897+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2023-11-27T18:44:37.643897+0000","last_clean_scrub_stamp":"2023-11-27T18:44:37.643897+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:18:11.992529+0000","scrub_duration":0.00355968,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"32'74","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:12.502342+0000","last_change":"2023-11-27T18:44:12.502402+0000","last_active":"2023-11-27T18:44:12.502342+0000","last_peered":"2023-11-27T18:44:12.502342+0000","last_clean":"2023-11-27T18:44:12.502342+0000","last_became_active":"2023-11-27T18:13:20.906418+0000","last_became_peered":"2023-11-27T18:13:20.906418+0000","last_unstale":"2023-11-27T18:44:12.502342+0000","last_undegraded":"2023-11-27T18:44:12.502342+0000","last_fullsized":"2023-11-27T18:44:12.502342+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'74","last_scrub_stamp":"2023-11-27T18:44:12.502149+0000","last_deep_scrub":"32'74","last_deep_scrub_stamp":"2023-11-27T18:44:12.502149+0000","last_clean_scrub_stamp":"2023-11-27T18:44:12.502149+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:48:55.390213+0000","scrub_duration":0.0089182870000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":5836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"32'20","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:59.211521+0000","last_change":"2023-11-27T18:43:59.211572+0000","last_active":"2023-11-27T18:43:59.211521+0000","last_peered":"2023-11-27T18:43:59.211521+0000","last_clean":"2023-11-27T18:43:59.211521+0000","last_became_active":"2023-11-27T18:13:14.418640+0000","last_became_peered":"2023-11-27T18:13:14.418640+0000","last_unstale":"2023-11-27T18:43:59.211521+0000","last_undegraded":"2023-11-27T18:43:59.211521+0000","last_fullsized":"2023-11-27T18:43:59.211521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2023-11-27T18:43:59.211339+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2023-11-27T18:43:59.211339+0000","last_clean_scrub_stamp":"2023-11-27T18:43:59.211339+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:15:35.201396+0000","scrub_duration":0.0038460930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"32'690","reported_seq":734,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:21.035487+0000","last_change":"2023-11-27T18:44:21.035487+0000","last_active":"2023-11-27T18:44:21.035487+0000","last_peered":"2023-11-27T18:44:21.035487+0000","last_clean":"2023-11-27T18:44:21.035487+0000","last_became_active":"2023-11-27T18:13:12.306331+0000","last_became_peered":"2023-11-27T18:13:12.306331+0000","last_unstale":"2023-11-27T18:44:21.035487+0000","last_undegraded":"2023-11-27T18:44:21.035487+0000","last_fullsized":"2023-11-27T18:44:21.035487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'690","last_scrub_stamp":"2023-11-27T18:44:21.035230+0000","last_deep_scrub":"32'690","last_deep_scrub_stamp":"2023-11-27T18:44:21.035230+0000","last_clean_scrub_stamp":"2023-11-27T18:44:21.035230+0000","objects_scrubbed":2,"log_size":690,"log_dups_size":0,"ondisk_log_size":690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:21:59.592660+0000","scrub_duration":0.039521944000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":683,"num_write_kb":4455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'77","reported_seq":111,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:25.693876+0000","last_change":"2023-11-27T18:44:25.694004+0000","last_active":"2023-11-27T18:44:25.693876+0000","last_peered":"2023-11-27T18:44:25.693876+0000","last_clean":"2023-11-27T18:44:25.693876+0000","last_became_active":"2023-11-27T18:14:22.717105+0000","last_became_peered":"2023-11-27T18:14:22.717105+0000","last_unstale":"2023-11-27T18:44:25.693876+0000","last_undegraded":"2023-11-27T18:44:25.693876+0000","last_fullsized":"2023-11-27T18:44:25.693876+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'77","last_scrub_stamp":"2023-11-27T18:44:25.693646+0000","last_deep_scrub":"32'77","last_deep_scrub_stamp":"2023-11-27T18:44:25.693646+0000","last_clean_scrub_stamp":"2023-11-27T18:44:25.693646+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:36:39.320387+0000","scrub_duration":0.0098094340000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":10073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7,5],"acting":[0,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"32'22","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:51.107717+0000","last_change":"2023-11-27T18:43:51.107717+0000","last_active":"2023-11-27T18:43:51.107717+0000","last_peered":"2023-11-27T18:43:51.107717+0000","last_clean":"2023-11-27T18:43:51.107717+0000","last_became_active":"2023-11-27T18:13:14.368117+0000","last_became_peered":"2023-11-27T18:13:14.368117+0000","last_unstale":"2023-11-27T18:43:51.107717+0000","last_undegraded":"2023-11-27T18:43:51.107717+0000","last_fullsized":"2023-11-27T18:43:51.107717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2023-11-27T18:43:51.107469+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2023-11-27T18:43:51.107469+0000","last_clean_scrub_stamp":"2023-11-27T18:43:51.107469+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:57:21.965939+0000","scrub_duration":0.0058469949999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"32'2","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:49.531217+0000","last_change":"2023-11-27T18:43:49.531318+0000","last_active":"2023-11-27T18:43:49.531217+0000","last_peered":"2023-11-27T18:43:49.531217+0000","last_clean":"2023-11-27T18:43:49.531217+0000","last_became_active":"2023-11-27T18:13:12.306644+0000","last_became_peered":"2023-11-27T18:13:12.306644+0000","last_unstale":"2023-11-27T18:43:49.531217+0000","last_undegraded":"2023-11-27T18:43:49.531217+0000","last_fullsized":"2023-11-27T18:43:49.531217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2023-11-27T18:43:49.530967+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2023-11-27T18:43:49.530967+0000","last_clean_scrub_stamp":"2023-11-27T18:43:49.530967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:08:46.212891+0000","scrub_duration":0.003406638,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"32'100","reported_seq":140,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:23.732513+0000","last_change":"2023-11-27T18:44:23.732513+0000","last_active":"2023-11-27T18:44:23.732513+0000","last_peered":"2023-11-27T18:44:23.732513+0000","last_clean":"2023-11-27T18:44:23.732513+0000","last_became_active":"2023-11-27T18:13:20.928830+0000","last_became_peered":"2023-11-27T18:13:20.928830+0000","last_unstale":"2023-11-27T18:44:23.732513+0000","last_undegraded":"2023-11-27T18:44:23.732513+0000","last_fullsized":"2023-11-27T18:44:23.732513+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'100","last_scrub_stamp":"2023-11-27T18:44:23.732242+0000","last_deep_scrub":"32'100","last_deep_scrub_stamp":"2023-11-27T18:44:23.732242+0000","last_clean_scrub_stamp":"2023-11-27T18:44:23.732242+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:37:33.556660+0000","scrub_duration":0.0098060309999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":7369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"32'24","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:52.943762+0000","last_change":"2023-11-27T18:43:52.943813+0000","last_active":"2023-11-27T18:43:52.943762+0000","last_peered":"2023-11-27T18:43:52.943762+0000","last_clean":"2023-11-27T18:43:52.943762+0000","last_became_active":"2023-11-27T18:13:14.378391+0000","last_became_peered":"2023-11-27T18:13:14.378391+0000","last_unstale":"2023-11-27T18:43:52.943762+0000","last_undegraded":"2023-11-27T18:43:52.943762+0000","last_fullsized":"2023-11-27T18:43:52.943762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'24","last_scrub_stamp":"2023-11-27T18:43:52.943561+0000","last_deep_scrub":"32'24","last_deep_scrub_stamp":"2023-11-27T18:43:52.943561+0000","last_clean_scrub_stamp":"2023-11-27T18:43:52.943561+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:36:18.307587+0000","scrub_duration":0.003991362,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"32'4","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:45.824544+0000","last_change":"2023-11-27T18:43:45.824599+0000","last_active":"2023-11-27T18:43:45.824544+0000","last_peered":"2023-11-27T18:43:45.824544+0000","last_clean":"2023-11-27T18:43:45.824544+0000","last_became_active":"2023-11-27T18:13:12.269795+0000","last_became_peered":"2023-11-27T18:13:12.269795+0000","last_unstale":"2023-11-27T18:43:45.824544+0000","last_undegraded":"2023-11-27T18:43:45.824544+0000","last_fullsized":"2023-11-27T18:43:45.824544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2023-11-27T18:43:45.824352+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2023-11-27T18:43:45.824352+0000","last_clean_scrub_stamp":"2023-11-27T18:43:45.824352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:21:33.244186+0000","scrub_duration":0.0037706549999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'67","reported_seq":107,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:01.092826+0000","last_change":"2023-11-27T18:44:01.092826+0000","last_active":"2023-11-27T18:44:01.092826+0000","last_peered":"2023-11-27T18:44:01.092826+0000","last_clean":"2023-11-27T18:44:01.092826+0000","last_became_active":"2023-11-27T18:13:20.906609+0000","last_became_peered":"2023-11-27T18:13:20.906609+0000","last_unstale":"2023-11-27T18:44:01.092826+0000","last_undegraded":"2023-11-27T18:44:01.092826+0000","last_fullsized":"2023-11-27T18:44:01.092826+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'67","last_scrub_stamp":"2023-11-27T18:44:01.092415+0000","last_deep_scrub":"32'67","last_deep_scrub_stamp":"2023-11-27T18:44:01.092415+0000","last_clean_scrub_stamp":"2023-11-27T18:44:01.092415+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:12:10.051315+0000","scrub_duration":0.0085197999999999992,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":7315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"32'21","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:43.136981+0000","last_change":"2023-11-27T18:43:43.137113+0000","last_active":"2023-11-27T18:43:43.136981+0000","last_peered":"2023-11-27T18:43:43.136981+0000","last_clean":"2023-11-27T18:43:43.136981+0000","last_became_active":"2023-11-27T18:13:14.414888+0000","last_became_peered":"2023-11-27T18:13:14.414888+0000","last_unstale":"2023-11-27T18:43:43.136981+0000","last_undegraded":"2023-11-27T18:43:43.136981+0000","last_fullsized":"2023-11-27T18:43:43.136981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2023-11-27T18:43:43.136763+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2023-11-27T18:43:43.136763+0000","last_clean_scrub_stamp":"2023-11-27T18:43:43.136763+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:48:26.024827+0000","scrub_duration":0.003973931,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"32'5","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:43.558828+0000","last_change":"2023-11-27T18:43:43.558883+0000","last_active":"2023-11-27T18:43:43.558828+0000","last_peered":"2023-11-27T18:43:43.558828+0000","last_clean":"2023-11-27T18:43:43.558828+0000","last_became_active":"2023-11-27T18:13:12.273356+0000","last_became_peered":"2023-11-27T18:13:12.273356+0000","last_unstale":"2023-11-27T18:43:43.558828+0000","last_undegraded":"2023-11-27T18:43:43.558828+0000","last_fullsized":"2023-11-27T18:43:43.558828+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2023-11-27T18:43:43.558640+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2023-11-27T18:43:43.558640+0000","last_clean_scrub_stamp":"2023-11-27T18:43:43.558640+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:49:12.209206+0000","scrub_duration":0.0032465200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'85","reported_seq":125,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:15.565429+0000","last_change":"2023-11-27T18:44:15.565429+0000","last_active":"2023-11-27T18:44:15.565429+0000","last_peered":"2023-11-27T18:44:15.565429+0000","last_clean":"2023-11-27T18:44:15.565429+0000","last_became_active":"2023-11-27T18:13:20.934797+0000","last_became_peered":"2023-11-27T18:13:20.934797+0000","last_unstale":"2023-11-27T18:44:15.565429+0000","last_undegraded":"2023-11-27T18:44:15.565429+0000","last_fullsized":"2023-11-27T18:44:15.565429+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'85","last_scrub_stamp":"2023-11-27T18:44:15.565164+0000","last_deep_scrub":"32'85","last_deep_scrub_stamp":"2023-11-27T18:44:15.565164+0000","last_clean_scrub_stamp":"2023-11-27T18:44:15.565164+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:13:55.135131+0000","scrub_duration":0.010705322999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":5270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'29","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:57.924916+0000","last_change":"2023-11-27T18:43:57.925019+0000","last_active":"2023-11-27T18:43:57.924916+0000","last_peered":"2023-11-27T18:43:57.924916+0000","last_clean":"2023-11-27T18:43:57.924916+0000","last_became_active":"2023-11-27T18:13:14.376304+0000","last_became_peered":"2023-11-27T18:13:14.376304+0000","last_unstale":"2023-11-27T18:43:57.924916+0000","last_undegraded":"2023-11-27T18:43:57.924916+0000","last_fullsized":"2023-11-27T18:43:57.924916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'29","last_scrub_stamp":"2023-11-27T18:43:57.924629+0000","last_deep_scrub":"32'29","last_deep_scrub_stamp":"2023-11-27T18:43:57.924629+0000","last_clean_scrub_stamp":"2023-11-27T18:43:57.924629+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:29:06.838395+0000","scrub_duration":0.0035453020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"32'8","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:31.723821+0000","last_change":"2023-11-27T18:44:31.723883+0000","last_active":"2023-11-27T18:44:31.723821+0000","last_peered":"2023-11-27T18:44:31.723821+0000","last_clean":"2023-11-27T18:44:31.723821+0000","last_became_active":"2023-11-27T18:13:12.307492+0000","last_became_peered":"2023-11-27T18:13:12.307492+0000","last_unstale":"2023-11-27T18:44:31.723821+0000","last_undegraded":"2023-11-27T18:44:31.723821+0000","last_fullsized":"2023-11-27T18:44:31.723821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2023-11-27T18:44:31.723615+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2023-11-27T18:44:31.723615+0000","last_clean_scrub_stamp":"2023-11-27T18:44:31.723615+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:15:43.578095+0000","scrub_duration":0.0069494530000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"32'53","reported_seq":94,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:02.443464+0000","last_change":"2023-11-27T18:44:02.443464+0000","last_active":"2023-11-27T18:44:02.443464+0000","last_peered":"2023-11-27T18:44:02.443464+0000","last_clean":"2023-11-27T18:44:02.443464+0000","last_became_active":"2023-11-27T18:13:20.917507+0000","last_became_peered":"2023-11-27T18:13:20.917507+0000","last_unstale":"2023-11-27T18:44:02.443464+0000","last_undegraded":"2023-11-27T18:44:02.443464+0000","last_fullsized":"2023-11-27T18:44:02.443464+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'53","last_scrub_stamp":"2023-11-27T18:44:02.443300+0000","last_deep_scrub":"32'53","last_deep_scrub_stamp":"2023-11-27T18:44:02.443300+0000","last_clean_scrub_stamp":"2023-11-27T18:44:02.443300+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:40:43.676662+0000","scrub_duration":0.0080949999999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":7028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"32'21","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:49.863843+0000","last_change":"2023-11-27T18:43:49.863898+0000","last_active":"2023-11-27T18:43:49.863843+0000","last_peered":"2023-11-27T18:43:49.863843+0000","last_clean":"2023-11-27T18:43:49.863843+0000","last_became_active":"2023-11-27T18:13:14.377289+0000","last_became_peered":"2023-11-27T18:13:14.377289+0000","last_unstale":"2023-11-27T18:43:49.863843+0000","last_undegraded":"2023-11-27T18:43:49.863843+0000","last_fullsized":"2023-11-27T18:43:49.863843+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2023-11-27T18:43:49.863644+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2023-11-27T18:43:49.863644+0000","last_clean_scrub_stamp":"2023-11-27T18:43:49.863644+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:01:22.274023+0000","scrub_duration":0.0055625429999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"32'327","reported_seq":371,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:40.843422+0000","last_change":"2023-11-27T18:43:40.843448+0000","last_active":"2023-11-27T18:43:40.843422+0000","last_peered":"2023-11-27T18:43:40.843422+0000","last_clean":"2023-11-27T18:43:40.843422+0000","last_became_active":"2023-11-27T18:13:12.267552+0000","last_became_peered":"2023-11-27T18:13:12.267552+0000","last_unstale":"2023-11-27T18:43:40.843422+0000","last_undegraded":"2023-11-27T18:43:40.843422+0000","last_fullsized":"2023-11-27T18:43:40.843422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'327","last_scrub_stamp":"2023-11-27T18:43:40.843323+0000","last_deep_scrub":"32'327","last_deep_scrub_stamp":"2023-11-27T18:43:40.843323+0000","last_clean_scrub_stamp":"2023-11-27T18:43:40.843323+0000","objects_scrubbed":1,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:56:06.018967+0000","scrub_duration":0.013467106,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"32'94","reported_seq":135,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:20.902014+0000","last_change":"2023-11-27T18:44:20.902129+0000","last_active":"2023-11-27T18:44:20.902014+0000","last_peered":"2023-11-27T18:44:20.902014+0000","last_clean":"2023-11-27T18:44:20.902014+0000","last_became_active":"2023-11-27T18:13:20.929370+0000","last_became_peered":"2023-11-27T18:13:20.929370+0000","last_unstale":"2023-11-27T18:44:20.902014+0000","last_undegraded":"2023-11-27T18:44:20.902014+0000","last_fullsized":"2023-11-27T18:44:20.902014+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'94","last_scrub_stamp":"2023-11-27T18:44:20.901767+0000","last_deep_scrub":"32'94","last_deep_scrub_stamp":"2023-11-27T18:44:20.901767+0000","last_clean_scrub_stamp":"2023-11-27T18:44:20.901767+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:39:51.079315+0000","scrub_duration":0.0092412929999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":11915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"32'22","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:01.454972+0000","last_change":"2023-11-27T18:44:01.454972+0000","last_active":"2023-11-27T18:44:01.454972+0000","last_peered":"2023-11-27T18:44:01.454972+0000","last_clean":"2023-11-27T18:44:01.454972+0000","last_became_active":"2023-11-27T18:13:14.369472+0000","last_became_peered":"2023-11-27T18:13:14.369472+0000","last_unstale":"2023-11-27T18:44:01.454972+0000","last_undegraded":"2023-11-27T18:44:01.454972+0000","last_fullsized":"2023-11-27T18:44:01.454972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2023-11-27T18:44:01.454715+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2023-11-27T18:44:01.454715+0000","last_clean_scrub_stamp":"2023-11-27T18:44:01.454715+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:38:40.560038+0000","scrub_duration":0.0038928529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:29.713697+0000","last_change":"2023-11-27T18:44:29.713697+0000","last_active":"2023-11-27T18:44:29.713697+0000","last_peered":"2023-11-27T18:44:29.713697+0000","last_clean":"2023-11-27T18:44:29.713697+0000","last_became_active":"2023-11-27T18:13:12.310495+0000","last_became_peered":"2023-11-27T18:13:12.310495+0000","last_unstale":"2023-11-27T18:44:29.713697+0000","last_undegraded":"2023-11-27T18:44:29.713697+0000","last_fullsized":"2023-11-27T18:44:29.713697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2023-11-27T18:44:29.713443+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2023-11-27T18:44:29.713443+0000","last_clean_scrub_stamp":"2023-11-27T18:44:29.713443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:34:09.203249+0000","scrub_duration":0.0040309719999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"32'62","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:19.291759+0000","last_change":"2023-11-27T18:44:19.291759+0000","last_active":"2023-11-27T18:44:19.291759+0000","last_peered":"2023-11-27T18:44:19.291759+0000","last_clean":"2023-11-27T18:44:19.291759+0000","last_became_active":"2023-11-27T18:13:20.907229+0000","last_became_peered":"2023-11-27T18:13:20.907229+0000","last_unstale":"2023-11-27T18:44:19.291759+0000","last_undegraded":"2023-11-27T18:44:19.291759+0000","last_fullsized":"2023-11-27T18:44:19.291759+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'62","last_scrub_stamp":"2023-11-27T18:44:19.291514+0000","last_deep_scrub":"32'62","last_deep_scrub_stamp":"2023-11-27T18:44:19.291514+0000","last_clean_scrub_stamp":"2023-11-27T18:44:19.291514+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:06:23.458563+0000","scrub_duration":0.0078187329999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":7408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"32'20","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:49.434991+0000","last_change":"2023-11-27T18:43:49.434991+0000","last_active":"2023-11-27T18:43:49.434991+0000","last_peered":"2023-11-27T18:43:49.434991+0000","last_clean":"2023-11-27T18:43:49.434991+0000","last_became_active":"2023-11-27T18:13:15.850263+0000","last_became_peered":"2023-11-27T18:13:15.850263+0000","last_unstale":"2023-11-27T18:43:49.434991+0000","last_undegraded":"2023-11-27T18:43:49.434991+0000","last_fullsized":"2023-11-27T18:43:49.434991+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2023-11-27T18:43:49.434748+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2023-11-27T18:43:49.434748+0000","last_clean_scrub_stamp":"2023-11-27T18:43:49.434748+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:46:15.277193+0000","scrub_duration":0.004346305,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"32'4","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:54.064497+0000","last_change":"2023-11-27T18:43:54.064497+0000","last_active":"2023-11-27T18:43:54.064497+0000","last_peered":"2023-11-27T18:43:54.064497+0000","last_clean":"2023-11-27T18:43:54.064497+0000","last_became_active":"2023-11-27T18:13:12.310138+0000","last_became_peered":"2023-11-27T18:13:12.310138+0000","last_unstale":"2023-11-27T18:43:54.064497+0000","last_undegraded":"2023-11-27T18:43:54.064497+0000","last_fullsized":"2023-11-27T18:43:54.064497+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2023-11-27T18:43:54.064090+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2023-11-27T18:43:54.064090+0000","last_clean_scrub_stamp":"2023-11-27T18:43:54.064090+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:32:42.710824+0000","scrub_duration":0.0045180919999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"32'81","reported_seq":122,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:20.310080+0000","last_change":"2023-11-27T18:44:20.310080+0000","last_active":"2023-11-27T18:44:20.310080+0000","last_peered":"2023-11-27T18:44:20.310080+0000","last_clean":"2023-11-27T18:44:20.310080+0000","last_became_active":"2023-11-27T18:13:20.896156+0000","last_became_peered":"2023-11-27T18:13:20.896156+0000","last_unstale":"2023-11-27T18:44:20.310080+0000","last_undegraded":"2023-11-27T18:44:20.310080+0000","last_fullsized":"2023-11-27T18:44:20.310080+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'81","last_scrub_stamp":"2023-11-27T18:44:20.309827+0000","last_deep_scrub":"32'81","last_deep_scrub_stamp":"2023-11-27T18:44:20.309827+0000","last_clean_scrub_stamp":"2023-11-27T18:44:20.309827+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:40:12.238112+0000","scrub_duration":0.0079776129999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":6173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"32'22","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:41.582072+0000","last_change":"2023-11-27T18:43:41.582072+0000","last_active":"2023-11-27T18:43:41.582072+0000","last_peered":"2023-11-27T18:43:41.582072+0000","last_clean":"2023-11-27T18:43:41.582072+0000","last_became_active":"2023-11-27T18:13:14.421125+0000","last_became_peered":"2023-11-27T18:13:14.421125+0000","last_unstale":"2023-11-27T18:43:41.582072+0000","last_undegraded":"2023-11-27T18:43:41.582072+0000","last_fullsized":"2023-11-27T18:43:41.582072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2023-11-27T18:43:41.581900+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2023-11-27T18:43:41.581900+0000","last_clean_scrub_stamp":"2023-11-27T18:43:41.581900+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:46:07.424345+0000","scrub_duration":0.0018251680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"32'5","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:16.048664+0000","last_change":"2023-11-27T18:44:16.048664+0000","last_active":"2023-11-27T18:44:16.048664+0000","last_peered":"2023-11-27T18:44:16.048664+0000","last_clean":"2023-11-27T18:44:16.048664+0000","last_became_active":"2023-11-27T18:13:12.301617+0000","last_became_peered":"2023-11-27T18:13:12.301617+0000","last_unstale":"2023-11-27T18:44:16.048664+0000","last_undegraded":"2023-11-27T18:44:16.048664+0000","last_fullsized":"2023-11-27T18:44:16.048664+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2023-11-27T18:44:16.048306+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2023-11-27T18:44:16.048306+0000","last_clean_scrub_stamp":"2023-11-27T18:44:16.048306+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:54:42.145821+0000","scrub_duration":0.0043585409999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'68","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:22.381445+0000","last_change":"2023-11-27T18:44:22.381445+0000","last_active":"2023-11-27T18:44:22.381445+0000","last_peered":"2023-11-27T18:44:22.381445+0000","last_clean":"2023-11-27T18:44:22.381445+0000","last_became_active":"2023-11-27T18:13:20.903019+0000","last_became_peered":"2023-11-27T18:13:20.903019+0000","last_unstale":"2023-11-27T18:44:22.381445+0000","last_undegraded":"2023-11-27T18:44:22.381445+0000","last_fullsized":"2023-11-27T18:44:22.381445+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'68","last_scrub_stamp":"2023-11-27T18:44:22.381185+0000","last_deep_scrub":"32'68","last_deep_scrub_stamp":"2023-11-27T18:44:22.381185+0000","last_clean_scrub_stamp":"2023-11-27T18:44:22.381185+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:05:21.538766+0000","scrub_duration":0.0091788240000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":4275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"32'26","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:15.846601+0000","last_change":"2023-11-27T18:44:15.846651+0000","last_active":"2023-11-27T18:44:15.846601+0000","last_peered":"2023-11-27T18:44:15.846601+0000","last_clean":"2023-11-27T18:44:15.846601+0000","last_became_active":"2023-11-27T18:13:14.378644+0000","last_became_peered":"2023-11-27T18:13:14.378644+0000","last_unstale":"2023-11-27T18:44:15.846601+0000","last_undegraded":"2023-11-27T18:44:15.846601+0000","last_fullsized":"2023-11-27T18:44:15.846601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'26","last_scrub_stamp":"2023-11-27T18:44:15.846395+0000","last_deep_scrub":"32'26","last_deep_scrub_stamp":"2023-11-27T18:44:15.846395+0000","last_clean_scrub_stamp":"2023-11-27T18:44:15.846395+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:16:14.706577+0000","scrub_duration":0.0035380469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"32'556","reported_seq":1150,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:44.099800+0000","last_change":"2023-11-27T18:43:44.099800+0000","last_active":"2023-11-27T18:43:44.099800+0000","last_peered":"2023-11-27T18:43:44.099800+0000","last_clean":"2023-11-27T18:43:44.099800+0000","last_became_active":"2023-11-27T18:13:12.305380+0000","last_became_peered":"2023-11-27T18:13:12.305380+0000","last_unstale":"2023-11-27T18:43:44.099800+0000","last_undegraded":"2023-11-27T18:43:44.099800+0000","last_fullsized":"2023-11-27T18:43:44.099800+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'556","last_scrub_stamp":"2023-11-27T18:43:44.099467+0000","last_deep_scrub":"32'556","last_deep_scrub_stamp":"2023-11-27T18:43:44.099467+0000","last_clean_scrub_stamp":"2023-11-27T18:43:44.099467+0000","objects_scrubbed":1,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:29:30.687440+0000","scrub_duration":0.0048880249999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128192,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":549,"num_read_kb":581,"num_write":552,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"32'76","reported_seq":116,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:27.382806+0000","last_change":"2023-11-27T18:44:27.382862+0000","last_active":"2023-11-27T18:44:27.382806+0000","last_peered":"2023-11-27T18:44:27.382806+0000","last_clean":"2023-11-27T18:44:27.382806+0000","last_became_active":"2023-11-27T18:13:20.913137+0000","last_became_peered":"2023-11-27T18:13:20.913137+0000","last_unstale":"2023-11-27T18:44:27.382806+0000","last_undegraded":"2023-11-27T18:44:27.382806+0000","last_fullsized":"2023-11-27T18:44:27.382806+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'76","last_scrub_stamp":"2023-11-27T18:44:27.382613+0000","last_deep_scrub":"32'76","last_deep_scrub_stamp":"2023-11-27T18:44:27.382613+0000","last_clean_scrub_stamp":"2023-11-27T18:44:27.382613+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:33:51.180861+0000","scrub_duration":0.0074036980000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":7407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"32'15","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:58.444628+0000","last_change":"2023-11-27T18:43:58.444628+0000","last_active":"2023-11-27T18:43:58.444628+0000","last_peered":"2023-11-27T18:43:58.444628+0000","last_clean":"2023-11-27T18:43:58.444628+0000","last_became_active":"2023-11-27T18:13:14.413413+0000","last_became_peered":"2023-11-27T18:13:14.413413+0000","last_unstale":"2023-11-27T18:43:58.444628+0000","last_undegraded":"2023-11-27T18:43:58.444628+0000","last_fullsized":"2023-11-27T18:43:58.444628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2023-11-27T18:43:58.444377+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2023-11-27T18:43:58.444377+0000","last_clean_scrub_stamp":"2023-11-27T18:43:58.444377+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:46:24.286822+0000","scrub_duration":0.003852397,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:10.127443+0000","last_change":"2023-11-27T18:44:10.127545+0000","last_active":"2023-11-27T18:44:10.127443+0000","last_peered":"2023-11-27T18:44:10.127443+0000","last_clean":"2023-11-27T18:44:10.127443+0000","last_became_active":"2023-11-27T18:13:12.315610+0000","last_became_peered":"2023-11-27T18:13:12.315610+0000","last_unstale":"2023-11-27T18:44:10.127443+0000","last_undegraded":"2023-11-27T18:44:10.127443+0000","last_fullsized":"2023-11-27T18:44:10.127443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2023-11-27T18:44:10.127224+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2023-11-27T18:44:10.127224+0000","last_clean_scrub_stamp":"2023-11-27T18:44:10.127224+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:50:06.266659+0000","scrub_duration":0.0045927720000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"32'85","reported_seq":125,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:23.925337+0000","last_change":"2023-11-27T18:44:23.925402+0000","last_active":"2023-11-27T18:44:23.925337+0000","last_peered":"2023-11-27T18:44:23.925337+0000","last_clean":"2023-11-27T18:44:23.925337+0000","last_became_active":"2023-11-27T18:13:20.912453+0000","last_became_peered":"2023-11-27T18:13:20.912453+0000","last_unstale":"2023-11-27T18:44:23.925337+0000","last_undegraded":"2023-11-27T18:44:23.925337+0000","last_fullsized":"2023-11-27T18:44:23.925337+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'85","last_scrub_stamp":"2023-11-27T18:44:23.925116+0000","last_deep_scrub":"32'85","last_deep_scrub_stamp":"2023-11-27T18:44:23.925116+0000","last_clean_scrub_stamp":"2023-11-27T18:44:23.925116+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:25:08.143647+0000","scrub_duration":0.0082730440000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":10738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"32'21","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:38.774348+0000","last_change":"2023-11-27T18:43:38.774348+0000","last_active":"2023-11-27T18:43:38.774348+0000","last_peered":"2023-11-27T18:43:38.774348+0000","last_clean":"2023-11-27T18:43:38.774348+0000","last_became_active":"2023-11-27T18:13:14.414156+0000","last_became_peered":"2023-11-27T18:13:14.414156+0000","last_unstale":"2023-11-27T18:43:38.774348+0000","last_undegraded":"2023-11-27T18:43:38.774348+0000","last_fullsized":"2023-11-27T18:43:38.774348+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2023-11-27T18:43:38.774109+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2023-11-27T18:43:38.774109+0000","last_clean_scrub_stamp":"2023-11-27T18:43:38.774109+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:37:26.401993+0000","scrub_duration":0.003067443,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"32'3","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:20.021203+0000","last_change":"2023-11-27T18:44:20.021203+0000","last_active":"2023-11-27T18:44:20.021203+0000","last_peered":"2023-11-27T18:44:20.021203+0000","last_clean":"2023-11-27T18:44:20.021203+0000","last_became_active":"2023-11-27T18:13:12.308050+0000","last_became_peered":"2023-11-27T18:13:12.308050+0000","last_unstale":"2023-11-27T18:44:20.021203+0000","last_undegraded":"2023-11-27T18:44:20.021203+0000","last_fullsized":"2023-11-27T18:44:20.021203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2023-11-27T18:44:20.020928+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2023-11-27T18:44:20.020928+0000","last_clean_scrub_stamp":"2023-11-27T18:44:20.020928+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:41:44.074226+0000","scrub_duration":0.003879857,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"32'119","reported_seq":199,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:35.406964+0000","last_change":"2023-11-27T18:43:35.406964+0000","last_active":"2023-11-27T18:43:35.406964+0000","last_peered":"2023-11-27T18:43:35.406964+0000","last_clean":"2023-11-27T18:43:35.406964+0000","last_became_active":"2023-11-27T18:12:38.370748+0000","last_became_peered":"2023-11-27T18:12:38.370748+0000","last_unstale":"2023-11-27T18:43:35.406964+0000","last_undegraded":"2023-11-27T18:43:35.406964+0000","last_fullsized":"2023-11-27T18:43:35.406964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2023-11-27T18:43:35.406767+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2023-11-27T18:43:35.406767+0000","last_clean_scrub_stamp":"2023-11-27T18:43:35.406767+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:03:00.314752+0000","scrub_duration":0.010946301,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'86","reported_seq":127,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:47.724998+0000","last_change":"2023-11-27T18:44:47.724998+0000","last_active":"2023-11-27T18:44:47.724998+0000","last_peered":"2023-11-27T18:44:47.724998+0000","last_clean":"2023-11-27T18:44:47.724998+0000","last_became_active":"2023-11-27T18:13:20.926559+0000","last_became_peered":"2023-11-27T18:13:20.926559+0000","last_unstale":"2023-11-27T18:44:47.724998+0000","last_undegraded":"2023-11-27T18:44:47.724998+0000","last_fullsized":"2023-11-27T18:44:47.724998+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'86","last_scrub_stamp":"2023-11-27T18:44:47.724734+0000","last_deep_scrub":"32'86","last_deep_scrub_stamp":"2023-11-27T18:44:47.724734+0000","last_clean_scrub_stamp":"2023-11-27T18:44:47.724734+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:24:38.071910+0000","scrub_duration":0.010656432,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":7930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"32'24","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:35.676327+0000","last_change":"2023-11-27T18:44:35.676327+0000","last_active":"2023-11-27T18:44:35.676327+0000","last_peered":"2023-11-27T18:44:35.676327+0000","last_clean":"2023-11-27T18:44:35.676327+0000","last_became_active":"2023-11-27T18:13:14.419636+0000","last_became_peered":"2023-11-27T18:13:14.419636+0000","last_unstale":"2023-11-27T18:44:35.676327+0000","last_undegraded":"2023-11-27T18:44:35.676327+0000","last_fullsized":"2023-11-27T18:44:35.676327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'24","last_scrub_stamp":"2023-11-27T18:44:35.676071+0000","last_deep_scrub":"32'24","last_deep_scrub_stamp":"2023-11-27T18:44:35.676071+0000","last_clean_scrub_stamp":"2023-11-27T18:44:35.676071+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:07:47.911622+0000","scrub_duration":0.00342597,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"32'2","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:43.374050+0000","last_change":"2023-11-27T18:43:43.374050+0000","last_active":"2023-11-27T18:43:43.374050+0000","last_peered":"2023-11-27T18:43:43.374050+0000","last_clean":"2023-11-27T18:43:43.374050+0000","last_became_active":"2023-11-27T18:13:12.267764+0000","last_became_peered":"2023-11-27T18:13:12.267764+0000","last_unstale":"2023-11-27T18:43:43.374050+0000","last_undegraded":"2023-11-27T18:43:43.374050+0000","last_fullsized":"2023-11-27T18:43:43.374050+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2023-11-27T18:43:43.373801+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2023-11-27T18:43:43.373801+0000","last_clean_scrub_stamp":"2023-11-27T18:43:43.373801+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:57:29.602489+0000","scrub_duration":0.0042106540000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"32'73","reported_seq":113,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:04.359448+0000","last_change":"2023-11-27T18:44:04.359503+0000","last_active":"2023-11-27T18:44:04.359448+0000","last_peered":"2023-11-27T18:44:04.359448+0000","last_clean":"2023-11-27T18:44:04.359448+0000","last_became_active":"2023-11-27T18:13:20.914157+0000","last_became_peered":"2023-11-27T18:13:20.914157+0000","last_unstale":"2023-11-27T18:44:04.359448+0000","last_undegraded":"2023-11-27T18:44:04.359448+0000","last_fullsized":"2023-11-27T18:44:04.359448+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'73","last_scrub_stamp":"2023-11-27T18:44:04.359245+0000","last_deep_scrub":"32'73","last_deep_scrub_stamp":"2023-11-27T18:44:04.359245+0000","last_clean_scrub_stamp":"2023-11-27T18:44:04.359245+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:30:35.787623+0000","scrub_duration":0.0096271519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":5275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'24","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:04.449383+0000","last_change":"2023-11-27T18:44:04.449383+0000","last_active":"2023-11-27T18:44:04.449383+0000","last_peered":"2023-11-27T18:44:04.449383+0000","last_clean":"2023-11-27T18:44:04.449383+0000","last_became_active":"2023-11-27T18:13:14.363285+0000","last_became_peered":"2023-11-27T18:13:14.363285+0000","last_unstale":"2023-11-27T18:44:04.449383+0000","last_undegraded":"2023-11-27T18:44:04.449383+0000","last_fullsized":"2023-11-27T18:44:04.449383+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'24","last_scrub_stamp":"2023-11-27T18:44:04.449134+0000","last_deep_scrub":"32'24","last_deep_scrub_stamp":"2023-11-27T18:44:04.449134+0000","last_clean_scrub_stamp":"2023-11-27T18:44:04.449134+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:31:02.404937+0000","scrub_duration":0.0036982669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:59.020774+0000","last_change":"2023-11-27T18:43:59.020774+0000","last_active":"2023-11-27T18:43:59.020774+0000","last_peered":"2023-11-27T18:43:59.020774+0000","last_clean":"2023-11-27T18:43:59.020774+0000","last_became_active":"2023-11-27T18:13:12.312038+0000","last_became_peered":"2023-11-27T18:13:12.312038+0000","last_unstale":"2023-11-27T18:43:59.020774+0000","last_undegraded":"2023-11-27T18:43:59.020774+0000","last_fullsized":"2023-11-27T18:43:59.020774+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2023-11-27T18:43:59.020532+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2023-11-27T18:43:59.020532+0000","last_clean_scrub_stamp":"2023-11-27T18:43:59.020532+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:11:10.104848+0000","scrub_duration":0.007309444,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"32'90","reported_seq":130,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:18.938261+0000","last_change":"2023-11-27T18:44:18.938261+0000","last_active":"2023-11-27T18:44:18.938261+0000","last_peered":"2023-11-27T18:44:18.938261+0000","last_clean":"2023-11-27T18:44:18.938261+0000","last_became_active":"2023-11-27T18:13:20.912734+0000","last_became_peered":"2023-11-27T18:13:20.912734+0000","last_unstale":"2023-11-27T18:44:18.938261+0000","last_undegraded":"2023-11-27T18:44:18.938261+0000","last_fullsized":"2023-11-27T18:44:18.938261+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'90","last_scrub_stamp":"2023-11-27T18:44:18.937834+0000","last_deep_scrub":"32'90","last_deep_scrub_stamp":"2023-11-27T18:44:18.937834+0000","last_clean_scrub_stamp":"2023-11-27T18:44:18.937834+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:36:32.564575+0000","scrub_duration":0.010434255,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":13642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"32'25","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:19.606734+0000","last_change":"2023-11-27T18:44:19.606734+0000","last_active":"2023-11-27T18:44:19.606734+0000","last_peered":"2023-11-27T18:44:19.606734+0000","last_clean":"2023-11-27T18:44:19.606734+0000","last_became_active":"2023-11-27T18:13:14.363772+0000","last_became_peered":"2023-11-27T18:13:14.363772+0000","last_unstale":"2023-11-27T18:44:19.606734+0000","last_undegraded":"2023-11-27T18:44:19.606734+0000","last_fullsized":"2023-11-27T18:44:19.606734+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'25","last_scrub_stamp":"2023-11-27T18:44:19.606489+0000","last_deep_scrub":"32'25","last_deep_scrub_stamp":"2023-11-27T18:44:19.606489+0000","last_clean_scrub_stamp":"2023-11-27T18:44:19.606489+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:15:55.596546+0000","scrub_duration":0.0048144879999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"32'5","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:44.804824+0000","last_change":"2023-11-27T18:43:44.804824+0000","last_active":"2023-11-27T18:43:44.804824+0000","last_peered":"2023-11-27T18:43:44.804824+0000","last_clean":"2023-11-27T18:43:44.804824+0000","last_became_active":"2023-11-27T18:13:12.304400+0000","last_became_peered":"2023-11-27T18:13:12.304400+0000","last_unstale":"2023-11-27T18:43:44.804824+0000","last_undegraded":"2023-11-27T18:43:44.804824+0000","last_fullsized":"2023-11-27T18:43:44.804824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2023-11-27T18:43:44.804676+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2023-11-27T18:43:44.804676+0000","last_clean_scrub_stamp":"2023-11-27T18:43:44.804676+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:34:25.156520+0000","scrub_duration":0.005907214,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"32'60","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:38.700459+0000","last_change":"2023-11-27T18:44:38.700513+0000","last_active":"2023-11-27T18:44:38.700459+0000","last_peered":"2023-11-27T18:44:38.700459+0000","last_clean":"2023-11-27T18:44:38.700459+0000","last_became_active":"2023-11-27T18:13:20.918984+0000","last_became_peered":"2023-11-27T18:13:20.918984+0000","last_unstale":"2023-11-27T18:44:38.700459+0000","last_undegraded":"2023-11-27T18:44:38.700459+0000","last_fullsized":"2023-11-27T18:44:38.700459+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'60","last_scrub_stamp":"2023-11-27T18:44:38.700253+0000","last_deep_scrub":"32'60","last_deep_scrub_stamp":"2023-11-27T18:44:38.700253+0000","last_clean_scrub_stamp":"2023-11-27T18:44:38.700253+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:35:59.976977+0000","scrub_duration":0.010648087000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":5801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"32'17","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:00.411686+0000","last_change":"2023-11-27T18:44:00.411686+0000","last_active":"2023-11-27T18:44:00.411686+0000","last_peered":"2023-11-27T18:44:00.411686+0000","last_clean":"2023-11-27T18:44:00.411686+0000","last_became_active":"2023-11-27T18:13:15.852339+0000","last_became_peered":"2023-11-27T18:13:15.852339+0000","last_unstale":"2023-11-27T18:44:00.411686+0000","last_undegraded":"2023-11-27T18:44:00.411686+0000","last_fullsized":"2023-11-27T18:44:00.411686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'17","last_scrub_stamp":"2023-11-27T18:44:00.411434+0000","last_deep_scrub":"32'17","last_deep_scrub_stamp":"2023-11-27T18:44:00.411434+0000","last_clean_scrub_stamp":"2023-11-27T18:44:00.411434+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:55:07.805364+0000","scrub_duration":0.0033991469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"32'8","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:53.555022+0000","last_change":"2023-11-27T18:43:53.555022+0000","last_active":"2023-11-27T18:43:53.555022+0000","last_peered":"2023-11-27T18:43:53.555022+0000","last_clean":"2023-11-27T18:43:53.555022+0000","last_became_active":"2023-11-27T18:13:12.310921+0000","last_became_peered":"2023-11-27T18:13:12.310921+0000","last_unstale":"2023-11-27T18:43:53.555022+0000","last_undegraded":"2023-11-27T18:43:53.555022+0000","last_fullsized":"2023-11-27T18:43:53.555022+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2023-11-27T18:43:53.554762+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2023-11-27T18:43:53.554762+0000","last_clean_scrub_stamp":"2023-11-27T18:43:53.554762+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:55:00.948692+0000","scrub_duration":0.0077624699999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"32'108","reported_seq":148,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:48.434011+0000","last_change":"2023-11-27T18:43:48.434127+0000","last_active":"2023-11-27T18:43:48.434011+0000","last_peered":"2023-11-27T18:43:48.434011+0000","last_clean":"2023-11-27T18:43:48.434011+0000","last_became_active":"2023-11-27T18:13:20.924209+0000","last_became_peered":"2023-11-27T18:13:20.924209+0000","last_unstale":"2023-11-27T18:43:48.434011+0000","last_undegraded":"2023-11-27T18:43:48.434011+0000","last_fullsized":"2023-11-27T18:43:48.434011+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'108","last_scrub_stamp":"2023-11-27T18:43:48.433759+0000","last_deep_scrub":"32'108","last_deep_scrub_stamp":"2023-11-27T18:43:48.433759+0000","last_clean_scrub_stamp":"2023-11-27T18:43:48.433759+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:01:47.609449+0000","scrub_duration":0.0086909529999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":10743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"32'21","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:44.098293+0000","last_change":"2023-11-27T18:43:44.098343+0000","last_active":"2023-11-27T18:43:44.098293+0000","last_peered":"2023-11-27T18:43:44.098293+0000","last_clean":"2023-11-27T18:43:44.098293+0000","last_became_active":"2023-11-27T18:13:14.421377+0000","last_became_peered":"2023-11-27T18:13:14.421377+0000","last_unstale":"2023-11-27T18:43:44.098293+0000","last_undegraded":"2023-11-27T18:43:44.098293+0000","last_fullsized":"2023-11-27T18:43:44.098293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2023-11-27T18:43:44.098079+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2023-11-27T18:43:44.098079+0000","last_clean_scrub_stamp":"2023-11-27T18:43:44.098079+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:35:06.114321+0000","scrub_duration":0.0038697369999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"32'16","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:39.823098+0000","last_change":"2023-11-27T18:43:39.823170+0000","last_active":"2023-11-27T18:43:39.823098+0000","last_peered":"2023-11-27T18:43:39.823098+0000","last_clean":"2023-11-27T18:43:39.823098+0000","last_became_active":"2023-11-27T18:13:12.177997+0000","last_became_peered":"2023-11-27T18:13:12.177997+0000","last_unstale":"2023-11-27T18:43:39.823098+0000","last_undegraded":"2023-11-27T18:43:39.823098+0000","last_fullsized":"2023-11-27T18:43:39.823098+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2023-11-27T18:43:39.822860+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2023-11-27T18:43:39.822860+0000","last_clean_scrub_stamp":"2023-11-27T18:43:39.822860+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:51:20.471317+0000","scrub_duration":0.0097847799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"32'95","reported_seq":134,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:22.901078+0000","last_change":"2023-11-27T18:44:22.901078+0000","last_active":"2023-11-27T18:44:22.901078+0000","last_peered":"2023-11-27T18:44:22.901078+0000","last_clean":"2023-11-27T18:44:22.901078+0000","last_became_active":"2023-11-27T18:13:20.914144+0000","last_became_peered":"2023-11-27T18:13:20.914144+0000","last_unstale":"2023-11-27T18:44:22.901078+0000","last_undegraded":"2023-11-27T18:44:22.901078+0000","last_fullsized":"2023-11-27T18:44:22.901078+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'95","last_scrub_stamp":"2023-11-27T18:44:22.900794+0000","last_deep_scrub":"32'95","last_deep_scrub_stamp":"2023-11-27T18:44:22.900794+0000","last_clean_scrub_stamp":"2023-11-27T18:44:22.900794+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:23:07.955913+0000","scrub_duration":0.008362721,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":5846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"32'23","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:40.431950+0000","last_change":"2023-11-27T18:43:40.431969+0000","last_active":"2023-11-27T18:43:40.431950+0000","last_peered":"2023-11-27T18:43:40.431950+0000","last_clean":"2023-11-27T18:43:40.431950+0000","last_became_active":"2023-11-27T18:13:15.801804+0000","last_became_peered":"2023-11-27T18:13:15.801804+0000","last_unstale":"2023-11-27T18:43:40.431950+0000","last_undegraded":"2023-11-27T18:43:40.431950+0000","last_fullsized":"2023-11-27T18:43:40.431950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2023-11-27T18:43:40.431874+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2023-11-27T18:43:40.431874+0000","last_clean_scrub_stamp":"2023-11-27T18:43:40.431874+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:16:45.688555+0000","scrub_duration":0.002873408,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"32'5","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:57.545050+0000","last_change":"2023-11-27T18:43:57.545160+0000","last_active":"2023-11-27T18:43:57.545050+0000","last_peered":"2023-11-27T18:43:57.545050+0000","last_clean":"2023-11-27T18:43:57.545050+0000","last_became_active":"2023-11-27T18:13:12.300585+0000","last_became_peered":"2023-11-27T18:13:12.300585+0000","last_unstale":"2023-11-27T18:43:57.545050+0000","last_undegraded":"2023-11-27T18:43:57.545050+0000","last_fullsized":"2023-11-27T18:43:57.545050+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2023-11-27T18:43:57.544819+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2023-11-27T18:43:57.544819+0000","last_clean_scrub_stamp":"2023-11-27T18:43:57.544819+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:33:15.951006+0000","scrub_duration":0.0033027500000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"32'85","reported_seq":124,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:26.923608+0000","last_change":"2023-11-27T18:44:26.923608+0000","last_active":"2023-11-27T18:44:26.923608+0000","last_peered":"2023-11-27T18:44:26.923608+0000","last_clean":"2023-11-27T18:44:26.923608+0000","last_became_active":"2023-11-27T18:13:20.914216+0000","last_became_peered":"2023-11-27T18:13:20.914216+0000","last_unstale":"2023-11-27T18:44:26.923608+0000","last_undegraded":"2023-11-27T18:44:26.923608+0000","last_fullsized":"2023-11-27T18:44:26.923608+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'85","last_scrub_stamp":"2023-11-27T18:44:26.923259+0000","last_deep_scrub":"32'85","last_deep_scrub_stamp":"2023-11-27T18:44:26.923259+0000","last_clean_scrub_stamp":"2023-11-27T18:44:26.923259+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:33:53.863173+0000","scrub_duration":0.0090487410000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":6050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"32'39","reported_seq":87,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:52.770044+0000","last_change":"2023-11-27T18:44:52.770150+0000","last_active":"2023-11-27T18:44:52.770044+0000","last_peered":"2023-11-27T18:44:52.770044+0000","last_clean":"2023-11-27T18:44:52.770044+0000","last_became_active":"2023-11-27T18:14:22.517527+0000","last_became_peered":"2023-11-27T18:14:22.517527+0000","last_unstale":"2023-11-27T18:44:52.770044+0000","last_undegraded":"2023-11-27T18:44:52.770044+0000","last_fullsized":"2023-11-27T18:44:52.770044+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'39","last_scrub_stamp":"2023-11-27T18:44:52.769800+0000","last_deep_scrub":"32'39","last_deep_scrub_stamp":"2023-11-27T18:44:52.769800+0000","last_clean_scrub_stamp":"2023-11-27T18:44:52.769800+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:07:31.475217+0000","scrub_duration":0.0048998050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"32'5","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:00.195175+0000","last_change":"2023-11-27T18:44:00.195227+0000","last_active":"2023-11-27T18:44:00.195175+0000","last_peered":"2023-11-27T18:44:00.195175+0000","last_clean":"2023-11-27T18:44:00.195175+0000","last_became_active":"2023-11-27T18:13:12.304777+0000","last_became_peered":"2023-11-27T18:13:12.304777+0000","last_unstale":"2023-11-27T18:44:00.195175+0000","last_undegraded":"2023-11-27T18:44:00.195175+0000","last_fullsized":"2023-11-27T18:44:00.195175+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2023-11-27T18:44:00.194991+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2023-11-27T18:44:00.194991+0000","last_clean_scrub_stamp":"2023-11-27T18:44:00.194991+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:46:55.415546+0000","scrub_duration":0.0035181409999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"32'64","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:26.427944+0000","last_change":"2023-11-27T18:44:26.427998+0000","last_active":"2023-11-27T18:44:26.427944+0000","last_peered":"2023-11-27T18:44:26.427944+0000","last_clean":"2023-11-27T18:44:26.427944+0000","last_became_active":"2023-11-27T18:13:20.902282+0000","last_became_peered":"2023-11-27T18:13:20.902282+0000","last_unstale":"2023-11-27T18:44:26.427944+0000","last_undegraded":"2023-11-27T18:44:26.427944+0000","last_fullsized":"2023-11-27T18:44:26.427944+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'64","last_scrub_stamp":"2023-11-27T18:44:26.427738+0000","last_deep_scrub":"32'64","last_deep_scrub_stamp":"2023-11-27T18:44:26.427738+0000","last_clean_scrub_stamp":"2023-11-27T18:44:26.427738+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:28:07.913582+0000","scrub_duration":0.010060662,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":6349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"32'27","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:13.318208+0000","last_change":"2023-11-27T18:44:13.318253+0000","last_active":"2023-11-27T18:44:13.318208+0000","last_peered":"2023-11-27T18:44:13.318208+0000","last_clean":"2023-11-27T18:44:13.318208+0000","last_became_active":"2023-11-27T18:13:14.415004+0000","last_became_peered":"2023-11-27T18:13:14.415004+0000","last_unstale":"2023-11-27T18:44:13.318208+0000","last_undegraded":"2023-11-27T18:44:13.318208+0000","last_fullsized":"2023-11-27T18:44:13.318208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'27","last_scrub_stamp":"2023-11-27T18:44:13.318061+0000","last_deep_scrub":"32'27","last_deep_scrub_stamp":"2023-11-27T18:44:13.318061+0000","last_clean_scrub_stamp":"2023-11-27T18:44:13.318061+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:33:31.724248+0000","scrub_duration":0.0035498249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"32'7","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:43.077245+0000","last_change":"2023-11-27T18:43:43.077303+0000","last_active":"2023-11-27T18:43:43.077245+0000","last_peered":"2023-11-27T18:43:43.077245+0000","last_clean":"2023-11-27T18:43:43.077245+0000","last_became_active":"2023-11-27T18:13:12.268237+0000","last_became_peered":"2023-11-27T18:13:12.268237+0000","last_unstale":"2023-11-27T18:43:43.077245+0000","last_undegraded":"2023-11-27T18:43:43.077245+0000","last_fullsized":"2023-11-27T18:43:43.077245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2023-11-27T18:43:43.077057+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2023-11-27T18:43:43.077057+0000","last_clean_scrub_stamp":"2023-11-27T18:43:43.077057+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:43:39.542648+0000","scrub_duration":0.0087600239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"32'82","reported_seq":121,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:39.656373+0000","last_change":"2023-11-27T18:44:39.656373+0000","last_active":"2023-11-27T18:44:39.656373+0000","last_peered":"2023-11-27T18:44:39.656373+0000","last_clean":"2023-11-27T18:44:39.656373+0000","last_became_active":"2023-11-27T18:13:20.899358+0000","last_became_peered":"2023-11-27T18:13:20.899358+0000","last_unstale":"2023-11-27T18:44:39.656373+0000","last_undegraded":"2023-11-27T18:44:39.656373+0000","last_fullsized":"2023-11-27T18:44:39.656373+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'82","last_scrub_stamp":"2023-11-27T18:44:39.656226+0000","last_deep_scrub":"32'82","last_deep_scrub_stamp":"2023-11-27T18:44:39.656226+0000","last_clean_scrub_stamp":"2023-11-27T18:44:39.656226+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:21:21.403178+0000","scrub_duration":0.0083303760000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":8446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"32'23","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:08.498067+0000","last_change":"2023-11-27T18:44:08.498067+0000","last_active":"2023-11-27T18:44:08.498067+0000","last_peered":"2023-11-27T18:44:08.498067+0000","last_clean":"2023-11-27T18:44:08.498067+0000","last_became_active":"2023-11-27T18:13:14.371637+0000","last_became_peered":"2023-11-27T18:13:14.371637+0000","last_unstale":"2023-11-27T18:44:08.498067+0000","last_undegraded":"2023-11-27T18:44:08.498067+0000","last_fullsized":"2023-11-27T18:44:08.498067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2023-11-27T18:44:08.497806+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2023-11-27T18:44:08.497806+0000","last_clean_scrub_stamp":"2023-11-27T18:44:08.497806+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:53:14.709913+0000","scrub_duration":0.0041375810000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"32'875","reported_seq":918,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:43.474525+0000","last_change":"2023-11-27T18:43:43.474525+0000","last_active":"2023-11-27T18:43:43.474525+0000","last_peered":"2023-11-27T18:43:43.474525+0000","last_clean":"2023-11-27T18:43:43.474525+0000","last_became_active":"2023-11-27T18:13:12.248077+0000","last_became_peered":"2023-11-27T18:13:12.248077+0000","last_unstale":"2023-11-27T18:43:43.474525+0000","last_undegraded":"2023-11-27T18:43:43.474525+0000","last_fullsized":"2023-11-27T18:43:43.474525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'875","last_scrub_stamp":"2023-11-27T18:43:43.474251+0000","last_deep_scrub":"32'875","last_deep_scrub_stamp":"2023-11-27T18:43:43.474251+0000","last_clean_scrub_stamp":"2023-11-27T18:43:43.474251+0000","objects_scrubbed":4,"log_size":875,"log_dups_size":0,"ondisk_log_size":875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:21:15.277979+0000","scrub_duration":0.045304398000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":867,"num_write_kb":4596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"32'83","reported_seq":122,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:08.889040+0000","last_change":"2023-11-27T18:44:08.889093+0000","last_active":"2023-11-27T18:44:08.889040+0000","last_peered":"2023-11-27T18:44:08.889040+0000","last_clean":"2023-11-27T18:44:08.889040+0000","last_became_active":"2023-11-27T18:13:20.918381+0000","last_became_peered":"2023-11-27T18:13:20.918381+0000","last_unstale":"2023-11-27T18:44:08.889040+0000","last_undegraded":"2023-11-27T18:44:08.889040+0000","last_fullsized":"2023-11-27T18:44:08.889040+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'83","last_scrub_stamp":"2023-11-27T18:44:08.888853+0000","last_deep_scrub":"32'83","last_deep_scrub_stamp":"2023-11-27T18:44:08.888853+0000","last_clean_scrub_stamp":"2023-11-27T18:44:08.888853+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:07:18.255198+0000","scrub_duration":0.0092657209999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":11273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"32'25","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:38.063922+0000","last_change":"2023-11-27T18:43:38.063922+0000","last_active":"2023-11-27T18:43:38.063922+0000","last_peered":"2023-11-27T18:43:38.063922+0000","last_clean":"2023-11-27T18:43:38.063922+0000","last_became_active":"2023-11-27T18:13:14.415026+0000","last_became_peered":"2023-11-27T18:13:14.415026+0000","last_unstale":"2023-11-27T18:43:38.063922+0000","last_undegraded":"2023-11-27T18:43:38.063922+0000","last_fullsized":"2023-11-27T18:43:38.063922+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'25","last_scrub_stamp":"2023-11-27T18:43:38.063802+0000","last_deep_scrub":"32'25","last_deep_scrub_stamp":"2023-11-27T18:43:38.063802+0000","last_clean_scrub_stamp":"2023-11-27T18:43:38.063802+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:55:14.604318+0000","scrub_duration":0.0021425820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"32'401","reported_seq":444,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:46.071950+0000","last_change":"2023-11-27T18:43:46.071950+0000","last_active":"2023-11-27T18:43:46.071950+0000","last_peered":"2023-11-27T18:43:46.071950+0000","last_clean":"2023-11-27T18:43:46.071950+0000","last_became_active":"2023-11-27T18:13:12.180112+0000","last_became_peered":"2023-11-27T18:13:12.180112+0000","last_unstale":"2023-11-27T18:43:46.071950+0000","last_undegraded":"2023-11-27T18:43:46.071950+0000","last_fullsized":"2023-11-27T18:43:46.071950+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'401","last_scrub_stamp":"2023-11-27T18:43:46.071689+0000","last_deep_scrub":"32'401","last_deep_scrub_stamp":"2023-11-27T18:43:46.071689+0000","last_clean_scrub_stamp":"2023-11-27T18:43:46.071689+0000","objects_scrubbed":2,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:53:59.905538+0000","scrub_duration":0.0074079840000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":397,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"32'109","reported_seq":148,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:07.393509+0000","last_change":"2023-11-27T18:44:07.393565+0000","last_active":"2023-11-27T18:44:07.393509+0000","last_peered":"2023-11-27T18:44:07.393509+0000","last_clean":"2023-11-27T18:44:07.393509+0000","last_became_active":"2023-11-27T18:13:20.921675+0000","last_became_peered":"2023-11-27T18:13:20.921675+0000","last_unstale":"2023-11-27T18:44:07.393509+0000","last_undegraded":"2023-11-27T18:44:07.393509+0000","last_fullsized":"2023-11-27T18:44:07.393509+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'109","last_scrub_stamp":"2023-11-27T18:44:07.393308+0000","last_deep_scrub":"32'109","last_deep_scrub_stamp":"2023-11-27T18:44:07.393308+0000","last_clean_scrub_stamp":"2023-11-27T18:44:07.393308+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:11:18.477624+0000","scrub_duration":0.0094143639999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":15987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"32'29","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:00.974174+0000","last_change":"2023-11-27T18:44:00.974174+0000","last_active":"2023-11-27T18:44:00.974174+0000","last_peered":"2023-11-27T18:44:00.974174+0000","last_clean":"2023-11-27T18:44:00.974174+0000","last_became_active":"2023-11-27T18:13:14.415142+0000","last_became_peered":"2023-11-27T18:13:14.415142+0000","last_unstale":"2023-11-27T18:44:00.974174+0000","last_undegraded":"2023-11-27T18:44:00.974174+0000","last_fullsized":"2023-11-27T18:44:00.974174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'29","last_scrub_stamp":"2023-11-27T18:44:00.973707+0000","last_deep_scrub":"32'29","last_deep_scrub_stamp":"2023-11-27T18:44:00.973707+0000","last_clean_scrub_stamp":"2023-11-27T18:44:00.973707+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:05:00.131288+0000","scrub_duration":0.0069063780000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"32'2","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:54.529597+0000","last_change":"2023-11-27T18:43:54.529597+0000","last_active":"2023-11-27T18:43:54.529597+0000","last_peered":"2023-11-27T18:43:54.529597+0000","last_clean":"2023-11-27T18:43:54.529597+0000","last_became_active":"2023-11-27T18:13:12.273400+0000","last_became_peered":"2023-11-27T18:13:12.273400+0000","last_unstale":"2023-11-27T18:43:54.529597+0000","last_undegraded":"2023-11-27T18:43:54.529597+0000","last_fullsized":"2023-11-27T18:43:54.529597+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2023-11-27T18:43:54.529213+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2023-11-27T18:43:54.529213+0000","last_clean_scrub_stamp":"2023-11-27T18:43:54.529213+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:42:29.722428+0000","scrub_duration":0.0039019240000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"32'83","reported_seq":122,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:54.129517+0000","last_change":"2023-11-27T18:43:54.129623+0000","last_active":"2023-11-27T18:43:54.129517+0000","last_peered":"2023-11-27T18:43:54.129517+0000","last_clean":"2023-11-27T18:43:54.129517+0000","last_became_active":"2023-11-27T18:13:20.912063+0000","last_became_peered":"2023-11-27T18:13:20.912063+0000","last_unstale":"2023-11-27T18:43:54.129517+0000","last_undegraded":"2023-11-27T18:43:54.129517+0000","last_fullsized":"2023-11-27T18:43:54.129517+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'83","last_scrub_stamp":"2023-11-27T18:43:54.129288+0000","last_deep_scrub":"32'83","last_deep_scrub_stamp":"2023-11-27T18:43:54.129288+0000","last_clean_scrub_stamp":"2023-11-27T18:43:54.129288+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:31:56.018013+0000","scrub_duration":0.010352907999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":11074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"32'29","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:57.411534+0000","last_change":"2023-11-27T18:43:57.411534+0000","last_active":"2023-11-27T18:43:57.411534+0000","last_peered":"2023-11-27T18:43:57.411534+0000","last_clean":"2023-11-27T18:43:57.411534+0000","last_became_active":"2023-11-27T18:13:15.911255+0000","last_became_peered":"2023-11-27T18:13:15.911255+0000","last_unstale":"2023-11-27T18:43:57.411534+0000","last_undegraded":"2023-11-27T18:43:57.411534+0000","last_fullsized":"2023-11-27T18:43:57.411534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'29","last_scrub_stamp":"2023-11-27T18:43:57.411145+0000","last_deep_scrub":"32'29","last_deep_scrub_stamp":"2023-11-27T18:43:57.411145+0000","last_clean_scrub_stamp":"2023-11-27T18:43:57.411145+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:14:36.787565+0000","scrub_duration":0.0040442129999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:39.424093+0000","last_change":"2023-11-27T18:43:39.424093+0000","last_active":"2023-11-27T18:43:39.424093+0000","last_peered":"2023-11-27T18:43:39.424093+0000","last_clean":"2023-11-27T18:43:39.424093+0000","last_became_active":"2023-11-27T18:13:12.167740+0000","last_became_peered":"2023-11-27T18:13:12.167740+0000","last_unstale":"2023-11-27T18:43:39.424093+0000","last_undegraded":"2023-11-27T18:43:39.424093+0000","last_fullsized":"2023-11-27T18:43:39.424093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2023-11-27T18:43:39.423989+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2023-11-27T18:43:39.423989+0000","last_clean_scrub_stamp":"2023-11-27T18:43:39.423989+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:46:23.132083+0000","scrub_duration":0.0030606299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"32'75","reported_seq":114,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:03.908541+0000","last_change":"2023-11-27T18:44:03.908593+0000","last_active":"2023-11-27T18:44:03.908541+0000","last_peered":"2023-11-27T18:44:03.908541+0000","last_clean":"2023-11-27T18:44:03.908541+0000","last_became_active":"2023-11-27T18:13:20.914607+0000","last_became_peered":"2023-11-27T18:13:20.914607+0000","last_unstale":"2023-11-27T18:44:03.908541+0000","last_undegraded":"2023-11-27T18:44:03.908541+0000","last_fullsized":"2023-11-27T18:44:03.908541+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'75","last_scrub_stamp":"2023-11-27T18:44:03.908354+0000","last_deep_scrub":"32'75","last_deep_scrub_stamp":"2023-11-27T18:44:03.908354+0000","last_clean_scrub_stamp":"2023-11-27T18:44:03.908354+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:26:01.993815+0000","scrub_duration":0.0078989079999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":8428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"32'67","reported_seq":108,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:05.871166+0000","last_change":"2023-11-27T18:44:05.871279+0000","last_active":"2023-11-27T18:44:05.871166+0000","last_peered":"2023-11-27T18:44:05.871166+0000","last_clean":"2023-11-27T18:44:05.871166+0000","last_became_active":"2023-11-27T18:13:20.930060+0000","last_became_peered":"2023-11-27T18:13:20.930060+0000","last_unstale":"2023-11-27T18:44:05.871166+0000","last_undegraded":"2023-11-27T18:44:05.871166+0000","last_fullsized":"2023-11-27T18:44:05.871166+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'67","last_scrub_stamp":"2023-11-27T18:44:05.870841+0000","last_deep_scrub":"32'67","last_deep_scrub_stamp":"2023-11-27T18:44:05.870841+0000","last_clean_scrub_stamp":"2023-11-27T18:44:05.870841+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:35:49.956028+0000","scrub_duration":0.0086515519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":4718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"32'28","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:48.824454+0000","last_change":"2023-11-27T18:43:48.824454+0000","last_active":"2023-11-27T18:43:48.824454+0000","last_peered":"2023-11-27T18:43:48.824454+0000","last_clean":"2023-11-27T18:43:48.824454+0000","last_became_active":"2023-11-27T18:13:14.379936+0000","last_became_peered":"2023-11-27T18:13:14.379936+0000","last_unstale":"2023-11-27T18:43:48.824454+0000","last_undegraded":"2023-11-27T18:43:48.824454+0000","last_fullsized":"2023-11-27T18:43:48.824454+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'28","last_scrub_stamp":"2023-11-27T18:43:48.824202+0000","last_deep_scrub":"32'28","last_deep_scrub_stamp":"2023-11-27T18:43:48.824202+0000","last_clean_scrub_stamp":"2023-11-27T18:43:48.824202+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:33:23.140569+0000","scrub_duration":0.0037596090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:02.194594+0000","last_change":"2023-11-27T18:44:02.194594+0000","last_active":"2023-11-27T18:44:02.194594+0000","last_peered":"2023-11-27T18:44:02.194594+0000","last_clean":"2023-11-27T18:44:02.194594+0000","last_became_active":"2023-11-27T18:13:12.300624+0000","last_became_peered":"2023-11-27T18:13:12.300624+0000","last_unstale":"2023-11-27T18:44:02.194594+0000","last_undegraded":"2023-11-27T18:44:02.194594+0000","last_fullsized":"2023-11-27T18:44:02.194594+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2023-11-27T18:44:02.194405+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2023-11-27T18:44:02.194405+0000","last_clean_scrub_stamp":"2023-11-27T18:44:02.194405+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:36:15.821146+0000","scrub_duration":0.002438207,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"32'93","reported_seq":134,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:44.644738+0000","last_change":"2023-11-27T18:44:44.644797+0000","last_active":"2023-11-27T18:44:44.644738+0000","last_peered":"2023-11-27T18:44:44.644738+0000","last_clean":"2023-11-27T18:44:44.644738+0000","last_became_active":"2023-11-27T18:13:20.918816+0000","last_became_peered":"2023-11-27T18:13:20.918816+0000","last_unstale":"2023-11-27T18:44:44.644738+0000","last_undegraded":"2023-11-27T18:44:44.644738+0000","last_fullsized":"2023-11-27T18:44:44.644738+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'93","last_scrub_stamp":"2023-11-27T18:44:44.644520+0000","last_deep_scrub":"32'93","last_deep_scrub_stamp":"2023-11-27T18:44:44.644520+0000","last_clean_scrub_stamp":"2023-11-27T18:44:44.644520+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:27:22.530907+0000","scrub_duration":0.0081621119999999991,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":12357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'29","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:00.013177+0000","last_change":"2023-11-27T18:44:00.013177+0000","last_active":"2023-11-27T18:44:00.013177+0000","last_peered":"2023-11-27T18:44:00.013177+0000","last_clean":"2023-11-27T18:44:00.013177+0000","last_became_active":"2023-11-27T18:13:14.368880+0000","last_became_peered":"2023-11-27T18:13:14.368880+0000","last_unstale":"2023-11-27T18:44:00.013177+0000","last_undegraded":"2023-11-27T18:44:00.013177+0000","last_fullsized":"2023-11-27T18:44:00.013177+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'29","last_scrub_stamp":"2023-11-27T18:44:00.012994+0000","last_deep_scrub":"32'29","last_deep_scrub_stamp":"2023-11-27T18:44:00.012994+0000","last_clean_scrub_stamp":"2023-11-27T18:44:00.012994+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:11:00.650657+0000","scrub_duration":0.0025903329999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"32'2","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:45.456272+0000","last_change":"2023-11-27T18:43:45.456272+0000","last_active":"2023-11-27T18:43:45.456272+0000","last_peered":"2023-11-27T18:43:45.456272+0000","last_clean":"2023-11-27T18:43:45.456272+0000","last_became_active":"2023-11-27T18:13:12.269755+0000","last_became_peered":"2023-11-27T18:13:12.269755+0000","last_unstale":"2023-11-27T18:43:45.456272+0000","last_undegraded":"2023-11-27T18:43:45.456272+0000","last_fullsized":"2023-11-27T18:43:45.456272+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2023-11-27T18:43:45.455903+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2023-11-27T18:43:45.455903+0000","last_clean_scrub_stamp":"2023-11-27T18:43:45.455903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:48:41.926518+0000","scrub_duration":0.0043083679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"32'664","reported_seq":706,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:06.184206+0000","last_change":"2023-11-27T18:44:06.184265+0000","last_active":"2023-11-27T18:44:06.184206+0000","last_peered":"2023-11-27T18:44:06.184206+0000","last_clean":"2023-11-27T18:44:06.184206+0000","last_became_active":"2023-11-27T18:13:12.307299+0000","last_became_peered":"2023-11-27T18:13:12.307299+0000","last_unstale":"2023-11-27T18:44:06.184206+0000","last_undegraded":"2023-11-27T18:44:06.184206+0000","last_fullsized":"2023-11-27T18:44:06.184206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'664","last_scrub_stamp":"2023-11-27T18:44:06.184010+0000","last_deep_scrub":"32'664","last_deep_scrub_stamp":"2023-11-27T18:44:06.184010+0000","last_clean_scrub_stamp":"2023-11-27T18:44:06.184010+0000","objects_scrubbed":1,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:22:51.239130+0000","scrub_duration":0.037709518999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":658,"num_write_kb":4457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"32'24","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:56.906458+0000","last_change":"2023-11-27T18:43:56.906562+0000","last_active":"2023-11-27T18:43:56.906458+0000","last_peered":"2023-11-27T18:43:56.906458+0000","last_clean":"2023-11-27T18:43:56.906458+0000","last_became_active":"2023-11-27T18:13:14.378635+0000","last_became_peered":"2023-11-27T18:13:14.378635+0000","last_unstale":"2023-11-27T18:43:56.906458+0000","last_undegraded":"2023-11-27T18:43:56.906458+0000","last_fullsized":"2023-11-27T18:43:56.906458+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'24","last_scrub_stamp":"2023-11-27T18:43:56.906221+0000","last_deep_scrub":"32'24","last_deep_scrub_stamp":"2023-11-27T18:43:56.906221+0000","last_clean_scrub_stamp":"2023-11-27T18:43:56.906221+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:37:13.969082+0000","scrub_duration":0.0049891079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"32'56","reported_seq":94,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:14.983391+0000","last_change":"2023-11-27T18:44:14.983450+0000","last_active":"2023-11-27T18:44:14.983391+0000","last_peered":"2023-11-27T18:44:14.983391+0000","last_clean":"2023-11-27T18:44:14.983391+0000","last_became_active":"2023-11-27T18:13:20.902571+0000","last_became_peered":"2023-11-27T18:13:20.902571+0000","last_unstale":"2023-11-27T18:44:14.983391+0000","last_undegraded":"2023-11-27T18:44:14.983391+0000","last_fullsized":"2023-11-27T18:44:14.983391+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'56","last_scrub_stamp":"2023-11-27T18:44:14.983184+0000","last_deep_scrub":"32'56","last_deep_scrub_stamp":"2023-11-27T18:44:14.983184+0000","last_clean_scrub_stamp":"2023-11-27T18:44:14.983184+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:04:26.840047+0000","scrub_duration":0.0072933249999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":3581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"32'593","reported_seq":634,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:53.084392+0000","last_change":"2023-11-27T18:43:53.084442+0000","last_active":"2023-11-27T18:43:53.084392+0000","last_peered":"2023-11-27T18:43:53.084392+0000","last_clean":"2023-11-27T18:43:53.084392+0000","last_became_active":"2023-11-27T18:13:12.303988+0000","last_became_peered":"2023-11-27T18:13:12.303988+0000","last_unstale":"2023-11-27T18:43:53.084392+0000","last_undegraded":"2023-11-27T18:43:53.084392+0000","last_fullsized":"2023-11-27T18:43:53.084392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'593","last_scrub_stamp":"2023-11-27T18:43:53.084250+0000","last_deep_scrub":"32'593","last_deep_scrub_stamp":"2023-11-27T18:43:53.084250+0000","last_clean_scrub_stamp":"2023-11-27T18:43:53.084250+0000","objects_scrubbed":1,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:42:28.277464+0000","scrub_duration":0.035525191999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":588,"num_write_kb":4406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"32'22","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:45.471070+0000","last_change":"2023-11-27T18:43:45.471121+0000","last_active":"2023-11-27T18:43:45.471070+0000","last_peered":"2023-11-27T18:43:45.471070+0000","last_clean":"2023-11-27T18:43:45.471070+0000","last_became_active":"2023-11-27T18:13:15.802420+0000","last_became_peered":"2023-11-27T18:13:15.802420+0000","last_unstale":"2023-11-27T18:43:45.471070+0000","last_undegraded":"2023-11-27T18:43:45.471070+0000","last_fullsized":"2023-11-27T18:43:45.471070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2023-11-27T18:43:45.470886+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2023-11-27T18:43:45.470886+0000","last_clean_scrub_stamp":"2023-11-27T18:43:45.470886+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:31:10.801503+0000","scrub_duration":0.0041067050000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"32'93","reported_seq":126,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:22.515614+0000","last_change":"2023-11-27T18:44:22.515614+0000","last_active":"2023-11-27T18:44:22.515614+0000","last_peered":"2023-11-27T18:44:22.515614+0000","last_clean":"2023-11-27T18:44:22.515614+0000","last_became_active":"2023-11-27T18:14:22.715684+0000","last_became_peered":"2023-11-27T18:14:22.715684+0000","last_unstale":"2023-11-27T18:44:22.515614+0000","last_undegraded":"2023-11-27T18:44:22.515614+0000","last_fullsized":"2023-11-27T18:44:22.515614+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'93","last_scrub_stamp":"2023-11-27T18:44:22.515282+0000","last_deep_scrub":"32'93","last_deep_scrub_stamp":"2023-11-27T18:44:22.515282+0000","last_clean_scrub_stamp":"2023-11-27T18:44:22.515282+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:53:28.727389+0000","scrub_duration":0.0093497249999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":6465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,0],"acting":[2,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"32'34","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:46.457142+0000","last_change":"2023-11-27T18:43:46.457142+0000","last_active":"2023-11-27T18:43:46.457142+0000","last_peered":"2023-11-27T18:43:46.457142+0000","last_clean":"2023-11-27T18:43:46.457142+0000","last_became_active":"2023-11-27T18:13:15.848503+0000","last_became_peered":"2023-11-27T18:13:15.848503+0000","last_unstale":"2023-11-27T18:43:46.457142+0000","last_undegraded":"2023-11-27T18:43:46.457142+0000","last_fullsized":"2023-11-27T18:43:46.457142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'34","last_scrub_stamp":"2023-11-27T18:43:46.456824+0000","last_deep_scrub":"32'34","last_deep_scrub_stamp":"2023-11-27T18:43:46.456824+0000","last_clean_scrub_stamp":"2023-11-27T18:43:46.456824+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:08:43.138748+0000","scrub_duration":0.0043843550000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"32'28","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:49.064091+0000","last_change":"2023-11-27T18:43:49.064091+0000","last_active":"2023-11-27T18:43:49.064091+0000","last_peered":"2023-11-27T18:43:49.064091+0000","last_clean":"2023-11-27T18:43:49.064091+0000","last_became_active":"2023-11-27T18:13:14.336072+0000","last_became_peered":"2023-11-27T18:13:14.336072+0000","last_unstale":"2023-11-27T18:43:49.064091+0000","last_undegraded":"2023-11-27T18:43:49.064091+0000","last_fullsized":"2023-11-27T18:43:49.064091+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'28","last_scrub_stamp":"2023-11-27T18:43:49.063835+0000","last_deep_scrub":"32'28","last_deep_scrub_stamp":"2023-11-27T18:43:49.063835+0000","last_clean_scrub_stamp":"2023-11-27T18:43:49.063835+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:47:03.229458+0000","scrub_duration":0.0039140190000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"32'27","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:33.671193+0000","last_change":"2023-11-27T18:44:33.671295+0000","last_active":"2023-11-27T18:44:33.671193+0000","last_peered":"2023-11-27T18:44:33.671193+0000","last_clean":"2023-11-27T18:44:33.671193+0000","last_became_active":"2023-11-27T18:13:14.418679+0000","last_became_peered":"2023-11-27T18:13:14.418679+0000","last_unstale":"2023-11-27T18:44:33.671193+0000","last_undegraded":"2023-11-27T18:44:33.671193+0000","last_fullsized":"2023-11-27T18:44:33.671193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'27","last_scrub_stamp":"2023-11-27T18:44:33.670971+0000","last_deep_scrub":"32'27","last_deep_scrub_stamp":"2023-11-27T18:44:33.670971+0000","last_clean_scrub_stamp":"2023-11-27T18:44:33.670971+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:47:21.515528+0000","scrub_duration":0.0043623430000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"32'22","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:17.905891+0000","last_change":"2023-11-27T18:44:17.905891+0000","last_active":"2023-11-27T18:44:17.905891+0000","last_peered":"2023-11-27T18:44:17.905891+0000","last_clean":"2023-11-27T18:44:17.905891+0000","last_became_active":"2023-11-27T18:13:14.376292+0000","last_became_peered":"2023-11-27T18:13:14.376292+0000","last_unstale":"2023-11-27T18:44:17.905891+0000","last_undegraded":"2023-11-27T18:44:17.905891+0000","last_fullsized":"2023-11-27T18:44:17.905891+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2023-11-27T18:44:17.905641+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2023-11-27T18:44:17.905641+0000","last_clean_scrub_stamp":"2023-11-27T18:44:17.905641+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:37:27.730059+0000","scrub_duration":0.0045156429999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"32'16","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:00.501536+0000","last_change":"2023-11-27T18:44:00.501586+0000","last_active":"2023-11-27T18:44:00.501536+0000","last_peered":"2023-11-27T18:44:00.501536+0000","last_clean":"2023-11-27T18:44:00.501536+0000","last_became_active":"2023-11-27T18:13:14.366983+0000","last_became_peered":"2023-11-27T18:13:14.366983+0000","last_unstale":"2023-11-27T18:44:00.501536+0000","last_undegraded":"2023-11-27T18:44:00.501536+0000","last_fullsized":"2023-11-27T18:44:00.501536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2023-11-27T18:44:00.501340+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2023-11-27T18:44:00.501340+0000","last_clean_scrub_stamp":"2023-11-27T18:44:00.501340+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:49:29.151906+0000","scrub_duration":0.004046137,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"32'22","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:07.334877+0000","last_change":"2023-11-27T18:44:07.334964+0000","last_active":"2023-11-27T18:44:07.334877+0000","last_peered":"2023-11-27T18:44:07.334877+0000","last_clean":"2023-11-27T18:44:07.334877+0000","last_became_active":"2023-11-27T18:13:14.375466+0000","last_became_peered":"2023-11-27T18:13:14.375466+0000","last_unstale":"2023-11-27T18:44:07.334877+0000","last_undegraded":"2023-11-27T18:44:07.334877+0000","last_fullsized":"2023-11-27T18:44:07.334877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2023-11-27T18:44:07.334684+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2023-11-27T18:44:07.334684+0000","last_clean_scrub_stamp":"2023-11-27T18:44:07.334684+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:26:11.770623+0000","scrub_duration":0.003893086,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"32'33","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:54.330470+0000","last_change":"2023-11-27T18:43:54.330520+0000","last_active":"2023-11-27T18:43:54.330470+0000","last_peered":"2023-11-27T18:43:54.330470+0000","last_clean":"2023-11-27T18:43:54.330470+0000","last_became_active":"2023-11-27T18:13:15.910418+0000","last_became_peered":"2023-11-27T18:13:15.910418+0000","last_unstale":"2023-11-27T18:43:54.330470+0000","last_undegraded":"2023-11-27T18:43:54.330470+0000","last_fullsized":"2023-11-27T18:43:54.330470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'33","last_scrub_stamp":"2023-11-27T18:43:54.330345+0000","last_deep_scrub":"32'33","last_deep_scrub_stamp":"2023-11-27T18:43:54.330345+0000","last_clean_scrub_stamp":"2023-11-27T18:43:54.330345+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:38:33.435667+0000","scrub_duration":0.003384789,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"32'19","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:40.213006+0000","last_change":"2023-11-27T18:43:40.213056+0000","last_active":"2023-11-27T18:43:40.213006+0000","last_peered":"2023-11-27T18:43:40.213006+0000","last_clean":"2023-11-27T18:43:40.213006+0000","last_became_active":"2023-11-27T18:13:14.366249+0000","last_became_peered":"2023-11-27T18:13:14.366249+0000","last_unstale":"2023-11-27T18:43:40.213006+0000","last_undegraded":"2023-11-27T18:43:40.213006+0000","last_fullsized":"2023-11-27T18:43:40.213006+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'19","last_scrub_stamp":"2023-11-27T18:43:40.212814+0000","last_deep_scrub":"32'19","last_deep_scrub_stamp":"2023-11-27T18:43:40.212814+0000","last_clean_scrub_stamp":"2023-11-27T18:43:40.212814+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:43:45.456072+0000","scrub_duration":0.0037923340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"32'19","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:57.205712+0000","last_change":"2023-11-27T18:43:57.205768+0000","last_active":"2023-11-27T18:43:57.205712+0000","last_peered":"2023-11-27T18:43:57.205712+0000","last_clean":"2023-11-27T18:43:57.205712+0000","last_became_active":"2023-11-27T18:13:14.414873+0000","last_became_peered":"2023-11-27T18:13:14.414873+0000","last_unstale":"2023-11-27T18:43:57.205712+0000","last_undegraded":"2023-11-27T18:43:57.205712+0000","last_fullsized":"2023-11-27T18:43:57.205712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'19","last_scrub_stamp":"2023-11-27T18:43:57.205511+0000","last_deep_scrub":"32'19","last_deep_scrub_stamp":"2023-11-27T18:43:57.205511+0000","last_clean_scrub_stamp":"2023-11-27T18:43:57.205511+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:15:56.065694+0000","scrub_duration":0.0041963039999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'30","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:42.178327+0000","last_change":"2023-11-27T18:43:42.178327+0000","last_active":"2023-11-27T18:43:42.178327+0000","last_peered":"2023-11-27T18:43:42.178327+0000","last_clean":"2023-11-27T18:43:42.178327+0000","last_became_active":"2023-11-27T18:13:14.416072+0000","last_became_peered":"2023-11-27T18:13:14.416072+0000","last_unstale":"2023-11-27T18:43:42.178327+0000","last_undegraded":"2023-11-27T18:43:42.178327+0000","last_fullsized":"2023-11-27T18:43:42.178327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'30","last_scrub_stamp":"2023-11-27T18:43:42.178083+0000","last_deep_scrub":"32'30","last_deep_scrub_stamp":"2023-11-27T18:43:42.178083+0000","last_clean_scrub_stamp":"2023-11-27T18:43:42.178083+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:38:21.283406+0000","scrub_duration":0.0037760110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"32'25","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:43.469763+0000","last_change":"2023-11-27T18:43:43.469763+0000","last_active":"2023-11-27T18:43:43.469763+0000","last_peered":"2023-11-27T18:43:43.469763+0000","last_clean":"2023-11-27T18:43:43.469763+0000","last_became_active":"2023-11-27T18:13:15.800699+0000","last_became_peered":"2023-11-27T18:13:15.800699+0000","last_unstale":"2023-11-27T18:43:43.469763+0000","last_undegraded":"2023-11-27T18:43:43.469763+0000","last_fullsized":"2023-11-27T18:43:43.469763+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'25","last_scrub_stamp":"2023-11-27T18:43:43.469354+0000","last_deep_scrub":"32'25","last_deep_scrub_stamp":"2023-11-27T18:43:43.469354+0000","last_clean_scrub_stamp":"2023-11-27T18:43:43.469354+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:06:57.450424+0000","scrub_duration":0.0036779529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"32'35","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:54.929176+0000","last_change":"2023-11-27T18:43:54.929176+0000","last_active":"2023-11-27T18:43:54.929176+0000","last_peered":"2023-11-27T18:43:54.929176+0000","last_clean":"2023-11-27T18:43:54.929176+0000","last_became_active":"2023-11-27T18:13:14.413567+0000","last_became_peered":"2023-11-27T18:13:14.413567+0000","last_unstale":"2023-11-27T18:43:54.929176+0000","last_undegraded":"2023-11-27T18:43:54.929176+0000","last_fullsized":"2023-11-27T18:43:54.929176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'35","last_scrub_stamp":"2023-11-27T18:43:54.928847+0000","last_deep_scrub":"32'35","last_deep_scrub_stamp":"2023-11-27T18:43:54.928847+0000","last_clean_scrub_stamp":"2023-11-27T18:43:54.928847+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:04:35.264476+0000","scrub_duration":0.0070704210000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"32'26","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:39.551329+0000","last_change":"2023-11-27T18:43:39.551329+0000","last_active":"2023-11-27T18:43:39.551329+0000","last_peered":"2023-11-27T18:43:39.551329+0000","last_clean":"2023-11-27T18:43:39.551329+0000","last_became_active":"2023-11-27T18:13:14.362805+0000","last_became_peered":"2023-11-27T18:13:14.362805+0000","last_unstale":"2023-11-27T18:43:39.551329+0000","last_undegraded":"2023-11-27T18:43:39.551329+0000","last_fullsized":"2023-11-27T18:43:39.551329+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'26","last_scrub_stamp":"2023-11-27T18:43:39.551003+0000","last_deep_scrub":"32'26","last_deep_scrub_stamp":"2023-11-27T18:43:39.551003+0000","last_clean_scrub_stamp":"2023-11-27T18:43:39.551003+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:35:59.020605+0000","scrub_duration":0.0038830560000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"32'25","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:49.220754+0000","last_change":"2023-11-27T18:43:49.220754+0000","last_active":"2023-11-27T18:43:49.220754+0000","last_peered":"2023-11-27T18:43:49.220754+0000","last_clean":"2023-11-27T18:43:49.220754+0000","last_became_active":"2023-11-27T18:13:14.415661+0000","last_became_peered":"2023-11-27T18:13:14.415661+0000","last_unstale":"2023-11-27T18:43:49.220754+0000","last_undegraded":"2023-11-27T18:43:49.220754+0000","last_fullsized":"2023-11-27T18:43:49.220754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'25","last_scrub_stamp":"2023-11-27T18:43:49.220417+0000","last_deep_scrub":"32'25","last_deep_scrub_stamp":"2023-11-27T18:43:49.220417+0000","last_clean_scrub_stamp":"2023-11-27T18:43:49.220417+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:52:55.432524+0000","scrub_duration":0.0032154839999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"32'35","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:53.134216+0000","last_change":"2023-11-27T18:43:53.134235+0000","last_active":"2023-11-27T18:43:53.134216+0000","last_peered":"2023-11-27T18:43:53.134216+0000","last_clean":"2023-11-27T18:43:53.134216+0000","last_became_active":"2023-11-27T18:13:14.413542+0000","last_became_peered":"2023-11-27T18:13:14.413542+0000","last_unstale":"2023-11-27T18:43:53.134216+0000","last_undegraded":"2023-11-27T18:43:53.134216+0000","last_fullsized":"2023-11-27T18:43:53.134216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'35","last_scrub_stamp":"2023-11-27T18:43:53.134137+0000","last_deep_scrub":"32'35","last_deep_scrub_stamp":"2023-11-27T18:43:53.134137+0000","last_clean_scrub_stamp":"2023-11-27T18:43:53.134137+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:11:41.311566+0000","scrub_duration":0.0029978460000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"32'23","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:41.120056+0000","last_change":"2023-11-27T18:43:41.120113+0000","last_active":"2023-11-27T18:43:41.120056+0000","last_peered":"2023-11-27T18:43:41.120056+0000","last_clean":"2023-11-27T18:43:41.120056+0000","last_became_active":"2023-11-27T18:13:14.416556+0000","last_became_peered":"2023-11-27T18:13:14.416556+0000","last_unstale":"2023-11-27T18:43:41.120056+0000","last_undegraded":"2023-11-27T18:43:41.120056+0000","last_fullsized":"2023-11-27T18:43:41.120056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2023-11-27T18:43:41.119872+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2023-11-27T18:43:41.119872+0000","last_clean_scrub_stamp":"2023-11-27T18:43:41.119872+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:10:52.204187+0000","scrub_duration":0.0061959529999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"32'28","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:48.216828+0000","last_change":"2023-11-27T18:43:48.216899+0000","last_active":"2023-11-27T18:43:48.216828+0000","last_peered":"2023-11-27T18:43:48.216828+0000","last_clean":"2023-11-27T18:43:48.216828+0000","last_became_active":"2023-11-27T18:13:14.418823+0000","last_became_peered":"2023-11-27T18:13:14.418823+0000","last_unstale":"2023-11-27T18:43:48.216828+0000","last_undegraded":"2023-11-27T18:43:48.216828+0000","last_fullsized":"2023-11-27T18:43:48.216828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'28","last_scrub_stamp":"2023-11-27T18:43:48.216586+0000","last_deep_scrub":"32'28","last_deep_scrub_stamp":"2023-11-27T18:43:48.216586+0000","last_clean_scrub_stamp":"2023-11-27T18:43:48.216586+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:41:08.176550+0000","scrub_duration":0.0040263709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"32'26","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:06.889016+0000","last_change":"2023-11-27T18:44:06.889118+0000","last_active":"2023-11-27T18:44:06.889016+0000","last_peered":"2023-11-27T18:44:06.889016+0000","last_clean":"2023-11-27T18:44:06.889016+0000","last_became_active":"2023-11-27T18:13:14.368100+0000","last_became_peered":"2023-11-27T18:13:14.368100+0000","last_unstale":"2023-11-27T18:44:06.889016+0000","last_undegraded":"2023-11-27T18:44:06.889016+0000","last_fullsized":"2023-11-27T18:44:06.889016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'26","last_scrub_stamp":"2023-11-27T18:44:06.888797+0000","last_deep_scrub":"32'26","last_deep_scrub_stamp":"2023-11-27T18:44:06.888797+0000","last_clean_scrub_stamp":"2023-11-27T18:44:06.888797+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:41:26.848761+0000","scrub_duration":0.0044410040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"32'26","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:08.359034+0000","last_change":"2023-11-27T18:44:08.359106+0000","last_active":"2023-11-27T18:44:08.359034+0000","last_peered":"2023-11-27T18:44:08.359034+0000","last_clean":"2023-11-27T18:44:08.359034+0000","last_became_active":"2023-11-27T18:13:14.376559+0000","last_became_peered":"2023-11-27T18:13:14.376559+0000","last_unstale":"2023-11-27T18:44:08.359034+0000","last_undegraded":"2023-11-27T18:44:08.359034+0000","last_fullsized":"2023-11-27T18:44:08.359034+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'26","last_scrub_stamp":"2023-11-27T18:44:08.358811+0000","last_deep_scrub":"32'26","last_deep_scrub_stamp":"2023-11-27T18:44:08.358811+0000","last_clean_scrub_stamp":"2023-11-27T18:44:08.358811+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:55:15.752741+0000","scrub_duration":0.0033520529999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"32'32","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:14.351358+0000","last_change":"2023-11-27T18:44:14.351358+0000","last_active":"2023-11-27T18:44:14.351358+0000","last_peered":"2023-11-27T18:44:14.351358+0000","last_clean":"2023-11-27T18:44:14.351358+0000","last_became_active":"2023-11-27T18:13:14.367298+0000","last_became_peered":"2023-11-27T18:13:14.367298+0000","last_unstale":"2023-11-27T18:44:14.351358+0000","last_undegraded":"2023-11-27T18:44:14.351358+0000","last_fullsized":"2023-11-27T18:44:14.351358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'32","last_scrub_stamp":"2023-11-27T18:44:14.351059+0000","last_deep_scrub":"32'32","last_deep_scrub_stamp":"2023-11-27T18:44:14.351059+0000","last_clean_scrub_stamp":"2023-11-27T18:44:14.351059+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:52:32.289440+0000","scrub_duration":0.0044719979999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"32'17","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:10.472560+0000","last_change":"2023-11-27T18:44:10.472560+0000","last_active":"2023-11-27T18:44:10.472560+0000","last_peered":"2023-11-27T18:44:10.472560+0000","last_clean":"2023-11-27T18:44:10.472560+0000","last_became_active":"2023-11-27T18:13:14.363776+0000","last_became_peered":"2023-11-27T18:13:14.363776+0000","last_unstale":"2023-11-27T18:44:10.472560+0000","last_undegraded":"2023-11-27T18:44:10.472560+0000","last_fullsized":"2023-11-27T18:44:10.472560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'17","last_scrub_stamp":"2023-11-27T18:44:10.472316+0000","last_deep_scrub":"32'17","last_deep_scrub_stamp":"2023-11-27T18:44:10.472316+0000","last_clean_scrub_stamp":"2023-11-27T18:44:10.472316+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:39:02.921131+0000","scrub_duration":0.0035518479999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"32'24","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:02.481993+0000","last_change":"2023-11-27T18:44:02.481993+0000","last_active":"2023-11-27T18:44:02.481993+0000","last_peered":"2023-11-27T18:44:02.481993+0000","last_clean":"2023-11-27T18:44:02.481993+0000","last_became_active":"2023-11-27T18:13:14.423099+0000","last_became_peered":"2023-11-27T18:13:14.423099+0000","last_unstale":"2023-11-27T18:44:02.481993+0000","last_undegraded":"2023-11-27T18:44:02.481993+0000","last_fullsized":"2023-11-27T18:44:02.481993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'24","last_scrub_stamp":"2023-11-27T18:44:02.481722+0000","last_deep_scrub":"32'24","last_deep_scrub_stamp":"2023-11-27T18:44:02.481722+0000","last_clean_scrub_stamp":"2023-11-27T18:44:02.481722+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:05:01.639303+0000","scrub_duration":0.0029840750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"32'32","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:13.535973+0000","last_change":"2023-11-27T18:44:13.535973+0000","last_active":"2023-11-27T18:44:13.535973+0000","last_peered":"2023-11-27T18:44:13.535973+0000","last_clean":"2023-11-27T18:44:13.535973+0000","last_became_active":"2023-11-27T18:13:14.419780+0000","last_became_peered":"2023-11-27T18:13:14.419780+0000","last_unstale":"2023-11-27T18:44:13.535973+0000","last_undegraded":"2023-11-27T18:44:13.535973+0000","last_fullsized":"2023-11-27T18:44:13.535973+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'32","last_scrub_stamp":"2023-11-27T18:44:13.535729+0000","last_deep_scrub":"32'32","last_deep_scrub_stamp":"2023-11-27T18:44:13.535729+0000","last_clean_scrub_stamp":"2023-11-27T18:44:13.535729+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:33:45.089867+0000","scrub_duration":0.003331957,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"32'29","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:47.417728+0000","last_change":"2023-11-27T18:43:47.417728+0000","last_active":"2023-11-27T18:43:47.417728+0000","last_peered":"2023-11-27T18:43:47.417728+0000","last_clean":"2023-11-27T18:43:47.417728+0000","last_became_active":"2023-11-27T18:13:15.909918+0000","last_became_peered":"2023-11-27T18:13:15.909918+0000","last_unstale":"2023-11-27T18:43:47.417728+0000","last_undegraded":"2023-11-27T18:43:47.417728+0000","last_fullsized":"2023-11-27T18:43:47.417728+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'29","last_scrub_stamp":"2023-11-27T18:43:47.417382+0000","last_deep_scrub":"32'29","last_deep_scrub_stamp":"2023-11-27T18:43:47.417382+0000","last_clean_scrub_stamp":"2023-11-27T18:43:47.417382+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:19:46.839575+0000","scrub_duration":0.0058622300000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"32'19","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:16.893374+0000","last_change":"2023-11-27T18:44:16.893423+0000","last_active":"2023-11-27T18:44:16.893374+0000","last_peered":"2023-11-27T18:44:16.893374+0000","last_clean":"2023-11-27T18:44:16.893374+0000","last_became_active":"2023-11-27T18:13:14.369285+0000","last_became_peered":"2023-11-27T18:13:14.369285+0000","last_unstale":"2023-11-27T18:44:16.893374+0000","last_undegraded":"2023-11-27T18:44:16.893374+0000","last_fullsized":"2023-11-27T18:44:16.893374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'19","last_scrub_stamp":"2023-11-27T18:44:16.893184+0000","last_deep_scrub":"32'19","last_deep_scrub_stamp":"2023-11-27T18:44:16.893184+0000","last_clean_scrub_stamp":"2023-11-27T18:44:16.893184+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:38:51.524388+0000","scrub_duration":0.0035687570000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"32'20","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:00.467317+0000","last_change":"2023-11-27T18:44:00.467368+0000","last_active":"2023-11-27T18:44:00.467317+0000","last_peered":"2023-11-27T18:44:00.467317+0000","last_clean":"2023-11-27T18:44:00.467317+0000","last_became_active":"2023-11-27T18:13:14.385566+0000","last_became_peered":"2023-11-27T18:13:14.385566+0000","last_unstale":"2023-11-27T18:44:00.467317+0000","last_undegraded":"2023-11-27T18:44:00.467317+0000","last_fullsized":"2023-11-27T18:44:00.467317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2023-11-27T18:44:00.467139+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2023-11-27T18:44:00.467139+0000","last_clean_scrub_stamp":"2023-11-27T18:44:00.467139+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:06:04.634187+0000","scrub_duration":0.003836959,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"32'26","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:48.437473+0000","last_change":"2023-11-27T18:43:48.437524+0000","last_active":"2023-11-27T18:43:48.437473+0000","last_peered":"2023-11-27T18:43:48.437473+0000","last_clean":"2023-11-27T18:43:48.437473+0000","last_became_active":"2023-11-27T18:13:15.848237+0000","last_became_peered":"2023-11-27T18:13:15.848237+0000","last_unstale":"2023-11-27T18:43:48.437473+0000","last_undegraded":"2023-11-27T18:43:48.437473+0000","last_fullsized":"2023-11-27T18:43:48.437473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'26","last_scrub_stamp":"2023-11-27T18:43:48.437293+0000","last_deep_scrub":"32'26","last_deep_scrub_stamp":"2023-11-27T18:43:48.437293+0000","last_clean_scrub_stamp":"2023-11-27T18:43:48.437293+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:36:07.906895+0000","scrub_duration":0.003956256,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"32'23","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:01.434220+0000","last_change":"2023-11-27T18:44:01.434271+0000","last_active":"2023-11-27T18:44:01.434220+0000","last_peered":"2023-11-27T18:44:01.434220+0000","last_clean":"2023-11-27T18:44:01.434220+0000","last_became_active":"2023-11-27T18:13:14.372974+0000","last_became_peered":"2023-11-27T18:13:14.372974+0000","last_unstale":"2023-11-27T18:44:01.434220+0000","last_undegraded":"2023-11-27T18:44:01.434220+0000","last_fullsized":"2023-11-27T18:44:01.434220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2023-11-27T18:44:01.434016+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2023-11-27T18:44:01.434016+0000","last_clean_scrub_stamp":"2023-11-27T18:44:01.434016+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:11:02.071680+0000","scrub_duration":0.0043765549999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"32'18","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:52.342162+0000","last_change":"2023-11-27T18:43:52.342216+0000","last_active":"2023-11-27T18:43:52.342162+0000","last_peered":"2023-11-27T18:43:52.342162+0000","last_clean":"2023-11-27T18:43:52.342162+0000","last_became_active":"2023-11-27T18:13:15.850353+0000","last_became_peered":"2023-11-27T18:13:15.850353+0000","last_unstale":"2023-11-27T18:43:52.342162+0000","last_undegraded":"2023-11-27T18:43:52.342162+0000","last_fullsized":"2023-11-27T18:43:52.342162+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2023-11-27T18:43:52.341952+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2023-11-27T18:43:52.341952+0000","last_clean_scrub_stamp":"2023-11-27T18:43:52.341952+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:32:31.049285+0000","scrub_duration":0.0042809079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"32'25","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:44:08.853010+0000","last_change":"2023-11-27T18:44:08.853010+0000","last_active":"2023-11-27T18:44:08.853010+0000","last_peered":"2023-11-27T18:44:08.853010+0000","last_clean":"2023-11-27T18:44:08.853010+0000","last_became_active":"2023-11-27T18:13:14.380714+0000","last_became_peered":"2023-11-27T18:13:14.380714+0000","last_unstale":"2023-11-27T18:44:08.853010+0000","last_undegraded":"2023-11-27T18:44:08.853010+0000","last_fullsized":"2023-11-27T18:44:08.853010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'25","last_scrub_stamp":"2023-11-27T18:44:08.852772+0000","last_deep_scrub":"32'25","last_deep_scrub_stamp":"2023-11-27T18:44:08.852772+0000","last_clean_scrub_stamp":"2023-11-27T18:44:08.852772+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:53:15.064879+0000","scrub_duration":0.0037987149999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"32'19","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:47.103117+0000","last_change":"2023-11-27T18:43:47.103117+0000","last_active":"2023-11-27T18:43:47.103117+0000","last_peered":"2023-11-27T18:43:47.103117+0000","last_clean":"2023-11-27T18:43:47.103117+0000","last_became_active":"2023-11-27T18:13:14.367978+0000","last_became_peered":"2023-11-27T18:13:14.367978+0000","last_unstale":"2023-11-27T18:43:47.103117+0000","last_undegraded":"2023-11-27T18:43:47.103117+0000","last_fullsized":"2023-11-27T18:43:47.103117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'19","last_scrub_stamp":"2023-11-27T18:43:47.102851+0000","last_deep_scrub":"32'19","last_deep_scrub_stamp":"2023-11-27T18:43:47.102851+0000","last_clean_scrub_stamp":"2023-11-27T18:43:47.102851+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:06:22.873872+0000","scrub_duration":0.0033780609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"32'23","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T18:43:38.508875+0000","last_change":"2023-11-27T18:43:38.508875+0000","last_active":"2023-11-27T18:43:38.508875+0000","last_peered":"2023-11-27T18:43:38.508875+0000","last_clean":"2023-11-27T18:43:38.508875+0000","last_became_active":"2023-11-27T18:13:14.418928+0000","last_became_peered":"2023-11-27T18:13:14.418928+0000","last_unstale":"2023-11-27T18:43:38.508875+0000","last_undegraded":"2023-11-27T18:43:38.508875+0000","last_fullsized":"2023-11-27T18:43:38.508875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2023-11-27T18:43:38.508560+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2023-11-27T18:43:38.508560+0000","last_clean_scrub_stamp":"2023-11-27T18:43:38.508560+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:08:35.190483+0000","scrub_duration":0.0073382730000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2386,"num_write_kb":255070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2569,"ondisk_log_size":2569,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1576,"ondisk_log_size":1576,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":24107291,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":549,"num_read_kb":581,"num_write":5694,"num_write_kb":26819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32874496,"data_stored":48214582,"data_compressed":4737124,"data_compressed_allocated":7356416,"data_compressed_original":22757376,"omap_allocated":0,"internal_metadata":0},"log_size":5266,"ondisk_log_size":5266,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67010,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719477130,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36008,"kb_used_data":4832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335832,"statfs":{"total":96636764160,"available":96599891968,"internally_reserved":0,"allocated":4947968,"data_stored":8056568,"data_compressed":850146,"data_compressed_allocated":1241088,"data_compressed_original":4562944,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:44:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":0.90900000000000003,"15min":0.86399999999999999},"min":{"1min":0.68200000000000005,"5min":0.55800000000000005,"15min":0.45400000000000001},"max":{"1min":1.448,"5min":1.448,"15min":1.4730000000000001},"last":1.151},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.92300000000000004,"15min":0.92900000000000005},"min":{"1min":0.55100000000000005,"5min":0.49399999999999999,"15min":0.46000000000000002},"max":{"1min":1.2889999999999999,"5min":1.536,"15min":1.536},"last":0.67100000000000004}]},{"osd":1,"last update":"Mon Nov 27 18:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.98099999999999998,"15min":0.96299999999999997},"min":{"1min":0.63200000000000001,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2769999999999999,"5min":1.51,"15min":1.51},"last":1.117},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92500000000000004,"15min":0.92700000000000005},"min":{"1min":0.68600000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2589999999999999,"5min":1.361,"15min":1.482},"last":0.92200000000000004}]},{"osd":2,"last update":"Mon Nov 27 18:44:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":0.996,"15min":0.97499999999999998},"min":{"1min":0.73999999999999999,"5min":0.54100000000000004,"15min":0.53900000000000003},"max":{"1min":1.325,"5min":1.4730000000000001,"15min":1.603},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.92200000000000004,"15min":0.92700000000000005},"min":{"1min":0.70899999999999996,"5min":0.58299999999999996,"15min":0.52700000000000002},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.389},"last":0.98999999999999999}]},{"osd":3,"last update":"Mon Nov 27 18:44:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.98799999999999999,"15min":0.97399999999999998},"min":{"1min":0.66200000000000003,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.2669999999999999,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.024,"5min":1.0349999999999999,"15min":1.0409999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.3859999999999999,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":1.0920000000000001}]},{"osd":4,"last update":"Mon Nov 27 18:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.90800000000000003,"15min":0.90600000000000003},"min":{"1min":0.57199999999999995,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.3500000000000001,"5min":1.518,"15min":1.518},"last":0.59199999999999997},{"interface":"front","average":{"1min":1.002,"5min":1.0169999999999999,"15min":1.0029999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.339,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.85099999999999998}]},{"osd":6,"last update":"Mon Nov 27 18:44:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.016,"15min":1.004},"min":{"1min":0.60599999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.403,"5min":1.417,"15min":1.49},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.177,"5min":1.048,"15min":1.042},"min":{"1min":0.81599999999999995,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.476,"5min":1.476,"15min":1.605},"last":0.77200000000000002}]},{"osd":7,"last update":"Mon Nov 27 18:44:40 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.1459999999999999,"15min":1.125},"min":{"1min":0.751,"5min":0.49299999999999999,"15min":0.47999999999999998},"max":{"1min":1.397,"5min":1.617,"15min":1.831},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.169,"15min":1.177},"min":{"1min":0.64400000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.454,"5min":1.6639999999999999,"15min":1.768},"last":1.194}]}]},{"osd":7,"up_from":16,"seq":68719477131,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33280,"kb_used_data":2104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338560,"statfs":{"total":96636764160,"available":96602685440,"internally_reserved":0,"allocated":2154496,"data_stored":3272747,"data_compressed":386056,"data_compressed_allocated":532480,"data_compressed_original":1863680,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:44:27 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.88,"15min":0.88100000000000001},"min":{"1min":0.54600000000000004,"5min":0.54000000000000004,"15min":0.49399999999999999},"max":{"1min":1.1519999999999999,"5min":1.357,"15min":1.4199999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.96699999999999997,"15min":0.93799999999999994},"min":{"1min":0.66100000000000003,"5min":0.54500000000000004,"15min":0.49299999999999999},"max":{"1min":1.294,"5min":1.411,"15min":1.7110000000000001},"last":0.93999999999999995}]},{"osd":1,"last update":"Mon Nov 27 18:44:27 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.88700000000000001,"15min":0.92000000000000004},"min":{"1min":0.53600000000000003,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.1859999999999999,"5min":1.379,"15min":1.379},"last":0.749},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.012,"15min":0.98599999999999999},"min":{"1min":0.76000000000000001,"5min":0.65600000000000003,"15min":0.54800000000000004},"max":{"1min":1.4299999999999999,"5min":1.4450000000000001,"15min":1.768},"last":1.0580000000000001}]},{"osd":2,"last update":"Mon Nov 27 18:44:27 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.99299999999999999,"15min":0.99399999999999999},"min":{"1min":0.61699999999999999,"5min":0.57399999999999995,"15min":0.52000000000000002},"max":{"1min":1.2749999999999999,"5min":1.4119999999999999,"15min":1.6870000000000001},"last":1.196},{"interface":"front","average":{"1min":1.0189999999999999,"5min":0.95899999999999996,"15min":0.94299999999999995},"min":{"1min":0.748,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.415},"last":0.90000000000000002}]},{"osd":3,"last update":"Mon Nov 27 18:44:27 2023","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":0.98199999999999998,"15min":0.97699999999999998},"min":{"1min":0.72199999999999998,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.2849999999999999,"5min":1.323,"15min":1.4550000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.093,"5min":1.0820000000000001,"15min":1.075},"min":{"1min":0.85599999999999998,"5min":0.57299999999999995,"15min":0.51300000000000001},"max":{"1min":1.3799999999999999,"5min":1.4990000000000001,"15min":1.5820000000000001},"last":1.304}]},{"osd":4,"last update":"Mon Nov 27 18:44:27 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.98799999999999999,"15min":0.92600000000000005},"min":{"1min":0.53900000000000003,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.319,"5min":6.6539999999999999,"15min":6.6539999999999999},"last":1.143},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.95699999999999996,"15min":0.98999999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.2989999999999999,"5min":1.456,"15min":2.0649999999999999},"last":1.091}]},{"osd":5,"last update":"Mon Nov 27 18:44:27 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":1.0629999999999999,"15min":1.0409999999999999},"min":{"1min":0.55800000000000005,"5min":0.35699999999999998,"15min":0.35199999999999998},"max":{"1min":1.4079999999999999,"5min":1.825,"15min":1.825},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.018,"5min":1.0249999999999999,"15min":1.0329999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.39200000000000002},"max":{"1min":1.4279999999999999,"5min":1.591,"15min":1.679},"last":1.256}]},{"osd":6,"last update":"Mon Nov 27 18:44:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.0780000000000001,"15min":1.081},"min":{"1min":0.71399999999999997,"5min":0.45300000000000001,"15min":0.43099999999999999},"max":{"1min":1.2869999999999999,"5min":1.5089999999999999,"15min":1.956},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.135,"5min":1.125,"15min":1.1499999999999999},"min":{"1min":0.68400000000000005,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.411,"5min":1.7170000000000001,"15min":1.8839999999999999},"last":0.98299999999999998}]}]},{"osd":6,"up_from":16,"seq":68719477131,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30016,"kb_used_data":3000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341824,"statfs":{"total":96636764160,"available":96606027776,"internally_reserved":0,"allocated":3072000,"data_stored":4332626,"data_compressed":430585,"data_compressed_allocated":663552,"data_compressed_original":2125824,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:44:30 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.96699999999999997,"15min":0.93300000000000005},"min":{"1min":0.63900000000000001,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.28,"5min":1.375,"15min":1.956},"last":0.69899999999999995},{"interface":"front","average":{"1min":1.016,"5min":1.0589999999999999,"15min":1.036},"min":{"1min":0.79600000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.232,"5min":1.534,"15min":1.5629999999999999},"last":1.206}]},{"osd":1,"last update":"Mon Nov 27 18:44:30 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.90200000000000002,"15min":0.89100000000000001},"min":{"1min":0.57099999999999995,"5min":0.52200000000000002,"15min":0.51200000000000001},"max":{"1min":1.367,"5min":1.4179999999999999,"15min":1.5229999999999999},"last":1.1100000000000001},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.92300000000000004,"15min":0.92500000000000004},"min":{"1min":0.60099999999999998,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.1619999999999999,"5min":1.3819999999999999,"15min":1.5629999999999999},"last":1.0489999999999999}]},{"osd":2,"last update":"Mon Nov 27 18:44:30 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.97799999999999998,"15min":0.95999999999999996},"min":{"1min":0.81599999999999995,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.141,"5min":2.2349999999999999,"15min":2.2349999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.026,"5min":1.071,"15min":1.056},"min":{"1min":0.70799999999999996,"5min":0.65500000000000003,"15min":0.52900000000000003},"max":{"1min":1.232,"5min":3.6549999999999998,"15min":3.6549999999999998},"last":0.84199999999999997}]},{"osd":3,"last update":"Mon Nov 27 18:44:30 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":1.036,"15min":1.0269999999999999},"min":{"1min":0.67500000000000004,"5min":0.64400000000000002,"15min":0.52800000000000002},"max":{"1min":1.2270000000000001,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.754},{"interface":"front","average":{"1min":1.081,"5min":1.0800000000000001,"15min":1.0640000000000001},"min":{"1min":0.748,"5min":0.63500000000000001,"15min":0.57699999999999996},"max":{"1min":1.228,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.012}]},{"osd":4,"last update":"Mon Nov 27 18:44:30 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.97199999999999998,"15min":0.96599999999999997},"min":{"1min":0.66600000000000004,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.2769999999999999,"5min":1.5309999999999999,"15min":1.712},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.96399999999999997,"5min":1.0720000000000001,"15min":1.0529999999999999},"min":{"1min":0.55600000000000005,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.3120000000000001,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.2689999999999999}]},{"osd":5,"last update":"Mon Nov 27 18:44:30 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":1.008,"15min":0.99299999999999999},"min":{"1min":0.70399999999999996,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.294,"5min":1.879,"15min":1.879},"last":1.151},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.123,"15min":1.133},"min":{"1min":0.85999999999999999,"5min":0.59399999999999997,"15min":0.46500000000000002},"max":{"1min":1.331,"5min":3.7509999999999999,"15min":3.7509999999999999},"last":1.1819999999999999}]},{"osd":7,"last update":"Mon Nov 27 18:44:30 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.161,"15min":1.151},"min":{"1min":0.64700000000000002,"5min":0.55300000000000005,"15min":0.40400000000000003},"max":{"1min":1.4630000000000001,"5min":1.962,"15min":1.962},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.1839999999999999,"15min":1.159},"min":{"1min":0.68100000000000005,"5min":0.55800000000000005,"15min":0.499},"max":{"1min":1.514,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":1.242}]}]},{"osd":3,"up_from":16,"seq":68719477129,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58052,"kb_used_data":8828,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94313788,"statfs":{"total":96636764160,"available":96577318912,"internally_reserved":0,"allocated":9039872,"data_stored":12721816,"data_compressed":1205599,"data_compressed_allocated":1880064,"data_compressed_original":5767168,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:44:44 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.69799999999999995,"15min":0.71799999999999997},"min":{"1min":0.47099999999999997,"5min":0.252,"15min":0.252},"max":{"1min":1.046,"5min":1.101,"15min":1.456},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.76100000000000001,"15min":0.78200000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.0980000000000001,"5min":1.387,"15min":1.387},"last":0.86199999999999999}]},{"osd":1,"last update":"Mon Nov 27 18:44:44 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.77400000000000002,"15min":0.77800000000000002},"min":{"1min":0.39300000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.99199999999999999,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.83699999999999997,"15min":0.89000000000000001},"min":{"1min":0.36499999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.022,"5min":1.3280000000000001,"15min":1.4690000000000001},"last":0.71999999999999997}]},{"osd":2,"last update":"Mon Nov 27 18:44:44 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.89000000000000001,"15min":0.91200000000000003},"min":{"1min":0.44800000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.1279999999999999,"5min":1.371,"15min":1.631},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.92100000000000004,"15min":0.94399999999999995},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.39000000000000001},"max":{"1min":1.127,"5min":1.375,"15min":1.375},"last":0.82499999999999996}]},{"osd":4,"last update":"Mon Nov 27 18:44:44 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.98399999999999999,"15min":0.99299999999999999},"min":{"1min":0.73599999999999999,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3580000000000001,"5min":1.573,"15min":1.6439999999999999},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0149999999999999,"15min":1.048},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.179,"5min":1.4950000000000001,"15min":1.605},"last":1.016}]},{"osd":5,"last update":"Mon Nov 27 18:44:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.044,"15min":1.079},"min":{"1min":0.68500000000000005,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.3129999999999999,"5min":1.409,"15min":1.766},"last":1.2729999999999999},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.153,"15min":1.171},"min":{"1min":0.59299999999999997,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4259999999999999,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.1559999999999999}]},{"osd":6,"last update":"Mon Nov 27 18:44:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.115,"15min":1.1040000000000001},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55200000000000005},"max":{"1min":2.1499999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.093,"5min":1.1200000000000001,"15min":1.1679999999999999},"min":{"1min":0.65600000000000003,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.3149999999999999,"5min":1.7050000000000001,"15min":1.7270000000000001},"last":1.3380000000000001}]},{"osd":7,"last update":"Mon Nov 27 18:44:44 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.21,"15min":1.2410000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.5820000000000001,"5min":1.915,"15min":1.915},"last":1.24},{"interface":"front","average":{"1min":1.091,"5min":1.171,"15min":1.169},"min":{"1min":0.755,"5min":0.621,"15min":0.496},"max":{"1min":1.631,"5min":1.6819999999999999,"15min":1.9339999999999999},"last":1.196}]}]},{"osd":2,"up_from":16,"seq":68719477130,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33272,"kb_used_data":6256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94338568,"statfs":{"total":96636764160,"available":96602693632,"internally_reserved":0,"allocated":6406144,"data_stored":8527602,"data_compressed":750925,"data_compressed_allocated":1228800,"data_compressed_original":3559424,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:44:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.71199999999999997,"15min":0.71399999999999997},"min":{"1min":0.46000000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.1080000000000001,"5min":1.2729999999999999,"15min":1.2869999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.77700000000000002,"15min":0.81499999999999995},"min":{"1min":0.46200000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.0349999999999999,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":0.74399999999999999}]},{"osd":1,"last update":"Mon Nov 27 18:44:45 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.80500000000000005,"15min":0.83299999999999996},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.028,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84299999999999997,"15min":0.88300000000000001},"min":{"1min":0.67400000000000004,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.091,"5min":2.6400000000000001,"15min":2.6400000000000001},"last":1.181}]},{"osd":3,"last update":"Mon Nov 27 18:44:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.79400000000000004,"15min":0.81200000000000006},"min":{"1min":0.48699999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.2889999999999999,"5min":1.4750000000000001,"15min":1.6259999999999999},"last":1.004},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.93799999999999994,"15min":0.95699999999999996},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.232,"5min":1.554,"15min":1.554},"last":0.71199999999999997}]},{"osd":4,"last update":"Mon Nov 27 18:44:45 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.02,"15min":1.0309999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.401,"5min":1.49,"15min":1.5620000000000001},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0189999999999999,"15min":1.0389999999999999},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.57799999999999996},"max":{"1min":1.3049999999999999,"5min":1.861,"15min":1.861},"last":0.88200000000000001}]},{"osd":5,"last update":"Mon Nov 27 18:44:45 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.0580000000000001,"15min":1.0780000000000001},"min":{"1min":0.747,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2989999999999999,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":1.087},{"interface":"front","average":{"1min":1.077,"5min":1.0369999999999999,"15min":1.042},"min":{"1min":0.59099999999999997,"5min":0.55700000000000005,"15min":0.53000000000000003},"max":{"1min":1.448,"5min":1.5209999999999999,"15min":1.6859999999999999},"last":1.218}]},{"osd":6,"last update":"Mon Nov 27 18:44:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0940000000000001,"15min":1.103},"min":{"1min":0.53400000000000003,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.3959999999999999,"5min":1.585,"15min":1.6339999999999999},"last":1.2949999999999999},{"interface":"front","average":{"1min":1.149,"5min":1.1599999999999999,"15min":1.1659999999999999},"min":{"1min":0.68100000000000005,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.3680000000000001,"5min":1.786,"15min":1.8420000000000001},"last":0.97599999999999998}]},{"osd":7,"last update":"Mon Nov 27 18:44:45 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.1539999999999999,"15min":1.1819999999999999},"min":{"1min":0.76700000000000002,"5min":0.63400000000000001,"15min":0.625},"max":{"1min":1.5109999999999999,"5min":1.7869999999999999,"15min":1.8799999999999999},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.105,"5min":1.161,"15min":1.165},"min":{"1min":0.64000000000000001,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.3779999999999999,"5min":3.4289999999999998,"15min":3.4289999999999998},"last":1.125}]}]},{"osd":1,"up_from":16,"seq":68719477130,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44056,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327784,"statfs":{"total":96636764160,"available":96591650816,"internally_reserved":0,"allocated":409600,"data_stored":728760,"data_compressed":33505,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.70799999999999996},"min":{"1min":0.51600000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.2969999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.76200000000000001,"15min":0.81499999999999995},"min":{"1min":0.58699999999999997,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.1319999999999999,"5min":1.282,"15min":1.397},"last":0.76600000000000001}]},{"osd":2,"last update":"Mon Nov 27 18:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.73599999999999999,"15min":0.74299999999999999},"min":{"1min":0.57699999999999996,"5min":0.37,"15min":0.36299999999999999},"max":{"1min":1.0469999999999999,"5min":1.1439999999999999,"15min":1.3480000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83499999999999996,"15min":0.874},"min":{"1min":0.63400000000000001,"5min":0.41699999999999998,"15min":0.38500000000000001},"max":{"1min":1.105,"5min":1.4359999999999999,"15min":1.9610000000000001},"last":0.90800000000000003}]},{"osd":3,"last update":"Mon Nov 27 18:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.93300000000000005,"15min":0.96699999999999997},"min":{"1min":0.76800000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.3260000000000001,"5min":1.341,"15min":1.8009999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.879,"15min":0.89600000000000002},"min":{"1min":0.45000000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.0960000000000001,"5min":1.462,"15min":2.0960000000000001},"last":1.0349999999999999}]},{"osd":4,"last update":"Mon Nov 27 18:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.93500000000000005,"15min":0.94999999999999996},"min":{"1min":0.64400000000000002,"5min":0.56899999999999995,"15min":0.51800000000000002},"max":{"1min":1.254,"5min":1.425,"15min":1.4970000000000001},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.141,"5min":1.054,"15min":1.095},"min":{"1min":0.94199999999999995,"5min":0.629,"15min":0.61399999999999999},"max":{"1min":1.411,"5min":1.478,"15min":2.496},"last":1.0860000000000001}]},{"osd":5,"last update":"Mon Nov 27 18:44:37 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.0409999999999999,"15min":1.0820000000000001},"min":{"1min":0.67000000000000004,"5min":0.58299999999999996,"15min":0.51500000000000001},"max":{"1min":1.28,"5min":1.534,"15min":2.1970000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.04,"15min":1.056},"min":{"1min":0.754,"5min":0.61199999999999999,"15min":0.60599999999999998},"max":{"1min":1.4350000000000001,"5min":1.605,"15min":1.7529999999999999},"last":0.997}]},{"osd":6,"last update":"Mon Nov 27 18:44:37 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.123,"15min":1.1870000000000001},"min":{"1min":0.91400000000000003,"5min":0.60499999999999998,"15min":0.503},"max":{"1min":1.3220000000000001,"5min":1.6060000000000001,"15min":2.4319999999999999},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.1299999999999999,"15min":1.169},"min":{"1min":0.879,"5min":0.61599999999999999,"15min":0.53900000000000003},"max":{"1min":1.337,"5min":1.5660000000000001,"15min":2.3700000000000001},"last":0.94099999999999995}]},{"osd":7,"last update":"Mon Nov 27 18:44:37 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.1619999999999999,"15min":1.202},"min":{"1min":0.88800000000000001,"5min":0.64300000000000002,"15min":0.56799999999999995},"max":{"1min":1.429,"5min":1.6160000000000001,"15min":2.2879999999999998},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.125,"5min":1.127,"15min":1.161},"min":{"1min":0.85099999999999998,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.395,"5min":1.7070000000000001,"15min":1.7170000000000001},"last":1.0649999999999999}]}]},{"osd":0,"up_from":16,"seq":68719477131,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42672,"kb_used_data":3176,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329168,"statfs":{"total":96636764160,"available":96593068032,"internally_reserved":0,"allocated":3252224,"data_stored":4332682,"data_compressed":397480,"data_compressed_allocated":610304,"data_compressed_original":1900544,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 27 18:44:41 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.69199999999999995,"15min":0.71899999999999997},"min":{"1min":0.51700000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.333,"5min":1.333,"15min":1.6599999999999999},"last":1.2410000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.82699999999999996,"15min":0.83599999999999997},"min":{"1min":0.51800000000000002,"5min":0.47499999999999998,"15min":0.42399999999999999},"max":{"1min":1.0549999999999999,"5min":1.391,"15min":1.391},"last":0.61499999999999999}]},{"osd":2,"last update":"Mon Nov 27 18:44:41 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.81000000000000005,"15min":0.84999999999999998},"min":{"1min":0.58099999999999996,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.093,"5min":1.3799999999999999,"15min":1.405},"last":0.875},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84199999999999997,"15min":0.85499999999999998},"min":{"1min":0.56799999999999995,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.127,"5min":1.341,"15min":1.4730000000000001},"last":0.83499999999999996}]},{"osd":3,"last update":"Mon Nov 27 18:44:41 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.83699999999999997,"15min":0.86199999999999999},"min":{"1min":0.57499999999999996,"5min":0.46400000000000002,"15min":0.42099999999999999},"max":{"1min":1.0669999999999999,"5min":1.3440000000000001,"15min":1.5309999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.95599999999999996,"15min":0.96399999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.3979999999999999,"5min":1.421,"15min":1.514},"last":1.0589999999999999}]},{"osd":4,"last update":"Mon Nov 27 18:44:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":0.96199999999999997,"15min":0.96999999999999997},"min":{"1min":0.77100000000000002,"5min":0.64400000000000002,"15min":0.57099999999999995},"max":{"1min":1.274,"5min":1.4299999999999999,"15min":1.73},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0349999999999999,"15min":1.0669999999999999},"min":{"1min":0.89200000000000002,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.478,"5min":1.478,"15min":1.6060000000000001},"last":1.159}]},{"osd":5,"last update":"Mon Nov 27 18:44:41 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.0669999999999999,"15min":1.0800000000000001},"min":{"1min":0.86199999999999999,"5min":0.69899999999999995,"15min":0.56899999999999995},"max":{"1min":1.2649999999999999,"5min":1.5369999999999999,"15min":1.774},"last":1.1879999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.01,"15min":1.03},"min":{"1min":0.77800000000000002,"5min":0.64700000000000002,"15min":0.624},"max":{"1min":1.2210000000000001,"5min":1.3859999999999999,"15min":1.855},"last":1.2050000000000001}]},{"osd":6,"last update":"Mon Nov 27 18:44:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.127,"15min":1.157},"min":{"1min":0.77600000000000002,"5min":0.67200000000000004,"15min":0.59599999999999997},"max":{"1min":1.4610000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.147,"5min":1.137,"15min":1.1659999999999999},"min":{"1min":0.85899999999999999,"5min":0.81799999999999995,"15min":0.745},"max":{"1min":1.302,"5min":1.5029999999999999,"15min":1.7130000000000001},"last":1.0309999999999999}]},{"osd":7,"last update":"Mon Nov 27 18:44:41 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.163,"15min":1.1899999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.60799999999999998},"max":{"1min":1.4279999999999999,"5min":1.591,"15min":1.748},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.095,"5min":1.131,"15min":1.147},"min":{"1min":0.90300000000000002,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.27,"5min":1.7230000000000001,"15min":1.7849999999999999},"last":1.1140000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509835,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55512,"kb_used_data":6288,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94316328,"statfs":{"total":96636764160,"available":96579919872,"internally_reserved":0,"allocated":6438912,"data_stored":8528274,"data_compressed":749838,"data_compressed_allocated":1245184,"data_compressed_original":3551232,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 18:44:41 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.90500000000000003,"15min":0.88900000000000001},"min":{"1min":0.55500000000000005,"5min":0.53700000000000003,"15min":0.46300000000000002},"max":{"1min":1.204,"5min":1.385,"15min":1.675},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.91500000000000004,"15min":0.91400000000000003},"min":{"1min":0.62,"5min":0.498,"15min":0.373},"max":{"1min":1.2989999999999999,"5min":1.325,"15min":1.506},"last":0.98999999999999999}]},{"osd":1,"last update":"Mon Nov 27 18:44:41 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.94999999999999996,"15min":0.94199999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.242,"5min":1.4790000000000001,"15min":2.2759999999999998},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.0049999999999999,"5min":0.98099999999999998,"15min":0.95699999999999996},"min":{"1min":0.63800000000000001,"5min":0.62,"15min":0.49399999999999999},"max":{"1min":1.411,"5min":1.411,"15min":1.569},"last":1.1870000000000001}]},{"osd":2,"last update":"Mon Nov 27 18:44:41 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.95899999999999996,"15min":0.96399999999999997},"min":{"1min":0.76600000000000001,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.21,"5min":1.5649999999999999,"15min":2.3730000000000002},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0289999999999999,"15min":1.0089999999999999},"min":{"1min":0.624,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.256,"5min":1.4770000000000001,"15min":1.7729999999999999},"last":0.86499999999999999}]},{"osd":3,"last update":"Mon Nov 27 18:44:41 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.96499999999999997,"15min":0.95499999999999996},"min":{"1min":0.64400000000000002,"5min":0.58099999999999996,"15min":0.53900000000000003},"max":{"1min":1.228,"5min":1.411,"15min":1.7130000000000001},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.01,"15min":1.0429999999999999},"min":{"1min":0.82299999999999995,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.1910000000000001,"5min":1.5169999999999999,"15min":2.2069999999999999},"last":1.038}]},{"osd":5,"last update":"Mon Nov 27 18:44:41 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.97099999999999997,"15min":0.96999999999999997},"min":{"1min":0.50800000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.3280000000000001,"5min":1.4410000000000001,"15min":1.7290000000000001},"last":1.272},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97399999999999998,"15min":0.96199999999999997},"min":{"1min":0.65600000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.248,"5min":1.3799999999999999,"15min":1.6659999999999999},"last":1.3220000000000001}]},{"osd":6,"last update":"Mon Nov 27 18:44:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0660000000000001,"15min":1.032},"min":{"1min":0.66900000000000004,"5min":0.52200000000000002,"15min":0.48299999999999998},"max":{"1min":1.304,"5min":1.6579999999999999,"15min":2.4199999999999999},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.171,"15min":1.145},"min":{"1min":0.65800000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.464,"5min":1.591,"15min":1.8140000000000001},"last":1.349}]},{"osd":7,"last update":"Mon Nov 27 18:44:41 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.0720000000000001,"15min":1.0629999999999999},"min":{"1min":0.72799999999999998,"5min":0.46100000000000002,"15min":0.40400000000000003},"max":{"1min":1.294,"5min":1.623,"15min":2.0419999999999998},"last":1.224},{"interface":"front","average":{"1min":1.131,"5min":1.1599999999999999,"15min":1.1639999999999999},"min":{"1min":0.83899999999999997,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.357,"5min":1.736,"15min":2.3279999999999998},"last":1.173}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33505,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33505,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2912256,"data_stored":4194360,"data_compressed":397480,"data_compressed_allocated":610304,"data_compressed_original":1900544,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6066176,"data_stored":8389280,"data_compressed":750925,"data_compressed_allocated":1228800,"data_compressed_original":3559424,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8699904,"data_stored":12583494,"data_compressed":1205599,"data_compressed_allocated":1880064,"data_compressed_original":5767168,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6098944,"data_stored":8389952,"data_compressed":749838,"data_compressed_allocated":1245184,"data_compressed_original":3551232,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4546560,"data_stored":7328697,"data_compressed":816641,"data_compressed_allocated":1196032,"data_compressed_original":3989504,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":2732032,"data_stored":4194304,"data_compressed":430585,"data_compressed_allocated":663552,"data_compressed_original":2125824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1814528,"data_stored":3134425,"data_compressed":386056,"data_compressed_allocated":532480,"data_compressed_original":1863680,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T18:45:10.682 DEBUG:teuthology.orchestra.run.smithi091:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-11-27T18:45:10.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.837+0000 7f3cc11d7640 1 Processor -- start 2023-11-27T18:45:10.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.837+0000 7f3cc11d7640 1 -- start start 2023-11-27T18:45:10.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.837+0000 7f3cc11d7640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f3cbc14ffb0 0x7f3cbc159fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:10.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.837+0000 7f3cc11d7640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f3cbc0c3360 0x7f3cbc06e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:10.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.837+0000 7f3cc11d7640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cbc15d500 con 0x7f3cbc0c37a0 2023-11-27T18:45:10.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.837+0000 7f3cc11d7640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cbc071270 con 0x7f3cbc14ffb0 2023-11-27T18:45:10.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.837+0000 7f3cc11d7640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cbc0717f0 con 0x7f3cbc0c3360 2023-11-27T18:45:10.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.837+0000 7f3cbad9d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f3cbc14ffb0 0x7f3cbc159fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:45:10.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.837+0000 7f3cbb59e640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f3cbc0c37a0 0x7f3cbc06a520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:43714/0 (socket says 172.21.15.91:43714) 2023-11-27T18:45:10.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.837+0000 7f3cbb59e640 1 -- 172.21.15.91:0/528052785 learned_addr learned my addr 172.21.15.91:0/528052785 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:45:10.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.837+0000 7f3cba59c640 1 --2- 172.21.15.91:0/528052785 >> v2:172.21.15.94:3300/0 conn(0x7f3cbc0c3360 0x7f3cbc06e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:45:10.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.845+0000 7f3cbad9d640 1 -- 172.21.15.91:0/528052785 >> v2:172.21.15.94:3300/0 conn(0x7f3cbc0c3360 msgr2=0x7f3cbc06e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:45:10.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.845+0000 7f3cbad9d640 1 --2- 172.21.15.91:0/528052785 >> v2:172.21.15.94:3300/0 conn(0x7f3cbc0c3360 0x7f3cbc06e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:10.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.845+0000 7f3cbad9d640 1 -- 172.21.15.91:0/528052785 >> v1:172.21.15.91:6789/0 conn(0x7f3cbc0c37a0 legacy=0x7f3cbc06a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:10.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.845+0000 7f3cbad9d640 1 -- 172.21.15.91:0/528052785 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cbc15d990 con 0x7f3cbc14ffb0 2023-11-27T18:45:10.852 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.853+0000 7f3cbad9d640 1 --2- 172.21.15.91:0/528052785 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3cbc14ffb0 0x7f3cbc159fc0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc070c90 tx=0x7f3cac01ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b98da3b39db9398e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:45:10.857 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.857+0000 7f3cb9d9b640 1 -- 172.21.15.91:0/528052785 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cac0a8950 con 0x7f3cbc14ffb0 2023-11-27T18:45:10.857 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.857+0000 7f3cb9d9b640 1 -- 172.21.15.91:0/528052785 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cac0a8ab0 con 0x7f3cbc14ffb0 2023-11-27T18:45:10.857 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.857+0000 7f3cb9d9b640 1 -- 172.21.15.91:0/528052785 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cac0a8e40 con 0x7f3cbc14ffb0 2023-11-27T18:45:10.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.857+0000 7f3cc11d7640 1 -- 172.21.15.91:0/528052785 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3cbc14ffb0 msgr2=0x7f3cbc159fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:10.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.857+0000 7f3cc11d7640 1 --2- 172.21.15.91:0/528052785 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3cbc14ffb0 0x7f3cbc159fc0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc070c90 tx=0x7f3cac01ec50 comp rx=0 tx=0).stop 2023-11-27T18:45:10.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.857+0000 7f3cc11d7640 1 -- 172.21.15.91:0/528052785 shutdown_connections 2023-11-27T18:45:10.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.857+0000 7f3cc11d7640 1 --2- 172.21.15.91:0/528052785 >> v2:172.21.15.94:3300/0 conn(0x7f3cbc0c3360 0x7f3cbc06e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:10.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.857+0000 7f3cc11d7640 1 --2- 172.21.15.91:0/528052785 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3cbc14ffb0 0x7f3cbc159fc0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:10.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.857+0000 7f3cc11d7640 1 -- 172.21.15.91:0/528052785 >> 172.21.15.91:0/528052785 conn(0x7f3cbc0ca9d0 msgr2=0x7f3cbc0cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:45:10.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.857+0000 7f3cc11d7640 1 -- 172.21.15.91:0/528052785 shutdown_connections 2023-11-27T18:45:10.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.857+0000 7f3cc11d7640 1 -- 172.21.15.91:0/528052785 wait complete. 2023-11-27T18:45:10.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.857+0000 7f3cc11d7640 1 Processor -- start 2023-11-27T18:45:10.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.857+0000 7f3cc11d7640 1 -- start start 2023-11-27T18:45:10.860 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.861+0000 7f3cc11d7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3cbc0c3360 0x7f3cbc1505d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:10.860 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.861+0000 7f3cc11d7640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3cbc0c37a0 0x7f3cbc149280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:10.860 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.861+0000 7f3cc11d7640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3cbc14ffb0 0x7f3cbc1497c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:10.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.861+0000 7f3cc11d7640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cbc0bb8d0 con 0x7f3cbc0c37a0 2023-11-27T18:45:10.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.861+0000 7f3cc11d7640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cbc15bd80 con 0x7f3cbc0c3360 2023-11-27T18:45:10.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.861+0000 7f3cc11d7640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cbc150b10 con 0x7f3cbc14ffb0 2023-11-27T18:45:10.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.861+0000 7f3cba59c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3cbc0c37a0 0x7f3cbc149280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:45:10.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.861+0000 7f3cba59c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3cbc0c37a0 0x7f3cbc149280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:55354/0 (socket says 172.21.15.91:55354) 2023-11-27T18:45:10.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.861+0000 7f3cba59c640 1 -- 172.21.15.91:0/1595325849 learned_addr learned my addr 172.21.15.91:0/1595325849 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:45:10.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.861+0000 7f3cbb59e640 1 --2- 172.21.15.91:0/1595325849 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3cbc14ffb0 0x7f3cbc1497c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:45:10.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.861+0000 7f3cbad9d640 1 --2- 172.21.15.91:0/1595325849 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3cbc0c3360 0x7f3cbc1505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:45:10.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.865+0000 7f3cba59c640 1 -- 172.21.15.91:0/1595325849 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3cbc14ffb0 msgr2=0x7f3cbc1497c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:10.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.865+0000 7f3cba59c640 1 --2- 172.21.15.91:0/1595325849 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3cbc14ffb0 0x7f3cbc1497c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:10.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.865+0000 7f3cba59c640 1 -- 172.21.15.91:0/1595325849 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3cbc0c3360 msgr2=0x7f3cbc1505d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:10.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.865+0000 7f3cba59c640 1 --2- 172.21.15.91:0/1595325849 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3cbc0c3360 0x7f3cbc1505d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:10.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.865+0000 7f3cba59c640 1 -- 172.21.15.91:0/1595325849 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cac009420 con 0x7f3cbc0c37a0 2023-11-27T18:45:10.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.865+0000 7f3cba59c640 1 --2- 172.21.15.91:0/1595325849 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3cbc0c37a0 0x7f3cbc149280 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3cb000e930 tx=0x7f3cb000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:45:10.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.869+0000 7f3ca37fe640 1 -- 172.21.15.91:0/1595325849 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb0009690 con 0x7f3cbc0c37a0 2023-11-27T18:45:10.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.869+0000 7f3ca37fe640 1 -- 172.21.15.91:0/1595325849 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cb000ca00 con 0x7f3cbc0c37a0 2023-11-27T18:45:10.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.869+0000 7f3ca37fe640 1 -- 172.21.15.91:0/1595325849 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb000cd70 con 0x7f3cbc0c37a0 2023-11-27T18:45:10.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.869+0000 7f3cc11d7640 1 -- 172.21.15.91:0/1595325849 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cbc152d00 con 0x7f3cbc0c37a0 2023-11-27T18:45:10.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.869+0000 7f3cc11d7640 1 -- 172.21.15.91:0/1595325849 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cbc0bcf30 con 0x7f3cbc0c37a0 2023-11-27T18:45:10.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.873+0000 7f3cc11d7640 1 -- 172.21.15.91:0/1595325849 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cbc06f730 con 0x7f3cbc0c37a0 2023-11-27T18:45:10.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.893+0000 7f3ca37fe640 1 -- 172.21.15.91:0/1595325849 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f3cb0013470 con 0x7f3cbc0c37a0 2023-11-27T18:45:10.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.893+0000 7f3ca37fe640 1 --2- 172.21.15.91:0/1595325849 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f3ca8066840 0x7f3ca8068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:10.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.893+0000 7f3cbad9d640 1 --2- 172.21.15.91:0/1595325849 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f3ca8066840 0x7f3ca8068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:45:10.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.893+0000 7f3cbad9d640 1 --2- 172.21.15.91:0/1595325849 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f3ca8066840 0x7f3ca8068d00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3cac0b2000 tx=0x7f3cac0aa070 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:45:10.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:10.897+0000 7f3ca37fe640 1 -- 172.21.15.91:0/1595325849 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f3cb0055b00 con 0x7f3cbc0c37a0 2023-11-27T18:45:11.029 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:45:11.032 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:45:11.142 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.141+0000 7f3ca37fe640 1 -- 172.21.15.91:0/1595325849 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f3cb0051e40 con 0x7f3cbc0c37a0 2023-11-27T18:45:11.303 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.301+0000 7f3cc11d7640 1 -- 172.21.15.91:0/1595325849 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f3cbc0c2390 con 0x7f3cbc0c37a0 2023-11-27T18:45:11.481 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.481+0000 7f3ca37fe640 1 -- 172.21.15.91:0/1595325849 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7f3cb0021070 con 0x7f3cbc0c37a0 2023-11-27T18:45:11.482 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.481+0000 7f3ca37fe640 1 -- 172.21.15.91:0/1595325849 <== mon.0 v2:172.21.15.91:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3cb0059ba0 con 0x7f3cbc0c37a0 2023-11-27T18:45:11.484 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.485+0000 7f3cc11d7640 1 -- 172.21.15.91:0/1595325849 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f3ca8066840 msgr2=0x7f3ca8068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:11.485 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.485+0000 7f3cc11d7640 1 --2- 172.21.15.91:0/1595325849 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f3ca8066840 0x7f3ca8068d00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3cac0b2000 tx=0x7f3cac0aa070 comp rx=0 tx=0).stop 2023-11-27T18:45:11.485 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.485+0000 7f3cc11d7640 1 -- 172.21.15.91:0/1595325849 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3cbc0c37a0 msgr2=0x7f3cbc149280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:11.485 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.485+0000 7f3cc11d7640 1 --2- 172.21.15.91:0/1595325849 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3cbc0c37a0 0x7f3cbc149280 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3cb000e930 tx=0x7f3cb000edf0 comp rx=0 tx=0).stop 2023-11-27T18:45:11.485 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.485+0000 7f3cc11d7640 1 -- 172.21.15.91:0/1595325849 shutdown_connections 2023-11-27T18:45:11.485 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.485+0000 7f3cc11d7640 1 --2- 172.21.15.91:0/1595325849 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f3ca8066840 0x7f3ca8068d00 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:11.485 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.485+0000 7f3cc11d7640 1 --2- 172.21.15.91:0/1595325849 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3cbc14ffb0 0x7f3cbc1497c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:11.485 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.485+0000 7f3cc11d7640 1 --2- 172.21.15.91:0/1595325849 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3cbc0c37a0 0x7f3cbc149280 secure :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3cb000e930 tx=0x7f3cb000edf0 comp rx=0 tx=0).stop 2023-11-27T18:45:11.485 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.485+0000 7f3cc11d7640 1 --2- 172.21.15.91:0/1595325849 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3cbc0c3360 0x7f3cbc1505d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:11.485 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.485+0000 7f3cc11d7640 1 -- 172.21.15.91:0/1595325849 >> 172.21.15.91:0/1595325849 conn(0x7f3cbc0ca9d0 msgr2=0x7f3cbc14a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:45:11.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.485+0000 7f3cc11d7640 1 -- 172.21.15.91:0/1595325849 shutdown_connections 2023-11-27T18:45:11.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.485+0000 7f3cc11d7640 1 -- 172.21.15.91:0/1595325849 wait complete. 2023-11-27T18:45:11.508 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-27T18:45:11.508 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T18:45:11.677 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.677+0000 7f648c808640 1 Processor -- start 2023-11-27T18:45:11.677 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.677+0000 7f648c808640 1 -- start start 2023-11-27T18:45:11.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.677+0000 7f648c808640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f648815ced0 0x7f648806a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:11.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.677+0000 7f648c808640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f64880c6690 0x7f64880c7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:11.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.677+0000 7f648c808640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64880c6b50 con 0x7f64880c8c40 2023-11-27T18:45:11.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.677+0000 7f648c808640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64880721d0 con 0x7f648815ced0 2023-11-27T18:45:11.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.677+0000 7f648c808640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64880724b0 con 0x7f64880c6690 2023-11-27T18:45:11.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.681+0000 7f648659c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f648815ced0 0x7f648806a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:45:11.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.681+0000 7f6486d9d640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f64880c6690 0x7f64880c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:45:11.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.681+0000 7f648659c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f648815ced0 0x7f648806a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.91:55258/0 (socket says 172.21.15.91:55258) 2023-11-27T18:45:11.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.681+0000 7f648659c640 1 -- 172.21.15.91:0/4047391363 learned_addr learned my addr 172.21.15.91:0/4047391363 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:45:11.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.685+0000 7f6486d9d640 1 -- 172.21.15.91:0/4047391363 >> v2:172.21.15.94:3300/0 conn(0x7f648815ced0 msgr2=0x7f648806a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:45:11.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.685+0000 7f6486d9d640 1 --2- 172.21.15.91:0/4047391363 >> v2:172.21.15.94:3300/0 conn(0x7f648815ced0 0x7f648806a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:11.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.685+0000 7f6486d9d640 1 -- 172.21.15.91:0/4047391363 >> v1:172.21.15.91:6789/0 conn(0x7f64880c8c40 legacy=0x7f648815d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:45:11.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.685+0000 7f6486d9d640 1 -- 172.21.15.91:0/4047391363 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64880c6da0 con 0x7f64880c6690 2023-11-27T18:45:11.697 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.697+0000 7f6486d9d640 1 --2- 172.21.15.91:0/4047391363 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f64880c6690 0x7f64880c7880 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6480009d90 tx=0x7f648001c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aebc17034227f04a server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:45:11.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.805+0000 7f648559a640 1 -- 172.21.15.91:0/4047391363 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64800a5900 con 0x7f64880c6690 2023-11-27T18:45:11.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.805+0000 7f648559a640 1 -- 172.21.15.91:0/4047391363 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f64800a5a60 con 0x7f64880c6690 2023-11-27T18:45:11.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.805+0000 7f648559a640 1 -- 172.21.15.91:0/4047391363 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64800a5e10 con 0x7f64880c6690 2023-11-27T18:45:11.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.809+0000 7f648c808640 1 -- 172.21.15.91:0/4047391363 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f64880c6690 msgr2=0x7f64880c7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:11.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.809+0000 7f648c808640 1 --2- 172.21.15.91:0/4047391363 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f64880c6690 0x7f64880c7880 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6480009d90 tx=0x7f648001c880 comp rx=0 tx=0).stop 2023-11-27T18:45:11.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.809+0000 7f648c808640 1 -- 172.21.15.91:0/4047391363 shutdown_connections 2023-11-27T18:45:11.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.809+0000 7f648c808640 1 --2- 172.21.15.91:0/4047391363 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f64880c6690 0x7f64880c7880 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:11.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.809+0000 7f648c808640 1 --2- 172.21.15.91:0/4047391363 >> v2:172.21.15.94:3300/0 conn(0x7f648815ced0 0x7f648806a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:11.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.809+0000 7f648c808640 1 -- 172.21.15.91:0/4047391363 >> 172.21.15.91:0/4047391363 conn(0x7f64880cbaa0 msgr2=0x7f64880c7fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:45:11.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.809+0000 7f648c808640 1 -- 172.21.15.91:0/4047391363 shutdown_connections 2023-11-27T18:45:11.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.809+0000 7f648c808640 1 -- 172.21.15.91:0/4047391363 wait complete. 2023-11-27T18:45:11.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.809+0000 7f648c808640 1 Processor -- start 2023-11-27T18:45:11.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.809+0000 7f648c808640 1 -- start start 2023-11-27T18:45:11.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.813+0000 7f648c808640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f64880c6690 0x7f6488145c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:11.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.813+0000 7f648c808640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f64880c8c40 0x7f64881f2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:11.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.813+0000 7f648c808640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f648815ced0 0x7f6488141330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:11.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.813+0000 7f648c808640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64880c98a0 con 0x7f64880c6690 2023-11-27T18:45:11.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.813+0000 7f648c808640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64880cb320 con 0x7f64880c8c40 2023-11-27T18:45:11.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.813+0000 7f648c808640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6488149800 con 0x7f648815ced0 2023-11-27T18:45:11.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.813+0000 7f648659c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f64880c6690 0x7f6488145c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:45:11.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.813+0000 7f648659c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f64880c6690 0x7f6488145c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:55360/0 (socket says 172.21.15.91:55360) 2023-11-27T18:45:11.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.813+0000 7f648659c640 1 -- 172.21.15.91:0/3864020008 learned_addr learned my addr 172.21.15.91:0/3864020008 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:45:11.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.813+0000 7f6485d9b640 1 --2- 172.21.15.91:0/3864020008 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f64880c8c40 0x7f64881f2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:45:11.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.817+0000 7f648659c640 1 -- 172.21.15.91:0/3864020008 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f648815ced0 msgr2=0x7f6488141330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:11.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.817+0000 7f648659c640 1 --2- 172.21.15.91:0/3864020008 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f648815ced0 0x7f6488141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:11.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.817+0000 7f648659c640 1 -- 172.21.15.91:0/3864020008 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f64880c8c40 msgr2=0x7f64881f2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:11.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.817+0000 7f648659c640 1 --2- 172.21.15.91:0/3864020008 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f64880c8c40 0x7f64881f2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:11.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.817+0000 7f648659c640 1 -- 172.21.15.91:0/3864020008 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6480009a70 con 0x7f64880c6690 2023-11-27T18:45:11.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.817+0000 7f648659c640 1 --2- 172.21.15.91:0/3864020008 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f64880c6690 0x7f6488145c10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f647800e820 tx=0x7f647800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:45:11.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.825+0000 7f647effd640 1 -- 172.21.15.91:0/3864020008 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6478009580 con 0x7f64880c6690 2023-11-27T18:45:11.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.825+0000 7f647effd640 1 -- 172.21.15.91:0/3864020008 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f647800c940 con 0x7f64880c6690 2023-11-27T18:45:11.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.825+0000 7f647effd640 1 -- 172.21.15.91:0/3864020008 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f647800ccf0 con 0x7f64880c6690 2023-11-27T18:45:11.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.825+0000 7f648c808640 1 -- 172.21.15.91:0/3864020008 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f648813f170 con 0x7f64880c6690 2023-11-27T18:45:11.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.825+0000 7f648c808640 1 -- 172.21.15.91:0/3864020008 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6488148d20 con 0x7f64880c6690 2023-11-27T18:45:11.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.825+0000 7f648c808640 1 -- 172.21.15.91:0/3864020008 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6488067810 con 0x7f64880c6690 2023-11-27T18:45:11.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.853+0000 7f647effd640 1 -- 172.21.15.91:0/3864020008 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f6478013470 con 0x7f64880c6690 2023-11-27T18:45:11.855 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.853+0000 7f647effd640 1 --2- 172.21.15.91:0/3864020008 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f6468066820 0x7f6468068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:11.855 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.853+0000 7f6485d9b640 1 --2- 172.21.15.91:0/3864020008 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f6468066820 0x7f6468068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:45:11.856 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.857+0000 7f6485d9b640 1 --2- 172.21.15.91:0/3864020008 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f6468066820 0x7f6468068ce0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6488163e40 tx=0x7f6470009040 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:45:11.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:11.857+0000 7f647effd640 1 -- 172.21.15.91:0/3864020008 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f64780558f0 con 0x7f64880c6690 2023-11-27T18:45:12.265 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.265+0000 7f647effd640 1 -- 172.21.15.91:0/3864020008 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f6478051c30 con 0x7f64880c6690 2023-11-27T18:45:12.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.493+0000 7f648c808640 1 -- 172.21.15.91:0/3864020008 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f64880c6260 con 0x7f64880c6690 2023-11-27T18:45:12.590 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.589+0000 7f647effd640 1 -- 172.21.15.91:0/3864020008 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6491 (secure 0 0 0) 0x7f6478021070 con 0x7f64880c6690 2023-11-27T18:45:12.590 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:45:12.590 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1156758494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1156758494},{"type":"v1","addr":"172.21.15.91:6835","nonce":1156758494}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4227,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/2636117364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2636117364},{"type":"v1","addr":"172.21.15.91:6837","nonce":2636117364}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6839/1813662020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6838","nonce":1813662020},{"type":"v1","addr":"172.21.15.91:6839","nonce":1813662020}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4243,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3605337236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3605337236},{"type":"v1","addr":"172.21.15.94:6833","nonce":3605337236}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4246,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/1691562292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1691562292},{"type":"v1","addr":"172.21.15.94:6835","nonce":1691562292}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T18:13:13.083833+0000","modified":"2023-11-27T18:13:54.891064+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":10,"addr":"172.21.15.94:6837/3938864244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":3938864244},{"type":"v1","addr":"172.21.15.94:6837","nonce":3938864244}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-27T18:45:12.591 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 9 2023-11-27T18:45:12.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.593+0000 7f648c808640 1 -- 172.21.15.91:0/3864020008 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f6468066820 msgr2=0x7f6468068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:12.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.593+0000 7f648c808640 1 --2- 172.21.15.91:0/3864020008 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f6468066820 0x7f6468068ce0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6488163e40 tx=0x7f6470009040 comp rx=0 tx=0).stop 2023-11-27T18:45:12.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.593+0000 7f648c808640 1 -- 172.21.15.91:0/3864020008 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f64880c6690 msgr2=0x7f6488145c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:12.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.593+0000 7f648c808640 1 --2- 172.21.15.91:0/3864020008 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f64880c6690 0x7f6488145c10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f647800e820 tx=0x7f647800ece0 comp rx=0 tx=0).stop 2023-11-27T18:45:12.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.593+0000 7f648c808640 1 -- 172.21.15.91:0/3864020008 shutdown_connections 2023-11-27T18:45:12.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.593+0000 7f648c808640 1 --2- 172.21.15.91:0/3864020008 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f6468066820 0x7f6468068ce0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:12.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.593+0000 7f648c808640 1 --2- 172.21.15.91:0/3864020008 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f648815ced0 0x7f6488141330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:12.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.593+0000 7f648c808640 1 --2- 172.21.15.91:0/3864020008 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f64880c8c40 0x7f64881f2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:12.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.593+0000 7f648c808640 1 --2- 172.21.15.91:0/3864020008 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f64880c6690 0x7f6488145c10 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:12.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.593+0000 7f648c808640 1 -- 172.21.15.91:0/3864020008 >> 172.21.15.91:0/3864020008 conn(0x7f64880cbaa0 msgr2=0x7f6488150ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:45:12.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.593+0000 7f648c808640 1 -- 172.21.15.91:0/3864020008 shutdown_connections 2023-11-27T18:45:12.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.593+0000 7f648c808640 1 -- 172.21.15.91:0/3864020008 wait complete. 2023-11-27T18:45:12.613 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T18:45:12.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.733+0000 7f9483c76640 1 Processor -- start 2023-11-27T18:45:12.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.733+0000 7f9483c76640 1 -- start start 2023-11-27T18:45:12.734 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.733+0000 7f9483c76640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f947c0c6c50 0x7f947c0c2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:12.734 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.733+0000 7f9483c76640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f947c0c73e0 con 0x7f947c0c82f0 2023-11-27T18:45:12.734 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.733+0000 7f9483c76640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f947c0701f0 con 0x7f947c153a20 2023-11-27T18:45:12.734 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.733+0000 7f9483c76640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f947c0c7120 con 0x7f947c0c6c50 2023-11-27T18:45:12.735 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.733+0000 7f9481211640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f947c0c6c50 0x7f947c0c2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:45:12.736 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.737+0000 7f9481a12640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f947c153a20 0x7f947c0c1bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.91:39690/0 (socket says 172.21.15.91:39690) 2023-11-27T18:45:12.736 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.737+0000 7f9481a12640 1 -- 172.21.15.91:0/1358785846 learned_addr learned my addr 172.21.15.91:0/1358785846 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:45:12.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.741+0000 7f9481211640 1 -- 172.21.15.91:0/1358785846 >> v1:172.21.15.94:6789/0 conn(0x7f947c153a20 legacy=0x7f947c0c1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:12.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.741+0000 7f9481211640 1 -- 172.21.15.91:0/1358785846 >> v1:172.21.15.91:6789/0 conn(0x7f947c0c82f0 legacy=0x7f947c159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:45:12.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.741+0000 7f9481211640 1 -- 172.21.15.91:0/1358785846 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f947c06f8c0 con 0x7f947c0c6c50 2023-11-27T18:45:12.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.749+0000 7f9481211640 1 --2- 172.21.15.91:0/1358785846 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f947c0c6c50 0x7f947c0c2c70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f94780097f0 tx=0x7f947801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90672f7f0b241760 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:45:12.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.893+0000 7f9480a10640 1 -- 172.21.15.91:0/1358785846 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94780ab600 con 0x7f947c0c6c50 2023-11-27T18:45:12.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.893+0000 7f9480a10640 1 -- 172.21.15.91:0/1358785846 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f94780a7050 con 0x7f947c0c6c50 2023-11-27T18:45:12.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.893+0000 7f9480a10640 1 -- 172.21.15.91:0/1358785846 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94780ab9a0 con 0x7f947c0c6c50 2023-11-27T18:45:12.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.893+0000 7f9483c76640 1 -- 172.21.15.91:0/1358785846 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f947c0c6c50 msgr2=0x7f947c0c2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:12.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.893+0000 7f9483c76640 1 --2- 172.21.15.91:0/1358785846 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f947c0c6c50 0x7f947c0c2c70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f94780097f0 tx=0x7f947801c480 comp rx=0 tx=0).stop 2023-11-27T18:45:12.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.893+0000 7f9483c76640 1 -- 172.21.15.91:0/1358785846 shutdown_connections 2023-11-27T18:45:12.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.893+0000 7f9483c76640 1 --2- 172.21.15.91:0/1358785846 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f947c0c6c50 0x7f947c0c2c70 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:12.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.893+0000 7f9483c76640 1 -- 172.21.15.91:0/1358785846 >> 172.21.15.91:0/1358785846 conn(0x7f947c0cbec0 msgr2=0x7f947c0cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:45:12.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.893+0000 7f9483c76640 1 -- 172.21.15.91:0/1358785846 shutdown_connections 2023-11-27T18:45:12.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.893+0000 7f9483c76640 1 -- 172.21.15.91:0/1358785846 wait complete. 2023-11-27T18:45:12.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.897+0000 7f9483c76640 1 Processor -- start 2023-11-27T18:45:12.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.897+0000 7f9483c76640 1 -- start start 2023-11-27T18:45:12.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.897+0000 7f9483c76640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f947c0c6c50 0x7f947c147a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:12.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.897+0000 7f9483c76640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f947c0c82f0 0x7f947c0caf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:12.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.897+0000 7f9483c76640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f947c153a20 0x7f947c0cb470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:12.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.897+0000 7f9483c76640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947c0cb9b0 con 0x7f947c0c6c50 2023-11-27T18:45:12.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.897+0000 7f9483c76640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947c1569e0 con 0x7f947c153a20 2023-11-27T18:45:12.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.897+0000 7f9483c76640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f947c149e00 con 0x7f947c0c82f0 2023-11-27T18:45:12.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.897+0000 7f9482213640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f947c153a20 0x7f947c0cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:45:12.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.901+0000 7f9482213640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f947c153a20 0x7f947c0cb470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.91:55282/0 (socket says 172.21.15.91:55282) 2023-11-27T18:45:12.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.901+0000 7f9482213640 1 -- 172.21.15.91:0/1442343544 learned_addr learned my addr 172.21.15.91:0/1442343544 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:45:12.901 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.901+0000 7f9481211640 1 --2- 172.21.15.91:0/1442343544 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f947c0c82f0 0x7f947c0caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:45:12.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.905+0000 7f9482213640 1 -- 172.21.15.91:0/1442343544 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f947c0c82f0 msgr2=0x7f947c0caf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:12.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.905+0000 7f9482213640 1 --2- 172.21.15.91:0/1442343544 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f947c0c82f0 0x7f947c0caf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:12.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.905+0000 7f9482213640 1 -- 172.21.15.91:0/1442343544 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f947c0c6c50 msgr2=0x7f947c147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:12.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.905+0000 7f9482213640 1 --2- 172.21.15.91:0/1442343544 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f947c0c6c50 0x7f947c147a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:12.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.905+0000 7f9482213640 1 -- 172.21.15.91:0/1442343544 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9478009420 con 0x7f947c153a20 2023-11-27T18:45:12.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.909+0000 7f9482213640 1 --2- 172.21.15.91:0/1442343544 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f947c153a20 0x7f947c0cb470 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f947400c7b0 tx=0x7f947400cc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:45:12.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.913+0000 7f94727fc640 1 -- 172.21.15.91:0/1442343544 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9474003d90 con 0x7f947c153a20 2023-11-27T18:45:12.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.913+0000 7f94727fc640 1 -- 172.21.15.91:0/1442343544 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f947400ce60 con 0x7f947c153a20 2023-11-27T18:45:12.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.913+0000 7f94727fc640 1 -- 172.21.15.91:0/1442343544 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94740052d0 con 0x7f947c153a20 2023-11-27T18:45:12.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.913+0000 7f9483c76640 1 -- 172.21.15.91:0/1442343544 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f947c0c2510 con 0x7f947c153a20 2023-11-27T18:45:12.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.913+0000 7f9483c76640 1 -- 172.21.15.91:0/1442343544 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f947c154070 con 0x7f947c153a20 2023-11-27T18:45:12.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:12.913+0000 7f9483c76640 1 -- 172.21.15.91:0/1442343544 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f947c067810 con 0x7f947c153a20 2023-11-27T18:45:13.206 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.205+0000 7f94727fc640 1 -- 172.21.15.91:0/1442343544 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f9474005430 con 0x7f947c153a20 2023-11-27T18:45:13.206 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.205+0000 7f94727fc640 1 --2- 172.21.15.91:0/1442343544 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f9460066840 0x7f9460068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:13.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.205+0000 7f9481a12640 1 --2- 172.21.15.91:0/1442343544 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f9460066840 0x7f9460068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:45:13.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.209+0000 7f9481a12640 1 --2- 172.21.15.91:0/1442343544 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f9460066840 0x7f9460068d00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f946c001560 tx=0x7f946c007a50 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:45:13.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.217+0000 7f94727fc640 1 -- 172.21.15.91:0/1442343544 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9474054db0 con 0x7f947c153a20 2023-11-27T18:45:13.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.329+0000 7f94727fc640 1 -- 172.21.15.91:0/1442343544 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f94740510f0 con 0x7f947c153a20 2023-11-27T18:45:13.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.533+0000 7f9483c76640 1 -- 172.21.15.91:0/1442343544 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f947c14a530 con 0x7f947c153a20 2023-11-27T18:45:13.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.581+0000 7f94727fc640 1 -- 172.21.15.91:0/1442343544 <== mon.1 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6491 (secure 0 0 0) 0x7f9474017070 con 0x7f947c153a20 2023-11-27T18:45:13.583 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:45:13.583 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1156758494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1156758494},{"type":"v1","addr":"172.21.15.91:6835","nonce":1156758494}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4227,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/2636117364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2636117364},{"type":"v1","addr":"172.21.15.91:6837","nonce":2636117364}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6839/1813662020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6838","nonce":1813662020},{"type":"v1","addr":"172.21.15.91:6839","nonce":1813662020}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4243,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3605337236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3605337236},{"type":"v1","addr":"172.21.15.94:6833","nonce":3605337236}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4246,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/1691562292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1691562292},{"type":"v1","addr":"172.21.15.94:6835","nonce":1691562292}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T18:13:13.083833+0000","modified":"2023-11-27T18:13:54.891064+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":10,"addr":"172.21.15.94:6837/3938864244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":3938864244},{"type":"v1","addr":"172.21.15.94:6837","nonce":3938864244}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-27T18:45:13.584 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 9 2023-11-27T18:45:13.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.585+0000 7f9483c76640 1 -- 172.21.15.91:0/1442343544 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f9460066840 msgr2=0x7f9460068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:13.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.585+0000 7f9483c76640 1 --2- 172.21.15.91:0/1442343544 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f9460066840 0x7f9460068d00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f946c001560 tx=0x7f946c007a50 comp rx=0 tx=0).stop 2023-11-27T18:45:13.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.585+0000 7f9483c76640 1 -- 172.21.15.91:0/1442343544 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f947c153a20 msgr2=0x7f947c0cb470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:13.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.585+0000 7f9483c76640 1 --2- 172.21.15.91:0/1442343544 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f947c153a20 0x7f947c0cb470 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f947400c7b0 tx=0x7f947400cc70 comp rx=0 tx=0).stop 2023-11-27T18:45:13.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.585+0000 7f9483c76640 1 -- 172.21.15.91:0/1442343544 shutdown_connections 2023-11-27T18:45:13.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.585+0000 7f9483c76640 1 --2- 172.21.15.91:0/1442343544 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f9460066840 0x7f9460068d00 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:13.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.585+0000 7f9483c76640 1 --2- 172.21.15.91:0/1442343544 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f947c0c82f0 0x7f947c0caf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:13.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.585+0000 7f9483c76640 1 --2- 172.21.15.91:0/1442343544 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f947c153a20 0x7f947c0cb470 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:13.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.585+0000 7f9483c76640 1 --2- 172.21.15.91:0/1442343544 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f947c0c6c50 0x7f947c147a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:13.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.585+0000 7f9483c76640 1 -- 172.21.15.91:0/1442343544 >> 172.21.15.91:0/1442343544 conn(0x7f947c0cbec0 msgr2=0x7f947c142a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:45:13.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.585+0000 7f9483c76640 1 -- 172.21.15.91:0/1442343544 shutdown_connections 2023-11-27T18:45:13.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.585+0000 7f9483c76640 1 -- 172.21.15.91:0/1442343544 wait complete. 2023-11-27T18:45:13.606 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T18:45:13.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.729+0000 7f71102a6640 1 Processor -- start 2023-11-27T18:45:13.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.729+0000 7f71102a6640 1 -- start start 2023-11-27T18:45:13.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.733+0000 7f71102a6640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f71081504c0 0x7f710815a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:13.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.733+0000 7f71102a6640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f71080c8610 0x7f7108071f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:13.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.733+0000 7f71102a6640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f710815a900 con 0x7f71081508a0 2023-11-27T18:45:13.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.733+0000 7f71102a6640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71080c1b10 con 0x7f71081504c0 2023-11-27T18:45:13.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.733+0000 7f71102a6640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71081563c0 con 0x7f71080c8610 2023-11-27T18:45:13.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.733+0000 7f710e042640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f71081504c0 0x7f710815a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:45:13.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.733+0000 7f710e042640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f71081504c0 0x7f710815a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:55382/0 (socket says 172.21.15.91:55382) 2023-11-27T18:45:13.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.733+0000 7f710e042640 1 -- 172.21.15.91:0/54140462 learned_addr learned my addr 172.21.15.91:0/54140462 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:45:13.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.733+0000 7f710d841640 1 --2- 172.21.15.91:0/54140462 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f71080c8610 0x7f7108071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:45:13.736 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.737+0000 7f710e042640 1 -- 172.21.15.91:0/54140462 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f71080c8610 msgr2=0x7f7108071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:45:13.736 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.737+0000 7f710e042640 1 --2- 172.21.15.91:0/54140462 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f71080c8610 0x7f7108071f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:13.736 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.737+0000 7f710e042640 1 -- 172.21.15.91:0/54140462 >> v1:172.21.15.94:6789/0 conn(0x7f71081508a0 legacy=0x7f71080c6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:13.736 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.737+0000 7f710e042640 1 -- 172.21.15.91:0/54140462 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71080c6200 con 0x7f71081504c0 2023-11-27T18:45:13.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.741+0000 7f710e042640 1 --2- 172.21.15.91:0/54140462 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f71081504c0 0x7f710815a3c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f70f800bb10 tx=0x7f70f8021400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8728002489dc725 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:45:13.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.745+0000 7f710d040640 1 -- 172.21.15.91:0/54140462 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f80b1600 con 0x7f71081504c0 2023-11-27T18:45:13.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.745+0000 7f710d040640 1 -- 172.21.15.91:0/54140462 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f70f80ad050 con 0x7f71081504c0 2023-11-27T18:45:13.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.745+0000 7f710d040640 1 -- 172.21.15.91:0/54140462 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f80b19a0 con 0x7f71081504c0 2023-11-27T18:45:13.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.745+0000 7f71102a6640 1 -- 172.21.15.91:0/54140462 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f71081504c0 msgr2=0x7f710815a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:13.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.745+0000 7f71102a6640 1 --2- 172.21.15.91:0/54140462 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f71081504c0 0x7f710815a3c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f70f800bb10 tx=0x7f70f8021400 comp rx=0 tx=0).stop 2023-11-27T18:45:13.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.745+0000 7f71102a6640 1 -- 172.21.15.91:0/54140462 shutdown_connections 2023-11-27T18:45:13.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.745+0000 7f71102a6640 1 --2- 172.21.15.91:0/54140462 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f71080c8610 0x7f7108071f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:13.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.745+0000 7f71102a6640 1 --2- 172.21.15.91:0/54140462 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f71081504c0 0x7f710815a3c0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:13.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.745+0000 7f71102a6640 1 -- 172.21.15.91:0/54140462 >> 172.21.15.91:0/54140462 conn(0x7f71080c79b0 msgr2=0x7f71080c7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:45:13.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.745+0000 7f71102a6640 1 -- 172.21.15.91:0/54140462 shutdown_connections 2023-11-27T18:45:13.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.745+0000 7f71102a6640 1 -- 172.21.15.91:0/54140462 wait complete. 2023-11-27T18:45:13.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.749+0000 7f71102a6640 1 Processor -- start 2023-11-27T18:45:13.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.749+0000 7f71102a6640 1 -- start start 2023-11-27T18:45:13.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.749+0000 7f71102a6640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f71080c8610 0x7f7108070f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:13.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.749+0000 7f71102a6640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71081504c0 0x7f71081df810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:13.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.749+0000 7f71102a6640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f71081508a0 0x7f7108149a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:13.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.749+0000 7f71102a6640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71081e02c0 con 0x7f71081508a0 2023-11-27T18:45:13.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.749+0000 7f71102a6640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710814dac0 con 0x7f71081504c0 2023-11-27T18:45:13.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.749+0000 7f71102a6640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71081e1cd0 con 0x7f71080c8610 2023-11-27T18:45:13.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.749+0000 7f710e843640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f71081508a0 0x7f7108149a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:45:13.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.749+0000 7f710e843640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f71081508a0 0x7f7108149a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:55392/0 (socket says 172.21.15.91:55392) 2023-11-27T18:45:13.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.749+0000 7f710e843640 1 -- 172.21.15.91:0/3650004995 learned_addr learned my addr 172.21.15.91:0/3650004995 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:45:13.752 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.753+0000 7f710d841640 1 --2- 172.21.15.91:0/3650004995 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71081504c0 0x7f71081df810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:45:13.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.753+0000 7f710e843640 1 -- 172.21.15.91:0/3650004995 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f71080c8610 msgr2=0x7f7108070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:13.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.753+0000 7f710e843640 1 --2- 172.21.15.91:0/3650004995 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f71080c8610 0x7f7108070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:13.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.753+0000 7f710e843640 1 -- 172.21.15.91:0/3650004995 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71081504c0 msgr2=0x7f71081df810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:13.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.753+0000 7f710e843640 1 --2- 172.21.15.91:0/3650004995 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71081504c0 0x7f71081df810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:13.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.753+0000 7f710e843640 1 -- 172.21.15.91:0/3650004995 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f800b770 con 0x7f71081508a0 2023-11-27T18:45:13.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.757+0000 7f710e843640 1 --2- 172.21.15.91:0/3650004995 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f71081508a0 0x7f7108149a00 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f710000c760 tx=0x7f710000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:45:13.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.761+0000 7f70feffd640 1 -- 172.21.15.91:0/3650004995 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7100003b80 con 0x7f71081508a0 2023-11-27T18:45:13.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.761+0000 7f71102a6640 1 -- 172.21.15.91:0/3650004995 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71081e1410 con 0x7f71081508a0 2023-11-27T18:45:13.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.761+0000 7f71102a6640 1 -- 172.21.15.91:0/3650004995 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71081e1680 con 0x7f71081508a0 2023-11-27T18:45:13.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.761+0000 7f71102a6640 1 -- 172.21.15.91:0/3650004995 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7108067150 con 0x7f71081508a0 2023-11-27T18:45:13.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:13.969+0000 7f70feffd640 1 -- 172.21.15.91:0/3650004995 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f710000ce10 con 0x7f71081508a0 2023-11-27T18:45:14.012 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.013+0000 7f70feffd640 1 -- 172.21.15.91:0/3650004995 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7100001770 con 0x7f71081508a0 2023-11-27T18:45:14.040 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.041+0000 7f70feffd640 1 -- 172.21.15.91:0/3650004995 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f710000a850 con 0x7f71081508a0 2023-11-27T18:45:14.041 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.041+0000 7f70feffd640 1 --2- 172.21.15.91:0/3650004995 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f70ec066820 0x7f70ec068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:14.041 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.041+0000 7f710e042640 1 --2- 172.21.15.91:0/3650004995 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f70ec066820 0x7f70ec068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:45:14.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.041+0000 7f710e042640 1 --2- 172.21.15.91:0/3650004995 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f70ec066820 0x7f70ec068ce0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f70f80b3000 tx=0x7f70f8004740 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:45:14.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.073+0000 7f70feffd640 1 -- 172.21.15.91:0/3650004995 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7100055fa0 con 0x7f71081508a0 2023-11-27T18:45:14.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.077+0000 7f70feffd640 1 -- 172.21.15.91:0/3650004995 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f7100051be0 con 0x7f71081508a0 2023-11-27T18:45:14.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.241+0000 7f71102a6640 1 -- 172.21.15.91:0/3650004995 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71080c5770 con 0x7f71081508a0 2023-11-27T18:45:14.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.401+0000 7f70feffd640 1 -- 172.21.15.91:0/3650004995 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+18421 (secure 0 0 0) 0x7f7100055200 con 0x7f71081508a0 2023-11-27T18:45:14.403 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T18:45:14.403 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":32,"fsid":"08c8ebbf-7936-4c41-a995-d5600de2d072","created":"2023-11-27T18:12:06.484593+0000","modified":"2023-11-27T18:14:21.835068+0000","last_up_change":"2023-11-27T18:12:33.154694+0000","last_in_change":"2023-11-27T18:12:23.622113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T18:12:35.450305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T18:13:09.589619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T18:13:11.439236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-27T18:13:18.514694+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ad53c08-dd19-4ae6-87c5-fa15bea3b4ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6811","nonce":472303992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6813","nonce":472303992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6817","nonce":472303992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":472303992},{"type":"v1","addr":"172.21.15.91:6815","nonce":472303992}]},"public_addr":"172.21.15.91:6811/472303992","cluster_addr":"172.21.15.91:6813/472303992","heartbeat_back_addr":"172.21.15.91:6817/472303992","heartbeat_front_addr":"172.21.15.91:6815/472303992","state":["exists","up"]},{"osd":1,"uuid":"f8b5f147-ed29-4329-a787-a12cc34a2569","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6827","nonce":12316911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6829","nonce":12316911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6833","nonce":12316911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":12316911},{"type":"v1","addr":"172.21.15.91:6831","nonce":12316911}]},"public_addr":"172.21.15.91:6827/12316911","cluster_addr":"172.21.15.91:6829/12316911","heartbeat_back_addr":"172.21.15.91:6833/12316911","heartbeat_front_addr":"172.21.15.91:6831/12316911","state":["exists","up"]},{"osd":2,"uuid":"c3029f9a-1c48-4f5d-983a-172a614d8795","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6803","nonce":3776125919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6805","nonce":3776125919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6809","nonce":3776125919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3776125919},{"type":"v1","addr":"172.21.15.91:6807","nonce":3776125919}]},"public_addr":"172.21.15.91:6803/3776125919","cluster_addr":"172.21.15.91:6805/3776125919","heartbeat_back_addr":"172.21.15.91:6809/3776125919","heartbeat_front_addr":"172.21.15.91:6807/3776125919","state":["exists","up"]},{"osd":3,"uuid":"ab4b6fb2-0126-491b-9224-54a6badc5da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6819","nonce":1297704794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6821","nonce":1297704794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6825","nonce":1297704794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":1297704794},{"type":"v1","addr":"172.21.15.91:6823","nonce":1297704794}]},"public_addr":"172.21.15.91:6819/1297704794","cluster_addr":"172.21.15.91:6821/1297704794","heartbeat_back_addr":"172.21.15.91:6825/1297704794","heartbeat_front_addr":"172.21.15.91:6823/1297704794","state":["exists","up"]},{"osd":4,"uuid":"695071a8-2de8-4cba-bf20-050021a03bb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6809","nonce":2501531833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6811","nonce":2501531833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6815","nonce":2501531833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2501531833},{"type":"v1","addr":"172.21.15.94:6813","nonce":2501531833}]},"public_addr":"172.21.15.94:6809/2501531833","cluster_addr":"172.21.15.94:6811/2501531833","heartbeat_back_addr":"172.21.15.94:6815/2501531833","heartbeat_front_addr":"172.21.15.94:6813/2501531833","state":["exists","up"]},{"osd":5,"uuid":"ca01da14-a700-4845-8db2-f5e3370677e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6817","nonce":2448969592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6819","nonce":2448969592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6823","nonce":2448969592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2448969592},{"type":"v1","addr":"172.21.15.94:6821","nonce":2448969592}]},"public_addr":"172.21.15.94:6817/2448969592","cluster_addr":"172.21.15.94:6819/2448969592","heartbeat_back_addr":"172.21.15.94:6823/2448969592","heartbeat_front_addr":"172.21.15.94:6821/2448969592","state":["exists","up"]},{"osd":6,"uuid":"4784bc77-6c33-4e47-abba-d37484982f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6825","nonce":3389553935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6827","nonce":3389553935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6831","nonce":3389553935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":3389553935},{"type":"v1","addr":"172.21.15.94:6829","nonce":3389553935}]},"public_addr":"172.21.15.94:6825/3389553935","cluster_addr":"172.21.15.94:6827/3389553935","heartbeat_back_addr":"172.21.15.94:6831/3389553935","heartbeat_front_addr":"172.21.15.94:6829/3389553935","state":["exists","up"]},{"osd":7,"uuid":"b954cf3f-4a4f-4a75-9f90-014f72c16d15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6801","nonce":1606498064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6803","nonce":1606498064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6807","nonce":1606498064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1606498064},{"type":"v1","addr":"172.21.15.94:6805","nonce":1606498064}]},"public_addr":"172.21.15.94:6801/1606498064","cluster_addr":"172.21.15.94:6803/1606498064","heartbeat_back_addr":"172.21.15.94:6807/1606498064","heartbeat_front_addr":"172.21.15.94:6805/1606498064","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.534968+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.506182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.339267+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.532432+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:28.935756+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.471559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.485014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T18:12:29.352978+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":0,"to":7}]},{"pgid":"4.d","mappings":[{"from":3,"to":0}]},{"pgid":"4.1d","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T18:45:14.406 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.405+0000 7f71102a6640 1 -- 172.21.15.91:0/3650004995 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f70ec066820 msgr2=0x7f70ec068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:14.406 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.405+0000 7f71102a6640 1 --2- 172.21.15.91:0/3650004995 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f70ec066820 0x7f70ec068ce0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f70f80b3000 tx=0x7f70f8004740 comp rx=0 tx=0).stop 2023-11-27T18:45:14.406 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.405+0000 7f71102a6640 1 -- 172.21.15.91:0/3650004995 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f71081508a0 msgr2=0x7f7108149a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:14.406 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.405+0000 7f71102a6640 1 --2- 172.21.15.91:0/3650004995 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f71081508a0 0x7f7108149a00 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f710000c760 tx=0x7f710000cc20 comp rx=0 tx=0).stop 2023-11-27T18:45:14.406 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.405+0000 7f71102a6640 1 -- 172.21.15.91:0/3650004995 shutdown_connections 2023-11-27T18:45:14.406 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.405+0000 7f71102a6640 1 --2- 172.21.15.91:0/3650004995 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f70ec066820 0x7f70ec068ce0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:14.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.405+0000 7f71102a6640 1 --2- 172.21.15.91:0/3650004995 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f71081508a0 0x7f7108149a00 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:14.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.405+0000 7f71102a6640 1 --2- 172.21.15.91:0/3650004995 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71081504c0 0x7f71081df810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:14.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.405+0000 7f71102a6640 1 --2- 172.21.15.91:0/3650004995 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f71080c8610 0x7f7108070f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:14.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.405+0000 7f71102a6640 1 -- 172.21.15.91:0/3650004995 >> 172.21.15.91:0/3650004995 conn(0x7f71080c79b0 msgr2=0x7f710806d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:45:14.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.405+0000 7f71102a6640 1 -- 172.21.15.91:0/3650004995 shutdown_connections 2023-11-27T18:45:14.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.405+0000 7f71102a6640 1 -- 172.21.15.91:0/3650004995 wait complete. 2023-11-27T18:45:14.427 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-27T18:45:14.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.545+0000 7fad1517d640 1 Processor -- start 2023-11-27T18:45:14.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.545+0000 7fad1517d640 1 -- start start 2023-11-27T18:45:14.547 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.545+0000 7fad1517d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fad1013f640 0x7fad10072480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:14.547 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.545+0000 7fad1517d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fad1006a520 0x7fad1006a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:14.547 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.545+0000 7fad1517d640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad10156640 con 0x7fad101598e0 2023-11-27T18:45:14.547 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.545+0000 7fad1517d640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad10070ce0 con 0x7fad1006a520 2023-11-27T18:45:14.547 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.545+0000 7fad1517d640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad101562f0 con 0x7fad1013f640 2023-11-27T18:45:14.547 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.545+0000 7fad0f59e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fad1006a520 0x7fad1006a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:45:14.548 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.549+0000 7fad0f59e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fad1006a520 0x7fad1006a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:55394/0 (socket says 172.21.15.91:55394) 2023-11-27T18:45:14.548 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.549+0000 7fad0f59e640 1 -- 172.21.15.91:0/2165062176 learned_addr learned my addr 172.21.15.91:0/2165062176 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:45:14.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.549+0000 7fad0f59e640 1 -- 172.21.15.91:0/2165062176 >> v2:172.21.15.94:3300/0 conn(0x7fad1013f640 msgr2=0x7fad10072480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:45:14.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.549+0000 7fad0f59e640 1 --2- 172.21.15.91:0/2165062176 >> v2:172.21.15.94:3300/0 conn(0x7fad1013f640 0x7fad10072480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:14.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.549+0000 7fad0f59e640 1 -- 172.21.15.91:0/2165062176 >> v1:172.21.15.94:6789/0 conn(0x7fad101598e0 legacy=0x7fad10156ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:45:14.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.549+0000 7fad0f59e640 1 -- 172.21.15.91:0/2165062176 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad10159dd0 con 0x7fad1006a520 2023-11-27T18:45:14.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.553+0000 7fad0f59e640 1 --2- 172.21.15.91:0/2165062176 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fad1006a520 0x7fad1006a990 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fad1006b3d0 tx=0x7fad0801eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=978be5b96500bb1d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:45:14.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.561+0000 7fad0e59c640 1 -- 172.21.15.91:0/2165062176 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0800b2d0 con 0x7fad1006a520 2023-11-27T18:45:14.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.561+0000 7fad0e59c640 1 -- 172.21.15.91:0/2165062176 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fad0800b430 con 0x7fad1006a520 2023-11-27T18:45:14.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.561+0000 7fad0e59c640 1 -- 172.21.15.91:0/2165062176 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad080a7b70 con 0x7fad1006a520 2023-11-27T18:45:14.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.561+0000 7fad1517d640 1 -- 172.21.15.91:0/2165062176 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fad1006a520 msgr2=0x7fad1006a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:14.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.561+0000 7fad1517d640 1 --2- 172.21.15.91:0/2165062176 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fad1006a520 0x7fad1006a990 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fad1006b3d0 tx=0x7fad0801eb60 comp rx=0 tx=0).stop 2023-11-27T18:45:14.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.561+0000 7fad1517d640 1 -- 172.21.15.91:0/2165062176 shutdown_connections 2023-11-27T18:45:14.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.561+0000 7fad1517d640 1 --2- 172.21.15.91:0/2165062176 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fad1006a520 0x7fad1006a990 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:14.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.561+0000 7fad1517d640 1 --2- 172.21.15.91:0/2165062176 >> v2:172.21.15.94:3300/0 conn(0x7fad1013f640 0x7fad10072480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:14.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.561+0000 7fad1517d640 1 -- 172.21.15.91:0/2165062176 >> 172.21.15.91:0/2165062176 conn(0x7fad100ca9d0 msgr2=0x7fad100cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:45:14.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.561+0000 7fad1517d640 1 -- 172.21.15.91:0/2165062176 shutdown_connections 2023-11-27T18:45:14.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.561+0000 7fad1517d640 1 -- 172.21.15.91:0/2165062176 wait complete. 2023-11-27T18:45:14.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.561+0000 7fad1517d640 1 Processor -- start 2023-11-27T18:45:14.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.561+0000 7fad1517d640 1 -- start start 2023-11-27T18:45:14.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.561+0000 7fad1517d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fad1006a520 0x7fad10136db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:14.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.561+0000 7fad1517d640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fad1013f640 0x7fad1015f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:14.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.561+0000 7fad1517d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fad101598e0 0x7fad101f2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:14.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.561+0000 7fad1517d640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad101f24e0 con 0x7fad1006a520 2023-11-27T18:45:14.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.561+0000 7fad1517d640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad10136810 con 0x7fad101598e0 2023-11-27T18:45:14.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.561+0000 7fad1517d640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad10136ab0 con 0x7fad1013f640 2023-11-27T18:45:14.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.561+0000 7fad0ed9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fad1006a520 0x7fad10136db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:45:14.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.565+0000 7fad0ed9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fad1006a520 0x7fad10136db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:55410/0 (socket says 172.21.15.91:55410) 2023-11-27T18:45:14.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.565+0000 7fad0ed9d640 1 -- 172.21.15.91:0/1625862437 learned_addr learned my addr 172.21.15.91:0/1625862437 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:45:14.568 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.569+0000 7fad0ed9d640 1 -- 172.21.15.91:0/1625862437 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fad1013f640 msgr2=0x7fad1015f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:14.568 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.569+0000 7fad0ed9d640 1 --2- 172.21.15.91:0/1625862437 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fad1013f640 0x7fad1015f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:14.568 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.569+0000 7fad0ed9d640 1 -- 172.21.15.91:0/1625862437 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fad101598e0 msgr2=0x7fad101f2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:14.568 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.569+0000 7fad0ed9d640 1 --2- 172.21.15.91:0/1625862437 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fad101598e0 0x7fad101f2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:14.568 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.569+0000 7fad0ed9d640 1 -- 172.21.15.91:0/1625862437 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad0800bd40 con 0x7fad1006a520 2023-11-27T18:45:14.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.569+0000 7fad0ed9d640 1 --2- 172.21.15.91:0/1625862437 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fad1006a520 0x7fad10136db0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7facf800b550 tx=0x7facf800ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:45:14.574 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.573+0000 7fad07fff640 1 -- 172.21.15.91:0/1625862437 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf8011890 con 0x7fad1006a520 2023-11-27T18:45:14.574 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.573+0000 7fad07fff640 1 -- 172.21.15.91:0/1625862437 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7facf8011a10 con 0x7fad1006a520 2023-11-27T18:45:14.574 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.573+0000 7fad1517d640 1 -- 172.21.15.91:0/1625862437 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad100be220 con 0x7fad1006a520 2023-11-27T18:45:14.574 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.573+0000 7fad07fff640 1 -- 172.21.15.91:0/1625862437 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf8011de0 con 0x7fad1006a520 2023-11-27T18:45:14.574 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.573+0000 7fad1517d640 1 -- 172.21.15.91:0/1625862437 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad100be4e0 con 0x7fad1006a520 2023-11-27T18:45:14.574 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.573+0000 7fad1517d640 1 -- 172.21.15.91:0/1625862437 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad1004e850 con 0x7fad1006a520 2023-11-27T18:45:14.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.593+0000 7fad07fff640 1 -- 172.21.15.91:0/1625862437 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7facf801a400 con 0x7fad1006a520 2023-11-27T18:45:14.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.593+0000 7fad07fff640 1 --2- 172.21.15.91:0/1625862437 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7facf0066870 0x7facf0068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:14.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.593+0000 7fad0659c640 1 --2- 172.21.15.91:0/1625862437 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7facf0066870 0x7facf0068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:45:14.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.593+0000 7fad0659c640 1 --2- 172.21.15.91:0/1625862437 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7facf0066870 0x7facf0068d30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fad10132f10 tx=0x7fad00006bb0 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:45:14.596 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.597+0000 7fad07fff640 1 -- 172.21.15.91:0/1625862437 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6547+0+0 (secure 0 0 0) 0x7facf8025e40 con 0x7fad1006a520 2023-11-27T18:45:14.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:14.861+0000 7fad07fff640 1 -- 172.21.15.91:0/1625862437 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7facf8051d50 con 0x7fad1006a520 2023-11-27T18:45:15.054 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.053+0000 7fad1517d640 1 -- 172.21.15.91:0/1625862437 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fad10153d10 con 0x7fad1006a520 2023-11-27T18:45:15.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.409+0000 7fad07fff640 1 -- 172.21.15.91:0/1625862437 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7facf8015070 con 0x7fad1006a520 2023-11-27T18:45:15.408 INFO:teuthology.orchestra.run.smithi091.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-27T18:45:15.411 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.409+0000 7fad1517d640 1 -- 172.21.15.91:0/1625862437 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7facf0066870 msgr2=0x7facf0068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:15.411 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.409+0000 7fad1517d640 1 --2- 172.21.15.91:0/1625862437 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7facf0066870 0x7facf0068d30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fad10132f10 tx=0x7fad00006bb0 comp rx=0 tx=0).stop 2023-11-27T18:45:15.411 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.409+0000 7fad1517d640 1 -- 172.21.15.91:0/1625862437 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fad1006a520 msgr2=0x7fad10136db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:15.411 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.409+0000 7fad1517d640 1 --2- 172.21.15.91:0/1625862437 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fad1006a520 0x7fad10136db0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7facf800b550 tx=0x7facf800ba10 comp rx=0 tx=0).stop 2023-11-27T18:45:15.411 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.409+0000 7fad1517d640 1 -- 172.21.15.91:0/1625862437 shutdown_connections 2023-11-27T18:45:15.411 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.409+0000 7fad1517d640 1 --2- 172.21.15.91:0/1625862437 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7facf0066870 0x7facf0068d30 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:15.411 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.409+0000 7fad1517d640 1 --2- 172.21.15.91:0/1625862437 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fad1013f640 0x7fad1015f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:15.411 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.409+0000 7fad1517d640 1 --2- 172.21.15.91:0/1625862437 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fad101598e0 0x7fad101f2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:15.411 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.409+0000 7fad1517d640 1 --2- 172.21.15.91:0/1625862437 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fad1006a520 0x7fad10136db0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:15.411 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.409+0000 7fad1517d640 1 -- 172.21.15.91:0/1625862437 >> 172.21.15.91:0/1625862437 conn(0x7fad100ca9d0 msgr2=0x7fad10155460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:45:15.411 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.409+0000 7fad1517d640 1 -- 172.21.15.91:0/1625862437 shutdown_connections 2023-11-27T18:45:15.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.409+0000 7fad1517d640 1 -- 172.21.15.91:0/1625862437 wait complete. 2023-11-27T18:45:15.435 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-27T18:45:15.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.561+0000 7f4d7c545640 1 Processor -- start 2023-11-27T18:45:15.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.561+0000 7f4d7c545640 1 -- start start 2023-11-27T18:45:15.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.561+0000 7f4d7c545640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4d7413f640 0x7f4d74072480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:15.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.561+0000 7f4d7c545640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f4d7406a520 0x7f4d7406a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:15.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.561+0000 7f4d7c545640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d74156640 con 0x7f4d741598e0 2023-11-27T18:45:15.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.561+0000 7f4d7c545640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d74070ce0 con 0x7f4d7406a520 2023-11-27T18:45:15.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.561+0000 7f4d7c545640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d741562f0 con 0x7f4d7413f640 2023-11-27T18:45:15.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.565+0000 7f4d7aae2640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f4d7406a520 0x7f4d7406a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:45:15.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.565+0000 7f4d7aae2640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f4d7406a520 0x7f4d7406a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:55422/0 (socket says 172.21.15.91:55422) 2023-11-27T18:45:15.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.565+0000 7f4d7aae2640 1 -- 172.21.15.91:0/2533667845 learned_addr learned my addr 172.21.15.91:0/2533667845 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:45:15.567 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.565+0000 7f4d7aae2640 1 -- 172.21.15.91:0/2533667845 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4d7413f640 msgr2=0x7f4d74072480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:45:15.567 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.565+0000 7f4d7aae2640 1 --2- 172.21.15.91:0/2533667845 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4d7413f640 0x7f4d74072480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:15.567 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.565+0000 7f4d7aae2640 1 -- 172.21.15.91:0/2533667845 >> v1:172.21.15.94:6789/0 conn(0x7f4d741598e0 legacy=0x7f4d74156ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:45:15.568 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.565+0000 7f4d7aae2640 1 -- 172.21.15.91:0/2533667845 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d74159dd0 con 0x7f4d7406a520 2023-11-27T18:45:15.571 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.569+0000 7f4d7aae2640 1 --2- 172.21.15.91:0/2533667845 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d7406a520 0x7f4d7406a9d0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c009e50 tx=0x7f4d6c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bd26e3339399a2c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:45:15.576 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.577+0000 7f4d792df640 1 -- 172.21.15.91:0/2533667845 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c0a5820 con 0x7f4d7406a520 2023-11-27T18:45:15.576 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.577+0000 7f4d792df640 1 -- 172.21.15.91:0/2533667845 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4d6c0a5980 con 0x7f4d7406a520 2023-11-27T18:45:15.576 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.577+0000 7f4d792df640 1 -- 172.21.15.91:0/2533667845 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c0a5d30 con 0x7f4d7406a520 2023-11-27T18:45:15.578 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.577+0000 7f4d7c545640 1 -- 172.21.15.91:0/2533667845 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d7406a520 msgr2=0x7f4d7406a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:15.578 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.577+0000 7f4d7c545640 1 --2- 172.21.15.91:0/2533667845 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d7406a520 0x7f4d7406a9d0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c009e50 tx=0x7f4d6c01c9a0 comp rx=0 tx=0).stop 2023-11-27T18:45:15.578 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.577+0000 7f4d7c545640 1 -- 172.21.15.91:0/2533667845 shutdown_connections 2023-11-27T18:45:15.578 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.577+0000 7f4d7c545640 1 --2- 172.21.15.91:0/2533667845 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d7406a520 0x7f4d7406a9d0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:15.578 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.577+0000 7f4d7c545640 1 --2- 172.21.15.91:0/2533667845 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4d7413f640 0x7f4d74072480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:15.578 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.577+0000 7f4d7c545640 1 -- 172.21.15.91:0/2533667845 >> 172.21.15.91:0/2533667845 conn(0x7f4d740ca9d0 msgr2=0x7f4d740cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:45:15.579 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.577+0000 7f4d7c545640 1 -- 172.21.15.91:0/2533667845 shutdown_connections 2023-11-27T18:45:15.579 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.577+0000 7f4d7c545640 1 -- 172.21.15.91:0/2533667845 wait complete. 2023-11-27T18:45:15.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.577+0000 7f4d7c545640 1 Processor -- start 2023-11-27T18:45:15.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.577+0000 7f4d7c545640 1 -- start start 2023-11-27T18:45:15.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.577+0000 7f4d7c545640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4d7406a520 0x7f4d7415cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:15.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.577+0000 7f4d7c545640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d7413f640 0x7f4d7415b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:15.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.577+0000 7f4d7c545640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4d741598e0 0x7f4d7415bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:15.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.577+0000 7f4d7c545640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7415c1c0 con 0x7f4d7413f640 2023-11-27T18:45:15.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.577+0000 7f4d7c545640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d740c4b00 con 0x7f4d7406a520 2023-11-27T18:45:15.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.577+0000 7f4d7c545640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d741f1f50 con 0x7f4d741598e0 2023-11-27T18:45:15.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.581+0000 7f4d79ae0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d7413f640 0x7f4d7415b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:45:15.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.581+0000 7f4d79ae0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d7413f640 0x7f4d7415b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:55424/0 (socket says 172.21.15.91:55424) 2023-11-27T18:45:15.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.581+0000 7f4d79ae0640 1 -- 172.21.15.91:0/96125584 learned_addr learned my addr 172.21.15.91:0/96125584 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:45:15.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.585+0000 7f4d79ae0640 1 -- 172.21.15.91:0/96125584 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4d741598e0 msgr2=0x7f4d7415bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:15.585 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.585+0000 7f4d79ae0640 1 --2- 172.21.15.91:0/96125584 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4d741598e0 0x7f4d7415bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:15.585 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.585+0000 7f4d79ae0640 1 -- 172.21.15.91:0/96125584 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4d7406a520 msgr2=0x7f4d7415cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:15.585 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.585+0000 7f4d79ae0640 1 --2- 172.21.15.91:0/96125584 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4d7406a520 0x7f4d7415cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:15.585 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.585+0000 7f4d79ae0640 1 -- 172.21.15.91:0/96125584 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d6c009b30 con 0x7f4d7413f640 2023-11-27T18:45:15.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.585+0000 7f4d79ae0640 1 --2- 172.21.15.91:0/96125584 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d7413f640 0x7f4d7415b630 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4d6400c410 tx=0x7f4d6400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:45:15.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.593+0000 7f4d6affd640 1 -- 172.21.15.91:0/96125584 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d64003600 con 0x7f4d7413f640 2023-11-27T18:45:15.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.593+0000 7f4d6affd640 1 -- 172.21.15.91:0/96125584 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4d64003780 con 0x7f4d7413f640 2023-11-27T18:45:15.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.593+0000 7f4d6affd640 1 -- 172.21.15.91:0/96125584 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d64003b50 con 0x7f4d7413f640 2023-11-27T18:45:15.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.593+0000 7f4d7c545640 1 -- 172.21.15.91:0/96125584 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d7415ab10 con 0x7f4d7413f640 2023-11-27T18:45:15.595 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.593+0000 7f4d7c545640 1 -- 172.21.15.91:0/96125584 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d7415b0d0 con 0x7f4d7413f640 2023-11-27T18:45:15.595 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.593+0000 7f4d7c545640 1 -- 172.21.15.91:0/96125584 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d740c1f60 con 0x7f4d7413f640 2023-11-27T18:45:15.891 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.889+0000 7f4d6affd640 1 -- 172.21.15.91:0/96125584 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f4d64003cb0 con 0x7f4d7413f640 2023-11-27T18:45:15.892 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.893+0000 7f4d6affd640 1 --2- 172.21.15.91:0/96125584 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f4d580667f0 0x7f4d58068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:15.892 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.893+0000 7f4d7a2e1640 1 --2- 172.21.15.91:0/96125584 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f4d580667f0 0x7f4d58068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:45:15.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.893+0000 7f4d7a2e1640 1 --2- 172.21.15.91:0/96125584 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f4d580667f0 0x7f4d58068cb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4d70009730 tx=0x7f4d70006ca0 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:45:15.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.921+0000 7f4d6affd640 1 -- 172.21.15.91:0/96125584 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4d640010f0 con 0x7f4d7413f640 2023-11-27T18:45:15.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:15.921+0000 7f4d6affd640 1 -- 172.21.15.91:0/96125584 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f4d64050b30 con 0x7f4d7413f640 2023-11-27T18:45:16.125 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:16.125+0000 7f4d7c545640 1 -- 172.21.15.91:0/96125584 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4d7404e850 con 0x7f4d7413f640 2023-11-27T18:45:17.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.205+0000 7f4d6affd640 1 -- 172.21.15.91:0/96125584 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4d64017020 con 0x7f4d7413f640 2023-11-27T18:45:17.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.213+0000 7f4d7c545640 1 -- 172.21.15.91:0/96125584 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f4d580667f0 msgr2=0x7f4d58068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:17.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.213+0000 7f4d7c545640 1 --2- 172.21.15.91:0/96125584 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f4d580667f0 0x7f4d58068cb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4d70009730 tx=0x7f4d70006ca0 comp rx=0 tx=0).stop 2023-11-27T18:45:17.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.213+0000 7f4d7c545640 1 -- 172.21.15.91:0/96125584 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d7413f640 msgr2=0x7f4d7415b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:17.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.213+0000 7f4d7c545640 1 --2- 172.21.15.91:0/96125584 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d7413f640 0x7f4d7415b630 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4d6400c410 tx=0x7f4d6400c8d0 comp rx=0 tx=0).stop 2023-11-27T18:45:17.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.213+0000 7f4d7c545640 1 -- 172.21.15.91:0/96125584 shutdown_connections 2023-11-27T18:45:17.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.213+0000 7f4d7c545640 1 --2- 172.21.15.91:0/96125584 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f4d580667f0 0x7f4d58068cb0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:17.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.213+0000 7f4d7c545640 1 --2- 172.21.15.91:0/96125584 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4d741598e0 0x7f4d7415bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:17.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.213+0000 7f4d7c545640 1 --2- 172.21.15.91:0/96125584 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d7413f640 0x7f4d7415b630 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:17.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.213+0000 7f4d7c545640 1 --2- 172.21.15.91:0/96125584 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4d7406a520 0x7f4d7415cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:17.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.213+0000 7f4d7c545640 1 -- 172.21.15.91:0/96125584 >> 172.21.15.91:0/96125584 conn(0x7f4d740ca9d0 msgr2=0x7f4d741554e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:45:17.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.213+0000 7f4d7c545640 1 -- 172.21.15.91:0/96125584 shutdown_connections 2023-11-27T18:45:17.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.213+0000 7f4d7c545640 1 -- 172.21.15.91:0/96125584 wait complete. 2023-11-27T18:45:17.236 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-27T18:45:17.365 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.365+0000 7f5ecbda9640 1 Processor -- start 2023-11-27T18:45:17.365 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.365+0000 7f5ecbda9640 1 -- start start 2023-11-27T18:45:17.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.365+0000 7f5ecbda9640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5ec40cc1a0 0x7f5ec40c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:17.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.365+0000 7f5ecbda9640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f5ec40c6b30 0x7f5ec414fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:17.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.365+0000 7f5ecbda9640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ec415a600 con 0x7f5ec40cbdc0 2023-11-27T18:45:17.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.365+0000 7f5ecbda9640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ec40b2100 con 0x7f5ec40c6b30 2023-11-27T18:45:17.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.365+0000 7f5ecbda9640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec40c1270 con 0x7f5ec40cc1a0 2023-11-27T18:45:17.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.365+0000 7f5ec9344640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5ec40cc1a0 0x7f5ec40c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:45:17.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.365+0000 7f5eca346640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f5ec40c6b30 0x7f5ec414fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:45:17.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.369+0000 7f5ec9344640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5ec40cc1a0 0x7f5ec40c65f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.91:36222/0 (socket says 172.21.15.91:36222) 2023-11-27T18:45:17.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.369+0000 7f5ec9344640 1 -- 172.21.15.91:0/2502954327 learned_addr learned my addr 172.21.15.91:0/2502954327 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:45:17.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.377+0000 7f5ec9344640 1 -- 172.21.15.91:0/2502954327 >> v2:172.21.15.94:3300/0 conn(0x7f5ec40c6b30 msgr2=0x7f5ec414fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:45:17.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.377+0000 7f5ec9344640 1 --2- 172.21.15.91:0/2502954327 >> v2:172.21.15.94:3300/0 conn(0x7f5ec40c6b30 0x7f5ec414fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:17.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.377+0000 7f5ec9344640 1 -- 172.21.15.91:0/2502954327 >> v1:172.21.15.94:6789/0 conn(0x7f5ec40cbdc0 legacy=0x7f5ec4159ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:45:17.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.377+0000 7f5ec9344640 1 -- 172.21.15.91:0/2502954327 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec40c1550 con 0x7f5ec40cc1a0 2023-11-27T18:45:17.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.385+0000 7f5ec9344640 1 --2- 172.21.15.91:0/2502954327 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5ec40cc1a0 0x7f5ec40c65f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5eb4009e50 tx=0x7f5eb401f1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=855f6fc463c9ef01 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:45:17.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.393+0000 7f5ec8b43640 1 -- 172.21.15.91:0/2502954327 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb40af400 con 0x7f5ec40cc1a0 2023-11-27T18:45:17.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.393+0000 7f5ec8b43640 1 -- 172.21.15.91:0/2502954327 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5eb40ab050 con 0x7f5ec40cc1a0 2023-11-27T18:45:17.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.393+0000 7f5ec8b43640 1 -- 172.21.15.91:0/2502954327 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb40af7a0 con 0x7f5ec40cc1a0 2023-11-27T18:45:17.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.393+0000 7f5ecbda9640 1 -- 172.21.15.91:0/2502954327 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5ec40cc1a0 msgr2=0x7f5ec40c65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:17.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.393+0000 7f5ecbda9640 1 --2- 172.21.15.91:0/2502954327 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5ec40cc1a0 0x7f5ec40c65f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5eb4009e50 tx=0x7f5eb401f1c0 comp rx=0 tx=0).stop 2023-11-27T18:45:17.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.393+0000 7f5ecbda9640 1 -- 172.21.15.91:0/2502954327 shutdown_connections 2023-11-27T18:45:17.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.393+0000 7f5ecbda9640 1 --2- 172.21.15.91:0/2502954327 >> v2:172.21.15.94:3300/0 conn(0x7f5ec40c6b30 0x7f5ec414fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:17.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.393+0000 7f5ecbda9640 1 --2- 172.21.15.91:0/2502954327 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5ec40cc1a0 0x7f5ec40c65f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:17.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.393+0000 7f5ecbda9640 1 -- 172.21.15.91:0/2502954327 >> 172.21.15.91:0/2502954327 conn(0x7f5ec4066990 msgr2=0x7f5ec4071e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:45:17.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.393+0000 7f5ecbda9640 1 -- 172.21.15.91:0/2502954327 shutdown_connections 2023-11-27T18:45:17.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.393+0000 7f5ecbda9640 1 -- 172.21.15.91:0/2502954327 wait complete. 2023-11-27T18:45:17.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.393+0000 7f5ecbda9640 1 Processor -- start 2023-11-27T18:45:17.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.393+0000 7f5ecbda9640 1 -- start start 2023-11-27T18:45:17.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.397+0000 7f5ecbda9640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5ec40c6b30 0x7f5ec41ef770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:17.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.397+0000 7f5ecbda9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5ec40cbdc0 0x7f5ec4153e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:17.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.397+0000 7f5ecbda9640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5ec4155230 0x7f5ec40cac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:17.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.397+0000 7f5ecbda9640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec41efcb0 con 0x7f5ec40c6b30 2023-11-27T18:45:17.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.397+0000 7f5ecbda9640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec41eed20 con 0x7f5ec40cbdc0 2023-11-27T18:45:17.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.397+0000 7f5ecbda9640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec4155be0 con 0x7f5ec4155230 2023-11-27T18:45:17.397 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.397+0000 7f5ec9b45640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5ec40c6b30 0x7f5ec41ef770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:45:17.397 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.397+0000 7f5ec9344640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5ec40cbdc0 0x7f5ec4153e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:45:17.397 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.397+0000 7f5ec9b45640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5ec40c6b30 0x7f5ec41ef770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:53746/0 (socket says 172.21.15.91:53746) 2023-11-27T18:45:17.397 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.397+0000 7f5ec9b45640 1 -- 172.21.15.91:0/244411660 learned_addr learned my addr 172.21.15.91:0/244411660 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:45:17.398 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.397+0000 7f5eca346640 1 --2- 172.21.15.91:0/244411660 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5ec4155230 0x7f5ec40cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:45:17.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.401+0000 7f5ec9b45640 1 -- 172.21.15.91:0/244411660 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5ec4155230 msgr2=0x7f5ec40cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:17.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.401+0000 7f5ec9b45640 1 --2- 172.21.15.91:0/244411660 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5ec4155230 0x7f5ec40cac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:17.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.401+0000 7f5ec9b45640 1 -- 172.21.15.91:0/244411660 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5ec40cbdc0 msgr2=0x7f5ec4153e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:17.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.401+0000 7f5ec9b45640 1 --2- 172.21.15.91:0/244411660 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5ec40cbdc0 0x7f5ec4153e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:17.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.401+0000 7f5ec9b45640 1 -- 172.21.15.91:0/244411660 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb4009b30 con 0x7f5ec40c6b30 2023-11-27T18:45:17.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.401+0000 7f5ec9b45640 1 --2- 172.21.15.91:0/244411660 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5ec40c6b30 0x7f5ec41ef770 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5eac00b410 tx=0x7f5eac00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:45:17.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.405+0000 7f5ec27fc640 1 -- 172.21.15.91:0/244411660 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eac004020 con 0x7f5ec40c6b30 2023-11-27T18:45:17.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.405+0000 7f5ec27fc640 1 -- 172.21.15.91:0/244411660 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5eac004180 con 0x7f5ec40c6b30 2023-11-27T18:45:17.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.405+0000 7f5ec27fc640 1 -- 172.21.15.91:0/244411660 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eac011630 con 0x7f5ec40c6b30 2023-11-27T18:45:17.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.405+0000 7f5ecbda9640 1 -- 172.21.15.91:0/244411660 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ec40cb820 con 0x7f5ec40c6b30 2023-11-27T18:45:17.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.409+0000 7f5ecbda9640 1 -- 172.21.15.91:0/244411660 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ec4156160 con 0x7f5ec40c6b30 2023-11-27T18:45:17.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.409+0000 7f5ecbda9640 1 -- 172.21.15.91:0/244411660 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ec404e8c0 con 0x7f5ec40c6b30 2023-11-27T18:45:17.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.433+0000 7f5ec27fc640 1 -- 172.21.15.91:0/244411660 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f5eac011790 con 0x7f5ec40c6b30 2023-11-27T18:45:17.433 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.433+0000 7f5ec27fc640 1 --2- 172.21.15.91:0/244411660 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f5ea40667f0 0x7f5ea4068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:17.433 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.433+0000 7f5ec9344640 1 --2- 172.21.15.91:0/244411660 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f5ea40667f0 0x7f5ea4068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:45:17.433 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.433+0000 7f5ec9344640 1 --2- 172.21.15.91:0/244411660 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f5ea40667f0 0x7f5ea4068cb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5eb40b1000 tx=0x7f5eb40aa000 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:45:17.437 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.437+0000 7f5ec27fc640 1 -- 172.21.15.91:0/244411660 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f5eac0555b0 con 0x7f5ec40c6b30 2023-11-27T18:45:17.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.713+0000 7f5ec27fc640 1 -- 172.21.15.91:0/244411660 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f5eac051860 con 0x7f5ec40c6b30 2023-11-27T18:45:17.886 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:17.885+0000 7f5ecbda9640 1 -- 172.21.15.91:0/244411660 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5ec414f430 con 0x7f5ec40c6b30 2023-11-27T18:45:18.732 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-11-27T18:45:19.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.293+0000 7f5ec27fc640 1 -- 172.21.15.91:0/244411660 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v34) v1 ==== 181+0+0 (secure 0 0 0) 0x7f5eac015070 con 0x7f5ec40c6b30 2023-11-27T18:45:19.295 INFO:teuthology.orchestra.run.smithi091.stderr:pool 'cephfs_metadata' removed 2023-11-27T18:45:19.297 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.297+0000 7f5ecbda9640 1 -- 172.21.15.91:0/244411660 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f5ea40667f0 msgr2=0x7f5ea4068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:19.297 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.297+0000 7f5ecbda9640 1 --2- 172.21.15.91:0/244411660 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f5ea40667f0 0x7f5ea4068cb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5eb40b1000 tx=0x7f5eb40aa000 comp rx=0 tx=0).stop 2023-11-27T18:45:19.297 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.297+0000 7f5ecbda9640 1 -- 172.21.15.91:0/244411660 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5ec40c6b30 msgr2=0x7f5ec41ef770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:19.297 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.297+0000 7f5ecbda9640 1 --2- 172.21.15.91:0/244411660 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5ec40c6b30 0x7f5ec41ef770 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5eac00b410 tx=0x7f5eac00b8d0 comp rx=0 tx=0).stop 2023-11-27T18:45:19.298 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.297+0000 7f5ecbda9640 1 -- 172.21.15.91:0/244411660 shutdown_connections 2023-11-27T18:45:19.298 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.297+0000 7f5ecbda9640 1 --2- 172.21.15.91:0/244411660 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f5ea40667f0 0x7f5ea4068cb0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:19.298 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.297+0000 7f5ecbda9640 1 --2- 172.21.15.91:0/244411660 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5ec4155230 0x7f5ec40cac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:19.298 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.297+0000 7f5ecbda9640 1 --2- 172.21.15.91:0/244411660 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5ec40cbdc0 0x7f5ec4153e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:19.298 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.297+0000 7f5ecbda9640 1 --2- 172.21.15.91:0/244411660 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5ec40c6b30 0x7f5ec41ef770 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:19.298 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.297+0000 7f5ecbda9640 1 -- 172.21.15.91:0/244411660 >> 172.21.15.91:0/244411660 conn(0x7f5ec4066990 msgr2=0x7f5ec414d800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:45:19.298 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.297+0000 7f5ecbda9640 1 -- 172.21.15.91:0/244411660 shutdown_connections 2023-11-27T18:45:19.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.297+0000 7f5ecbda9640 1 -- 172.21.15.91:0/244411660 wait complete. 2023-11-27T18:45:19.323 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-27T18:45:19.454 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.453+0000 7f5a2fe6f640 1 Processor -- start 2023-11-27T18:45:19.454 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.453+0000 7f5a2fe6f640 1 -- start start 2023-11-27T18:45:19.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.453+0000 7f5a2fe6f640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f5a28151800 0x7f5a280b19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:19.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.453+0000 7f5a2fe6f640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5a280c7a90 0x7f5a280c8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:19.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.453+0000 7f5a2fe6f640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a280b1f30 con 0x7f5a2815a8a0 2023-11-27T18:45:19.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.453+0000 7f5a2fe6f640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a280c3b00 con 0x7f5a28151800 2023-11-27T18:45:19.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.453+0000 7f5a2fe6f640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a28070570 con 0x7f5a280c7a90 2023-11-27T18:45:19.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.453+0000 7f5a2dc0b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f5a28151800 0x7f5a280b19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:45:19.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.457+0000 7f5a2dc0b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f5a28151800 0x7f5a280b19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:53752/0 (socket says 172.21.15.91:53752) 2023-11-27T18:45:19.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.457+0000 7f5a2dc0b640 1 -- 172.21.15.91:0/3097840049 learned_addr learned my addr 172.21.15.91:0/3097840049 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:45:19.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.457+0000 7f5a2e40c640 1 --2- 172.21.15.91:0/3097840049 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5a280c7a90 0x7f5a280c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:45:19.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.457+0000 7f5a2dc0b640 1 -- 172.21.15.91:0/3097840049 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5a280c7a90 msgr2=0x7f5a280c8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:45:19.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.457+0000 7f5a2dc0b640 1 --2- 172.21.15.91:0/3097840049 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5a280c7a90 0x7f5a280c8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:19.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.457+0000 7f5a2dc0b640 1 -- 172.21.15.91:0/3097840049 >> v1:172.21.15.94:6789/0 conn(0x7f5a2815a8a0 legacy=0x7f5a2806fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:19.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.457+0000 7f5a2dc0b640 1 -- 172.21.15.91:0/3097840049 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a2815ad90 con 0x7f5a28151800 2023-11-27T18:45:19.462 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.461+0000 7f5a2dc0b640 1 --2- 172.21.15.91:0/3097840049 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5a28151800 0x7f5a280b19f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5a24009870 tx=0x7f5a2401ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=353dd7f20961fbdd server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:45:19.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.465+0000 7f5a2cc09640 1 -- 172.21.15.91:0/3097840049 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a240a8a30 con 0x7f5a28151800 2023-11-27T18:45:19.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.465+0000 7f5a2cc09640 1 -- 172.21.15.91:0/3097840049 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5a240a8b90 con 0x7f5a28151800 2023-11-27T18:45:19.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.465+0000 7f5a2cc09640 1 -- 172.21.15.91:0/3097840049 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a240b0440 con 0x7f5a28151800 2023-11-27T18:45:19.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.465+0000 7f5a2fe6f640 1 -- 172.21.15.91:0/3097840049 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5a28151800 msgr2=0x7f5a280b19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:19.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.465+0000 7f5a2fe6f640 1 --2- 172.21.15.91:0/3097840049 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5a28151800 0x7f5a280b19f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5a24009870 tx=0x7f5a2401ed30 comp rx=0 tx=0).stop 2023-11-27T18:45:19.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.465+0000 7f5a2fe6f640 1 -- 172.21.15.91:0/3097840049 shutdown_connections 2023-11-27T18:45:19.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.465+0000 7f5a2fe6f640 1 --2- 172.21.15.91:0/3097840049 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5a280c7a90 0x7f5a280c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:19.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.465+0000 7f5a2fe6f640 1 --2- 172.21.15.91:0/3097840049 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5a28151800 0x7f5a280b19f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:19.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.465+0000 7f5a2fe6f640 1 -- 172.21.15.91:0/3097840049 >> 172.21.15.91:0/3097840049 conn(0x7f5a28071e80 msgr2=0x7f5a28072290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:45:19.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.465+0000 7f5a2fe6f640 1 -- 172.21.15.91:0/3097840049 shutdown_connections 2023-11-27T18:45:19.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.465+0000 7f5a2fe6f640 1 -- 172.21.15.91:0/3097840049 wait complete. 2023-11-27T18:45:19.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.469+0000 7f5a2fe6f640 1 Processor -- start 2023-11-27T18:45:19.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.469+0000 7f5a2fe6f640 1 -- start start 2023-11-27T18:45:19.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.469+0000 7f5a2fe6f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5a280c7a90 0x7f5a2815a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:19.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.469+0000 7f5a2fe6f640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5a28151800 0x7f5a281f0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:19.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.469+0000 7f5a2fe6f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5a2815a8a0 0x7f5a28159a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:19.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.469+0000 7f5a2fe6f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2814a770 con 0x7f5a2815a8a0 2023-11-27T18:45:19.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.469+0000 7f5a2fe6f640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2814acf0 con 0x7f5a280c7a90 2023-11-27T18:45:19.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.469+0000 7f5a2fe6f640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a280c6c60 con 0x7f5a28151800 2023-11-27T18:45:19.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.469+0000 7f5a2e40c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5a2815a8a0 0x7f5a28159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:45:19.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.469+0000 7f5a2e40c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5a2815a8a0 0x7f5a28159a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:53766/0 (socket says 172.21.15.91:53766) 2023-11-27T18:45:19.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.469+0000 7f5a2e40c640 1 -- 172.21.15.91:0/2242156039 learned_addr learned my addr 172.21.15.91:0/2242156039 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:45:19.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.469+0000 7f5a2dc0b640 1 --2- 172.21.15.91:0/2242156039 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5a280c7a90 0x7f5a2815a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:45:19.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.469+0000 7f5a2d40a640 1 --2- 172.21.15.91:0/2242156039 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5a28151800 0x7f5a281f0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:45:19.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.473+0000 7f5a2e40c640 1 -- 172.21.15.91:0/2242156039 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5a28151800 msgr2=0x7f5a281f0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:19.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.473+0000 7f5a2e40c640 1 --2- 172.21.15.91:0/2242156039 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5a28151800 0x7f5a281f0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:19.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.473+0000 7f5a2e40c640 1 -- 172.21.15.91:0/2242156039 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5a280c7a90 msgr2=0x7f5a2815a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:19.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.473+0000 7f5a2e40c640 1 --2- 172.21.15.91:0/2242156039 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5a280c7a90 0x7f5a2815a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:19.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.473+0000 7f5a2e40c640 1 -- 172.21.15.91:0/2242156039 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a240094d0 con 0x7f5a2815a8a0 2023-11-27T18:45:19.476 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.477+0000 7f5a2e40c640 1 --2- 172.21.15.91:0/2242156039 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5a2815a8a0 0x7f5a28159a60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5a20007e40 tx=0x7f5a2000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:45:19.480 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.481+0000 7f5a1e7fc640 1 -- 172.21.15.91:0/2242156039 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a20014620 con 0x7f5a2815a8a0 2023-11-27T18:45:19.480 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.481+0000 7f5a1e7fc640 1 -- 172.21.15.91:0/2242156039 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5a2000ee90 con 0x7f5a2815a8a0 2023-11-27T18:45:19.480 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.481+0000 7f5a1e7fc640 1 -- 172.21.15.91:0/2242156039 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a20014a00 con 0x7f5a2815a8a0 2023-11-27T18:45:19.481 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.481+0000 7f5a2fe6f640 1 -- 172.21.15.91:0/2242156039 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a281496a0 con 0x7f5a2815a8a0 2023-11-27T18:45:19.481 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.481+0000 7f5a2fe6f640 1 -- 172.21.15.91:0/2242156039 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a28149c60 con 0x7f5a2815a8a0 2023-11-27T18:45:19.481 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.481+0000 7f5a2fe6f640 1 -- 172.21.15.91:0/2242156039 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a2806f640 con 0x7f5a2815a8a0 2023-11-27T18:45:19.500 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.501+0000 7f5a1e7fc640 1 -- 172.21.15.91:0/2242156039 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f5a20014b60 con 0x7f5a2815a8a0 2023-11-27T18:45:19.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.501+0000 7f5a1e7fc640 1 --2- 172.21.15.91:0/2242156039 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f5a0c066840 0x7f5a0c068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:19.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.501+0000 7f5a2dc0b640 1 --2- 172.21.15.91:0/2242156039 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f5a0c066840 0x7f5a0c068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:45:19.502 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.501+0000 7f5a2dc0b640 1 --2- 172.21.15.91:0/2242156039 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f5a0c066840 0x7f5a0c068d00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5a240b2000 tx=0x7f5a24009040 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:45:19.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.749+0000 7f5a1e7fc640 1 -- 172.21.15.91:0/2242156039 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6195+0+0 (secure 0 0 0) 0x7f5a200566c0 con 0x7f5a2815a8a0 2023-11-27T18:45:19.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.749+0000 7f5a1e7fc640 1 -- 172.21.15.91:0/2242156039 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f5a20052a00 con 0x7f5a2815a8a0 2023-11-27T18:45:19.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:19.909+0000 7f5a2fe6f640 1 -- 172.21.15.91:0/2242156039 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5a2806f640 con 0x7f5a2815a8a0 2023-11-27T18:45:20.577 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.577+0000 7f5a1e7fc640 1 -- 172.21.15.91:0/2242156039 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v35) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5a2806f640 con 0x7f5a2815a8a0 2023-11-27T18:45:20.577 INFO:teuthology.orchestra.run.smithi091.stderr:pool 'cephfs_data' removed 2023-11-27T18:45:20.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.581+0000 7f5a2fe6f640 1 -- 172.21.15.91:0/2242156039 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f5a0c066840 msgr2=0x7f5a0c068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:20.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.581+0000 7f5a2fe6f640 1 --2- 172.21.15.91:0/2242156039 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f5a0c066840 0x7f5a0c068d00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5a240b2000 tx=0x7f5a24009040 comp rx=0 tx=0).stop 2023-11-27T18:45:20.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.581+0000 7f5a2fe6f640 1 -- 172.21.15.91:0/2242156039 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5a2815a8a0 msgr2=0x7f5a28159a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:20.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.581+0000 7f5a2fe6f640 1 --2- 172.21.15.91:0/2242156039 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5a2815a8a0 0x7f5a28159a60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5a20007e40 tx=0x7f5a2000e4b0 comp rx=0 tx=0).stop 2023-11-27T18:45:20.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.581+0000 7f5a2fe6f640 1 -- 172.21.15.91:0/2242156039 shutdown_connections 2023-11-27T18:45:20.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.581+0000 7f5a2fe6f640 1 --2- 172.21.15.91:0/2242156039 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7f5a0c066840 0x7f5a0c068d00 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:20.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.581+0000 7f5a2fe6f640 1 --2- 172.21.15.91:0/2242156039 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5a28151800 0x7f5a281f0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:20.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.581+0000 7f5a2fe6f640 1 --2- 172.21.15.91:0/2242156039 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5a2815a8a0 0x7f5a28159a60 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:20.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.581+0000 7f5a2fe6f640 1 --2- 172.21.15.91:0/2242156039 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5a280c7a90 0x7f5a2815a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:20.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.581+0000 7f5a2fe6f640 1 -- 172.21.15.91:0/2242156039 >> 172.21.15.91:0/2242156039 conn(0x7f5a28071e80 msgr2=0x7f5a28150630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:45:20.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.581+0000 7f5a2fe6f640 1 -- 172.21.15.91:0/2242156039 shutdown_connections 2023-11-27T18:45:20.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.581+0000 7f5a2fe6f640 1 -- 172.21.15.91:0/2242156039 wait complete. 2023-11-27T18:45:20.612 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-11-27T18:45:20.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.741+0000 7fb0487fc640 1 Processor -- start 2023-11-27T18:45:20.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.741+0000 7fb0487fc640 1 -- start start 2023-11-27T18:45:20.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.741+0000 7fb0487fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb0401578c0 0x7fb040157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:20.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.741+0000 7fb0487fc640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb0400c9260 0x7fb0400c96d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:20.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.741+0000 7fb0487fc640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb04006fe30 con 0x7fb0401515f0 2023-11-27T18:45:20.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.741+0000 7fb0487fc640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0401573c0 con 0x7fb0401578c0 2023-11-27T18:45:20.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.741+0000 7fb0487fc640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb04015b4d0 con 0x7fb0400c9260 2023-11-27T18:45:20.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.741+0000 7fb046598640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fb0401515f0 0x7fb0400c76c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:37166/0 (socket says 172.21.15.91:37166) 2023-11-27T18:45:20.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.741+0000 7fb046598640 1 -- 172.21.15.91:0/787955654 learned_addr learned my addr 172.21.15.91:0/787955654 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T18:45:20.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.741+0000 7fb046d99640 1 --2- 172.21.15.91:0/787955654 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb0400c9260 0x7fb0400c96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:45:20.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.745+0000 7fb045d97640 1 --2- 172.21.15.91:0/787955654 >> v2:172.21.15.91:3300/0 conn(0x7fb0401578c0 0x7fb040157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:45:20.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.745+0000 7fb045596640 1 -- 172.21.15.91:0/787955654 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1134433811 0 0) 0x7fb04006fe30 con 0x7fb0401515f0 2023-11-27T18:45:20.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.745+0000 7fb045596640 1 -- 172.21.15.91:0/787955654 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb02c003530 con 0x7fb0401515f0 2023-11-27T18:45:20.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.749+0000 7fb045d97640 1 -- 172.21.15.91:0/787955654 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb0400c9260 msgr2=0x7fb0400c96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T18:45:20.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.749+0000 7fb045d97640 1 --2- 172.21.15.91:0/787955654 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb0400c9260 0x7fb0400c96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:20.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.749+0000 7fb045d97640 1 -- 172.21.15.91:0/787955654 >> v1:172.21.15.91:6789/0 conn(0x7fb0401515f0 legacy=0x7fb0400c76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:20.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.749+0000 7fb045d97640 1 -- 172.21.15.91:0/787955654 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb04015b7b0 con 0x7fb0401578c0 2023-11-27T18:45:20.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.753+0000 7fb045d97640 1 --2- 172.21.15.91:0/787955654 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb0401578c0 0x7fb040157cc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb03c0097c0 tx=0x7fb03c01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd8959fc92c45056 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:45:20.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.757+0000 7fb045596640 1 -- 172.21.15.91:0/787955654 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03c0a8970 con 0x7fb0401578c0 2023-11-27T18:45:20.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.757+0000 7fb045596640 1 -- 172.21.15.91:0/787955654 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb03c0a8ad0 con 0x7fb0401578c0 2023-11-27T18:45:20.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.757+0000 7fb045596640 1 -- 172.21.15.91:0/787955654 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03c0a8e80 con 0x7fb0401578c0 2023-11-27T18:45:20.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.757+0000 7fb0487fc640 1 -- 172.21.15.91:0/787955654 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb0401578c0 msgr2=0x7fb040157cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:20.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.757+0000 7fb0487fc640 1 --2- 172.21.15.91:0/787955654 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb0401578c0 0x7fb040157cc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb03c0097c0 tx=0x7fb03c01ec70 comp rx=0 tx=0).stop 2023-11-27T18:45:20.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.757+0000 7fb0487fc640 1 -- 172.21.15.91:0/787955654 shutdown_connections 2023-11-27T18:45:20.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.757+0000 7fb0487fc640 1 --2- 172.21.15.91:0/787955654 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb0400c9260 0x7fb0400c96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:20.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.757+0000 7fb0487fc640 1 --2- 172.21.15.91:0/787955654 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb0401578c0 0x7fb040157cc0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:20.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.757+0000 7fb0487fc640 1 -- 172.21.15.91:0/787955654 >> 172.21.15.91:0/787955654 conn(0x7fb04006abb0 msgr2=0x7fb040070a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:45:20.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.757+0000 7fb0487fc640 1 -- 172.21.15.91:0/787955654 shutdown_connections 2023-11-27T18:45:20.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.757+0000 7fb0487fc640 1 -- 172.21.15.91:0/787955654 wait complete. 2023-11-27T18:45:20.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.757+0000 7fb0487fc640 1 Processor -- start 2023-11-27T18:45:20.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.757+0000 7fb0487fc640 1 -- start start 2023-11-27T18:45:20.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.757+0000 7fb0487fc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb0400c9260 0x7fb040153e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:20.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.757+0000 7fb0487fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb0401515f0 0x7fb040152af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:20.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.757+0000 7fb0487fc640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb0401578c0 0x7fb040159f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:20.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.757+0000 7fb0487fc640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0401f03a0 con 0x7fb0400c9260 2023-11-27T18:45:20.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.757+0000 7fb0487fc640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb040153030 con 0x7fb0401515f0 2023-11-27T18:45:20.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.757+0000 7fb0487fc640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0401f0050 con 0x7fb0401578c0 2023-11-27T18:45:20.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.761+0000 7fb046598640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb0400c9260 0x7fb040153e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:45:20.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.761+0000 7fb046598640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb0400c9260 0x7fb040153e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:53774/0 (socket says 172.21.15.91:53774) 2023-11-27T18:45:20.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.761+0000 7fb046598640 1 -- 172.21.15.91:0/510228401 learned_addr learned my addr 172.21.15.91:0/510228401 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T18:45:20.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.761+0000 7fb046d99640 1 --2- 172.21.15.91:0/510228401 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb0401578c0 0x7fb040159f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:45:20.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.761+0000 7fb045d97640 1 --2- 172.21.15.91:0/510228401 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb0401515f0 0x7fb040152af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:45:20.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.765+0000 7fb046598640 1 -- 172.21.15.91:0/510228401 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb0401578c0 msgr2=0x7fb040159f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:20.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.765+0000 7fb046598640 1 --2- 172.21.15.91:0/510228401 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb0401578c0 0x7fb040159f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:20.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.765+0000 7fb046598640 1 -- 172.21.15.91:0/510228401 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb0401515f0 msgr2=0x7fb040152af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:20.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.765+0000 7fb046598640 1 --2- 172.21.15.91:0/510228401 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb0401515f0 0x7fb040152af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:20.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.765+0000 7fb046598640 1 -- 172.21.15.91:0/510228401 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb03c009420 con 0x7fb0400c9260 2023-11-27T18:45:20.766 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.765+0000 7fb046598640 1 --2- 172.21.15.91:0/510228401 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb0400c9260 0x7fb040153e00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb03400c480 tx=0x7fb03400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:45:20.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.769+0000 7fb032ffd640 1 -- 172.21.15.91:0/510228401 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb034005cf0 con 0x7fb0400c9260 2023-11-27T18:45:20.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.769+0000 7fb032ffd640 1 -- 172.21.15.91:0/510228401 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb034005e50 con 0x7fb0400c9260 2023-11-27T18:45:20.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.769+0000 7fb032ffd640 1 -- 172.21.15.91:0/510228401 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0340072b0 con 0x7fb0400c9260 2023-11-27T18:45:20.771 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.769+0000 7fb0487fc640 1 -- 172.21.15.91:0/510228401 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb040150400 con 0x7fb0400c9260 2023-11-27T18:45:20.771 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.769+0000 7fb0487fc640 1 -- 172.21.15.91:0/510228401 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0401509a0 con 0x7fb0400c9260 2023-11-27T18:45:20.771 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.769+0000 7fb0487fc640 1 -- 172.21.15.91:0/510228401 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0401f04e0 con 0x7fb0400c9260 2023-11-27T18:45:20.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.789+0000 7fb032ffd640 1 -- 172.21.15.91:0/510228401 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 7) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fb034007410 con 0x7fb0400c9260 2023-11-27T18:45:20.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.789+0000 7fb032ffd640 1 --2- 172.21.15.91:0/510228401 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fb024066870 0x7fb024068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T18:45:20.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.789+0000 7fb045d97640 1 --2- 172.21.15.91:0/510228401 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fb024066870 0x7fb024068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T18:45:20.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:20.789+0000 7fb045d97640 1 --2- 172.21.15.91:0/510228401 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fb024066870 0x7fb024068d30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb03c0b2000 tx=0x7fb03c0aa070 comp rx=0 tx=0).ready entity=mgr.4136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T18:45:21.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:21.073+0000 7fb032ffd640 1 -- 172.21.15.91:0/510228401 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5752+0+0 (secure 0 0 0) 0x7fb0340549d0 con 0x7fb0400c9260 2023-11-27T18:45:21.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:21.073+0000 7fb032ffd640 1 -- 172.21.15.91:0/510228401 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fb034050d10 con 0x7fb0400c9260 2023-11-27T18:45:21.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:21.241+0000 7fb0487fc640 1 -- 172.21.15.91:0/510228401 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb0401f04e0 con 0x7fb0400c9260 2023-11-27T18:45:21.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:21.817+0000 7fb032ffd640 1 -- 172.21.15.91:0/510228401 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v36) v1 ==== 178+0+0 (secure 0 0 0) 0x7fb0401f04e0 con 0x7fb0400c9260 2023-11-27T18:45:21.818 INFO:teuthology.orchestra.run.smithi091.stderr:pool 'cephfs_data_ec' removed 2023-11-27T18:45:21.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:21.821+0000 7fb0487fc640 1 -- 172.21.15.91:0/510228401 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fb024066870 msgr2=0x7fb024068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:21.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:21.821+0000 7fb0487fc640 1 --2- 172.21.15.91:0/510228401 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fb024066870 0x7fb024068d30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb03c0b2000 tx=0x7fb03c0aa070 comp rx=0 tx=0).stop 2023-11-27T18:45:21.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:21.821+0000 7fb0487fc640 1 -- 172.21.15.91:0/510228401 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb0400c9260 msgr2=0x7fb040153e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T18:45:21.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:21.821+0000 7fb0487fc640 1 --2- 172.21.15.91:0/510228401 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb0400c9260 0x7fb040153e00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb03400c480 tx=0x7fb03400c940 comp rx=0 tx=0).stop 2023-11-27T18:45:21.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:21.821+0000 7fb0487fc640 1 -- 172.21.15.91:0/510228401 shutdown_connections 2023-11-27T18:45:21.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:21.821+0000 7fb0487fc640 1 --2- 172.21.15.91:0/510228401 >> [v2:172.21.15.91:6800/2814827118,v1:172.21.15.91:6801/2814827118] conn(0x7fb024066870 0x7fb024068d30 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:21.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:21.821+0000 7fb0487fc640 1 --2- 172.21.15.91:0/510228401 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb0401578c0 0x7fb040159f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:21.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:21.821+0000 7fb0487fc640 1 --2- 172.21.15.91:0/510228401 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb0401515f0 0x7fb040152af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:21.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:21.821+0000 7fb0487fc640 1 --2- 172.21.15.91:0/510228401 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb0400c9260 0x7fb040153e00 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T18:45:21.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:21.821+0000 7fb0487fc640 1 -- 172.21.15.91:0/510228401 >> 172.21.15.91:0/510228401 conn(0x7fb04006abb0 msgr2=0x7fb0400ccca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T18:45:21.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:21.821+0000 7fb0487fc640 1 -- 172.21.15.91:0/510228401 shutdown_connections 2023-11-27T18:45:21.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T18:45:21.821+0000 7fb0487fc640 1 -- 172.21.15.91:0/510228401 wait complete. 2023-11-27T18:45:21.843 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-27T18:45:21.843 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-27T18:45:21.844 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T18:45:21.879 INFO:tasks.ceph.mds.a.smithi091.stderr:2023-11-27T18:45:21.853+0000 b9ac640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i a (PID: 42149) UID: 0 2023-11-27T18:45:21.879 INFO:tasks.ceph.mds.a.smithi091.stderr:2023-11-27T18:45:21.857+0000 b9ac640 -1 mds.a *** got signal Terminated *** 2023-11-27T18:45:25.546 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~7s 2023-11-27T18:45:27.946 INFO:tasks.ceph.mds.a:Stopped 2023-11-27T18:45:27.946 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-27T18:45:27.946 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T18:45:27.989 INFO:tasks.ceph.mds.c.smithi091.stderr:2023-11-27T18:45:27.956+0000 b9ac640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i c (PID: 42151) UID: 0 2023-11-27T18:45:27.990 INFO:tasks.ceph.mds.c.smithi091.stderr:2023-11-27T18:45:27.960+0000 b9ac640 -1 mds.c *** got signal Terminated *** 2023-11-27T18:45:32.259 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~14s 2023-11-27T18:45:34.047 INFO:tasks.ceph.mds.c:Stopped 2023-11-27T18:45:34.048 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2023-11-27T18:45:34.048 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T18:45:34.078 INFO:tasks.ceph.mds.e.smithi091.stderr:2023-11-27T18:45:34.052+0000 b9ac640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i e (PID: 42152) UID: 0 2023-11-27T18:45:34.083 INFO:tasks.ceph.mds.e.smithi091.stderr:2023-11-27T18:45:34.056+0000 b9ac640 -1 mds.e *** got signal Terminated *** 2023-11-27T18:45:38.771 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~0s 2023-11-27T18:45:38.771 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~20s 2023-11-27T18:45:40.149 INFO:tasks.ceph.mds.e:Stopped 2023-11-27T18:45:40.149 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-27T18:45:40.149 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T18:45:40.188 INFO:tasks.ceph.mds.b.smithi094.stderr:2023-11-27T18:45:40.157+0000 b9ac640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i b (PID: 42103) UID: 0 2023-11-27T18:45:40.191 INFO:tasks.ceph.mds.b.smithi094.stderr:2023-11-27T18:45:40.165+0000 b9ac640 -1 mds.b *** got signal Terminated *** 2023-11-27T18:45:41.129 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:45:41.132 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:45:45.182 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-11-27T18:45:45.182 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~27s 2023-11-27T18:45:45.182 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e has been restored 2023-11-27T18:45:46.252 INFO:tasks.ceph.mds.b:Stopped 2023-11-27T18:45:46.252 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-27T18:45:46.252 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T18:45:46.252 INFO:tasks.ceph.mds.d:Stopped 2023-11-27T18:45:46.253 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2023-11-27T18:45:46.253 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T18:45:46.273 INFO:tasks.ceph.mds.f.smithi094.stderr:2023-11-27T18:45:46.257+0000 b9ac640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i f (PID: 42107) UID: 0 2023-11-27T18:45:46.274 INFO:tasks.ceph.mds.f.smithi094.stderr:2023-11-27T18:45:46.261+0000 b9ac640 -1 mds.f *** got signal Terminated *** 2023-11-27T18:45:51.492 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~0s 2023-11-27T18:45:51.492 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-11-27T18:45:51.492 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-11-27T18:45:52.355 INFO:tasks.ceph.mds.f:Stopped 2023-11-27T18:45:52.355 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-27T18:45:52.355 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-27T18:45:52.355 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T18:45:52.356 INFO:tasks.ceph.osd.0.smithi091.stderr:2023-11-27T18:45:52.356+0000 7f4e073f0640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 0 (PID: 38536) UID: 0 2023-11-27T18:45:52.357 INFO:tasks.ceph.osd.0.smithi091.stderr:2023-11-27T18:45:52.356+0000 7f4e073f0640 -1 osd.0 41 *** Got signal Terminated *** 2023-11-27T18:45:57.701 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-11-27T18:45:57.702 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f has been restored 2023-11-27T18:45:58.457 INFO:tasks.ceph.osd.0:Stopped 2023-11-27T18:45:58.458 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-27T18:45:58.458 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T18:45:58.459 INFO:tasks.ceph.osd.1.smithi091.stderr:2023-11-27T18:45:58.456+0000 7f6129794640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 1 (PID: 38538) UID: 0 2023-11-27T18:45:58.459 INFO:tasks.ceph.osd.1.smithi091.stderr:2023-11-27T18:45:58.456+0000 7f6129794640 -1 osd.1 42 *** Got signal Terminated *** 2023-11-27T18:45:58.675 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:34:19.753 38308== Warning: unimplemented fcntl command: 1036 2023-11-27T18:45:58.782 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:34:19.860 38308== Warning: unimplemented fcntl command: 1036 2023-11-27T18:45:58.888 INFO:tasks.ceph.mon.b.smithi094.stderr:==00:00:34:19.914 38305== Warning: unimplemented fcntl command: 1036 2023-11-27T18:45:58.897 INFO:tasks.ceph.mon.c.smithi094.stderr:==00:00:34:19.923 38307== Warning: unimplemented fcntl command: 1036 2023-11-27T18:45:58.915 INFO:tasks.ceph.mon.c.smithi094.stderr:==00:00:34:19.942 38307== Warning: unimplemented fcntl command: 1036 2023-11-27T18:45:58.952 INFO:tasks.ceph.mon.b.smithi094.stderr:==00:00:34:19.978 38305== Warning: unimplemented fcntl command: 1036 2023-11-27T18:45:59.107 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:34:20.185 38308== Warning: unimplemented fcntl command: 1036 2023-11-27T18:45:59.176 INFO:tasks.ceph.mon.b.smithi094.stderr:==00:00:34:20.202 38305== Warning: unimplemented fcntl command: 1036 2023-11-27T18:45:59.801 INFO:tasks.ceph.mon.c.smithi094.stderr:==00:00:34:20.299 38307== Warning: unimplemented fcntl command: 1036 2023-11-27T18:46:03.811 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-11-27T18:46:03.811 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2023-11-27T18:46:04.560 INFO:tasks.ceph.osd.1:Stopped 2023-11-27T18:46:04.560 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-27T18:46:04.561 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T18:46:04.564 INFO:tasks.ceph.osd.2.smithi091.stderr:2023-11-27T18:46:04.560+0000 7f2eba33f640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 2 (PID: 38540) UID: 0 2023-11-27T18:46:04.564 INFO:tasks.ceph.osd.2.smithi091.stderr:2023-11-27T18:46:04.560+0000 7f2eba33f640 -1 osd.2 44 *** Got signal Terminated *** 2023-11-27T18:46:09.819 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-11-27T18:46:09.819 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2023-11-27T18:46:10.662 INFO:tasks.ceph.osd.2:Stopped 2023-11-27T18:46:10.662 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-11-27T18:46:10.663 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T18:46:10.664 INFO:tasks.ceph.osd.3.smithi091.stderr:2023-11-27T18:46:10.663+0000 7f65b64c8640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 3 (PID: 38542) UID: 0 2023-11-27T18:46:10.664 INFO:tasks.ceph.osd.3.smithi091.stderr:2023-11-27T18:46:10.663+0000 7f65b64c8640 -1 osd.3 45 *** Got signal Terminated *** 2023-11-27T18:46:11.255 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:46:11.257 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:46:15.725 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-11-27T18:46:15.725 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2023-11-27T18:46:16.765 INFO:tasks.ceph.osd.3:Stopped 2023-11-27T18:46:16.765 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-11-27T18:46:16.765 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T18:46:16.766 INFO:tasks.ceph.osd.4.smithi094.stderr:2023-11-27T18:46:16.765+0000 7f685a218640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 4 (PID: 38622) UID: 0 2023-11-27T18:46:16.766 INFO:tasks.ceph.osd.4.smithi094.stderr:2023-11-27T18:46:16.765+0000 7f685a218640 -1 osd.4 46 *** Got signal Terminated *** 2023-11-27T18:46:21.532 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-11-27T18:46:21.532 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2023-11-27T18:46:22.866 INFO:tasks.ceph.osd.4:Stopped 2023-11-27T18:46:22.867 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-11-27T18:46:22.867 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T18:46:22.868 INFO:tasks.ceph.osd.5.smithi094.stderr:2023-11-27T18:46:22.868+0000 7ff5ab86b640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 5 (PID: 38625) UID: 0 2023-11-27T18:46:22.868 INFO:tasks.ceph.osd.5.smithi094.stderr:2023-11-27T18:46:22.868+0000 7ff5ab86b640 -1 osd.5 47 *** Got signal Terminated *** 2023-11-27T18:46:27.238 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-11-27T18:46:27.238 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2023-11-27T18:46:28.969 INFO:tasks.ceph.osd.5:Stopped 2023-11-27T18:46:28.969 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-11-27T18:46:28.969 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T18:46:28.970 INFO:tasks.ceph.osd.6.smithi094.stderr:2023-11-27T18:46:28.972+0000 7fd530ffc640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 6 (PID: 38627) UID: 0 2023-11-27T18:46:28.971 INFO:tasks.ceph.osd.6.smithi094.stderr:2023-11-27T18:46:28.972+0000 7fd530ffc640 -1 osd.6 48 *** Got signal Terminated *** 2023-11-27T18:46:32.843 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-11-27T18:46:32.844 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-11-27T18:46:35.071 INFO:tasks.ceph.osd.6:Stopped 2023-11-27T18:46:35.072 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-11-27T18:46:35.072 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T18:46:35.073 INFO:tasks.ceph.osd.7.smithi094.stderr:2023-11-27T18:46:35.072+0000 7fea74b84640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 7 (PID: 38629) UID: 0 2023-11-27T18:46:35.073 INFO:tasks.ceph.osd.7.smithi094.stderr:2023-11-27T18:46:35.072+0000 7fea74b84640 -1 osd.7 48 *** Got signal Terminated *** 2023-11-27T18:46:38.348 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-11-27T18:46:38.348 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-11-27T18:46:41.174 INFO:tasks.ceph.osd.7:Stopped 2023-11-27T18:46:41.174 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-27T18:46:41.174 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-11-27T18:46:41.174 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T18:46:41.176 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T18:46:41.171+0000 7efdf7a8b640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-mgr -f --cluster ceph -i y (PID: 38310) UID: 0 2023-11-27T18:46:41.176 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T18:46:41.171+0000 7efdf7a8b640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2023-11-27T18:46:41.205 INFO:tasks.ceph.mgr.y:Stopped 2023-11-27T18:46:41.205 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-27T18:46:41.206 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T18:46:41.234 INFO:tasks.ceph.mgr.x:Stopped 2023-11-27T18:46:41.234 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-27T18:46:41.235 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-27T18:46:41.235 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T18:46:41.264 INFO:tasks.ceph.mon.a.smithi091.stderr:2023-11-27T18:46:41.251+0000 a346640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a (PID: 38305) UID: 0 2023-11-27T18:46:41.265 INFO:tasks.ceph.mon.a.smithi091.stderr:2023-11-27T18:46:41.251+0000 a346640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-11-27T18:46:41.359 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:46:41.362 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:46:43.551 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2023-11-27T18:46:43.551 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-11-27T18:46:47.337 INFO:tasks.ceph.mon.a:Stopped 2023-11-27T18:46:47.337 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-27T18:46:47.337 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T18:46:47.375 INFO:tasks.ceph.mon.b.smithi094.stderr:2023-11-27T18:46:47.344+0000 a346640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b (PID: 38298) UID: 0 2023-11-27T18:46:47.377 INFO:tasks.ceph.mon.b.smithi094.stderr:2023-11-27T18:46:47.348+0000 a346640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-11-27T18:46:48.653 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2023-11-27T18:46:48.653 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2023-11-27T18:46:53.439 INFO:tasks.ceph.mon.b:Stopped 2023-11-27T18:46:53.439 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-27T18:46:53.440 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T18:46:53.478 INFO:tasks.ceph.mon.c.smithi094.stderr:2023-11-27T18:46:53.448+0000 a346640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c (PID: 38301) UID: 0 2023-11-27T18:46:53.479 INFO:tasks.ceph.mon.c.smithi094.stderr:2023-11-27T18:46:53.452+0000 a346640 -1 mon.c@2(probing) e1 *** Got Signal Terminated *** 2023-11-27T18:46:53.754 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2023-11-27T18:46:58.755 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2023-11-27T18:46:59.541 INFO:tasks.ceph.mon.c:Stopped 2023-11-27T18:46:59.542 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-27T18:46:59.542 DEBUG:teuthology.orchestra.run.smithi091:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow request' | egrep -v SLOW_OPS | egrep -v MON_DOWN | head -n 1 2023-11-27T18:46:59.559 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi091.front.sepia.ceph.com 2023-11-27T18:46:59.559 DEBUG:teuthology.orchestra.run.smithi091:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-27T18:46:59.828 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi091.front.sepia.ceph.com 2023-11-27T18:46:59.828 DEBUG:teuthology.orchestra.run.smithi091:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-27T18:47:00.014 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi091.front.sepia.ceph.com 2023-11-27T18:47:00.015 DEBUG:teuthology.orchestra.run.smithi091:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-27T18:47:00.205 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi091.front.sepia.ceph.com 2023-11-27T18:47:00.205 DEBUG:teuthology.orchestra.run.smithi091:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-11-27T18:47:00.398 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi094.front.sepia.ceph.com 2023-11-27T18:47:00.398 DEBUG:teuthology.orchestra.run.smithi094:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-11-27T18:47:00.569 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi094.front.sepia.ceph.com 2023-11-27T18:47:00.570 DEBUG:teuthology.orchestra.run.smithi094:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-11-27T18:47:00.765 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi094.front.sepia.ceph.com 2023-11-27T18:47:00.765 DEBUG:teuthology.orchestra.run.smithi094:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-11-27T18:47:00.912 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi094.front.sepia.ceph.com 2023-11-27T18:47:00.913 DEBUG:teuthology.orchestra.run.smithi094:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-11-27T18:47:01.055 INFO:tasks.ceph:Archiving mon data... 2023-11-27T18:47:01.057 DEBUG:teuthology.misc:Transferring archived files from smithi091:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7467937/data/mon.a.tgz 2023-11-27T18:47:01.058 DEBUG:teuthology.orchestra.run.smithi091:> mktemp 2023-11-27T18:47:01.063 INFO:teuthology.orchestra.run.smithi091.stdout:/tmp/tmp.SV7Vw8i4tk 2023-11-27T18:47:01.064 DEBUG:teuthology.orchestra.run.smithi091:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.SV7Vw8i4tk 2023-11-27T18:47:01.188 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod 0666 /tmp/tmp.SV7Vw8i4tk 2023-11-27T18:47:01.250 DEBUG:teuthology.orchestra.remote:smithi091:/tmp/tmp.SV7Vw8i4tk is 354KB 2023-11-27T18:47:01.310 DEBUG:teuthology.orchestra.run.smithi091:> rm -fr /tmp/tmp.SV7Vw8i4tk 2023-11-27T18:47:01.315 DEBUG:teuthology.misc:Transferring archived files from smithi094:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7467937/data/mon.b.tgz 2023-11-27T18:47:01.316 DEBUG:teuthology.orchestra.run.smithi094:> mktemp 2023-11-27T18:47:01.321 INFO:teuthology.orchestra.run.smithi094.stdout:/tmp/tmp.ZhG4vnuNKq 2023-11-27T18:47:01.321 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.ZhG4vnuNKq 2023-11-27T18:47:01.446 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 0666 /tmp/tmp.ZhG4vnuNKq 2023-11-27T18:47:01.513 DEBUG:teuthology.orchestra.remote:smithi094:/tmp/tmp.ZhG4vnuNKq is 360KB 2023-11-27T18:47:01.574 DEBUG:teuthology.orchestra.run.smithi094:> rm -fr /tmp/tmp.ZhG4vnuNKq 2023-11-27T18:47:01.579 DEBUG:teuthology.misc:Transferring archived files from smithi094:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7467937/data/mon.c.tgz 2023-11-27T18:47:01.579 DEBUG:teuthology.orchestra.run.smithi094:> mktemp 2023-11-27T18:47:01.628 INFO:teuthology.orchestra.run.smithi094.stdout:/tmp/tmp.aIP7owjwh7 2023-11-27T18:47:01.629 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.aIP7owjwh7 2023-11-27T18:47:01.754 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 0666 /tmp/tmp.aIP7owjwh7 2023-11-27T18:47:01.819 DEBUG:teuthology.orchestra.remote:smithi094:/tmp/tmp.aIP7owjwh7 is 360KB 2023-11-27T18:47:01.878 DEBUG:teuthology.orchestra.run.smithi094:> rm -fr /tmp/tmp.aIP7owjwh7 2023-11-27T18:47:01.883 INFO:tasks.ceph:Cleaning ceph cluster... 2023-11-27T18:47:01.883 DEBUG:teuthology.orchestra.run.smithi091:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-27T18:47:01.886 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-27T18:47:01.941 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-11-27T18:47:01.941 DEBUG:teuthology.orchestra.run.smithi091:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-27T18:47:01.943 DEBUG:teuthology.orchestra.run.smithi094:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-27T18:47:01.972 INFO:teuthology.orchestra.run.smithi091.stdout:/var/log/ceph/valgrind/client.0.log: Leak_StillReachable 2023-11-27T18:47:01.972 INFO:teuthology.orchestra.run.smithi091.stdout:/var/log/ceph/valgrind/mon.a.log: Leak_StillReachable 2023-11-27T18:47:01.985 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/client.0.log kind Leak_StillReachable 2023-11-27T18:47:01.985 ERROR:tasks.ceph:saw valgrind issue Leak_StillReachable in /var/log/ceph/valgrind/client.0.log 2023-11-27T18:47:01.986 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/mon.a.log kind Leak_StillReachable 2023-11-27T18:47:01.986 ERROR:tasks.ceph:saw valgrind issue Leak_StillReachable in /var/log/ceph/valgrind/mon.a.log 2023-11-27T18:47:02.019 INFO:teuthology.orchestra.run.smithi094.stdout:/var/log/ceph/valgrind/mds.d.log: Leak_PossiblyLost 2023-11-27T18:47:02.020 INFO:teuthology.orchestra.run.smithi094.stdout:/var/log/ceph/valgrind/mon.b.log: Leak_StillReachable 2023-11-27T18:47:02.020 INFO:teuthology.orchestra.run.smithi094.stdout:/var/log/ceph/valgrind/mon.c.log: Leak_StillReachable 2023-11-27T18:47:02.020 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/mds.d.log kind Leak_PossiblyLost 2023-11-27T18:47:02.020 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/mon.b.log kind Leak_StillReachable 2023-11-27T18:47:02.020 ERROR:tasks.ceph:saw valgrind issue Leak_StillReachable in /var/log/ceph/valgrind/mon.b.log 2023-11-27T18:47:02.020 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/mon.c.log kind Leak_StillReachable 2023-11-27T18:47:02.020 ERROR:tasks.ceph:saw valgrind issue Leak_StillReachable in /var/log/ceph/valgrind/mon.c.log 2023-11-27T18:47:02.020 INFO:tasks.ceph:Archiving crash dumps... 2023-11-27T18:47:02.022 DEBUG:teuthology.misc:Transferring archived files from smithi091:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7467937/remote/smithi091/crash 2023-11-27T18:47:02.023 DEBUG:teuthology.orchestra.run.smithi091:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-27T18:47:02.034 DEBUG:teuthology.misc:Transferring archived files from smithi094:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7467937/remote/smithi094/crash 2023-11-27T18:47:02.035 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-27T18:47:02.079 INFO:tasks.ceph:Shutting down logrotate 2023-11-27T18:47:02.079 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:47:02.081 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:47:02.160 DEBUG:teuthology.orchestra.run.smithi091:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-27T18:47:02.172 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-27T18:47:02.216 INFO:tasks.ceph:Compressing logs... 2023-11-27T18:47:02.216 DEBUG:teuthology.orchestra.run.smithi091:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-27T18:47:02.218 DEBUG:teuthology.orchestra.run.smithi094:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-27T18:47:02.242 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45876.log 2023-11-27T18:47:02.251 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44198.log 2023-11-27T18:47:02.251 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.45876.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-11-27T18:47:02.251 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46050.log 2023-11-27T18:47:02.251 INFO:teuthology.orchestra.run.smithi091.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45876.log.gz 2023-11-27T18:47:02.252 INFO:teuthology.orchestra.run.smithi091.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44198.log.gz 2023-11-27T18:47:02.252 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46102.log 2023-11-27T18:47:02.252 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.46050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42710.log 2023-11-27T18:47:02.252 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.46102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44642.log 2023-11-27T18:47:02.252 INFO:teuthology.orchestra.run.smithi091.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46050.log.gz 2023-11-27T18:47:02.252 INFO:teuthology.orchestra.run.smithi091.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46102.log.gz 2023-11-27T18:47:02.252 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.42710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46738.log 2023-11-27T18:47:02.252 INFO:teuthology.orchestra.run.smithi091.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42710.log.gz 2023-11-27T18:47:02.252 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-11-27T18:47:02.252 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44642.log: /var/log/ceph/ceph-client.admin.46738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44024.log 2023-11-27T18:47:02.252 INFO:teuthology.orchestra.run.smithi091.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44642.log.gz 2023-11-27T18:47:02.252 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44954.log/var/log/ceph/ceph-osd.0.log: 2023-11-27T18:47:02.253 INFO:teuthology.orchestra.run.smithi091.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46738.log.gz 2023-11-27T18:47:02.253 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46764.log 2023-11-27T18:47:02.253 INFO:teuthology.orchestra.run.smithi091.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44024.log.gz 2023-11-27T18:47:02.253 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45067.log 2023-11-27T18:47:02.253 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.46764.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44954.log.gz 2023-11-27T18:47:02.253 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46024.log 2023-11-27T18:47:02.253 INFO:teuthology.orchestra.run.smithi091.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46764.log.gz 2023-11-27T18:47:02.253 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.45067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43753.log 2023-11-27T18:47:02.253 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.46024.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45067.log.gz 2023-11-27T18:47:02.253 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44349.log 2023-11-27T18:47:02.253 INFO:teuthology.orchestra.run.smithi091.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46024.log.gz 2023-11-27T18:47:02.253 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.43753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45187.log 2023-11-27T18:47:02.253 INFO:teuthology.orchestra.run.smithi091.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43753.log.gz 2023-11-27T18:47:02.253 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45920.log 2023-11-27T18:47:02.254 INFO:teuthology.orchestra.run.smithi091.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44349.log.gz 2023-11-27T18:47:02.254 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.0.45187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45006.log 2023-11-27T18:47:02.254 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38547.log 2023-11-27T18:47:02.254 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.45920.log: /var/log/ceph/ceph-client.admin.45006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45850.log 2023-11-27T18:47:02.254 INFO:teuthology.orchestra.run.smithi091.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45920.log.gz 2023-11-27T18:47:02.254 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.38547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43996.log 2023-11-27T18:47:02.259 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.45850.log: gzip 88.5% -5 --verbose -- 90.9% /var/log/ceph/ceph-client.admin.44798.log 2023-11-27T18:47:02.259 INFO:teuthology.orchestra.run.smithi091.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45006.log.gz 2023-11-27T18:47:02.259 INFO:teuthology.orchestra.run.smithi091.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38547.log.gz 2023-11-27T18:47:02.259 INFO:teuthology.orchestra.run.smithi091.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45850.log.gz 2023-11-27T18:47:02.259 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.43996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43177.log 2023-11-27T18:47:02.259 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42419.log 2023-11-27T18:47:02.259 INFO:teuthology.orchestra.run.smithi091.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43996.log.gz 2023-11-27T18:47:02.259 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.43177.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44798.log.gz 2023-11-27T18:47:02.259 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-11-27T18:47:02.259 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.42419.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43177.log.gz 2023-11-27T18:47:02.260 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44590.log 2023-11-27T18:47:02.260 INFO:teuthology.orchestra.run.smithi091.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42419.log.gz 2023-11-27T18:47:02.260 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42158.log 2023-11-27T18:47:02.260 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.44590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42866.log 2023-11-27T18:47:02.260 INFO:teuthology.orchestra.run.smithi091.stderr: 88.2%/var/log/ceph/ceph-client.admin.42158.log: -- replaced with /var/log/ceph/ceph-client.admin.44590.log.gz 2023-11-27T18:47:02.260 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46232.log 2023-11-27T18:47:02.260 INFO:teuthology.orchestra.run.smithi091.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42158.log.gz 2023-11-27T18:47:02.260 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.42866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44824.log 2023-11-27T18:47:02.260 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.46232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43573.log 2023-11-27T18:47:02.260 INFO:teuthology.orchestra.run.smithi091.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.42866.log.gz 2023-11-27T18:47:02.260 INFO:teuthology.orchestra.run.smithi091.stderr: 88.7%/var/log/ceph/ceph-client.admin.44824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44902.log 2023-11-27T18:47:02.260 INFO:teuthology.orchestra.run.smithi091.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46232.log.gz 2023-11-27T18:47:02.260 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- 87.6% /var/log/ceph/ceph-client.admin.45746.log 2023-11-27T18:47:02.261 INFO:teuthology.orchestra.run.smithi091.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44824.log.gz 2023-11-27T18:47:02.261 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.43573.log: /var/log/ceph/ceph-client.admin.44902.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-11-27T18:47:02.261 INFO:teuthology.orchestra.run.smithi091.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43573.log.gz 2023-11-27T18:47:02.261 INFO:teuthology.orchestra.run.smithi091.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44902.log.gz 2023-11-27T18:47:02.261 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.45746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43282.log 2023-11-27T18:47:02.261 INFO:teuthology.orchestra.run.smithi091.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45746.log.gz 2023-11-27T18:47:02.261 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43469.log 2023-11-27T18:47:02.265 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.43282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42840.log 2023-11-27T18:47:02.265 INFO:teuthology.orchestra.run.smithi091.stderr: 88.3%/var/log/ceph/ceph-client.admin.43469.log: -- replaced with /var/log/ceph/ceph-client.admin.43282.log.gz 2023-11-27T18:47:02.265 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43754.log 2023-11-27T18:47:02.266 INFO:teuthology.orchestra.run.smithi091.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43469.log.gz 2023-11-27T18:47:02.266 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.42840.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42840.log.gz 2023-11-27T18:47:02.266 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43443.log 2023-11-27T18:47:02.266 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.43754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42736.log 2023-11-27T18:47:02.266 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.43443.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43754.log.gz 2023-11-27T18:47:02.266 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46206.log 2023-11-27T18:47:02.266 INFO:teuthology.orchestra.run.smithi091.stderr: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.43443.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.44746.log 2023-11-27T18:47:02.266 INFO:teuthology.orchestra.run.smithi091.stderr: 2023-11-27T18:47:02.266 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.42736.log: /var/log/ceph/ceph-client.admin.46206.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42736.log.gz 2023-11-27T18:47:02.266 INFO:teuthology.orchestra.run.smithi091.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46206.log.gz 2023-11-27T18:47:02.266 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44980.log 2023-11-27T18:47:02.266 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43942.log 2023-11-27T18:47:02.267 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44438.log 2023-11-27T18:47:02.267 INFO:teuthology.orchestra.run.smithi091.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44746.log.gz 2023-11-27T18:47:02.267 INFO:teuthology.orchestra.run.smithi091.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44980.log.gz 2023-11-27T18:47:02.267 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.43942.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43942.log.gz 2023-11-27T18:47:02.267 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42278.log 2023-11-27T18:47:02.267 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42450.log 2023-11-27T18:47:02.267 INFO:teuthology.orchestra.run.smithi091.stderr: 89.3%/var/log/ceph/ceph-client.admin.42278.log: -- replaced with /var/log/ceph/ceph-client.admin.44438.log.gzgzip 2023-11-27T18:47:02.267 INFO:teuthology.orchestra.run.smithi091.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42916.log 2023-11-27T18:47:02.267 INFO:teuthology.orchestra.run.smithi091.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42278.log.gz 2023-11-27T18:47:02.270 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.42450.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42450.log.gz 2023-11-27T18:47:02.271 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42632.log 2023-11-27T18:47:02.271 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.42916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42213.log 2023-11-27T18:47:02.271 INFO:teuthology.orchestra.run.smithi091.stderr: 88.7%/var/log/ceph/ceph-client.admin.42632.log: -- replaced with /var/log/ceph/ceph-client.admin.42916.log.gz 2023-11-27T18:47:02.271 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46442.log 2023-11-27T18:47:02.271 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42528.log 2023-11-27T18:47:02.271 INFO:teuthology.orchestra.run.smithi091.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42632.log.gz/var/log/ceph/ceph-client.admin.42213.log: 2023-11-27T18:47:02.271 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.46442.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42213.log.gz 2023-11-27T18:47:02.271 INFO:teuthology.orchestra.run.smithi091.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46442.log.gz 2023-11-27T18:47:02.271 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43752.log 2023-11-27T18:47:02.271 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.42528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43125.log 2023-11-27T18:47:02.272 INFO:teuthology.orchestra.run.smithi091.stderr: 89.4%/var/log/ceph/ceph-client.admin.43752.log: -- replaced with /var/log/ceph/ceph-client.admin.42528.log.gz 2023-11-27T18:47:02.272 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42788.log 2023-11-27T18:47:02.272 INFO:teuthology.orchestra.run.smithi091.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43752.log.gz 2023-11-27T18:47:02.272 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.43125.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43125.log.gz 2023-11-27T18:47:02.273 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44248.log 2023-11-27T18:47:02.273 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.42788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43924.log 2023-11-27T18:47:02.273 INFO:teuthology.orchestra.run.smithi091.stderr: 87.8%/var/log/ceph/ceph-client.admin.44248.log: -- replaced with /var/log/ceph/ceph-client.admin.42788.log.gz 2023-11-27T18:47:02.273 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46526.log 2023-11-27T18:47:02.274 INFO:teuthology.orchestra.run.smithi091.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44248.log.gz 2023-11-27T18:47:02.274 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.43924.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43924.log.gz 2023-11-27T18:47:02.274 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-11-27T18:47:02.274 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.46526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42502.log 2023-11-27T18:47:02.275 INFO:teuthology.orchestra.run.smithi091.stderr: 87.8%/var/log/ceph/ceph-osd.3.log: -- replaced with /var/log/ceph/ceph-client.admin.46526.log.gz 2023-11-27T18:47:02.275 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43652.log 2023-11-27T18:47:02.275 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.42502.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42502.log.gz 2023-11-27T18:47:02.275 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44694.log 2023-11-27T18:47:02.276 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45798.log 2023-11-27T18:47:02.276 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.43652.log: /var/log/ceph/ceph-client.admin.44694.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43652.log.gz 2023-11-27T18:47:02.277 INFO:teuthology.orchestra.run.smithi091.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44694.log.gz 2023-11-27T18:47:02.277 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42187.log 2023-11-27T18:47:02.277 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.45798.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45798.log.gz 2023-11-27T18:47:02.278 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43256.log 2023-11-27T18:47:02.278 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43626.log 2023-11-27T18:47:02.279 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.42187.log: /var/log/ceph/ceph-client.admin.43256.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42187.log.gz 2023-11-27T18:47:02.279 INFO:teuthology.orchestra.run.smithi091.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43256.log.gz 2023-11-27T18:47:02.279 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44144.log 2023-11-27T18:47:02.279 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44170.log 2023-11-27T18:47:02.280 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.43626.log: /var/log/ceph/ceph-client.admin.44144.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43626.log.gz 2023-11-27T18:47:02.281 INFO:teuthology.orchestra.run.smithi091.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44144.log.gz 2023-11-27T18:47:02.281 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42476.log 2023-11-27T18:47:02.281 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38524.log 2023-11-27T18:47:02.282 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44170.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44170.log.gz 2023-11-27T18:47:02.282 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44020.log 2023-11-27T18:47:02.283 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-11-27T18:47:02.285 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.42476.log: /var/log/ceph/ceph-client.admin.44020.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42476.log.gz 2023-11-27T18:47:02.285 INFO:teuthology.orchestra.run.smithi091.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44020.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43360.log 2023-11-27T18:47:02.285 INFO:teuthology.orchestra.run.smithi091.stderr: 2023-11-27T18:47:02.288 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38444.log 2023-11-27T18:47:02.288 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38572.log 2023-11-27T18:47:02.288 INFO:teuthology.orchestra.run.smithi094.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.38524.log.gz 2023-11-27T18:47:02.288 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38444.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-11-27T18:47:02.288 INFO:teuthology.orchestra.run.smithi094.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38444.log.gz 2023-11-27T18:47:02.288 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-11-27T18:47:02.288 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38572.log: /var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-11-27T18:47:02.288 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-osd.6.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.38572.log.gz 2023-11-27T18:47:02.288 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38499.log 2023-11-27T18:47:02.288 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38548.log 2023-11-27T18:47:02.289 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38420.log 2023-11-27T18:47:02.289 INFO:teuthology.orchestra.run.smithi094.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38499.log.gz 2023-11-27T18:47:02.289 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38548.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-11-27T18:47:02.289 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2023-11-27T18:47:02.289 INFO:teuthology.orchestra.run.smithi094.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38548.log.gz 2023-11-27T18:47:02.289 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38420.log: /var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-27T18:47:02.289 INFO:teuthology.orchestra.run.smithi094.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.38420.log.gz 2023-11-27T18:47:02.289 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-11-27T18:47:02.289 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38475.log 2023-11-27T18:47:02.289 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-27T18:47:02.291 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38475.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38475.log.gz 2023-11-27T18:47:02.291 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-11-27T18:47:02.293 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44616.log 2023-11-27T18:47:02.293 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.43360.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43360.log.gz 2023-11-27T18:47:02.293 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46258.log 2023-11-27T18:47:02.293 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44616.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44616.log.gz 2023-11-27T18:47:02.293 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46686.log 2023-11-27T18:47:02.293 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.46258.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46258.log.gz 2023-11-27T18:47:02.293 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43151.log 2023-11-27T18:47:02.293 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.46686.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46686.log.gz 2023-11-27T18:47:02.296 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45589.log 2023-11-27T18:47:02.296 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.43151.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43151.log.gz 2023-11-27T18:47:02.296 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46634.log 2023-11-27T18:47:02.296 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.45589.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45589.log.gz 2023-11-27T18:47:02.296 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44928.log 2023-11-27T18:47:02.298 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph.audit.log: 93.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-27T18:47:02.298 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.c.log 2023-11-27T18:47:02.298 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-mds.d.log: 93.5% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-27T18:47:02.298 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.f.log 2023-11-27T18:47:02.298 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/valgrind/mon.c.log: 92.5% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2023-11-27T18:47:02.298 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.b.log 2023-11-27T18:47:02.298 INFO:teuthology.orchestra.run.smithi094.stderr: 93.6% -- replaced with /var/log/ceph/valgrind/mon.c.log.gz 2023-11-27T18:47:02.298 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/valgrind/mds.f.log: 57.7% -- replaced with /var/log/ceph/valgrind/mds.f.log.gz 2023-11-27T18:47:02.298 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.d.log 2023-11-27T18:47:02.298 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/valgrind/mds.b.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.b.log 2023-11-27T18:47:02.298 INFO:teuthology.orchestra.run.smithi094.stderr: 57.6% -- replaced with /var/log/ceph/valgrind/mds.b.log.gz 2023-11-27T18:47:02.298 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/valgrind/mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-11-27T18:47:02.300 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/valgrind/mon.b.log: 93.6% -- replaced with /var/log/ceph/valgrind/mon.b.log.gz 2023-11-27T18:47:02.300 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-11-27T18:47:02.302 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.46634.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46634.log.gz 2023-11-27T18:47:02.302 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42120.log 2023-11-27T18:47:02.302 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44928.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44928.log.gz 2023-11-27T18:47:02.302 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44382.log 2023-11-27T18:47:02.302 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.42120.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42120.log.gz 2023-11-27T18:47:02.302 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46076.log 2023-11-27T18:47:02.303 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44382.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44382.log.gz 2023-11-27T18:47:02.303 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44410.log 2023-11-27T18:47:02.303 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.46076.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46076.log.gz 2023-11-27T18:47:02.303 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46556.log 2023-11-27T18:47:02.304 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-mds.b.log: 95.5% -- replaced with /var/log/ceph/valgrind/mds.d.log.gz 2023-11-27T18:47:02.304 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-11-27T18:47:02.305 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44410.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44410.log.gz 2023-11-27T18:47:02.305 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44174.log 2023-11-27T18:47:02.305 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.46556.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46556.log.gz 2023-11-27T18:47:02.305 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46284.log 2023-11-27T18:47:02.305 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44174.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44174.log.gz 2023-11-27T18:47:02.306 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45824.log 2023-11-27T18:47:02.306 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.46284.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46284.log.gz 2023-11-27T18:47:02.307 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42684.log 2023-11-27T18:47:02.308 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.45824.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45824.log.gz 2023-11-27T18:47:02.308 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44424.log 2023-11-27T18:47:02.309 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-mon.b.log: 92.5% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-11-27T18:47:02.309 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38596.log 2023-11-27T18:47:02.310 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.42684.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42684.log.gz 2023-11-27T18:47:02.310 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44428.log 2023-11-27T18:47:02.310 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44424.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44424.log.gz 2023-11-27T18:47:02.311 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43918.log 2023-11-27T18:47:02.311 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44428.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44428.log.gz 2023-11-27T18:47:02.312 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42658.log 2023-11-27T18:47:02.312 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-osd.4.log: 95.0% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-11-27T18:47:02.313 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38596.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38596.log.gz 2023-11-27T18:47:02.314 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.43918.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43918.log.gz 2023-11-27T18:47:02.314 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-27T18:47:02.314 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.42658.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42658.log.gz 2023-11-27T18:47:02.314 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44406.log 2023-11-27T18:47:02.319 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph.log: 88.0% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-27T18:47:02.319 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46154.log 2023-11-27T18:47:02.320 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44406.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44406.log.gz 2023-11-27T18:47:02.320 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43755.log 2023-11-27T18:47:02.327 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.46154.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46154.log.gz 2023-11-27T18:47:02.327 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44564.log 2023-11-27T18:47:02.328 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.43755.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43755.log.gz 2023-11-27T18:47:02.328 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44262.log 2023-11-27T18:47:02.328 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44564.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44564.log.gz 2023-11-27T18:47:02.328 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45946.log 2023-11-27T18:47:02.328 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44262.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44262.log.gz 2023-11-27T18:47:02.328 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46497.log 2023-11-27T18:47:02.328 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.45946.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45946.log.gz 2023-11-27T18:47:02.328 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46712.log 2023-11-27T18:47:02.328 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.46497.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46497.log.gz 2023-11-27T18:47:02.331 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46414.log 2023-11-27T18:47:02.331 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.46712.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46712.log.gz 2023-11-27T18:47:02.331 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.33507.log 2023-11-27T18:47:02.331 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.46414.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46414.log.gz 2023-11-27T18:47:02.332 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43746.log 2023-11-27T18:47:02.332 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph.tmp-client.admin.33507.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.33507.log.gz 2023-11-27T18:47:02.332 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46790.log 2023-11-27T18:47:02.333 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.43746.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43746.log.gz 2023-11-27T18:47:02.333 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43678.log 2023-11-27T18:47:02.333 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.46790.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46790.log.gz 2023-11-27T18:47:02.334 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46310.log 2023-11-27T18:47:02.335 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.43678.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43678.log.gz 2023-11-27T18:47:02.336 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45972.log 2023-11-27T18:47:02.336 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.46310.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46310.log.gz 2023-11-27T18:47:02.336 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43495.log 2023-11-27T18:47:02.336 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.45972.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45972.log.gz 2023-11-27T18:47:02.337 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46362.log 2023-11-27T18:47:02.337 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.43495.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43495.log.gz 2023-11-27T18:47:02.340 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46128.log 2023-11-27T18:47:02.340 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.46362.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46362.log.gz 2023-11-27T18:47:02.340 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44850.log 2023-11-27T18:47:02.340 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.46128.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46128.log.gz 2023-11-27T18:47:02.341 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46336.log 2023-11-27T18:47:02.341 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44850.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44850.log.gz 2023-11-27T18:47:02.342 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45998.log 2023-11-27T18:47:02.342 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.46336.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46336.log.gz 2023-11-27T18:47:02.343 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44503.log 2023-11-27T18:47:02.344 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.45998.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45998.log.gz 2023-11-27T18:47:02.344 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43308.log 2023-11-27T18:47:02.345 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44503.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44503.log.gz 2023-11-27T18:47:02.345 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42354.log 2023-11-27T18:47:02.346 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.43308.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43308.log.gz 2023-11-27T18:47:02.346 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44204.log 2023-11-27T18:47:02.347 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.42354.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42354.log.gz 2023-11-27T18:47:02.347 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45719.log 2023-11-27T18:47:02.348 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44204.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44204.log.gz 2023-11-27T18:47:02.348 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-27T18:47:02.349 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.45719.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45719.log.gz 2023-11-27T18:47:02.350 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45615.log 2023-11-27T18:47:02.351 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph.audit.log: 88.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-27T18:47:02.352 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46608.log 2023-11-27T18:47:02.353 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.45615.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45615.log.gz 2023-11-27T18:47:02.353 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43751.log 2023-11-27T18:47:02.354 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.46608.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46608.log.gz 2023-11-27T18:47:02.354 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-11-27T18:47:02.355 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.43751.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43751.log.gz 2023-11-27T18:47:02.356 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-11-27T18:47:02.364 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-mds.c.log: 92.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43988.log 2023-11-27T18:47:02.373 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-mds.a.log: 92.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-11-27T18:47:02.373 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43203.log 2023-11-27T18:47:02.373 INFO:teuthology.orchestra.run.smithi091.stderr: -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-11-27T18:47:02.373 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.43988.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43988.log.gz 2023-11-27T18:47:02.374 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/client.0.log 2023-11-27T18:47:02.374 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.43203.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43203.log.gz 2023-11-27T18:47:02.374 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.a.log 2023-11-27T18:47:02.375 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/valgrind/client.0.log: 77.9% -- replaced with /var/log/ceph/valgrind/client.0.log.gz 2023-11-27T18:47:02.375 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.a.log 2023-11-27T18:47:02.376 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/valgrind/mds.a.log: 57.7% -- replaced with /var/log/ceph/valgrind/mds.a.log.gz 2023-11-27T18:47:02.376 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.c.log 2023-11-27T18:47:02.377 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/valgrind/mon.a.log: 93.6% -- replaced with /var/log/ceph/valgrind/mon.a.log.gz 2023-11-27T18:47:02.378 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.e.log 2023-11-27T18:47:02.378 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/valgrind/mds.c.log: 57.7% -- replaced with /var/log/ceph/valgrind/mds.c.log.gz 2023-11-27T18:47:02.379 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42392.log 2023-11-27T18:47:02.380 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/valgrind/mds.e.log: 57.7% -- replaced with /var/log/ceph/valgrind/mds.e.log.gz 2023-11-27T18:47:02.380 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46180.log 2023-11-27T18:47:02.381 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.42392.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42392.log.gz 2023-11-27T18:47:02.381 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46388.log 2023-11-27T18:47:02.382 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.46180.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46180.log.gz 2023-11-27T18:47:02.382 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46580.log 2023-11-27T18:47:02.383 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.46388.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46388.log.gz 2023-11-27T18:47:02.383 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42580.log 2023-11-27T18:47:02.384 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.46580.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46580.log.gz 2023-11-27T18:47:02.385 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43600.log 2023-11-27T18:47:02.385 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.42580.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42580.log.gz 2023-11-27T18:47:02.386 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43982.log 2023-11-27T18:47:02.386 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.43600.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43600.log.gz 2023-11-27T18:47:02.387 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43097.log 2023-11-27T18:47:02.388 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.43982.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43982.log.gz 2023-11-27T18:47:02.389 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43758.log 2023-11-27T18:47:02.389 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.43097.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43097.log.gz 2023-11-27T18:47:02.389 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43042.log 2023-11-27T18:47:02.390 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.43758.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43758.log.gz 2023-11-27T18:47:02.390 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43704.log 2023-11-27T18:47:02.393 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.43042.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.43042.log.gz 2023-11-27T18:47:02.393 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43417.log 2023-11-27T18:47:02.394 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.43704.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43704.log.gz 2023-11-27T18:47:02.394 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45772.log 2023-11-27T18:47:02.395 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.43417.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43417.log.gz 2023-11-27T18:47:02.395 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45667.log 2023-11-27T18:47:02.396 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.45772.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45772.log.gz 2023-11-27T18:47:02.397 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42762.log 2023-11-27T18:47:02.397 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.45667.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45667.log.gz 2023-11-27T18:47:02.397 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38312.log 2023-11-27T18:47:02.398 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.42762.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42762.log.gz 2023-11-27T18:47:02.399 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45693.log 2023-11-27T18:47:02.400 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.38312.log: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.38312.log.gz 2023-11-27T18:47:02.401 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44876.log 2023-11-27T18:47:02.401 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.45693.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45693.log.gz 2023-11-27T18:47:02.402 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45641.log 2023-11-27T18:47:02.402 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44876.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44876.log.gz 2023-11-27T18:47:02.403 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43745.log 2023-11-27T18:47:02.404 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.45641.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45641.log.gz 2023-11-27T18:47:02.404 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43521.log 2023-11-27T18:47:02.405 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.43745.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43745.log.gz 2023-11-27T18:47:02.405 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44668.log 2023-11-27T18:47:02.406 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.43521.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43521.log.gz 2023-11-27T18:47:02.407 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43334.log 2023-11-27T18:47:02.407 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44668.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44668.log.gz 2023-11-27T18:47:02.408 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38666.log 2023-11-27T18:47:02.408 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.43334.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43334.log.gz 2023-11-27T18:47:02.409 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43229.log 2023-11-27T18:47:02.409 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.38666.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38666.log.gz 2023-11-27T18:47:02.410 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46660.log 2023-11-27T18:47:02.410 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.43229.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43229.log.gz 2023-11-27T18:47:02.411 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42606.log 2023-11-27T18:47:02.412 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.46660.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46660.log.gz 2023-11-27T18:47:02.412 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44720.log 2023-11-27T18:47:02.413 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.42606.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42606.log.gz 2023-11-27T18:47:02.413 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46469.log 2023-11-27T18:47:02.414 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44720.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44720.log.gz 2023-11-27T18:47:02.414 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43386.log 2023-11-27T18:47:02.415 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.46469.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46469.log.gz 2023-11-27T18:47:02.415 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43547.log 2023-11-27T18:47:02.416 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.43386.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43386.log.gz 2023-11-27T18:47:02.416 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2023-11-27T18:47:02.417 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.43547.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43547.log.gz 2023-11-27T18:47:02.418 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44772.log 2023-11-27T18:47:02.426 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-mds.e.log: 92.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42554.log 2023-11-27T18:47:02.427 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44772.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44772.log.gz 2023-11-27T18:47:02.427 INFO:teuthology.orchestra.run.smithi091.stderr: -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2023-11-27T18:47:02.427 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42814.log 2023-11-27T18:47:02.428 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.42554.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42554.log.gz 2023-11-27T18:47:02.429 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44297.log 2023-11-27T18:47:02.429 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.42814.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42814.log.gz 2023-11-27T18:47:02.430 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44297.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44297.log.gz 2023-11-27T18:47:02.519 INFO:teuthology.orchestra.run.smithi091.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-11-27T18:47:02.710 INFO:teuthology.orchestra.run.smithi094.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-11-27T18:47:02.825 INFO:teuthology.orchestra.run.smithi094.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-11-27T18:47:03.756 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2023-11-27T18:47:03.769 INFO:teuthology.orchestra.run.smithi091.stderr: 89.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-11-27T18:47:04.274 INFO:teuthology.orchestra.run.smithi091.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-11-27T18:47:04.289 INFO:teuthology.orchestra.run.smithi091.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-11-27T18:47:04.765 INFO:teuthology.orchestra.run.smithi094.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-11-27T18:47:04.918 INFO:teuthology.orchestra.run.smithi094.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-11-27T18:47:05.118 INFO:teuthology.orchestra.run.smithi094.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-11-27T18:47:05.469 INFO:teuthology.orchestra.run.smithi091.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-11-27T18:47:05.592 INFO:teuthology.orchestra.run.smithi091.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-11-27T18:47:05.770 INFO:teuthology.orchestra.run.smithi094.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-11-27T18:47:07.926 INFO:teuthology.orchestra.run.smithi091.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.0.45187.log.gz 2023-11-27T18:47:07.927 INFO:teuthology.orchestra.run.smithi091.stderr: 2023-11-27T18:47:07.927 INFO:teuthology.orchestra.run.smithi091.stderr:real 0m5.708s 2023-11-27T18:47:07.927 INFO:teuthology.orchestra.run.smithi091.stderr:user 0m17.655s 2023-11-27T18:47:07.927 INFO:teuthology.orchestra.run.smithi091.stderr:sys 0m0.617s 2023-11-27T18:47:11.932 INFO:teuthology.orchestra.run.smithi094.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-11-27T18:47:15.671 INFO:teuthology.orchestra.run.smithi094.stderr: 2023-11-27T18:47:15.672 INFO:teuthology.orchestra.run.smithi094.stderr:real 0m9.669s 2023-11-27T18:47:15.672 INFO:teuthology.orchestra.run.smithi094.stderr:user 0m21.344s 2023-11-27T18:47:15.672 INFO:teuthology.orchestra.run.smithi094.stderr:sys 0m0.753s 2023-11-27T18:47:15.672 INFO:tasks.ceph:Archiving logs... 2023-11-27T18:47:15.672 DEBUG:teuthology.misc:Transferring archived files from smithi091:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7467937/remote/smithi091/log 2023-11-27T18:47:15.677 DEBUG:teuthology.orchestra.run.smithi091:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-27T18:47:18.026 DEBUG:teuthology.misc:Transferring archived files from smithi094:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7467937/remote/smithi094/log 2023-11-27T18:47:18.027 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-27T18:47:20.644 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa/tasks/ceph.py", line 1957, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa/tasks/ceph.py", line 251, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa/tasks/ceph.py", line 368, in valgrind_post raise valgrind_exception Exception: saw valgrind issues 2023-11-27T18:47:20.645 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-27T18:47:20.657 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa/tasks/ceph.py", line 1957, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa/tasks/ceph.py", line 251, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa/tasks/ceph.py", line 368, in valgrind_post raise valgrind_exception Exception: saw valgrind issues 2023-11-27T18:47:20.658 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-27T18:47:20.658 DEBUG:teuthology.orchestra.run.smithi091:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-27T18:47:20.661 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-27T18:47:20.726 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-27T18:47:20.734 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-27T18:47:20.735 DEBUG:teuthology.orchestra.run.smithi091:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-27T18:47:20.737 DEBUG:teuthology.orchestra.run.smithi094:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-27T18:47:20.748 INFO:teuthology.orchestra.run.smithi091.stdout: remote refid st t when poll reach delay offset jitter 2023-11-27T18:47:20.748 INFO:teuthology.orchestra.run.smithi091.stdout:============================================================================== 2023-11-27T18:47:20.748 INFO:teuthology.orchestra.run.smithi091.stdout:*hv01.front.sepi 44.4.53.2 2 u 72 128 377 0.092 -2.087 0.325 2023-11-27T18:47:20.748 INFO:teuthology.orchestra.run.smithi091.stdout:+hv02.front.sepi 63.231.80.2 3 u 96 128 377 0.104 -2.111 0.271 2023-11-27T18:47:20.748 INFO:teuthology.orchestra.run.smithi091.stdout:+hv03.front.sepi 74.6.168.72 3 u 81 128 377 0.089 -7.248 0.371 2023-11-27T18:47:20.748 INFO:teuthology.orchestra.run.smithi091.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2023-11-27T18:47:20.749 INFO:teuthology.orchestra.run.smithi094.stdout: remote refid st t when poll reach delay offset jitter 2023-11-27T18:47:20.749 INFO:teuthology.orchestra.run.smithi094.stdout:============================================================================== 2023-11-27T18:47:20.749 INFO:teuthology.orchestra.run.smithi094.stdout:*hv01.front.sepi 44.4.53.2 2 u 21 128 377 0.152 -2.205 1.125 2023-11-27T18:47:20.749 INFO:teuthology.orchestra.run.smithi094.stdout:+hv02.front.sepi 63.231.80.2 3 u 8 128 377 0.187 -2.272 0.958 2023-11-27T18:47:20.749 INFO:teuthology.orchestra.run.smithi094.stdout:+hv03.front.sepi 74.6.168.72 3 u 23 128 377 0.162 -7.985 0.421 2023-11-27T18:47:20.750 INFO:teuthology.orchestra.run.smithi094.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2023-11-27T18:47:20.750 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-27T18:47:20.759 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-27T18:47:20.760 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-27T18:47:20.773 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-27T18:47:20.787 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-27T18:47:20.802 INFO:teuthology.task.internal:Duration was 3386.870698 seconds 2023-11-27T18:47:20.802 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-27T18:47:20.815 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-27T18:47:20.815 DEBUG:teuthology.orchestra.run.smithi091:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-27T18:47:20.818 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-27T18:47:20.894 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-27T18:47:20.895 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi091.front.sepia.ceph.com 2023-11-27T18:47:20.895 DEBUG:teuthology.orchestra.run.smithi091:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-27T18:47:20.905 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi094.front.sepia.ceph.com 2023-11-27T18:47:20.905 DEBUG:teuthology.orchestra.run.smithi094:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-27T18:47:20.916 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-27T18:47:20.916 DEBUG:teuthology.orchestra.run.smithi091:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-27T18:47:20.949 DEBUG:teuthology.orchestra.run.smithi094:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-27T18:47:20.985 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-27T18:47:20.985 DEBUG:teuthology.orchestra.run.smithi091:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-27T18:47:21.017 DEBUG:teuthology.orchestra.run.smithi094:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-27T18:47:21.087 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-27T18:47:21.097 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-27T18:47:21.097 DEBUG:teuthology.orchestra.run.smithi091:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-27T18:47:21.108 DEBUG:teuthology.orchestra.run.smithi094:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-27T18:47:21.119 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-27T18:47:21.132 DEBUG:teuthology.orchestra.run.smithi091:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-27T18:47:21.157 DEBUG:teuthology.orchestra.run.smithi094:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-27T18:47:21.164 INFO:teuthology.orchestra.run.smithi091.stdout:kernel.core_pattern = core 2023-11-27T18:47:21.173 INFO:teuthology.orchestra.run.smithi094.stdout:kernel.core_pattern = core 2023-11-27T18:47:21.288 DEBUG:teuthology.orchestra.run.smithi091:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-27T18:47:21.293 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T18:47:21.294 DEBUG:teuthology.orchestra.run.smithi094:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-27T18:47:21.336 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T18:47:21.336 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-27T18:47:21.347 INFO:teuthology.task.internal:Transferring archived files... 2023-11-27T18:47:21.347 DEBUG:teuthology.misc:Transferring archived files from smithi091:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7467937/remote/smithi091 2023-11-27T18:47:21.347 DEBUG:teuthology.orchestra.run.smithi091:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-27T18:47:21.367 DEBUG:teuthology.misc:Transferring archived files from smithi094:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7467937/remote/smithi094 2023-11-27T18:47:21.367 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-27T18:47:21.398 INFO:teuthology.task.internal:Removing archive directory... 2023-11-27T18:47:21.399 DEBUG:teuthology.orchestra.run.smithi091:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-27T18:47:21.405 DEBUG:teuthology.orchestra.run.smithi094:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-27T18:47:21.444 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-27T18:47:21.454 INFO:teuthology.task.internal:Not uploading archives. 2023-11-27T18:47:21.454 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-27T18:47:21.471 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-27T18:47:21.471 DEBUG:teuthology.orchestra.run.smithi091:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-27T18:47:21.474 DEBUG:teuthology.orchestra.run.smithi094:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-27T18:47:21.478 INFO:teuthology.orchestra.run.smithi091.stdout: 655475 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 27 18:47 /home/ubuntu/cephtest 2023-11-27T18:47:21.492 INFO:teuthology.orchestra.run.smithi094.stdout: 655472 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 27 18:47 /home/ubuntu/cephtest 2023-11-27T18:47:21.493 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-27T18:47:21.506 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-27T18:47:21.522 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: Exception: saw valgrind issues 2023-11-27T18:47:21.522 INFO:teuthology.nuke:Checking targets against current locks 2023-11-27T18:47:21.549 DEBUG:teuthology.nuke:shortname: smithi091 2023-11-27T18:47:21.550 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-27T18:47:21.573 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi091.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7467937', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-27 17:42:24.513593', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBKVdsiaKfK7JJRWmw0yxYjamAJInhD3MWIycbQ+vulPgVrKu4kAo0dhMzI1Ga0/Ctpp+DMJ+tgefRpK6crNKE0='} 2023-11-27T18:47:21.578 DEBUG:teuthology.nuke:shortname: smithi094 2023-11-27T18:47:21.578 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-27T18:47:21.602 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi094.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7467937', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-27 17:42:24.515239', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE2j367sZ/iH6ILWHVsfKU/p16P680VfV/kF7Gk3UXlGjFhS2L7n8rWr/ODyDwDq2P+YJDYM5ZB0XDVzlqsQVUU='} 2023-11-27T18:47:21.633 INFO:teuthology.orchestra.console.smithi091:Power off 2023-11-27T18:47:21.633 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-27T18:47:21.656 DEBUG:teuthology.orchestra.console.smithi091:power off output: Chassis Power Control: Down/Off 2023-11-27T18:47:21.656 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T18:47:21.670 INFO:teuthology.orchestra.console.smithi094:Power off 2023-11-27T18:47:21.671 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-27T18:47:21.681 DEBUG:teuthology.orchestra.console.smithi091:check power output: Chassis Power is on 2023-11-27T18:47:21.691 DEBUG:teuthology.orchestra.console.smithi094:power off output: Chassis Power Control: Down/Off 2023-11-27T18:47:21.692 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T18:47:21.714 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is on 2023-11-27T18:47:25.681 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T18:47:25.715 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T18:47:25.792 DEBUG:teuthology.orchestra.console.smithi091:check power output: Chassis Power is on 2023-11-27T18:47:25.824 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is on 2023-11-27T18:47:29.798 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T18:47:29.826 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T18:47:29.909 DEBUG:teuthology.orchestra.console.smithi091:check power output: Chassis Power is on 2023-11-27T18:47:29.936 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is on 2023-11-27T18:47:33.913 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T18:47:33.936 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T18:47:34.023 DEBUG:teuthology.orchestra.console.smithi091:check power output: Chassis Power is off 2023-11-27T18:47:34.045 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off 2023-11-27T18:47:34.125 INFO:teuthology.orchestra.console.smithi091:Power off completed 2023-11-27T18:47:34.146 INFO:teuthology.orchestra.console.smithi094:Power off completed 2023-11-27T18:47:34.250 INFO:teuthology.run:Summary data: description: fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/valgrind} duration: 3386.8706979751587 failure_reason: saw valgrind issues flavor: default owner: scheduled_yuriw@teuthology status: fail success: false 2023-11-27T18:47:34.251 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-27T18:47:34.326 INFO:teuthology.run:FAIL